2026-02-23T12:33:11.789 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-23T12:33:11.806 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T12:33:11.899 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_12:27:41-crimson-rados-main-distro-debug-trial/66427 branch: main description: crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/cephadm objectstore/seastore/segmented$/{crimson_seastore_segmented} thrashers/{pggrow} thrashosds-health workloads/radosbench} email: null first_in_suite: false flavor: debug job_id: '66427' kernel: branch: distro kdb: true sha1: distro last_in_suite: false machine_type: trial name: shraddhaag-2026-02-23_12:27:41-crimson-rados-main-distro-debug-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client.0: debug ms: 1 debug objecter: 20 debug rados: 20 global: crimson_allow_pg_split: false enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc osd_max_pg_log_entries: 2 osd_min_pg_log_entries: 1 osd_pg_log_trim_min: 0 osd_pool_default_min_size: 2 osd_pool_default_size: 3 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 osd pool default crimson: true paxos service trim min: 10 osd: crimson cpu num: 4 crimson osd obc lru size: 10 debug ms: 20 debug osd: 20 debug seastore: 20 debug seastore backref: 20 debug seastore cache: 20 debug seastore cleaner: 20 debug seastore device: 20 debug seastore epm: 20 debug seastore fixedkv tree: 20 debug seastore journal: 20 debug seastore lba: 20 debug seastore odata: 20 debug seastore omap: 20 debug seastore onode: 20 debug seastore t: 20 debug seastore tm: 20 osd blocked scrub grace period: 3600 osd debug reject backfill probability: 0.3 osd delete sleep: 1 osd max backfills: 3 osd max markdown count: 1000 osd objectstore: seastore osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true osd snap trim sleep: 2 seastore cachepin size pershard: 64M seastore max concurrent transactions: 8 crimson_compat: true flavor: debug log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub - Degraded data redundancy - is down - osds down - pg .*? is .*?degraded.*?, acting - pg .*? is stuck - pg degraded - PG_BACKFILL_FULL - Low space hindering backfill .*? backfill_toofull - OSD_ROOT_DOWN - pgs degraded - pgs undersized - is active.*backfill_toofull.* sha1: e371433fcd1390a0b82cfb18effc422c1f5d8c1d ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: debug sha1: e371433fcd1390a0b82cfb18effc422c1f5d8c1d thrashosds: min_in: 4 workunit: branch: wip-shraddhaag-enable-cephadm-tests env: CRIMSON_COMPAT: '1' sha1: a78040ddef3ba5a489697ca2fe95df59a7d8bd08 owner: scheduled_shraddhaag@soko04.front.sepia.ceph.com priority: 49 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - client.0 - node-exporter.a - - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 7225 sha1: e371433fcd1390a0b82cfb18effc422c1f5d8c1d sleep_before_teardown: 0 suite: crimson-rados suite_branch: wip-shraddhaag-enable-cephadm-tests suite_path: /home/teuthworker/src/github.com_shraddhaag_ceph_a78040ddef3ba5a489697ca2fe95df59a7d8bd08/qa suite_relpath: qa suite_repo: https://github.com/shraddhaag/ceph.git suite_sha1: a78040ddef3ba5a489697ca2fe95df59a7d8bd08 targets: trial046.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG5/pFi0M7q7XFj+OAnytHIe1rFL8KTebBoDuab55h0yb+BP00r2HtA1WtdeqWblDUOb7jLBTUG5PV2D5sk0NN0= trial131.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC8G5CMlBAID9lld77mS8eAaZIh6FydN1NWjivWG/olypJaWvcUHvx6mnLAlbdpwiRakObF+MBjAw+W4denh+N4= tasks: - install: extra_packages: deb: - ceph-osd-crimson - ceph-osd-crimson-dbg rpm: - ceph-osd-crimson - ceph-osd-crimson-debuginfo - pexec: all: - sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson - cephadm: conf: mgr: debug mgr: 20 debug ms: 1 debug osd: 10 osd_type: crimson - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - thrashosds: ceph_objectstore_tool: false chance_down: 0 chance_inject_pause_short: 0 chance_pgnum_grow: 2 chance_pgpnum_fix: 1 chance_reset_purged_snaps_last: 0 chance_thrash_cluster_full: 0 chance_thrash_pg_upmap: 0 dump_ops_enable: false min_in: 2 noscrub_toggle_delay: 0 reweight_osd: 0 sighup_delay: 0 thrash_primary_affinity: false timeout: 2400 - full_sequential: - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-23_12:27:41 tube: trial user: shraddhaag verbose: false verify_ceph_hash: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3318653 2026-02-23T12:33:11.899 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_shraddhaag_ceph_a78040ddef3ba5a489697ca2fe95df59a7d8bd08/qa; will attempt to use it 2026-02-23T12:33:11.899 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_shraddhaag_ceph_a78040ddef3ba5a489697ca2fe95df59a7d8bd08/qa/tasks 2026-02-23T12:33:11.899 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-23T12:33:11.901 INFO:teuthology.task.internal:Saving configuration 2026-02-23T12:33:11.911 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-23T12:33:11.922 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-23T12:33:11.978 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial046.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_12:27:41-crimson-rados-main-distro-debug-trial/66427', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-23 12:29:01.787116', 'locked_by': 'scheduled_shraddhaag@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG5/pFi0M7q7XFj+OAnytHIe1rFL8KTebBoDuab55h0yb+BP00r2HtA1WtdeqWblDUOb7jLBTUG5PV2D5sk0NN0='} 2026-02-23T12:33:12.035 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial131.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_12:27:41-crimson-rados-main-distro-debug-trial/66427', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-23 12:29:01.787734', 'locked_by': 'scheduled_shraddhaag@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC8G5CMlBAID9lld77mS8eAaZIh6FydN1NWjivWG/olypJaWvcUHvx6mnLAlbdpwiRakObF+MBjAw+W4denh+N4='} 2026-02-23T12:33:12.035 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-23T12:33:12.048 INFO:teuthology.task.internal:roles: ubuntu@trial046.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2026-02-23T12:33:12.048 INFO:teuthology.task.internal:roles: ubuntu@trial131.front.sepia.ceph.com - ['osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2026-02-23T12:33:12.048 INFO:teuthology.run_tasks:Running task console_log... 2026-02-23T12:33:12.186 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7acf7041b420>, signals=[15]) 2026-02-23T12:33:12.187 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-23T12:33:12.197 INFO:teuthology.task.internal:Opening connections... 2026-02-23T12:33:12.198 DEBUG:teuthology.task.internal:connecting to ubuntu@trial046.front.sepia.ceph.com 2026-02-23T12:33:12.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T12:33:12.262 DEBUG:teuthology.task.internal:connecting to ubuntu@trial131.front.sepia.ceph.com 2026-02-23T12:33:12.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T12:33:12.323 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-23T12:33:12.338 DEBUG:teuthology.orchestra.run.trial046:> uname -m 2026-02-23T12:33:12.354 INFO:teuthology.orchestra.run.trial046.stdout:x86_64 2026-02-23T12:33:12.354 DEBUG:teuthology.orchestra.run.trial046:> cat /etc/os-release 2026-02-23T12:33:12.409 INFO:teuthology.orchestra.run.trial046.stdout:NAME="CentOS Stream" 2026-02-23T12:33:12.410 INFO:teuthology.orchestra.run.trial046.stdout:VERSION="9" 2026-02-23T12:33:12.410 INFO:teuthology.orchestra.run.trial046.stdout:ID="centos" 2026-02-23T12:33:12.410 INFO:teuthology.orchestra.run.trial046.stdout:ID_LIKE="rhel fedora" 2026-02-23T12:33:12.410 INFO:teuthology.orchestra.run.trial046.stdout:VERSION_ID="9" 2026-02-23T12:33:12.410 INFO:teuthology.orchestra.run.trial046.stdout:PLATFORM_ID="platform:el9" 2026-02-23T12:33:12.410 INFO:teuthology.orchestra.run.trial046.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-23T12:33:12.410 INFO:teuthology.orchestra.run.trial046.stdout:ANSI_COLOR="0;31" 2026-02-23T12:33:12.410 INFO:teuthology.orchestra.run.trial046.stdout:LOGO="fedora-logo-icon" 2026-02-23T12:33:12.410 INFO:teuthology.orchestra.run.trial046.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-23T12:33:12.410 INFO:teuthology.orchestra.run.trial046.stdout:HOME_URL="https://centos.org/" 2026-02-23T12:33:12.410 INFO:teuthology.orchestra.run.trial046.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-23T12:33:12.410 INFO:teuthology.orchestra.run.trial046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-23T12:33:12.410 INFO:teuthology.orchestra.run.trial046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-23T12:33:12.410 INFO:teuthology.lock.ops:Updating trial046.front.sepia.ceph.com on lock server 2026-02-23T12:33:12.470 DEBUG:teuthology.orchestra.run.trial131:> uname -m 2026-02-23T12:33:12.486 INFO:teuthology.orchestra.run.trial131.stdout:x86_64 2026-02-23T12:33:12.486 DEBUG:teuthology.orchestra.run.trial131:> cat /etc/os-release 2026-02-23T12:33:12.543 INFO:teuthology.orchestra.run.trial131.stdout:NAME="CentOS Stream" 2026-02-23T12:33:12.543 INFO:teuthology.orchestra.run.trial131.stdout:VERSION="9" 2026-02-23T12:33:12.543 INFO:teuthology.orchestra.run.trial131.stdout:ID="centos" 2026-02-23T12:33:12.543 INFO:teuthology.orchestra.run.trial131.stdout:ID_LIKE="rhel fedora" 2026-02-23T12:33:12.543 INFO:teuthology.orchestra.run.trial131.stdout:VERSION_ID="9" 2026-02-23T12:33:12.543 INFO:teuthology.orchestra.run.trial131.stdout:PLATFORM_ID="platform:el9" 2026-02-23T12:33:12.543 INFO:teuthology.orchestra.run.trial131.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-23T12:33:12.543 INFO:teuthology.orchestra.run.trial131.stdout:ANSI_COLOR="0;31" 2026-02-23T12:33:12.543 INFO:teuthology.orchestra.run.trial131.stdout:LOGO="fedora-logo-icon" 2026-02-23T12:33:12.543 INFO:teuthology.orchestra.run.trial131.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-23T12:33:12.543 INFO:teuthology.orchestra.run.trial131.stdout:HOME_URL="https://centos.org/" 2026-02-23T12:33:12.543 INFO:teuthology.orchestra.run.trial131.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-23T12:33:12.543 INFO:teuthology.orchestra.run.trial131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-23T12:33:12.543 INFO:teuthology.orchestra.run.trial131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-23T12:33:12.543 INFO:teuthology.lock.ops:Updating trial131.front.sepia.ceph.com on lock server 2026-02-23T12:33:12.611 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-23T12:33:12.624 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-23T12:33:12.635 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-23T12:33:12.635 DEBUG:teuthology.orchestra.run.trial046:> test '!' -e /home/ubuntu/cephtest 2026-02-23T12:33:12.637 DEBUG:teuthology.orchestra.run.trial131:> test '!' -e /home/ubuntu/cephtest 2026-02-23T12:33:12.651 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-23T12:33:12.662 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-23T12:33:12.662 DEBUG:teuthology.orchestra.run.trial046:> test -z $(ls -A /var/lib/ceph) 2026-02-23T12:33:12.693 DEBUG:teuthology.orchestra.run.trial131:> test -z $(ls -A /var/lib/ceph) 2026-02-23T12:33:12.709 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-23T12:33:12.855 INFO:teuthology.run_tasks:Running task kernel... 2026-02-23T12:33:12.870 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-23T12:33:12.870 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'osd.2': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-23T12:33:12.870 DEBUG:teuthology.orchestra.run.trial046:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-23T12:33:12.870 DEBUG:teuthology.orchestra.run.trial131:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-23T12:33:12.885 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T12:33:12.885 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-23T12:33:12.885 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T12:33:12.885 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-23T12:33:12.941 INFO:teuthology.orchestra.run.trial046.stdout:5.14.0-681.el9.x86_64 2026-02-23T12:33:12.941 INFO:teuthology.task.kernel:Running kernel on trial046: 5.14.0-681.el9.x86_64 2026-02-23T12:33:12.941 DEBUG:teuthology.orchestra.run.trial046:> sudo yum install -y kernel 2026-02-23T12:33:12.942 INFO:teuthology.orchestra.run.trial131.stdout:5.14.0-681.el9.x86_64 2026-02-23T12:33:12.942 INFO:teuthology.task.kernel:Running kernel on trial131: 5.14.0-681.el9.x86_64 2026-02-23T12:33:12.942 DEBUG:teuthology.orchestra.run.trial131:> sudo yum install -y kernel 2026-02-23T12:33:13.607 INFO:teuthology.orchestra.run.trial131.stdout:CentOS Stream 9 - BaseOS 32 MB/s | 8.9 MB 00:00 2026-02-23T12:33:14.381 INFO:teuthology.orchestra.run.trial046.stdout:CentOS Stream 9 - BaseOS 8.4 MB/s | 8.9 MB 00:01 2026-02-23T12:33:16.433 INFO:teuthology.orchestra.run.trial131.stdout:CentOS Stream 9 - AppStream 12 MB/s | 27 MB 00:02 2026-02-23T12:33:17.657 INFO:teuthology.orchestra.run.trial046.stdout:CentOS Stream 9 - AppStream 9.7 MB/s | 27 MB 00:02 2026-02-23T12:33:20.394 INFO:teuthology.orchestra.run.trial131.stdout:CentOS Stream 9 - CRB 5.0 MB/s | 7.8 MB 00:01 2026-02-23T12:33:21.432 INFO:teuthology.orchestra.run.trial046.stdout:CentOS Stream 9 - CRB 5.4 MB/s | 7.8 MB 00:01 2026-02-23T12:33:22.156 INFO:teuthology.orchestra.run.trial131.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 20 kB 00:01 2026-02-23T12:33:22.359 INFO:teuthology.orchestra.run.trial046.stdout:CentOS Stream 9 - Extras packages 98 kB/s | 20 kB 00:00 2026-02-23T12:33:23.308 INFO:teuthology.orchestra.run.trial131.stdout:Extra Packages for Enterprise Linux 19 MB/s | 20 MB 00:01 2026-02-23T12:33:23.526 INFO:teuthology.orchestra.run.trial046.stdout:Extra Packages for Enterprise Linux 18 MB/s | 20 MB 00:01 2026-02-23T12:33:26.508 INFO:teuthology.orchestra.run.trial131.stdout:lab-extras 2.8 MB/s | 50 kB 00:00 2026-02-23T12:33:26.662 INFO:teuthology.orchestra.run.trial046.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-23T12:33:27.518 INFO:teuthology.orchestra.run.trial131.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-23T12:33:27.518 INFO:teuthology.orchestra.run.trial131.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-23T12:33:27.537 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-23T12:33:27.537 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-23T12:33:27.537 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-23T12:33:27.561 DEBUG:teuthology.orchestra.run.trial131:> echo no | sudo yum reinstall kernel || true 2026-02-23T12:33:27.675 INFO:teuthology.orchestra.run.trial046.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-23T12:33:27.676 INFO:teuthology.orchestra.run.trial046.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-23T12:33:27.695 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-23T12:33:27.696 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-23T12:33:27.696 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-23T12:33:27.719 DEBUG:teuthology.orchestra.run.trial046:> echo no | sudo yum reinstall kernel || true 2026-02-23T12:33:27.862 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:00:01 ago on Mon 23 Feb 2026 12:33:26 PM UTC. 2026-02-23T12:33:27.942 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-23T12:33:27.943 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:33:27.943 INFO:teuthology.orchestra.run.trial131.stdout: Package Architecture Version Repository Size 2026-02-23T12:33:27.943 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:33:27.943 INFO:teuthology.orchestra.run.trial131.stdout:Reinstalling: 2026-02-23T12:33:27.943 INFO:teuthology.orchestra.run.trial131.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-23T12:33:27.943 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:33:27.943 INFO:teuthology.orchestra.run.trial131.stdout:Transaction Summary 2026-02-23T12:33:27.943 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:33:27.943 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:33:27.943 INFO:teuthology.orchestra.run.trial131.stdout:Total download size: 803 k 2026-02-23T12:33:27.943 INFO:teuthology.orchestra.run.trial131.stdout:Installed size: 0 2026-02-23T12:33:27.943 INFO:teuthology.orchestra.run.trial131.stderr:Operation aborted. 2026-02-23T12:33:27.963 INFO:teuthology.orchestra.run.trial131.stdout:Is this ok [y/N]: 2026-02-23T12:33:27.963 DEBUG:teuthology.orchestra.run.trial131:> sudo yum reinstall -y kernel || true 2026-02-23T12:33:28.019 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:02 ago on Mon 23 Feb 2026 12:33:26 PM UTC. 2026-02-23T12:33:28.098 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-23T12:33:28.099 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:33:28.099 INFO:teuthology.orchestra.run.trial046.stdout: Package Architecture Version Repository Size 2026-02-23T12:33:28.099 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:33:28.099 INFO:teuthology.orchestra.run.trial046.stdout:Reinstalling: 2026-02-23T12:33:28.099 INFO:teuthology.orchestra.run.trial046.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-23T12:33:28.099 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:33:28.099 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-23T12:33:28.099 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:33:28.099 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:33:28.099 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 803 k 2026-02-23T12:33:28.099 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 0 2026-02-23T12:33:28.099 INFO:teuthology.orchestra.run.trial046.stderr:Operation aborted. 2026-02-23T12:33:28.119 INFO:teuthology.orchestra.run.trial046.stdout:Is this ok [y/N]: 2026-02-23T12:33:28.119 DEBUG:teuthology.orchestra.run.trial046:> sudo yum reinstall -y kernel || true 2026-02-23T12:33:28.261 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:00:02 ago on Mon 23 Feb 2026 12:33:26 PM UTC. 2026-02-23T12:33:28.341 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-23T12:33:28.341 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:33:28.341 INFO:teuthology.orchestra.run.trial131.stdout: Package Architecture Version Repository Size 2026-02-23T12:33:28.342 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:33:28.342 INFO:teuthology.orchestra.run.trial131.stdout:Reinstalling: 2026-02-23T12:33:28.342 INFO:teuthology.orchestra.run.trial131.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-23T12:33:28.342 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:33:28.342 INFO:teuthology.orchestra.run.trial131.stdout:Transaction Summary 2026-02-23T12:33:28.342 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:33:28.342 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:33:28.342 INFO:teuthology.orchestra.run.trial131.stdout:Total download size: 803 k 2026-02-23T12:33:28.342 INFO:teuthology.orchestra.run.trial131.stdout:Installed size: 0 2026-02-23T12:33:28.342 INFO:teuthology.orchestra.run.trial131.stdout:Downloading Packages: 2026-02-23T12:33:28.419 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:02 ago on Mon 23 Feb 2026 12:33:26 PM UTC. 2026-02-23T12:33:28.500 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-23T12:33:28.501 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:33:28.501 INFO:teuthology.orchestra.run.trial046.stdout: Package Architecture Version Repository Size 2026-02-23T12:33:28.501 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:33:28.501 INFO:teuthology.orchestra.run.trial046.stdout:Reinstalling: 2026-02-23T12:33:28.501 INFO:teuthology.orchestra.run.trial046.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-23T12:33:28.501 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:33:28.501 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-23T12:33:28.501 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:33:28.501 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:33:28.501 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 803 k 2026-02-23T12:33:28.501 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 0 2026-02-23T12:33:28.501 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-23T12:33:28.616 INFO:teuthology.orchestra.run.trial046.stdout:kernel-5.14.0-681.el9.x86_64.rpm 30 MB/s | 803 kB 00:00 2026-02-23T12:33:28.616 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-23T12:33:28.616 INFO:teuthology.orchestra.run.trial046.stdout:Total 6.8 MB/s | 803 kB 00:00 2026-02-23T12:33:28.626 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-23T12:33:28.660 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-23T12:33:28.660 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-23T12:33:28.664 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-23T12:33:28.665 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-23T12:33:28.688 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-23T12:33:28.692 INFO:teuthology.orchestra.run.trial046.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-23T12:33:28.692 INFO:teuthology.orchestra.run.trial046.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-23T12:33:28.808 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-23T12:33:28.808 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-23T12:33:28.865 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-23T12:33:28.865 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:33:28.865 INFO:teuthology.orchestra.run.trial046.stdout:Reinstalled: 2026-02-23T12:33:28.865 INFO:teuthology.orchestra.run.trial046.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-23T12:33:28.865 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:33:28.865 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-23T12:33:28.890 DEBUG:teuthology.orchestra.run.trial046:> rpm -q kernel | sort -rV | head -n 1 2026-02-23T12:33:28.913 INFO:teuthology.orchestra.run.trial046.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-23T12:33:28.914 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-23T12:33:28.914 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-23T12:33:28.914 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-23T12:33:28.914 DEBUG:teuthology.orchestra.run.trial046:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-23T12:33:28.977 INFO:teuthology.orchestra.run.trial046.stdout:ttyS1 2026-02-23T12:33:29.008 DEBUG:teuthology.parallel:result is None 2026-02-23T12:33:29.553 INFO:teuthology.orchestra.run.trial131.stdout:kernel-5.14.0-681.el9.x86_64.rpm 882 kB/s | 803 kB 00:00 2026-02-23T12:33:29.554 INFO:teuthology.orchestra.run.trial131.stdout:-------------------------------------------------------------------------------- 2026-02-23T12:33:29.554 INFO:teuthology.orchestra.run.trial131.stdout:Total 662 kB/s | 803 kB 00:01 2026-02-23T12:33:29.564 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction check 2026-02-23T12:33:29.597 INFO:teuthology.orchestra.run.trial131.stdout:Transaction check succeeded. 2026-02-23T12:33:29.598 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction test 2026-02-23T12:33:29.602 INFO:teuthology.orchestra.run.trial131.stdout:Transaction test succeeded. 2026-02-23T12:33:29.602 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction 2026-02-23T12:33:29.626 INFO:teuthology.orchestra.run.trial131.stdout: Preparing : 1/1 2026-02-23T12:33:29.630 INFO:teuthology.orchestra.run.trial131.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-23T12:33:29.630 INFO:teuthology.orchestra.run.trial131.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-23T12:33:29.744 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-23T12:33:29.744 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-23T12:33:29.801 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-23T12:33:29.801 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:33:29.801 INFO:teuthology.orchestra.run.trial131.stdout:Reinstalled: 2026-02-23T12:33:29.801 INFO:teuthology.orchestra.run.trial131.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-23T12:33:29.801 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:33:29.801 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-23T12:33:29.827 DEBUG:teuthology.orchestra.run.trial131:> rpm -q kernel | sort -rV | head -n 1 2026-02-23T12:33:29.850 INFO:teuthology.orchestra.run.trial131.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-23T12:33:29.851 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-23T12:33:29.851 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-23T12:33:29.851 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2026-02-23T12:33:29.851 DEBUG:teuthology.orchestra.run.trial131:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-23T12:33:29.914 INFO:teuthology.orchestra.run.trial131.stdout:ttyS1 2026-02-23T12:33:29.938 DEBUG:teuthology.parallel:result is None 2026-02-23T12:33:29.938 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-23T12:33:29.950 INFO:teuthology.task.internal:Creating test directory... 2026-02-23T12:33:29.950 DEBUG:teuthology.orchestra.run.trial046:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-23T12:33:29.952 DEBUG:teuthology.orchestra.run.trial131:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-23T12:33:29.994 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-23T12:33:30.005 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-23T12:33:30.018 INFO:teuthology.task.internal:Creating archive directory... 2026-02-23T12:33:30.018 DEBUG:teuthology.orchestra.run.trial046:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-23T12:33:30.019 DEBUG:teuthology.orchestra.run.trial131:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-23T12:33:30.052 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-23T12:33:30.063 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-23T12:33:30.064 DEBUG:teuthology.orchestra.run.trial046:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-23T12:33:30.076 DEBUG:teuthology.orchestra.run.trial131:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-23T12:33:30.099 INFO:teuthology.orchestra.run.trial046.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T12:33:30.108 INFO:teuthology.orchestra.run.trial046.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T12:33:30.114 INFO:teuthology.orchestra.run.trial131.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T12:33:30.123 INFO:teuthology.orchestra.run.trial131.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T12:33:30.124 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-23T12:33:30.135 INFO:teuthology.task.internal:Configuring sudo... 2026-02-23T12:33:30.136 DEBUG:teuthology.orchestra.run.trial046:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-23T12:33:30.151 DEBUG:teuthology.orchestra.run.trial131:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-23T12:33:30.189 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-23T12:33:30.204 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-23T12:33:30.205 DEBUG:teuthology.orchestra.run.trial046:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-23T12:33:30.214 DEBUG:teuthology.orchestra.run.trial131:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-23T12:33:30.245 DEBUG:teuthology.orchestra.run.trial046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-23T12:33:30.348 DEBUG:teuthology.orchestra.run.trial046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-23T12:33:30.371 DEBUG:teuthology.orchestra.run.trial046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-23T12:33:30.496 DEBUG:teuthology.orchestra.run.trial046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-23T12:33:30.521 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-23T12:33:30.521 DEBUG:teuthology.orchestra.run.trial046:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-23T12:33:30.584 DEBUG:teuthology.orchestra.run.trial131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-23T12:33:30.661 DEBUG:teuthology.orchestra.run.trial131:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-23T12:33:30.686 DEBUG:teuthology.orchestra.run.trial131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-23T12:33:30.803 DEBUG:teuthology.orchestra.run.trial131:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-23T12:33:30.826 DEBUG:teuthology.orchestra.run.trial131:> set -ex 2026-02-23T12:33:30.826 DEBUG:teuthology.orchestra.run.trial131:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-23T12:33:30.889 DEBUG:teuthology.orchestra.run.trial046:> sudo service rsyslog restart 2026-02-23T12:33:30.890 DEBUG:teuthology.orchestra.run.trial131:> sudo service rsyslog restart 2026-02-23T12:33:30.917 INFO:teuthology.orchestra.run.trial046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-23T12:33:30.956 INFO:teuthology.orchestra.run.trial131.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-23T12:33:31.338 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-23T12:33:31.350 INFO:teuthology.task.internal:Starting timer... 2026-02-23T12:33:31.350 INFO:teuthology.run_tasks:Running task pcp... 2026-02-23T12:33:31.367 INFO:teuthology.run_tasks:Running task selinux... 2026-02-23T12:33:31.378 DEBUG:teuthology.orchestra.run.trial046:> sudo service auditd rotate 2026-02-23T12:33:31.406 INFO:teuthology.orchestra.run.trial046.stdout:Rotating logs: 2026-02-23T12:33:31.408 DEBUG:teuthology.orchestra.run.trial131:> sudo service auditd rotate 2026-02-23T12:33:31.438 INFO:teuthology.orchestra.run.trial131.stdout:Rotating logs: 2026-02-23T12:33:31.439 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-23T12:33:31.440 DEBUG:teuthology.orchestra.run.trial046:> /usr/sbin/getenforce 2026-02-23T12:33:31.464 INFO:teuthology.orchestra.run.trial046.stdout:Permissive 2026-02-23T12:33:31.464 DEBUG:teuthology.orchestra.run.trial131:> /usr/sbin/getenforce 2026-02-23T12:33:31.496 INFO:teuthology.orchestra.run.trial131.stdout:Permissive 2026-02-23T12:33:31.496 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial046.front.sepia.ceph.com': 'permissive', 'ubuntu@trial131.front.sepia.ceph.com': 'permissive'} 2026-02-23T12:33:31.496 DEBUG:teuthology.orchestra.run.trial046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-23T12:33:31.528 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T12:33:31.529 DEBUG:teuthology.orchestra.run.trial131:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-23T12:33:31.561 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T12:33:31.561 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-23T12:33:31.561 DEBUG:teuthology.orchestra.run.trial046:> sudo /usr/sbin/setenforce permissive 2026-02-23T12:33:31.594 DEBUG:teuthology.orchestra.run.trial131:> sudo /usr/sbin/setenforce permissive 2026-02-23T12:33:31.626 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-23T12:33:31.639 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-23T12:33:31.646 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-23T12:33:31.647 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial046.front.sepia.ceph.com,trial131.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-23T12:35:56.135 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial046.front.sepia.ceph.com'), Remote(name='ubuntu@trial131.front.sepia.ceph.com')] 2026-02-23T12:35:56.136 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-23T12:35:56.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T12:35:56.205 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-23T12:35:56.279 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-23T12:35:56.280 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-23T12:35:56.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T12:35:56.344 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-23T12:35:56.419 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-23T12:35:56.420 INFO:teuthology.run_tasks:Running task clock... 2026-02-23T12:35:56.432 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-23T12:35:56.432 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-23T12:35:56.432 DEBUG:teuthology.orchestra.run.trial046:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-23T12:35:56.434 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-23T12:35:56.434 DEBUG:teuthology.orchestra.run.trial131:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-23T12:35:56.460 INFO:teuthology.orchestra.run.trial046.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-23T12:35:56.472 INFO:teuthology.orchestra.run.trial046.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-23T12:35:56.486 INFO:teuthology.orchestra.run.trial131.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-23T12:35:56.491 INFO:teuthology.orchestra.run.trial046.stderr:sudo: ntpd: command not found 2026-02-23T12:35:56.498 INFO:teuthology.orchestra.run.trial131.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-23T12:35:56.500 INFO:teuthology.orchestra.run.trial046.stdout:506 Cannot talk to daemon 2026-02-23T12:35:56.512 INFO:teuthology.orchestra.run.trial046.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-23T12:35:56.518 INFO:teuthology.orchestra.run.trial131.stderr:sudo: ntpd: command not found 2026-02-23T12:35:56.522 INFO:teuthology.orchestra.run.trial046.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-23T12:35:56.527 INFO:teuthology.orchestra.run.trial131.stdout:506 Cannot talk to daemon 2026-02-23T12:35:56.539 INFO:teuthology.orchestra.run.trial131.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-23T12:35:56.551 INFO:teuthology.orchestra.run.trial131.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-23T12:35:56.570 INFO:teuthology.orchestra.run.trial046.stderr:bash: line 1: ntpq: command not found 2026-02-23T12:35:56.597 INFO:teuthology.orchestra.run.trial131.stderr:bash: line 1: ntpq: command not found 2026-02-23T12:35:56.693 INFO:teuthology.orchestra.run.trial046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-23T12:35:56.693 INFO:teuthology.orchestra.run.trial046.stdout:=============================================================================== 2026-02-23T12:35:56.693 INFO:teuthology.orchestra.run.trial046.stdout:^? 69-10-208-170.rainiercon> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-23T12:35:56.693 INFO:teuthology.orchestra.run.trial046.stdout:^? 38.45.64.130 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-23T12:35:56.693 INFO:teuthology.orchestra.run.trial046.stdout:^? ntp0.alb1.inoc.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-23T12:35:56.693 INFO:teuthology.orchestra.run.trial046.stdout:^? 198-23-133-146-host.colo> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-23T12:35:56.703 INFO:teuthology.orchestra.run.trial131.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-23T12:35:56.703 INFO:teuthology.orchestra.run.trial131.stdout:=============================================================================== 2026-02-23T12:35:56.703 INFO:teuthology.orchestra.run.trial131.stdout:^? t2.time.bf1.yahoo.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-23T12:35:56.703 INFO:teuthology.orchestra.run.trial131.stdout:^? 198-23-133-146-host.colo> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-23T12:35:56.703 INFO:teuthology.orchestra.run.trial131.stdout:^? us-west-1.clearnet.pw 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-23T12:35:56.703 INFO:teuthology.orchestra.run.trial131.stdout:^? chi2.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-23T12:35:56.704 INFO:teuthology.run_tasks:Running task install... 2026-02-23T12:35:56.718 DEBUG:teuthology.task.install:project ceph 2026-02-23T12:35:56.719 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'debug', 'sha1': 'e371433fcd1390a0b82cfb18effc422c1f5d8c1d'}} 2026-02-23T12:35:56.719 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': 'e371433fcd1390a0b82cfb18effc422c1f5d8c1d'} 2026-02-23T12:35:56.719 INFO:teuthology.task.install:Using flavor: debug 2026-02-23T12:35:56.721 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-23T12:35:56.721 INFO:teuthology.task.install:extra packages: {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']} 2026-02-23T12:35:56.722 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e371433fcd1390a0b82cfb18effc422c1f5d8c1d', 'tag': None, 'wait_for_package': False} 2026-02-23T12:35:56.722 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d 2026-02-23T12:35:56.723 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e371433fcd1390a0b82cfb18effc422c1f5d8c1d', 'tag': None, 'wait_for_package': False} 2026-02-23T12:35:56.723 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d 2026-02-23T12:35:56.876 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/e371433fcd1390a0b82cfb18effc422c1f5d8c1d/centos/9/flavors/debug/ 2026-02-23T12:35:56.876 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5439.ge371433f 2026-02-23T12:35:56.903 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/e371433fcd1390a0b82cfb18effc422c1f5d8c1d/centos/9/flavors/debug/ 2026-02-23T12:35:56.903 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5439.ge371433f 2026-02-23T12:35:57.199 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/e371433fcd1390a0b82cfb18effc422c1f5d8c1d/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/e371433fcd1390a0b82cfb18effc422c1f5d8c1d/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/e371433fcd1390a0b82cfb18effc422c1f5d8c1d/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-23T12:35:57.200 DEBUG:teuthology.orchestra.run.trial131:> set -ex 2026-02-23T12:35:57.200 DEBUG:teuthology.orchestra.run.trial131:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-23T12:35:57.226 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo on remote rpm x86_64 2026-02-23T12:35:57.227 DEBUG:teuthology.orchestra.run.trial131:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e371433fcd1390a0b82cfb18effc422c1f5d8c1d/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-23T12:35:57.240 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/e371433fcd1390a0b82cfb18effc422c1f5d8c1d/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/e371433fcd1390a0b82cfb18effc422c1f5d8c1d/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/e371433fcd1390a0b82cfb18effc422c1f5d8c1d/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-23T12:35:57.240 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-23T12:35:57.241 DEBUG:teuthology.orchestra.run.trial046:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-23T12:35:57.267 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo on remote rpm x86_64 2026-02-23T12:35:57.267 DEBUG:teuthology.orchestra.run.trial046:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e371433fcd1390a0b82cfb18effc422c1f5d8c1d/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-23T12:35:57.292 DEBUG:teuthology.orchestra.run.trial131:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-23T12:35:57.331 DEBUG:teuthology.orchestra.run.trial046:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-23T12:35:57.365 DEBUG:teuthology.orchestra.run.trial131:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-23T12:35:57.405 DEBUG:teuthology.orchestra.run.trial046:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-23T12:35:57.428 INFO:teuthology.orchestra.run.trial131.stdout:check_obsoletes = 1 2026-02-23T12:35:57.429 DEBUG:teuthology.orchestra.run.trial131:> sudo yum clean all 2026-02-23T12:35:57.468 INFO:teuthology.orchestra.run.trial046.stdout:check_obsoletes = 1 2026-02-23T12:35:57.469 DEBUG:teuthology.orchestra.run.trial046:> sudo yum clean all 2026-02-23T12:35:57.587 INFO:teuthology.orchestra.run.trial131.stdout:41 files removed 2026-02-23T12:35:57.601 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-radosgw 2026-02-23T12:35:57.627 INFO:teuthology.orchestra.run.trial046.stdout:41 files removed 2026-02-23T12:35:57.641 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-radosgw 2026-02-23T12:35:58.407 INFO:teuthology.orchestra.run.trial131.stdout:ceph packages for x86_64 137 kB/s | 92 kB 00:00 2026-02-23T12:35:58.455 INFO:teuthology.orchestra.run.trial046.stdout:ceph packages for x86_64 137 kB/s | 92 kB 00:00 2026-02-23T12:35:59.001 INFO:teuthology.orchestra.run.trial131.stdout:ceph noarch packages 42 kB/s | 24 kB 00:00 2026-02-23T12:35:59.044 INFO:teuthology.orchestra.run.trial046.stdout:ceph noarch packages 42 kB/s | 24 kB 00:00 2026-02-23T12:35:59.500 INFO:teuthology.orchestra.run.trial131.stdout:ceph source packages 4.3 kB/s | 2.1 kB 00:00 2026-02-23T12:35:59.543 INFO:teuthology.orchestra.run.trial046.stdout:ceph source packages 4.3 kB/s | 2.1 kB 00:00 2026-02-23T12:36:00.134 INFO:teuthology.orchestra.run.trial046.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.9 MB 00:00 2026-02-23T12:36:00.857 INFO:teuthology.orchestra.run.trial131.stdout:CentOS Stream 9 - BaseOS 6.7 MB/s | 8.9 MB 00:01 2026-02-23T12:36:03.309 INFO:teuthology.orchestra.run.trial046.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-23T12:36:03.954 INFO:teuthology.orchestra.run.trial131.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-23T12:36:07.251 INFO:teuthology.orchestra.run.trial046.stdout:CentOS Stream 9 - CRB 5.1 MB/s | 7.8 MB 00:01 2026-02-23T12:36:07.752 INFO:teuthology.orchestra.run.trial131.stdout:CentOS Stream 9 - CRB 5.5 MB/s | 7.8 MB 00:01 2026-02-23T12:36:08.440 INFO:teuthology.orchestra.run.trial046.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 20 kB 00:00 2026-02-23T12:36:09.496 INFO:teuthology.orchestra.run.trial131.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 20 kB 00:01 2026-02-23T12:36:09.814 INFO:teuthology.orchestra.run.trial046.stdout:Extra Packages for Enterprise Linux 16 MB/s | 20 MB 00:01 2026-02-23T12:36:10.442 INFO:teuthology.orchestra.run.trial131.stdout:Extra Packages for Enterprise Linux 23 MB/s | 20 MB 00:00 2026-02-23T12:36:13.047 INFO:teuthology.orchestra.run.trial046.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-23T12:36:13.649 INFO:teuthology.orchestra.run.trial131.stdout:lab-extras 1.9 MB/s | 50 kB 00:00 2026-02-23T12:36:14.243 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-23T12:36:14.244 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:36:14.244 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repository Size 2026-02-23T12:36:14.244 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout: ceph-radosgw x86_64 2:20.3.0-5439.ge371433f.el9 ceph 11 M 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout:Upgrading: 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout: librados2 x86_64 2:20.3.0-5439.ge371433f.el9 ceph 3.3 M 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout: librbd1 x86_64 2:20.3.0-5439.ge371433f.el9 ceph 2.7 M 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout:Installing dependencies: 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout: ceph-base x86_64 2:20.3.0-5439.ge371433f.el9 ceph 5.1 M 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout: ceph-common x86_64 2:20.3.0-5439.ge371433f.el9 ceph 21 M 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout: ceph-selinux x86_64 2:20.3.0-5439.ge371433f.el9 ceph 25 k 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout: libcephfs2 x86_64 2:20.3.0-5439.ge371433f.el9 ceph 860 k 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout: libradosstriper1 x86_64 2:20.3.0-5439.ge371433f.el9 ceph 263 k 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout: librgw2 x86_64 2:20.3.0-5439.ge371433f.el9 ceph 5.6 M 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout: python3-ceph-argparse x86_64 2:20.3.0-5439.ge371433f.el9 ceph 45 k 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout: python3-ceph-common x86_64 2:20.3.0-5439.ge371433f.el9 ceph 186 k 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout: python3-cephfs x86_64 2:20.3.0-5439.ge371433f.el9 ceph 204 k 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout: python3-rados x86_64 2:20.3.0-5439.ge371433f.el9 ceph 324 k 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout: python3-rbd x86_64 2:20.3.0-5439.ge371433f.el9 ceph 305 k 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout: python3-rgw x86_64 2:20.3.0-5439.ge371433f.el9 ceph 100 k 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout:Installing weak dependencies: 2026-02-23T12:36:14.245 INFO:teuthology.orchestra.run.trial046.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-23T12:36:14.246 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:36:14.246 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-23T12:36:14.246 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:36:14.246 INFO:teuthology.orchestra.run.trial046.stdout:Install 32 Packages 2026-02-23T12:36:14.246 INFO:teuthology.orchestra.run.trial046.stdout:Upgrade 2 Packages 2026-02-23T12:36:14.246 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:36:14.246 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 60 M 2026-02-23T12:36:14.246 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-23T12:36:14.850 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-23T12:36:14.851 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:36:14.851 INFO:teuthology.orchestra.run.trial131.stdout: Package Arch Version Repository Size 2026-02-23T12:36:14.851 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:36:14.851 INFO:teuthology.orchestra.run.trial131.stdout:Installing: 2026-02-23T12:36:14.851 INFO:teuthology.orchestra.run.trial131.stdout: ceph-radosgw x86_64 2:20.3.0-5439.ge371433f.el9 ceph 11 M 2026-02-23T12:36:14.851 INFO:teuthology.orchestra.run.trial131.stdout:Upgrading: 2026-02-23T12:36:14.851 INFO:teuthology.orchestra.run.trial131.stdout: librados2 x86_64 2:20.3.0-5439.ge371433f.el9 ceph 3.3 M 2026-02-23T12:36:14.851 INFO:teuthology.orchestra.run.trial131.stdout: librbd1 x86_64 2:20.3.0-5439.ge371433f.el9 ceph 2.7 M 2026-02-23T12:36:14.851 INFO:teuthology.orchestra.run.trial131.stdout:Installing dependencies: 2026-02-23T12:36:14.851 INFO:teuthology.orchestra.run.trial131.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-23T12:36:14.851 INFO:teuthology.orchestra.run.trial131.stdout: ceph-base x86_64 2:20.3.0-5439.ge371433f.el9 ceph 5.1 M 2026-02-23T12:36:14.851 INFO:teuthology.orchestra.run.trial131.stdout: ceph-common x86_64 2:20.3.0-5439.ge371433f.el9 ceph 21 M 2026-02-23T12:36:14.852 INFO:teuthology.orchestra.run.trial131.stdout: ceph-selinux x86_64 2:20.3.0-5439.ge371433f.el9 ceph 25 k 2026-02-23T12:36:14.852 INFO:teuthology.orchestra.run.trial131.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-23T12:36:14.852 INFO:teuthology.orchestra.run.trial131.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-23T12:36:14.852 INFO:teuthology.orchestra.run.trial131.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-23T12:36:14.852 INFO:teuthology.orchestra.run.trial131.stdout: libcephfs2 x86_64 2:20.3.0-5439.ge371433f.el9 ceph 860 k 2026-02-23T12:36:14.852 INFO:teuthology.orchestra.run.trial131.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-23T12:36:14.852 INFO:teuthology.orchestra.run.trial131.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-23T12:36:14.852 INFO:teuthology.orchestra.run.trial131.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-23T12:36:14.852 INFO:teuthology.orchestra.run.trial131.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-23T12:36:14.852 INFO:teuthology.orchestra.run.trial131.stdout: libradosstriper1 x86_64 2:20.3.0-5439.ge371433f.el9 ceph 263 k 2026-02-23T12:36:14.852 INFO:teuthology.orchestra.run.trial131.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-23T12:36:14.852 INFO:teuthology.orchestra.run.trial131.stdout: librgw2 x86_64 2:20.3.0-5439.ge371433f.el9 ceph 5.6 M 2026-02-23T12:36:14.852 INFO:teuthology.orchestra.run.trial131.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-23T12:36:14.852 INFO:teuthology.orchestra.run.trial131.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-23T12:36:14.852 INFO:teuthology.orchestra.run.trial131.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-23T12:36:14.852 INFO:teuthology.orchestra.run.trial131.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-23T12:36:14.852 INFO:teuthology.orchestra.run.trial131.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-23T12:36:14.852 INFO:teuthology.orchestra.run.trial131.stdout: python3-ceph-argparse x86_64 2:20.3.0-5439.ge371433f.el9 ceph 45 k 2026-02-23T12:36:14.852 INFO:teuthology.orchestra.run.trial131.stdout: python3-ceph-common x86_64 2:20.3.0-5439.ge371433f.el9 ceph 186 k 2026-02-23T12:36:14.852 INFO:teuthology.orchestra.run.trial131.stdout: python3-cephfs x86_64 2:20.3.0-5439.ge371433f.el9 ceph 204 k 2026-02-23T12:36:14.852 INFO:teuthology.orchestra.run.trial131.stdout: python3-rados x86_64 2:20.3.0-5439.ge371433f.el9 ceph 324 k 2026-02-23T12:36:14.852 INFO:teuthology.orchestra.run.trial131.stdout: python3-rbd x86_64 2:20.3.0-5439.ge371433f.el9 ceph 305 k 2026-02-23T12:36:14.853 INFO:teuthology.orchestra.run.trial131.stdout: python3-rgw x86_64 2:20.3.0-5439.ge371433f.el9 ceph 100 k 2026-02-23T12:36:14.853 INFO:teuthology.orchestra.run.trial131.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-23T12:36:14.853 INFO:teuthology.orchestra.run.trial131.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-23T12:36:14.853 INFO:teuthology.orchestra.run.trial131.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-23T12:36:14.853 INFO:teuthology.orchestra.run.trial131.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-23T12:36:14.853 INFO:teuthology.orchestra.run.trial131.stdout:Installing weak dependencies: 2026-02-23T12:36:14.853 INFO:teuthology.orchestra.run.trial131.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-23T12:36:14.853 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:36:14.853 INFO:teuthology.orchestra.run.trial131.stdout:Transaction Summary 2026-02-23T12:36:14.853 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:36:14.853 INFO:teuthology.orchestra.run.trial131.stdout:Install 32 Packages 2026-02-23T12:36:14.853 INFO:teuthology.orchestra.run.trial131.stdout:Upgrade 2 Packages 2026-02-23T12:36:14.853 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:36:14.854 INFO:teuthology.orchestra.run.trial131.stdout:Total download size: 60 M 2026-02-23T12:36:14.854 INFO:teuthology.orchestra.run.trial131.stdout:Downloading Packages: 2026-02-23T12:36:18.090 INFO:teuthology.orchestra.run.trial131.stdout:(1/34): ceph-radosgw-20.3.0-5439.ge371433f.el9. 3.7 MB/s | 11 MB 00:03 2026-02-23T12:36:18.160 INFO:teuthology.orchestra.run.trial131.stdout:(2/34): ceph-selinux-20.3.0-5439.ge371433f.el9. 359 kB/s | 25 kB 00:00 2026-02-23T12:36:18.499 INFO:teuthology.orchestra.run.trial131.stdout:(3/34): libcephfs2-20.3.0-5439.ge371433f.el9.x8 2.5 MB/s | 860 kB 00:00 2026-02-23T12:36:18.629 INFO:teuthology.orchestra.run.trial131.stdout:(4/34): libradosstriper1-20.3.0-5439.ge371433f. 2.0 MB/s | 263 kB 00:00 2026-02-23T12:36:19.236 INFO:teuthology.orchestra.run.trial131.stdout:(5/34): ceph-base-20.3.0-5439.ge371433f.el9.x86 1.2 MB/s | 5.1 MB 00:04 2026-02-23T12:36:19.306 INFO:teuthology.orchestra.run.trial131.stdout:(6/34): python3-ceph-argparse-20.3.0-5439.ge371 648 kB/s | 45 kB 00:00 2026-02-23T12:36:19.578 INFO:teuthology.orchestra.run.trial131.stdout:(7/34): python3-ceph-common-20.3.0-5439.ge37143 684 kB/s | 186 kB 00:00 2026-02-23T12:36:19.703 INFO:teuthology.orchestra.run.trial046.stdout:(1/34): ceph-base-20.3.0-5439.ge371433f.el9.x86 1.0 MB/s | 5.1 MB 00:04 2026-02-23T12:36:19.759 INFO:teuthology.orchestra.run.trial046.stdout:(2/34): ceph-selinux-20.3.0-5439.ge371433f.el9. 450 kB/s | 25 kB 00:00 2026-02-23T12:36:19.861 INFO:teuthology.orchestra.run.trial131.stdout:(8/34): python3-cephfs-20.3.0-5439.ge371433f.el 721 kB/s | 204 kB 00:00 2026-02-23T12:36:20.175 INFO:teuthology.orchestra.run.trial131.stdout:(9/34): librgw2-20.3.0-5439.ge371433f.el9.x86_6 3.6 MB/s | 5.6 MB 00:01 2026-02-23T12:36:20.292 INFO:teuthology.orchestra.run.trial131.stdout:(10/34): python3-rados-20.3.0-5439.ge371433f.el 754 kB/s | 324 kB 00:00 2026-02-23T12:36:20.302 INFO:teuthology.orchestra.run.trial131.stdout:(11/34): python3-rbd-20.3.0-5439.ge371433f.el9. 2.3 MB/s | 305 kB 00:00 2026-02-23T12:36:20.356 INFO:teuthology.orchestra.run.trial131.stdout:(12/34): mailcap-2.1.49-5.el9.noarch.rpm 620 kB/s | 33 kB 00:00 2026-02-23T12:36:20.413 INFO:teuthology.orchestra.run.trial131.stdout:(13/34): pciutils-3.7.0-7.el9.x86_64.rpm 1.6 MB/s | 93 kB 00:00 2026-02-23T12:36:20.418 INFO:teuthology.orchestra.run.trial131.stdout:(14/34): python3-rgw-20.3.0-5439.ge371433f.el9. 793 kB/s | 100 kB 00:00 2026-02-23T12:36:20.728 INFO:teuthology.orchestra.run.trial046.stdout:(3/34): libcephfs2-20.3.0-5439.ge371433f.el9.x8 887 kB/s | 860 kB 00:00 2026-02-23T12:36:21.010 INFO:teuthology.orchestra.run.trial131.stdout:(15/34): boost-program-options-1.75.0-13.el9.x8 174 kB/s | 104 kB 00:00 2026-02-23T12:36:21.071 INFO:teuthology.orchestra.run.trial046.stdout:(4/34): libradosstriper1-20.3.0-5439.ge371433f. 766 kB/s | 263 kB 00:00 2026-02-23T12:36:21.090 INFO:teuthology.orchestra.run.trial131.stdout:(16/34): libnbd-1.20.3-4.el9.x86_64.rpm 244 kB/s | 164 kB 00:00 2026-02-23T12:36:21.189 INFO:teuthology.orchestra.run.trial131.stdout:(17/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 455 kB/s | 45 kB 00:00 2026-02-23T12:36:21.266 INFO:teuthology.orchestra.run.trial131.stdout:(18/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 624 kB/s | 160 kB 00:00 2026-02-23T12:36:21.555 INFO:teuthology.orchestra.run.trial046.stdout:(5/34): ceph-radosgw-20.3.0-5439.ge371433f.el9. 1.6 MB/s | 11 MB 00:06 2026-02-23T12:36:21.625 INFO:teuthology.orchestra.run.trial046.stdout:(6/34): python3-ceph-argparse-20.3.0-5439.ge371 642 kB/s | 45 kB 00:00 2026-02-23T12:36:21.679 INFO:teuthology.orchestra.run.trial131.stdout:(19/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 710 kB/s | 292 kB 00:00 2026-02-23T12:36:21.838 INFO:teuthology.orchestra.run.trial046.stdout:(7/34): python3-ceph-common-20.3.0-5439.ge37143 877 kB/s | 186 kB 00:00 2026-02-23T12:36:21.994 INFO:teuthology.orchestra.run.trial131.stdout:(20/34): librdkafka-1.6.1-102.el9.x86_64.rpm 823 kB/s | 662 kB 00:00 2026-02-23T12:36:22.013 INFO:teuthology.orchestra.run.trial131.stdout:(21/34): qatlib-25.08.0-2.el9.x86_64.rpm 717 kB/s | 240 kB 00:00 2026-02-23T12:36:22.042 INFO:teuthology.orchestra.run.trial046.stdout:(8/34): python3-cephfs-20.3.0-5439.ge371433f.el 998 kB/s | 204 kB 00:00 2026-02-23T12:36:22.093 INFO:teuthology.orchestra.run.trial131.stdout:(22/34): qatlib-service-25.08.0-2.el9.x86_64.rp 374 kB/s | 37 kB 00:00 2026-02-23T12:36:22.114 INFO:teuthology.orchestra.run.trial131.stdout:(23/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 659 kB/s | 66 kB 00:00 2026-02-23T12:36:22.282 INFO:teuthology.orchestra.run.trial131.stdout:(24/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.6 MB/s | 308 kB 00:00 2026-02-23T12:36:22.328 INFO:teuthology.orchestra.run.trial131.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 540 kB/s | 25 kB 00:00 2026-02-23T12:36:22.370 INFO:teuthology.orchestra.run.trial131.stdout:(26/34): liboath-2.6.12-1.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2026-02-23T12:36:22.382 INFO:teuthology.orchestra.run.trial046.stdout:(9/34): python3-rados-20.3.0-5439.ge371433f.el9 954 kB/s | 324 kB 00:00 2026-02-23T12:36:22.408 INFO:teuthology.orchestra.run.trial131.stdout:(27/34): libunwind-1.6.2-1.el9.x86_64.rpm 1.7 MB/s | 67 kB 00:00 2026-02-23T12:36:22.454 INFO:teuthology.orchestra.run.trial131.stdout:(28/34): libarrow-9.0.0-15.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2026-02-23T12:36:22.611 INFO:teuthology.orchestra.run.trial131.stdout:(29/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 4.0 MB/s | 838 kB 00:00 2026-02-23T12:36:22.719 INFO:teuthology.orchestra.run.trial046.stdout:(10/34): python3-rbd-20.3.0-5439.ge371433f.el9. 906 kB/s | 305 kB 00:00 2026-02-23T12:36:22.729 INFO:teuthology.orchestra.run.trial131.stdout:(30/34): re2-20211101-20.el9.x86_64.rpm 695 kB/s | 191 kB 00:00 2026-02-23T12:36:22.859 INFO:teuthology.orchestra.run.trial046.stdout:(11/34): python3-rgw-20.3.0-5439.ge371433f.el9. 714 kB/s | 100 kB 00:00 2026-02-23T12:36:22.874 INFO:teuthology.orchestra.run.trial046.stdout:(12/34): mailcap-2.1.49-5.el9.noarch.rpm 2.2 MB/s | 33 kB 00:00 2026-02-23T12:36:22.883 INFO:teuthology.orchestra.run.trial046.stdout:(13/34): pciutils-3.7.0-7.el9.x86_64.rpm 11 MB/s | 93 kB 00:00 2026-02-23T12:36:22.923 INFO:teuthology.orchestra.run.trial046.stdout:(14/34): boost-program-options-1.75.0-13.el9.x8 2.6 MB/s | 104 kB 00:00 2026-02-23T12:36:22.936 INFO:teuthology.orchestra.run.trial131.stdout:(31/34): thrift-0.15.0-4.el9.x86_64.rpm 4.9 MB/s | 1.6 MB 00:00 2026-02-23T12:36:22.940 INFO:teuthology.orchestra.run.trial046.stdout:(15/34): libnbd-1.20.3-4.el9.x86_64.rpm 9.2 MB/s | 164 kB 00:00 2026-02-23T12:36:22.952 INFO:teuthology.orchestra.run.trial046.stdout:(16/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 14 MB/s | 160 kB 00:00 2026-02-23T12:36:22.961 INFO:teuthology.orchestra.run.trial046.stdout:(17/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 4.9 MB/s | 45 kB 00:00 2026-02-23T12:36:22.982 INFO:teuthology.orchestra.run.trial046.stdout:(18/34): librdkafka-1.6.1-102.el9.x86_64.rpm 31 MB/s | 662 kB 00:00 2026-02-23T12:36:22.993 INFO:teuthology.orchestra.run.trial046.stdout:(19/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 26 MB/s | 292 kB 00:00 2026-02-23T12:36:23.004 INFO:teuthology.orchestra.run.trial046.stdout:(20/34): qatlib-25.08.0-2.el9.x86_64.rpm 22 MB/s | 240 kB 00:00 2026-02-23T12:36:23.013 INFO:teuthology.orchestra.run.trial046.stdout:(21/34): qatlib-service-25.08.0-2.el9.x86_64.rp 4.1 MB/s | 37 kB 00:00 2026-02-23T12:36:23.022 INFO:teuthology.orchestra.run.trial046.stdout:(22/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 7.1 MB/s | 66 kB 00:00 2026-02-23T12:36:23.257 INFO:teuthology.orchestra.run.trial046.stdout:(23/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.3 MB/s | 308 kB 00:00 2026-02-23T12:36:23.418 INFO:teuthology.orchestra.run.trial046.stdout:(24/34): libarrow-9.0.0-15.el9.x86_64.rpm 27 MB/s | 4.4 MB 00:00 2026-02-23T12:36:23.448 INFO:teuthology.orchestra.run.trial046.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 820 kB/s | 25 kB 00:00 2026-02-23T12:36:23.479 INFO:teuthology.orchestra.run.trial046.stdout:(26/34): liboath-2.6.12-1.el9.x86_64.rpm 1.6 MB/s | 49 kB 00:00 2026-02-23T12:36:23.509 INFO:teuthology.orchestra.run.trial046.stdout:(27/34): libunwind-1.6.2-1.el9.x86_64.rpm 2.2 MB/s | 67 kB 00:00 2026-02-23T12:36:23.544 INFO:teuthology.orchestra.run.trial046.stdout:(28/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 24 MB/s | 838 kB 00:00 2026-02-23T12:36:23.575 INFO:teuthology.orchestra.run.trial046.stdout:(29/34): re2-20211101-20.el9.x86_64.rpm 6.0 MB/s | 191 kB 00:00 2026-02-23T12:36:23.614 INFO:teuthology.orchestra.run.trial046.stdout:(30/34): thrift-0.15.0-4.el9.x86_64.rpm 41 MB/s | 1.6 MB 00:00 2026-02-23T12:36:24.830 INFO:teuthology.orchestra.run.trial131.stdout:(32/34): librbd1-20.3.0-5439.ge371433f.el9.x86_ 1.4 MB/s | 2.7 MB 00:01 2026-02-23T12:36:26.110 INFO:teuthology.orchestra.run.trial131.stdout:(33/34): librados2-20.3.0-5439.ge371433f.el9.x8 995 kB/s | 3.3 MB 00:03 2026-02-23T12:36:26.674 INFO:teuthology.orchestra.run.trial046.stdout:(31/34): librados2-20.3.0-5439.ge371433f.el9.x8 1.1 MB/s | 3.3 MB 00:03 2026-02-23T12:36:28.874 INFO:teuthology.orchestra.run.trial046.stdout:(32/34): librbd1-20.3.0-5439.ge371433f.el9.x86_ 1.2 MB/s | 2.7 MB 00:02 2026-02-23T12:36:29.469 INFO:teuthology.orchestra.run.trial046.stdout:(33/34): librgw2-20.3.0-5439.ge371433f.el9.x86_ 686 kB/s | 5.6 MB 00:08 2026-02-23T12:36:38.269 INFO:teuthology.orchestra.run.trial131.stdout:(34/34): ceph-common-20.3.0-5439.ge371433f.el9. 919 kB/s | 21 MB 00:23 2026-02-23T12:36:38.273 INFO:teuthology.orchestra.run.trial131.stdout:-------------------------------------------------------------------------------- 2026-02-23T12:36:38.273 INFO:teuthology.orchestra.run.trial131.stdout:Total 2.6 MB/s | 60 MB 00:23 2026-02-23T12:36:38.359 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction check 2026-02-23T12:36:38.377 INFO:teuthology.orchestra.run.trial131.stdout:Transaction check succeeded. 2026-02-23T12:36:38.378 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction test 2026-02-23T12:36:38.621 INFO:teuthology.orchestra.run.trial131.stdout:Transaction test succeeded. 2026-02-23T12:36:38.621 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction 2026-02-23T12:36:38.900 INFO:teuthology.orchestra.run.trial131.stdout: Preparing : 1/1 2026-02-23T12:36:39.045 INFO:teuthology.orchestra.run.trial131.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/36 2026-02-23T12:36:39.048 INFO:teuthology.orchestra.run.trial131.stdout: Upgrading : librados2-2:20.3.0-5439.ge371433f.el9.x86_64 2/36 2026-02-23T12:36:39.080 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: librados2-2:20.3.0-5439.ge371433f.el9.x86_64 2/36 2026-02-23T12:36:39.118 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-rados-2:20.3.0-5439.ge371433f.el9.x86_64 3/36 2026-02-23T12:36:39.119 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libcephfs2-2:20.3.0-5439.ge371433f.el9.x86_64 4/36 2026-02-23T12:36:39.132 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: libcephfs2-2:20.3.0-5439.ge371433f.el9.x86_64 4/36 2026-02-23T12:36:39.142 INFO:teuthology.orchestra.run.trial131.stdout: Installing : liboath-2.6.12-1.el9.x86_64 5/36 2026-02-23T12:36:39.144 INFO:teuthology.orchestra.run.trial131.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/36 2026-02-23T12:36:39.148 INFO:teuthology.orchestra.run.trial131.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/36 2026-02-23T12:36:39.152 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 8/36 2026-02-23T12:36:39.163 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-ceph-argparse-2:20.3.0-5439.ge371433f.el9. 9/36 2026-02-23T12:36:39.176 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-cephfs-2:20.3.0-5439.ge371433f.el9.x86_64 10/36 2026-02-23T12:36:39.177 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libradosstriper1-2:20.3.0-5439.ge371433f.el9.x86_6 11/36 2026-02-23T12:36:39.200 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5439.ge371433f.el9.x86_6 11/36 2026-02-23T12:36:39.205 INFO:teuthology.orchestra.run.trial131.stdout: Installing : thrift-0.15.0-4.el9.x86_64 12/36 2026-02-23T12:36:39.235 INFO:teuthology.orchestra.run.trial131.stdout: Installing : re2-1:20211101-20.el9.x86_64 13/36 2026-02-23T12:36:39.239 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 14/36 2026-02-23T12:36:39.245 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 15/36 2026-02-23T12:36:39.247 INFO:teuthology.orchestra.run.trial131.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 16/36 2026-02-23T12:36:39.252 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 17/36 2026-02-23T12:36:39.369 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-23T12:36:39.370 INFO:teuthology.orchestra.run.trial131.stdout: Upgrading : librbd1-2:20.3.0-5439.ge371433f.el9.x86_64 19/36 2026-02-23T12:36:39.396 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: librbd1-2:20.3.0-5439.ge371433f.el9.x86_64 19/36 2026-02-23T12:36:39.399 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-rbd-2:20.3.0-5439.ge371433f.el9.x86_64 20/36 2026-02-23T12:36:39.406 INFO:teuthology.orchestra.run.trial131.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-23T12:36:39.660 INFO:teuthology.orchestra.run.trial131.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-23T12:36:39.661 INFO:teuthology.orchestra.run.trial131.stdout: Installing : librgw2-2:20.3.0-5439.ge371433f.el9.x86_64 23/36 2026-02-23T12:36:39.679 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: librgw2-2:20.3.0-5439.ge371433f.el9.x86_64 23/36 2026-02-23T12:36:39.683 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-rgw-2:20.3.0-5439.ge371433f.el9.x86_64 24/36 2026-02-23T12:36:39.687 INFO:teuthology.orchestra.run.trial131.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-23T12:36:39.690 INFO:teuthology.orchestra.run.trial131.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-23T12:36:39.691 INFO:teuthology.orchestra.run.trial131.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-23T12:36:39.708 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-23T12:36:39.711 INFO:teuthology.orchestra.run.trial131.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-23T12:36:39.744 INFO:teuthology.orchestra.run.trial131.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-23T12:36:39.746 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-ceph-common-2:20.3.0-5439.ge371433f.el9.x8 30/36 2026-02-23T12:36:40.705 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-common-2:20.3.0-5439.ge371433f.el9.x86_64 31/36 2026-02-23T12:36:40.708 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-common-2:20.3.0-5439.ge371433f.el9.x86_64 31/36 2026-02-23T12:36:40.974 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-common-2:20.3.0-5439.ge371433f.el9.x86_64 31/36 2026-02-23T12:36:40.978 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-base-2:20.3.0-5439.ge371433f.el9.x86_64 32/36 2026-02-23T12:36:41.018 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-base-2:20.3.0-5439.ge371433f.el9.x86_64 32/36 2026-02-23T12:36:41.018 INFO:teuthology.orchestra.run.trial131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-23T12:36:41.018 INFO:teuthology.orchestra.run.trial131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-23T12:36:41.018 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:36:41.021 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-selinux-2:20.3.0-5439.ge371433f.el9.x86_64 33/36 2026-02-23T12:36:41.416 INFO:teuthology.orchestra.run.trial046.stdout:(34/34): ceph-common-20.3.0-5439.ge371433f.el9. 799 kB/s | 21 MB 00:26 2026-02-23T12:36:41.418 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-23T12:36:41.418 INFO:teuthology.orchestra.run.trial046.stdout:Total 2.2 MB/s | 60 MB 00:27 2026-02-23T12:36:41.498 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-23T12:36:41.515 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-23T12:36:41.515 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-23T12:36:41.760 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-23T12:36:41.760 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-23T12:36:42.039 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-23T12:36:42.184 INFO:teuthology.orchestra.run.trial046.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/36 2026-02-23T12:36:42.187 INFO:teuthology.orchestra.run.trial046.stdout: Upgrading : librados2-2:20.3.0-5439.ge371433f.el9.x86_64 2/36 2026-02-23T12:36:42.218 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: librados2-2:20.3.0-5439.ge371433f.el9.x86_64 2/36 2026-02-23T12:36:42.255 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-rados-2:20.3.0-5439.ge371433f.el9.x86_64 3/36 2026-02-23T12:36:42.255 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libcephfs2-2:20.3.0-5439.ge371433f.el9.x86_64 4/36 2026-02-23T12:36:42.267 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: libcephfs2-2:20.3.0-5439.ge371433f.el9.x86_64 4/36 2026-02-23T12:36:42.276 INFO:teuthology.orchestra.run.trial046.stdout: Installing : liboath-2.6.12-1.el9.x86_64 5/36 2026-02-23T12:36:42.278 INFO:teuthology.orchestra.run.trial046.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/36 2026-02-23T12:36:42.281 INFO:teuthology.orchestra.run.trial046.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/36 2026-02-23T12:36:42.286 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 8/36 2026-02-23T12:36:42.297 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-ceph-argparse-2:20.3.0-5439.ge371433f.el9. 9/36 2026-02-23T12:36:42.310 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-cephfs-2:20.3.0-5439.ge371433f.el9.x86_64 10/36 2026-02-23T12:36:42.310 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libradosstriper1-2:20.3.0-5439.ge371433f.el9.x86_6 11/36 2026-02-23T12:36:42.332 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5439.ge371433f.el9.x86_6 11/36 2026-02-23T12:36:42.336 INFO:teuthology.orchestra.run.trial046.stdout: Installing : thrift-0.15.0-4.el9.x86_64 12/36 2026-02-23T12:36:42.365 INFO:teuthology.orchestra.run.trial046.stdout: Installing : re2-1:20211101-20.el9.x86_64 13/36 2026-02-23T12:36:42.369 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 14/36 2026-02-23T12:36:42.375 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 15/36 2026-02-23T12:36:42.377 INFO:teuthology.orchestra.run.trial046.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 16/36 2026-02-23T12:36:42.382 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 17/36 2026-02-23T12:36:42.498 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-23T12:36:42.499 INFO:teuthology.orchestra.run.trial046.stdout: Upgrading : librbd1-2:20.3.0-5439.ge371433f.el9.x86_64 19/36 2026-02-23T12:36:42.527 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: librbd1-2:20.3.0-5439.ge371433f.el9.x86_64 19/36 2026-02-23T12:36:42.530 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-rbd-2:20.3.0-5439.ge371433f.el9.x86_64 20/36 2026-02-23T12:36:42.536 INFO:teuthology.orchestra.run.trial046.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-23T12:36:42.790 INFO:teuthology.orchestra.run.trial046.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-23T12:36:42.791 INFO:teuthology.orchestra.run.trial046.stdout: Installing : librgw2-2:20.3.0-5439.ge371433f.el9.x86_64 23/36 2026-02-23T12:36:42.808 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: librgw2-2:20.3.0-5439.ge371433f.el9.x86_64 23/36 2026-02-23T12:36:42.812 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-rgw-2:20.3.0-5439.ge371433f.el9.x86_64 24/36 2026-02-23T12:36:42.817 INFO:teuthology.orchestra.run.trial046.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-23T12:36:42.820 INFO:teuthology.orchestra.run.trial046.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-23T12:36:42.820 INFO:teuthology.orchestra.run.trial046.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-23T12:36:42.838 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-23T12:36:42.841 INFO:teuthology.orchestra.run.trial046.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-23T12:36:42.875 INFO:teuthology.orchestra.run.trial046.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-23T12:36:42.877 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-ceph-common-2:20.3.0-5439.ge371433f.el9.x8 30/36 2026-02-23T12:36:43.835 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-common-2:20.3.0-5439.ge371433f.el9.x86_64 31/36 2026-02-23T12:36:43.838 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-common-2:20.3.0-5439.ge371433f.el9.x86_64 31/36 2026-02-23T12:36:44.102 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-common-2:20.3.0-5439.ge371433f.el9.x86_64 31/36 2026-02-23T12:36:44.105 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-base-2:20.3.0-5439.ge371433f.el9.x86_64 32/36 2026-02-23T12:36:44.142 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-base-2:20.3.0-5439.ge371433f.el9.x86_64 32/36 2026-02-23T12:36:44.142 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-23T12:36:44.142 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-23T12:36:44.142 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:36:44.145 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-selinux-2:20.3.0-5439.ge371433f.el9.x86_64 33/36 2026-02-23T12:36:45.523 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5439.ge371433f.el9.x86_64 33/36 2026-02-23T12:36:45.523 INFO:teuthology.orchestra.run.trial131.stdout:skipping the directory /sys 2026-02-23T12:36:45.523 INFO:teuthology.orchestra.run.trial131.stdout:skipping the directory /proc 2026-02-23T12:36:45.523 INFO:teuthology.orchestra.run.trial131.stdout:skipping the directory /mnt 2026-02-23T12:36:45.523 INFO:teuthology.orchestra.run.trial131.stdout:skipping the directory /var/tmp 2026-02-23T12:36:45.523 INFO:teuthology.orchestra.run.trial131.stdout:skipping the directory /home 2026-02-23T12:36:45.523 INFO:teuthology.orchestra.run.trial131.stdout:skipping the directory /root 2026-02-23T12:36:45.523 INFO:teuthology.orchestra.run.trial131.stdout:skipping the directory /tmp 2026-02-23T12:36:45.523 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:36:46.026 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-radosgw-2:20.3.0-5439.ge371433f.el9.x86_64 34/36 2026-02-23T12:36:46.050 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5439.ge371433f.el9.x86_64 34/36 2026-02-23T12:36:46.050 INFO:teuthology.orchestra.run.trial131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T12:36:46.050 INFO:teuthology.orchestra.run.trial131.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-23T12:36:46.050 INFO:teuthology.orchestra.run.trial131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-23T12:36:46.050 INFO:teuthology.orchestra.run.trial131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-23T12:36:46.050 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:36:46.051 INFO:teuthology.orchestra.run.trial131.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-23T12:36:46.065 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-23T12:36:46.065 INFO:teuthology.orchestra.run.trial131.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-23T12:36:46.120 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-23T12:36:46.121 INFO:teuthology.orchestra.run.trial131.stdout:Creating group 'qat' with GID 992. 2026-02-23T12:36:46.121 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:36:46.417 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-base-2:20.3.0-5439.ge371433f.el9.x86_64 1/36 2026-02-23T12:36:46.417 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-common-2:20.3.0-5439.ge371433f.el9.x86_64 2/36 2026-02-23T12:36:46.417 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-radosgw-2:20.3.0-5439.ge371433f.el9.x86_64 3/36 2026-02-23T12:36:46.417 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-selinux-2:20.3.0-5439.ge371433f.el9.x86_64 4/36 2026-02-23T12:36:46.417 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libcephfs2-2:20.3.0-5439.ge371433f.el9.x86_64 5/36 2026-02-23T12:36:46.417 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libradosstriper1-2:20.3.0-5439.ge371433f.el9.x86_6 6/36 2026-02-23T12:36:46.418 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : librgw2-2:20.3.0-5439.ge371433f.el9.x86_64 7/36 2026-02-23T12:36:46.418 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5439.ge371433f.el9. 8/36 2026-02-23T12:36:46.418 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-ceph-common-2:20.3.0-5439.ge371433f.el9.x8 9/36 2026-02-23T12:36:46.418 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-cephfs-2:20.3.0-5439.ge371433f.el9.x86_64 10/36 2026-02-23T12:36:46.418 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-rados-2:20.3.0-5439.ge371433f.el9.x86_64 11/36 2026-02-23T12:36:46.418 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-rbd-2:20.3.0-5439.ge371433f.el9.x86_64 12/36 2026-02-23T12:36:46.418 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-rgw-2:20.3.0-5439.ge371433f.el9.x86_64 13/36 2026-02-23T12:36:46.418 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-23T12:36:46.418 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-23T12:36:46.418 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-23T12:36:46.418 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-23T12:36:46.418 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-23T12:36:46.418 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-23T12:36:46.418 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-23T12:36:46.418 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-23T12:36:46.418 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-23T12:36:46.418 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-23T12:36:46.418 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-23T12:36:46.418 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-23T12:36:46.418 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-23T12:36:46.418 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-23T12:36:46.418 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-23T12:36:46.418 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-23T12:36:46.418 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-23T12:36:46.418 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-23T12:36:46.418 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-23T12:36:46.418 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : librados2-2:20.3.0-5439.ge371433f.el9.x86_64 33/36 2026-02-23T12:36:46.418 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-23T12:36:46.419 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : librbd1-2:20.3.0-5439.ge371433f.el9.x86_64 35/36 2026-02-23T12:36:46.479 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-23T12:36:46.479 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:36:46.480 INFO:teuthology.orchestra.run.trial131.stdout:Upgraded: 2026-02-23T12:36:46.480 INFO:teuthology.orchestra.run.trial131.stdout: librados2-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:36:46.480 INFO:teuthology.orchestra.run.trial131.stdout: librbd1-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:36:46.480 INFO:teuthology.orchestra.run.trial131.stdout:Installed: 2026-02-23T12:36:46.480 INFO:teuthology.orchestra.run.trial131.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-23T12:36:46.480 INFO:teuthology.orchestra.run.trial131.stdout: ceph-base-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:36:46.480 INFO:teuthology.orchestra.run.trial131.stdout: ceph-common-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:36:46.480 INFO:teuthology.orchestra.run.trial131.stdout: ceph-radosgw-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:36:46.480 INFO:teuthology.orchestra.run.trial131.stdout: ceph-selinux-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:36:46.480 INFO:teuthology.orchestra.run.trial131.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-23T12:36:46.480 INFO:teuthology.orchestra.run.trial131.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-23T12:36:46.481 INFO:teuthology.orchestra.run.trial131.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-23T12:36:46.481 INFO:teuthology.orchestra.run.trial131.stdout: libcephfs2-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:36:46.481 INFO:teuthology.orchestra.run.trial131.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-23T12:36:46.481 INFO:teuthology.orchestra.run.trial131.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-23T12:36:46.481 INFO:teuthology.orchestra.run.trial131.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-23T12:36:46.481 INFO:teuthology.orchestra.run.trial131.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-23T12:36:46.481 INFO:teuthology.orchestra.run.trial131.stdout: libradosstriper1-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:36:46.481 INFO:teuthology.orchestra.run.trial131.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-23T12:36:46.481 INFO:teuthology.orchestra.run.trial131.stdout: librgw2-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:36:46.481 INFO:teuthology.orchestra.run.trial131.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-23T12:36:46.482 INFO:teuthology.orchestra.run.trial131.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-23T12:36:46.482 INFO:teuthology.orchestra.run.trial131.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-23T12:36:46.482 INFO:teuthology.orchestra.run.trial131.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-23T12:36:46.482 INFO:teuthology.orchestra.run.trial131.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-23T12:36:46.482 INFO:teuthology.orchestra.run.trial131.stdout: python3-ceph-argparse-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:36:46.482 INFO:teuthology.orchestra.run.trial131.stdout: python3-ceph-common-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:36:46.482 INFO:teuthology.orchestra.run.trial131.stdout: python3-cephfs-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:36:46.482 INFO:teuthology.orchestra.run.trial131.stdout: python3-rados-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:36:46.482 INFO:teuthology.orchestra.run.trial131.stdout: python3-rbd-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:36:46.482 INFO:teuthology.orchestra.run.trial131.stdout: python3-rgw-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:36:46.482 INFO:teuthology.orchestra.run.trial131.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-23T12:36:46.482 INFO:teuthology.orchestra.run.trial131.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-23T12:36:46.483 INFO:teuthology.orchestra.run.trial131.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-23T12:36:46.483 INFO:teuthology.orchestra.run.trial131.stdout: re2-1:20211101-20.el9.x86_64 2026-02-23T12:36:46.483 INFO:teuthology.orchestra.run.trial131.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-23T12:36:46.483 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:36:46.483 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-23T12:36:46.520 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-test 2026-02-23T12:36:46.831 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:00:33 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:36:46.913 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-23T12:36:46.914 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:36:46.914 INFO:teuthology.orchestra.run.trial131.stdout: Package Arch Version Repository Size 2026-02-23T12:36:46.914 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:36:46.914 INFO:teuthology.orchestra.run.trial131.stdout:Installing: 2026-02-23T12:36:46.914 INFO:teuthology.orchestra.run.trial131.stdout: ceph-test x86_64 2:20.3.0-5439.ge371433f.el9 ceph 126 M 2026-02-23T12:36:46.914 INFO:teuthology.orchestra.run.trial131.stdout:Installing dependencies: 2026-02-23T12:36:46.914 INFO:teuthology.orchestra.run.trial131.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-23T12:36:46.914 INFO:teuthology.orchestra.run.trial131.stdout: libasan8 x86_64 15.2.1-7.el9 appstream 525 k 2026-02-23T12:36:46.914 INFO:teuthology.orchestra.run.trial131.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-23T12:36:46.914 INFO:teuthology.orchestra.run.trial131.stdout: libcephsqlite x86_64 2:20.3.0-5439.ge371433f.el9 ceph 153 k 2026-02-23T12:36:46.914 INFO:teuthology.orchestra.run.trial131.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-23T12:36:46.914 INFO:teuthology.orchestra.run.trial131.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-23T12:36:46.914 INFO:teuthology.orchestra.run.trial131.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-23T12:36:46.915 INFO:teuthology.orchestra.run.trial131.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-23T12:36:46.915 INFO:teuthology.orchestra.run.trial131.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-23T12:36:46.915 INFO:teuthology.orchestra.run.trial131.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-23T12:36:46.915 INFO:teuthology.orchestra.run.trial131.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-23T12:36:46.915 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:36:46.915 INFO:teuthology.orchestra.run.trial131.stdout:Transaction Summary 2026-02-23T12:36:46.915 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:36:46.915 INFO:teuthology.orchestra.run.trial131.stdout:Install 12 Packages 2026-02-23T12:36:46.915 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:36:46.916 INFO:teuthology.orchestra.run.trial131.stdout:Total download size: 131 M 2026-02-23T12:36:46.916 INFO:teuthology.orchestra.run.trial131.stdout:Installed size: 977 M 2026-02-23T12:36:46.916 INFO:teuthology.orchestra.run.trial131.stdout:Downloading Packages: 2026-02-23T12:36:47.436 INFO:teuthology.orchestra.run.trial131.stdout:(1/12): hwloc-libs-2.4.1-6.el9.x86_64.rpm 54 MB/s | 2.1 MB 00:00 2026-02-23T12:36:47.440 INFO:teuthology.orchestra.run.trial131.stdout:(2/12): libatomic-11.5.0-14.el9.x86_64.rpm 5.1 MB/s | 23 kB 00:00 2026-02-23T12:36:47.445 INFO:teuthology.orchestra.run.trial131.stdout:(3/12): lksctp-tools-1.0.19-2.el9.x86_64.rpm 18 MB/s | 94 kB 00:00 2026-02-23T12:36:47.930 INFO:teuthology.orchestra.run.trial131.stdout:(4/12): libcephsqlite-20.3.0-5439.ge371433f.el9 287 kB/s | 153 kB 00:00 2026-02-23T12:36:48.049 INFO:teuthology.orchestra.run.trial131.stdout:(5/12): libasan8-15.2.1-7.el9.x86_64.rpm 870 kB/s | 525 kB 00:00 2026-02-23T12:36:48.155 INFO:teuthology.orchestra.run.trial131.stdout:(6/12): libxslt-1.1.34-12.el9.x86_64.rpm 2.2 MB/s | 233 kB 00:00 2026-02-23T12:36:48.349 INFO:teuthology.orchestra.run.trial131.stdout:(7/12): protobuf-3.14.0-17.el9.x86_64.rpm 5.2 MB/s | 1.0 MB 00:00 2026-02-23T12:36:48.393 INFO:teuthology.orchestra.run.trial131.stdout:(8/12): libubsan-11.5.0-14.el9.x86_64.rpm 380 kB/s | 176 kB 00:00 2026-02-23T12:36:48.441 INFO:teuthology.orchestra.run.trial131.stdout:(9/12): socat-1.7.4.1-8.el9.x86_64.rpm 3.2 MB/s | 303 kB 00:00 2026-02-23T12:36:48.491 INFO:teuthology.orchestra.run.trial131.stdout:(10/12): xmlstarlet-1.6.1-20.el9.x86_64.rpm 653 kB/s | 64 kB 00:00 2026-02-23T12:36:48.578 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5439.ge371433f.el9.x86_64 33/36 2026-02-23T12:36:48.578 INFO:teuthology.orchestra.run.trial046.stdout:skipping the directory /sys 2026-02-23T12:36:48.578 INFO:teuthology.orchestra.run.trial046.stdout:skipping the directory /proc 2026-02-23T12:36:48.579 INFO:teuthology.orchestra.run.trial046.stdout:skipping the directory /mnt 2026-02-23T12:36:48.579 INFO:teuthology.orchestra.run.trial046.stdout:skipping the directory /var/tmp 2026-02-23T12:36:48.579 INFO:teuthology.orchestra.run.trial046.stdout:skipping the directory /home 2026-02-23T12:36:48.579 INFO:teuthology.orchestra.run.trial046.stdout:skipping the directory /root 2026-02-23T12:36:48.579 INFO:teuthology.orchestra.run.trial046.stdout:skipping the directory /tmp 2026-02-23T12:36:48.579 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:36:48.699 INFO:teuthology.orchestra.run.trial131.stdout:(11/12): yaml-cpp-0.6.3-5.el9.x86_64.rpm 473 kB/s | 122 kB 00:00 2026-02-23T12:36:49.080 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-radosgw-2:20.3.0-5439.ge371433f.el9.x86_64 34/36 2026-02-23T12:36:49.102 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5439.ge371433f.el9.x86_64 34/36 2026-02-23T12:36:49.102 INFO:teuthology.orchestra.run.trial046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T12:36:49.103 INFO:teuthology.orchestra.run.trial046.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-23T12:36:49.103 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-23T12:36:49.103 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-23T12:36:49.103 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:36:49.104 INFO:teuthology.orchestra.run.trial046.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-23T12:36:49.117 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-23T12:36:49.117 INFO:teuthology.orchestra.run.trial046.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-23T12:36:49.169 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-23T12:36:49.169 INFO:teuthology.orchestra.run.trial046.stdout:Creating group 'qat' with GID 992. 2026-02-23T12:36:49.169 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:36:49.465 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-base-2:20.3.0-5439.ge371433f.el9.x86_64 1/36 2026-02-23T12:36:49.466 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-common-2:20.3.0-5439.ge371433f.el9.x86_64 2/36 2026-02-23T12:36:49.466 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-radosgw-2:20.3.0-5439.ge371433f.el9.x86_64 3/36 2026-02-23T12:36:49.466 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-selinux-2:20.3.0-5439.ge371433f.el9.x86_64 4/36 2026-02-23T12:36:49.466 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libcephfs2-2:20.3.0-5439.ge371433f.el9.x86_64 5/36 2026-02-23T12:36:49.466 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libradosstriper1-2:20.3.0-5439.ge371433f.el9.x86_6 6/36 2026-02-23T12:36:49.466 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : librgw2-2:20.3.0-5439.ge371433f.el9.x86_64 7/36 2026-02-23T12:36:49.466 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5439.ge371433f.el9. 8/36 2026-02-23T12:36:49.466 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-ceph-common-2:20.3.0-5439.ge371433f.el9.x8 9/36 2026-02-23T12:36:49.466 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-cephfs-2:20.3.0-5439.ge371433f.el9.x86_64 10/36 2026-02-23T12:36:49.467 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-rados-2:20.3.0-5439.ge371433f.el9.x86_64 11/36 2026-02-23T12:36:49.467 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-rbd-2:20.3.0-5439.ge371433f.el9.x86_64 12/36 2026-02-23T12:36:49.467 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-rgw-2:20.3.0-5439.ge371433f.el9.x86_64 13/36 2026-02-23T12:36:49.467 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-23T12:36:49.467 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-23T12:36:49.467 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-23T12:36:49.467 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-23T12:36:49.467 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-23T12:36:49.467 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-23T12:36:49.467 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-23T12:36:49.467 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-23T12:36:49.467 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-23T12:36:49.467 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-23T12:36:49.468 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-23T12:36:49.468 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-23T12:36:49.468 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-23T12:36:49.468 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-23T12:36:49.468 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-23T12:36:49.468 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-23T12:36:49.468 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-23T12:36:49.468 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-23T12:36:49.468 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-23T12:36:49.468 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : librados2-2:20.3.0-5439.ge371433f.el9.x86_64 33/36 2026-02-23T12:36:49.468 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-23T12:36:49.468 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : librbd1-2:20.3.0-5439.ge371433f.el9.x86_64 35/36 2026-02-23T12:36:49.530 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-23T12:36:49.530 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:36:49.530 INFO:teuthology.orchestra.run.trial046.stdout:Upgraded: 2026-02-23T12:36:49.530 INFO:teuthology.orchestra.run.trial046.stdout: librados2-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:36:49.530 INFO:teuthology.orchestra.run.trial046.stdout: librbd1-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:36:49.531 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-23T12:36:49.531 INFO:teuthology.orchestra.run.trial046.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-23T12:36:49.531 INFO:teuthology.orchestra.run.trial046.stdout: ceph-base-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:36:49.531 INFO:teuthology.orchestra.run.trial046.stdout: ceph-common-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:36:49.531 INFO:teuthology.orchestra.run.trial046.stdout: ceph-radosgw-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:36:49.531 INFO:teuthology.orchestra.run.trial046.stdout: ceph-selinux-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:36:49.531 INFO:teuthology.orchestra.run.trial046.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-23T12:36:49.531 INFO:teuthology.orchestra.run.trial046.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-23T12:36:49.531 INFO:teuthology.orchestra.run.trial046.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-23T12:36:49.531 INFO:teuthology.orchestra.run.trial046.stdout: libcephfs2-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:36:49.531 INFO:teuthology.orchestra.run.trial046.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-23T12:36:49.532 INFO:teuthology.orchestra.run.trial046.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-23T12:36:49.532 INFO:teuthology.orchestra.run.trial046.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-23T12:36:49.532 INFO:teuthology.orchestra.run.trial046.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-23T12:36:49.532 INFO:teuthology.orchestra.run.trial046.stdout: libradosstriper1-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:36:49.532 INFO:teuthology.orchestra.run.trial046.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-23T12:36:49.532 INFO:teuthology.orchestra.run.trial046.stdout: librgw2-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:36:49.532 INFO:teuthology.orchestra.run.trial046.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-23T12:36:49.532 INFO:teuthology.orchestra.run.trial046.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-23T12:36:49.532 INFO:teuthology.orchestra.run.trial046.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-23T12:36:49.532 INFO:teuthology.orchestra.run.trial046.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-23T12:36:49.532 INFO:teuthology.orchestra.run.trial046.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-23T12:36:49.532 INFO:teuthology.orchestra.run.trial046.stdout: python3-ceph-argparse-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:36:49.532 INFO:teuthology.orchestra.run.trial046.stdout: python3-ceph-common-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:36:49.533 INFO:teuthology.orchestra.run.trial046.stdout: python3-cephfs-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:36:49.533 INFO:teuthology.orchestra.run.trial046.stdout: python3-rados-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:36:49.533 INFO:teuthology.orchestra.run.trial046.stdout: python3-rbd-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:36:49.533 INFO:teuthology.orchestra.run.trial046.stdout: python3-rgw-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:36:49.533 INFO:teuthology.orchestra.run.trial046.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-23T12:36:49.533 INFO:teuthology.orchestra.run.trial046.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-23T12:36:49.533 INFO:teuthology.orchestra.run.trial046.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-23T12:36:49.533 INFO:teuthology.orchestra.run.trial046.stdout: re2-1:20211101-20.el9.x86_64 2026-02-23T12:36:49.533 INFO:teuthology.orchestra.run.trial046.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-23T12:36:49.533 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:36:49.533 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-23T12:36:49.568 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-test 2026-02-23T12:36:49.880 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:36 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:36:49.963 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-23T12:36:49.964 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:36:49.964 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repository Size 2026-02-23T12:36:49.964 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:36:49.964 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-23T12:36:49.964 INFO:teuthology.orchestra.run.trial046.stdout: ceph-test x86_64 2:20.3.0-5439.ge371433f.el9 ceph 126 M 2026-02-23T12:36:49.964 INFO:teuthology.orchestra.run.trial046.stdout:Installing dependencies: 2026-02-23T12:36:49.965 INFO:teuthology.orchestra.run.trial046.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-23T12:36:49.965 INFO:teuthology.orchestra.run.trial046.stdout: libasan8 x86_64 15.2.1-7.el9 appstream 525 k 2026-02-23T12:36:49.965 INFO:teuthology.orchestra.run.trial046.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-23T12:36:49.965 INFO:teuthology.orchestra.run.trial046.stdout: libcephsqlite x86_64 2:20.3.0-5439.ge371433f.el9 ceph 153 k 2026-02-23T12:36:49.965 INFO:teuthology.orchestra.run.trial046.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-23T12:36:49.965 INFO:teuthology.orchestra.run.trial046.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-23T12:36:49.965 INFO:teuthology.orchestra.run.trial046.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-23T12:36:49.965 INFO:teuthology.orchestra.run.trial046.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-23T12:36:49.965 INFO:teuthology.orchestra.run.trial046.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-23T12:36:49.965 INFO:teuthology.orchestra.run.trial046.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-23T12:36:49.965 INFO:teuthology.orchestra.run.trial046.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-23T12:36:49.965 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:36:49.966 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-23T12:36:49.966 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:36:49.966 INFO:teuthology.orchestra.run.trial046.stdout:Install 12 Packages 2026-02-23T12:36:49.966 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:36:49.966 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 131 M 2026-02-23T12:36:49.966 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 977 M 2026-02-23T12:36:49.966 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-23T12:36:50.478 INFO:teuthology.orchestra.run.trial046.stdout:(1/12): hwloc-libs-2.4.1-6.el9.x86_64.rpm 21 MB/s | 2.1 MB 00:00 2026-02-23T12:36:50.486 INFO:teuthology.orchestra.run.trial046.stdout:(2/12): libatomic-11.5.0-14.el9.x86_64.rpm 1.8 MB/s | 23 kB 00:00 2026-02-23T12:36:50.498 INFO:teuthology.orchestra.run.trial046.stdout:(3/12): lksctp-tools-1.0.19-2.el9.x86_64.rpm 7.2 MB/s | 94 kB 00:00 2026-02-23T12:36:50.549 INFO:teuthology.orchestra.run.trial046.stdout:(4/12): libasan8-15.2.1-7.el9.x86_64.rpm 10 MB/s | 525 kB 00:00 2026-02-23T12:36:50.568 INFO:teuthology.orchestra.run.trial046.stdout:(5/12): libubsan-11.5.0-14.el9.x86_64.rpm 9.4 MB/s | 176 kB 00:00 2026-02-23T12:36:50.595 INFO:teuthology.orchestra.run.trial046.stdout:(6/12): libxslt-1.1.34-12.el9.x86_64.rpm 8.4 MB/s | 233 kB 00:00 2026-02-23T12:36:50.621 INFO:teuthology.orchestra.run.trial046.stdout:(7/12): protobuf-3.14.0-17.el9.x86_64.rpm 39 MB/s | 1.0 MB 00:00 2026-02-23T12:36:50.643 INFO:teuthology.orchestra.run.trial046.stdout:(8/12): socat-1.7.4.1-8.el9.x86_64.rpm 14 MB/s | 303 kB 00:00 2026-02-23T12:36:50.662 INFO:teuthology.orchestra.run.trial046.stdout:(9/12): xmlstarlet-1.6.1-20.el9.x86_64.rpm 3.2 MB/s | 64 kB 00:00 2026-02-23T12:36:50.848 INFO:teuthology.orchestra.run.trial046.stdout:(10/12): yaml-cpp-0.6.3-5.el9.x86_64.rpm 656 kB/s | 122 kB 00:00 2026-02-23T12:36:50.853 INFO:teuthology.orchestra.run.trial046.stdout:(11/12): libcephsqlite-20.3.0-5439.ge371433f.el 318 kB/s | 153 kB 00:00 2026-02-23T12:40:08.811 INFO:teuthology.orchestra.run.trial046.stdout:(12/12): ceph-test-20.3.0-5439.ge371433f.el9.x8 650 kB/s | 126 MB 03:18 2026-02-23T12:40:08.813 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-23T12:40:08.813 INFO:teuthology.orchestra.run.trial046.stdout:Total 674 kB/s | 131 MB 03:18 2026-02-23T12:40:08.880 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-23T12:40:08.890 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-23T12:40:08.891 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-23T12:40:09.317 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-23T12:40:09.318 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-23T12:40:09.775 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-23T12:40:09.783 INFO:teuthology.orchestra.run.trial046.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/12 2026-02-23T12:40:09.792 INFO:teuthology.orchestra.run.trial046.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/12 2026-02-23T12:40:09.797 INFO:teuthology.orchestra.run.trial046.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/12 2026-02-23T12:40:09.803 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/12 2026-02-23T12:40:09.805 INFO:teuthology.orchestra.run.trial046.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/12 2026-02-23T12:40:09.809 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 6/12 2026-02-23T12:40:09.810 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-23T12:40:09.826 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-23T12:40:09.828 INFO:teuthology.orchestra.run.trial046.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 8/12 2026-02-23T12:40:09.838 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 9/12 2026-02-23T12:40:09.846 INFO:teuthology.orchestra.run.trial046.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 10/12 2026-02-23T12:40:09.847 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libcephsqlite-2:20.3.0-5439.ge371433f.el9.x86_64 11/12 2026-02-23T12:40:12.532 INFO:teuthology.orchestra.run.trial131.stdout:(12/12): ceph-test-20.3.0-5439.ge371433f.el9.x8 629 kB/s | 126 MB 03:25 2026-02-23T12:40:12.534 INFO:teuthology.orchestra.run.trial131.stdout:-------------------------------------------------------------------------------- 2026-02-23T12:40:12.534 INFO:teuthology.orchestra.run.trial131.stdout:Total 651 kB/s | 131 MB 03:25 2026-02-23T12:40:12.603 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction check 2026-02-23T12:40:12.614 INFO:teuthology.orchestra.run.trial131.stdout:Transaction check succeeded. 2026-02-23T12:40:12.614 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction test 2026-02-23T12:40:13.042 INFO:teuthology.orchestra.run.trial131.stdout:Transaction test succeeded. 2026-02-23T12:40:13.043 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction 2026-02-23T12:40:13.495 INFO:teuthology.orchestra.run.trial131.stdout: Preparing : 1/1 2026-02-23T12:40:13.503 INFO:teuthology.orchestra.run.trial131.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/12 2026-02-23T12:40:13.512 INFO:teuthology.orchestra.run.trial131.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/12 2026-02-23T12:40:13.517 INFO:teuthology.orchestra.run.trial131.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/12 2026-02-23T12:40:13.521 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/12 2026-02-23T12:40:13.524 INFO:teuthology.orchestra.run.trial131.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/12 2026-02-23T12:40:13.528 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 6/12 2026-02-23T12:40:13.529 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-23T12:40:13.544 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-23T12:40:13.546 INFO:teuthology.orchestra.run.trial131.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 8/12 2026-02-23T12:40:13.556 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 9/12 2026-02-23T12:40:13.564 INFO:teuthology.orchestra.run.trial131.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 10/12 2026-02-23T12:40:13.565 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libcephsqlite-2:20.3.0-5439.ge371433f.el9.x86_64 11/12 2026-02-23T12:40:17.007 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5439.ge371433f.el9.x86_64 11/12 2026-02-23T12:40:17.025 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-test-2:20.3.0-5439.ge371433f.el9.x86_64 12/12 2026-02-23T12:40:17.817 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-test-2:20.3.0-5439.ge371433f.el9.x86_64 12/12 2026-02-23T12:40:17.818 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-test-2:20.3.0-5439.ge371433f.el9.x86_64 1/12 2026-02-23T12:40:17.818 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libcephsqlite-2:20.3.0-5439.ge371433f.el9.x86_64 2/12 2026-02-23T12:40:17.818 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/12 2026-02-23T12:40:17.818 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/12 2026-02-23T12:40:17.818 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/12 2026-02-23T12:40:17.818 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libasan8-15.2.1-7.el9.x86_64 6/12 2026-02-23T12:40:17.818 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 7/12 2026-02-23T12:40:17.818 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 8/12 2026-02-23T12:40:17.818 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 9/12 2026-02-23T12:40:17.819 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 10/12 2026-02-23T12:40:17.819 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 11/12 2026-02-23T12:40:17.872 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 12/12 2026-02-23T12:40:17.872 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:40:17.872 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-23T12:40:17.872 INFO:teuthology.orchestra.run.trial046.stdout: ceph-test-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:40:17.872 INFO:teuthology.orchestra.run.trial046.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-23T12:40:17.872 INFO:teuthology.orchestra.run.trial046.stdout: libasan8-15.2.1-7.el9.x86_64 2026-02-23T12:40:17.872 INFO:teuthology.orchestra.run.trial046.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-23T12:40:17.872 INFO:teuthology.orchestra.run.trial046.stdout: libcephsqlite-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:40:17.872 INFO:teuthology.orchestra.run.trial046.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-23T12:40:17.873 INFO:teuthology.orchestra.run.trial046.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-23T12:40:17.873 INFO:teuthology.orchestra.run.trial046.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-23T12:40:17.873 INFO:teuthology.orchestra.run.trial046.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-23T12:40:17.873 INFO:teuthology.orchestra.run.trial046.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-23T12:40:17.873 INFO:teuthology.orchestra.run.trial046.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-23T12:40:17.873 INFO:teuthology.orchestra.run.trial046.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-23T12:40:17.873 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:40:17.873 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-23T12:40:17.914 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph 2026-02-23T12:40:18.222 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:04:05 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:40:18.307 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-23T12:40:18.308 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:40:18.308 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repository Size 2026-02-23T12:40:18.309 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:40:18.309 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-23T12:40:18.309 INFO:teuthology.orchestra.run.trial046.stdout: ceph x86_64 2:20.3.0-5439.ge371433f.el9 ceph 6.5 k 2026-02-23T12:40:18.309 INFO:teuthology.orchestra.run.trial046.stdout:Installing dependencies: 2026-02-23T12:40:18.309 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mds x86_64 2:20.3.0-5439.ge371433f.el9 ceph 2.0 M 2026-02-23T12:40:18.309 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr x86_64 2:20.3.0-5439.ge371433f.el9 ceph 937 k 2026-02-23T12:40:18.309 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5439.ge371433f.el9 ceph-noarch 298 k 2026-02-23T12:40:18.309 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mon x86_64 2:20.3.0-5439.ge371433f.el9 ceph 4.9 M 2026-02-23T12:40:18.309 INFO:teuthology.orchestra.run.trial046.stdout: ceph-osd x86_64 2:20.3.0-5439.ge371433f.el9 ceph 164 k 2026-02-23T12:40:18.309 INFO:teuthology.orchestra.run.trial046.stdout: ceph-osd-classic x86_64 2:20.3.0-5439.ge371433f.el9 ceph 15 M 2026-02-23T12:40:18.309 INFO:teuthology.orchestra.run.trial046.stdout: ceph-osd-crimson x86_64 2:20.3.0-5439.ge371433f.el9 ceph 87 M 2026-02-23T12:40:18.310 INFO:teuthology.orchestra.run.trial046.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-23T12:40:18.310 INFO:teuthology.orchestra.run.trial046.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-23T12:40:18.310 INFO:teuthology.orchestra.run.trial046.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-23T12:40:18.310 INFO:teuthology.orchestra.run.trial046.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-23T12:40:18.310 INFO:teuthology.orchestra.run.trial046.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-23T12:40:18.310 INFO:teuthology.orchestra.run.trial046.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-23T12:40:18.310 INFO:teuthology.orchestra.run.trial046.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-23T12:40:18.310 INFO:teuthology.orchestra.run.trial046.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-23T12:40:18.310 INFO:teuthology.orchestra.run.trial046.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-23T12:40:18.310 INFO:teuthology.orchestra.run.trial046.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-23T12:40:18.310 INFO:teuthology.orchestra.run.trial046.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-23T12:40:18.310 INFO:teuthology.orchestra.run.trial046.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-23T12:40:18.310 INFO:teuthology.orchestra.run.trial046.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-23T12:40:18.311 INFO:teuthology.orchestra.run.trial046.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-23T12:40:18.311 INFO:teuthology.orchestra.run.trial046.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-23T12:40:18.311 INFO:teuthology.orchestra.run.trial046.stdout: python3-jaraco-collections 2026-02-23T12:40:18.311 INFO:teuthology.orchestra.run.trial046.stdout: noarch 3.0.0-8.el9 epel 23 k 2026-02-23T12:40:18.311 INFO:teuthology.orchestra.run.trial046.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-23T12:40:18.311 INFO:teuthology.orchestra.run.trial046.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-23T12:40:18.311 INFO:teuthology.orchestra.run.trial046.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-23T12:40:18.311 INFO:teuthology.orchestra.run.trial046.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-23T12:40:18.311 INFO:teuthology.orchestra.run.trial046.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-23T12:40:18.311 INFO:teuthology.orchestra.run.trial046.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-23T12:40:18.311 INFO:teuthology.orchestra.run.trial046.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-23T12:40:18.311 INFO:teuthology.orchestra.run.trial046.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-23T12:40:18.312 INFO:teuthology.orchestra.run.trial046.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-23T12:40:18.312 INFO:teuthology.orchestra.run.trial046.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-23T12:40:18.312 INFO:teuthology.orchestra.run.trial046.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-23T12:40:18.312 INFO:teuthology.orchestra.run.trial046.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-23T12:40:18.312 INFO:teuthology.orchestra.run.trial046.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-23T12:40:18.312 INFO:teuthology.orchestra.run.trial046.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-23T12:40:18.312 INFO:teuthology.orchestra.run.trial046.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-23T12:40:18.312 INFO:teuthology.orchestra.run.trial046.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-23T12:40:18.312 INFO:teuthology.orchestra.run.trial046.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-23T12:40:18.312 INFO:teuthology.orchestra.run.trial046.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-23T12:40:18.312 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:40:18.312 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-23T12:40:18.313 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:40:18.313 INFO:teuthology.orchestra.run.trial046.stdout:Install 42 Packages 2026-02-23T12:40:18.313 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:40:18.313 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 114 M 2026-02-23T12:40:18.314 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 961 M 2026-02-23T12:40:18.314 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-23T12:40:19.200 INFO:teuthology.orchestra.run.trial046.stdout:(1/42): ceph-20.3.0-5439.ge371433f.el9.x86_64.r 24 kB/s | 6.5 kB 00:00 2026-02-23T12:40:20.459 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5439.ge371433f.el9.x86_64 11/12 2026-02-23T12:40:20.477 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-test-2:20.3.0-5439.ge371433f.el9.x86_64 12/12 2026-02-23T12:40:21.067 INFO:teuthology.orchestra.run.trial046.stdout:(2/42): ceph-mgr-20.3.0-5439.ge371433f.el9.x86_ 438 kB/s | 937 kB 00:02 2026-02-23T12:40:21.291 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-test-2:20.3.0-5439.ge371433f.el9.x86_64 12/12 2026-02-23T12:40:21.291 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-test-2:20.3.0-5439.ge371433f.el9.x86_64 1/12 2026-02-23T12:40:21.292 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libcephsqlite-2:20.3.0-5439.ge371433f.el9.x86_64 2/12 2026-02-23T12:40:21.292 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/12 2026-02-23T12:40:21.292 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/12 2026-02-23T12:40:21.292 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/12 2026-02-23T12:40:21.292 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libasan8-15.2.1-7.el9.x86_64 6/12 2026-02-23T12:40:21.292 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 7/12 2026-02-23T12:40:21.292 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 8/12 2026-02-23T12:40:21.292 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 9/12 2026-02-23T12:40:21.292 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 10/12 2026-02-23T12:40:21.292 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 11/12 2026-02-23T12:40:21.345 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 12/12 2026-02-23T12:40:21.345 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:40:21.345 INFO:teuthology.orchestra.run.trial131.stdout:Installed: 2026-02-23T12:40:21.345 INFO:teuthology.orchestra.run.trial131.stdout: ceph-test-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:40:21.345 INFO:teuthology.orchestra.run.trial131.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-23T12:40:21.345 INFO:teuthology.orchestra.run.trial131.stdout: libasan8-15.2.1-7.el9.x86_64 2026-02-23T12:40:21.345 INFO:teuthology.orchestra.run.trial131.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-23T12:40:21.345 INFO:teuthology.orchestra.run.trial131.stdout: libcephsqlite-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:40:21.345 INFO:teuthology.orchestra.run.trial131.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-23T12:40:21.345 INFO:teuthology.orchestra.run.trial131.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-23T12:40:21.345 INFO:teuthology.orchestra.run.trial131.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-23T12:40:21.345 INFO:teuthology.orchestra.run.trial131.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-23T12:40:21.345 INFO:teuthology.orchestra.run.trial131.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-23T12:40:21.345 INFO:teuthology.orchestra.run.trial131.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-23T12:40:21.345 INFO:teuthology.orchestra.run.trial131.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-23T12:40:21.345 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:40:21.345 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-23T12:40:21.346 INFO:teuthology.orchestra.run.trial046.stdout:(3/42): ceph-osd-20.3.0-5439.ge371433f.el9.x86_ 584 kB/s | 164 kB 00:00 2026-02-23T12:40:21.383 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph 2026-02-23T12:40:21.681 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:04:08 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:40:21.764 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-23T12:40:21.765 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:40:21.766 INFO:teuthology.orchestra.run.trial131.stdout: Package Arch Version Repository Size 2026-02-23T12:40:21.766 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:40:21.766 INFO:teuthology.orchestra.run.trial131.stdout:Installing: 2026-02-23T12:40:21.766 INFO:teuthology.orchestra.run.trial131.stdout: ceph x86_64 2:20.3.0-5439.ge371433f.el9 ceph 6.5 k 2026-02-23T12:40:21.766 INFO:teuthology.orchestra.run.trial131.stdout:Installing dependencies: 2026-02-23T12:40:21.766 INFO:teuthology.orchestra.run.trial131.stdout: ceph-mds x86_64 2:20.3.0-5439.ge371433f.el9 ceph 2.0 M 2026-02-23T12:40:21.766 INFO:teuthology.orchestra.run.trial131.stdout: ceph-mgr x86_64 2:20.3.0-5439.ge371433f.el9 ceph 937 k 2026-02-23T12:40:21.766 INFO:teuthology.orchestra.run.trial131.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5439.ge371433f.el9 ceph-noarch 298 k 2026-02-23T12:40:21.766 INFO:teuthology.orchestra.run.trial131.stdout: ceph-mon x86_64 2:20.3.0-5439.ge371433f.el9 ceph 4.9 M 2026-02-23T12:40:21.766 INFO:teuthology.orchestra.run.trial131.stdout: ceph-osd x86_64 2:20.3.0-5439.ge371433f.el9 ceph 164 k 2026-02-23T12:40:21.766 INFO:teuthology.orchestra.run.trial131.stdout: ceph-osd-classic x86_64 2:20.3.0-5439.ge371433f.el9 ceph 15 M 2026-02-23T12:40:21.767 INFO:teuthology.orchestra.run.trial131.stdout: ceph-osd-crimson x86_64 2:20.3.0-5439.ge371433f.el9 ceph 87 M 2026-02-23T12:40:21.767 INFO:teuthology.orchestra.run.trial131.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-23T12:40:21.767 INFO:teuthology.orchestra.run.trial131.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-23T12:40:21.767 INFO:teuthology.orchestra.run.trial131.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-23T12:40:21.767 INFO:teuthology.orchestra.run.trial131.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-23T12:40:21.767 INFO:teuthology.orchestra.run.trial131.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-23T12:40:21.767 INFO:teuthology.orchestra.run.trial131.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-23T12:40:21.767 INFO:teuthology.orchestra.run.trial131.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-23T12:40:21.767 INFO:teuthology.orchestra.run.trial131.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-23T12:40:21.767 INFO:teuthology.orchestra.run.trial131.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-23T12:40:21.767 INFO:teuthology.orchestra.run.trial131.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-23T12:40:21.767 INFO:teuthology.orchestra.run.trial131.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-23T12:40:21.768 INFO:teuthology.orchestra.run.trial131.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-23T12:40:21.768 INFO:teuthology.orchestra.run.trial131.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-23T12:40:21.768 INFO:teuthology.orchestra.run.trial131.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-23T12:40:21.768 INFO:teuthology.orchestra.run.trial131.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-23T12:40:21.768 INFO:teuthology.orchestra.run.trial131.stdout: python3-jaraco-collections 2026-02-23T12:40:21.768 INFO:teuthology.orchestra.run.trial131.stdout: noarch 3.0.0-8.el9 epel 23 k 2026-02-23T12:40:21.768 INFO:teuthology.orchestra.run.trial131.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-23T12:40:21.768 INFO:teuthology.orchestra.run.trial131.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-23T12:40:21.768 INFO:teuthology.orchestra.run.trial131.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-23T12:40:21.768 INFO:teuthology.orchestra.run.trial131.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-23T12:40:21.768 INFO:teuthology.orchestra.run.trial131.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-23T12:40:21.768 INFO:teuthology.orchestra.run.trial131.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-23T12:40:21.768 INFO:teuthology.orchestra.run.trial131.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-23T12:40:21.769 INFO:teuthology.orchestra.run.trial131.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-23T12:40:21.769 INFO:teuthology.orchestra.run.trial131.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-23T12:40:21.769 INFO:teuthology.orchestra.run.trial131.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-23T12:40:21.769 INFO:teuthology.orchestra.run.trial131.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-23T12:40:21.769 INFO:teuthology.orchestra.run.trial131.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-23T12:40:21.769 INFO:teuthology.orchestra.run.trial131.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-23T12:40:21.769 INFO:teuthology.orchestra.run.trial131.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-23T12:40:21.769 INFO:teuthology.orchestra.run.trial131.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-23T12:40:21.769 INFO:teuthology.orchestra.run.trial131.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-23T12:40:21.769 INFO:teuthology.orchestra.run.trial131.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-23T12:40:21.769 INFO:teuthology.orchestra.run.trial131.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-23T12:40:21.769 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:40:21.770 INFO:teuthology.orchestra.run.trial131.stdout:Transaction Summary 2026-02-23T12:40:21.770 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:40:21.770 INFO:teuthology.orchestra.run.trial131.stdout:Install 42 Packages 2026-02-23T12:40:21.770 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:40:21.770 INFO:teuthology.orchestra.run.trial131.stdout:Total download size: 114 M 2026-02-23T12:40:21.771 INFO:teuthology.orchestra.run.trial131.stdout:Installed size: 961 M 2026-02-23T12:40:21.771 INFO:teuthology.orchestra.run.trial131.stdout:Downloading Packages: 2026-02-23T12:40:22.545 INFO:teuthology.orchestra.run.trial046.stdout:(4/42): ceph-mds-20.3.0-5439.ge371433f.el9.x86_ 572 kB/s | 2.0 MB 00:03 2026-02-23T12:40:22.631 INFO:teuthology.orchestra.run.trial131.stdout:(1/42): ceph-20.3.0-5439.ge371433f.el9.x86_64.r 23 kB/s | 6.5 kB 00:00 2026-02-23T12:40:25.619 INFO:teuthology.orchestra.run.trial131.stdout:(2/42): ceph-mgr-20.3.0-5439.ge371433f.el9.x86_ 286 kB/s | 937 kB 00:03 2026-02-23T12:40:26.523 INFO:teuthology.orchestra.run.trial131.stdout:(3/42): ceph-osd-20.3.0-5439.ge371433f.el9.x86_ 181 kB/s | 164 kB 00:00 2026-02-23T12:40:26.732 INFO:teuthology.orchestra.run.trial131.stdout:(4/42): ceph-mds-20.3.0-5439.ge371433f.el9.x86_ 472 kB/s | 2.0 MB 00:04 2026-02-23T12:40:28.606 INFO:teuthology.orchestra.run.trial046.stdout:(5/42): ceph-mon-20.3.0-5439.ge371433f.el9.x86_ 530 kB/s | 4.9 MB 00:09 2026-02-23T12:40:29.091 INFO:teuthology.orchestra.run.trial046.stdout:(6/42): ceph-mgr-modules-core-20.3.0-5439.ge371 613 kB/s | 298 kB 00:00 2026-02-23T12:40:29.669 INFO:teuthology.orchestra.run.trial046.stdout:(7/42): ledmon-libs-1.1.0-3.el9.x86_64.rpm 70 kB/s | 40 kB 00:00 2026-02-23T12:40:30.176 INFO:teuthology.orchestra.run.trial131.stdout:(5/42): ceph-mon-20.3.0-5439.ge371433f.el9.x86_ 660 kB/s | 4.9 MB 00:07 2026-02-23T12:40:30.300 INFO:teuthology.orchestra.run.trial046.stdout:(8/42): libconfig-1.7.2-9.el9.x86_64.rpm 114 kB/s | 72 kB 00:00 2026-02-23T12:40:30.799 INFO:teuthology.orchestra.run.trial131.stdout:(6/42): ceph-mgr-modules-core-20.3.0-5439.ge371 478 kB/s | 298 kB 00:00 2026-02-23T12:40:30.810 INFO:teuthology.orchestra.run.trial131.stdout:(7/42): ledmon-libs-1.1.0-3.el9.x86_64.rpm 3.5 MB/s | 40 kB 00:00 2026-02-23T12:40:30.818 INFO:teuthology.orchestra.run.trial131.stdout:(8/42): libconfig-1.7.2-9.el9.x86_64.rpm 9.2 MB/s | 72 kB 00:00 2026-02-23T12:40:30.828 INFO:teuthology.orchestra.run.trial131.stdout:(9/42): python3-cffi-1.14.5-5.el9.x86_64.rpm 25 MB/s | 253 kB 00:00 2026-02-23T12:40:30.863 INFO:teuthology.orchestra.run.trial131.stdout:(10/42): python3-cryptography-36.0.1-5.el9.x86_ 36 MB/s | 1.2 MB 00:00 2026-02-23T12:40:30.869 INFO:teuthology.orchestra.run.trial131.stdout:(11/42): python3-ply-3.11-14.el9.noarch.rpm 18 MB/s | 106 kB 00:00 2026-02-23T12:40:30.875 INFO:teuthology.orchestra.run.trial131.stdout:(12/42): python3-pycparser-2.20-6.el9.noarch.rp 21 MB/s | 135 kB 00:00 2026-02-23T12:40:30.882 INFO:teuthology.orchestra.run.trial131.stdout:(13/42): python3-pyparsing-2.4.7-9.el9.noarch.r 23 MB/s | 150 kB 00:00 2026-02-23T12:40:30.888 INFO:teuthology.orchestra.run.trial131.stdout:(14/42): python3-requests-2.25.1-10.el9.noarch. 19 MB/s | 126 kB 00:00 2026-02-23T12:40:30.895 INFO:teuthology.orchestra.run.trial131.stdout:(15/42): python3-urllib3-1.26.5-7.el9.noarch.rp 32 MB/s | 218 kB 00:00 2026-02-23T12:40:30.902 INFO:teuthology.orchestra.run.trial131.stdout:(16/42): unzip-6.0-59.el9.x86_64.rpm 26 MB/s | 182 kB 00:00 2026-02-23T12:40:30.909 INFO:teuthology.orchestra.run.trial131.stdout:(17/42): zip-3.0-35.el9.x86_64.rpm 43 MB/s | 266 kB 00:00 2026-02-23T12:40:31.074 INFO:teuthology.orchestra.run.trial046.stdout:(9/42): python3-cffi-1.14.5-5.el9.x86_64.rpm 327 kB/s | 253 kB 00:00 2026-02-23T12:40:32.021 INFO:teuthology.orchestra.run.trial046.stdout:(10/42): python3-cryptography-36.0.1-5.el9.x86_ 1.3 MB/s | 1.2 MB 00:00 2026-02-23T12:40:32.692 INFO:teuthology.orchestra.run.trial046.stdout:(11/42): python3-ply-3.11-14.el9.noarch.rpm 159 kB/s | 106 kB 00:00 2026-02-23T12:40:33.394 INFO:teuthology.orchestra.run.trial046.stdout:(12/42): python3-pycparser-2.20-6.el9.noarch.rp 192 kB/s | 135 kB 00:00 2026-02-23T12:40:34.106 INFO:teuthology.orchestra.run.trial046.stdout:(13/42): python3-pyparsing-2.4.7-9.el9.noarch.r 211 kB/s | 150 kB 00:00 2026-02-23T12:40:34.805 INFO:teuthology.orchestra.run.trial046.stdout:(14/42): python3-requests-2.25.1-10.el9.noarch. 181 kB/s | 126 kB 00:00 2026-02-23T12:40:35.558 INFO:teuthology.orchestra.run.trial046.stdout:(15/42): python3-urllib3-1.26.5-7.el9.noarch.rp 289 kB/s | 218 kB 00:00 2026-02-23T12:40:36.243 INFO:teuthology.orchestra.run.trial131.stdout:(18/42): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 46 kB/s | 246 kB 00:05 2026-02-23T12:40:36.286 INFO:teuthology.orchestra.run.trial046.stdout:(16/42): unzip-6.0-59.el9.x86_64.rpm 250 kB/s | 182 kB 00:00 2026-02-23T12:40:36.343 INFO:teuthology.orchestra.run.trial131.stdout:(19/42): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2026-02-23T12:40:36.443 INFO:teuthology.orchestra.run.trial131.stdout:(20/42): python3-libstoragemgmt-1.10.1-1.el9.x8 1.7 MB/s | 177 kB 00:00 2026-02-23T12:40:36.543 INFO:teuthology.orchestra.run.trial131.stdout:(21/42): python3-packaging-20.9-5.el9.noarch.rp 776 kB/s | 77 kB 00:00 2026-02-23T12:40:36.643 INFO:teuthology.orchestra.run.trial131.stdout:(22/42): python3-toml-0.10.2-6.el9.noarch.rpm 419 kB/s | 42 kB 00:00 2026-02-23T12:40:37.060 INFO:teuthology.orchestra.run.trial046.stdout:(17/42): zip-3.0-35.el9.x86_64.rpm 343 kB/s | 266 kB 00:00 2026-02-23T12:40:37.816 INFO:teuthology.orchestra.run.trial046.stdout:(18/42): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 326 kB/s | 246 kB 00:00 2026-02-23T12:40:37.994 INFO:teuthology.orchestra.run.trial046.stdout:(19/42): lua-5.4.4-4.el9.x86_64.rpm 1.0 MB/s | 188 kB 00:00 2026-02-23T12:40:38.095 INFO:teuthology.orchestra.run.trial046.stdout:(20/42): python3-libstoragemgmt-1.10.1-1.el9.x8 1.7 MB/s | 177 kB 00:00 2026-02-23T12:40:38.195 INFO:teuthology.orchestra.run.trial046.stdout:(21/42): python3-packaging-20.9-5.el9.noarch.rp 770 kB/s | 77 kB 00:00 2026-02-23T12:40:38.295 INFO:teuthology.orchestra.run.trial046.stdout:(22/42): python3-toml-0.10.2-6.el9.noarch.rpm 417 kB/s | 42 kB 00:00 2026-02-23T12:40:38.395 INFO:teuthology.orchestra.run.trial046.stdout:(23/42): lua-devel-5.4.4-4.el9.x86_64.rpm 225 kB/s | 22 kB 00:00 2026-02-23T12:40:38.747 INFO:teuthology.orchestra.run.trial046.stdout:(24/42): luarocks-3.9.2-5.el9.noarch.rpm 430 kB/s | 151 kB 00:00 2026-02-23T12:40:38.816 INFO:teuthology.orchestra.run.trial046.stdout:(25/42): python3-autocommand-2.2.2-8.el9.noarch 426 kB/s | 29 kB 00:00 2026-02-23T12:40:38.894 INFO:teuthology.orchestra.run.trial046.stdout:(26/42): python3-backports-tarfile-1.2.0-1.el9. 767 kB/s | 60 kB 00:00 2026-02-23T12:40:38.968 INFO:teuthology.orchestra.run.trial046.stdout:(27/42): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 591 kB/s | 43 kB 00:00 2026-02-23T12:40:39.079 INFO:teuthology.orchestra.run.trial046.stdout:(28/42): python3-cheroot-10.0.1-4.el9.noarch.rp 1.5 MB/s | 173 kB 00:00 2026-02-23T12:40:39.220 INFO:teuthology.orchestra.run.trial046.stdout:(29/42): python3-cherrypy-18.6.1-2.el9.noarch.r 2.5 MB/s | 358 kB 00:00 2026-02-23T12:40:39.282 INFO:teuthology.orchestra.run.trial046.stdout:(30/42): python3-jaraco-8.2.1-3.el9.noarch.rpm 172 kB/s | 11 kB 00:00 2026-02-23T12:40:39.344 INFO:teuthology.orchestra.run.trial046.stdout:(31/42): python3-jaraco-classes-3.2.1-5.el9.noa 284 kB/s | 18 kB 00:00 2026-02-23T12:40:39.407 INFO:teuthology.orchestra.run.trial046.stdout:(32/42): python3-jaraco-collections-3.0.0-8.el9 369 kB/s | 23 kB 00:00 2026-02-23T12:40:39.469 INFO:teuthology.orchestra.run.trial046.stdout:(33/42): python3-jaraco-context-6.0.1-3.el9.noa 317 kB/s | 20 kB 00:00 2026-02-23T12:40:39.531 INFO:teuthology.orchestra.run.trial046.stdout:(34/42): python3-jaraco-functools-3.5.0-2.el9.n 314 kB/s | 19 kB 00:00 2026-02-23T12:40:39.594 INFO:teuthology.orchestra.run.trial046.stdout:(35/42): python3-jaraco-text-4.0.0-2.el9.noarch 420 kB/s | 26 kB 00:00 2026-02-23T12:40:39.661 INFO:teuthology.orchestra.run.trial046.stdout:(36/42): python3-more-itertools-8.12.0-2.el9.no 1.1 MB/s | 79 kB 00:00 2026-02-23T12:40:39.723 INFO:teuthology.orchestra.run.trial046.stdout:(37/42): python3-portend-3.1.0-2.el9.noarch.rpm 264 kB/s | 16 kB 00:00 2026-02-23T12:40:39.791 INFO:teuthology.orchestra.run.trial046.stdout:(38/42): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.3 MB/s | 90 kB 00:00 2026-02-23T12:40:39.855 INFO:teuthology.orchestra.run.trial046.stdout:(39/42): python3-tempora-5.0.0-2.el9.noarch.rpm 561 kB/s | 36 kB 00:00 2026-02-23T12:40:39.917 INFO:teuthology.orchestra.run.trial046.stdout:(40/42): python3-zc-lockfile-2.0-10.el9.noarch. 320 kB/s | 20 kB 00:00 2026-02-23T12:40:41.677 INFO:teuthology.orchestra.run.trial131.stdout:(23/42): lua-devel-5.4.4-4.el9.x86_64.rpm 4.4 kB/s | 22 kB 00:05 2026-02-23T12:40:42.099 INFO:teuthology.orchestra.run.trial131.stdout:(24/42): luarocks-3.9.2-5.el9.noarch.rpm 359 kB/s | 151 kB 00:00 2026-02-23T12:40:42.181 INFO:teuthology.orchestra.run.trial131.stdout:(25/42): python3-autocommand-2.2.2-8.el9.noarch 361 kB/s | 29 kB 00:00 2026-02-23T12:40:42.270 INFO:teuthology.orchestra.run.trial131.stdout:(26/42): python3-backports-tarfile-1.2.0-1.el9. 673 kB/s | 60 kB 00:00 2026-02-23T12:40:42.355 INFO:teuthology.orchestra.run.trial131.stdout:(27/42): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 511 kB/s | 43 kB 00:00 2026-02-23T12:40:42.485 INFO:teuthology.orchestra.run.trial131.stdout:(28/42): python3-cheroot-10.0.1-4.el9.noarch.rp 1.3 MB/s | 173 kB 00:00 2026-02-23T12:40:42.649 INFO:teuthology.orchestra.run.trial131.stdout:(29/42): python3-cherrypy-18.6.1-2.el9.noarch.r 2.1 MB/s | 358 kB 00:00 2026-02-23T12:40:42.719 INFO:teuthology.orchestra.run.trial131.stdout:(30/42): python3-jaraco-8.2.1-3.el9.noarch.rpm 153 kB/s | 11 kB 00:00 2026-02-23T12:40:42.789 INFO:teuthology.orchestra.run.trial131.stdout:(31/42): python3-jaraco-classes-3.2.1-5.el9.noa 253 kB/s | 18 kB 00:00 2026-02-23T12:40:42.859 INFO:teuthology.orchestra.run.trial131.stdout:(32/42): python3-jaraco-collections-3.0.0-8.el9 328 kB/s | 23 kB 00:00 2026-02-23T12:40:42.930 INFO:teuthology.orchestra.run.trial131.stdout:(33/42): python3-jaraco-context-6.0.1-3.el9.noa 279 kB/s | 20 kB 00:00 2026-02-23T12:40:42.999 INFO:teuthology.orchestra.run.trial131.stdout:(34/42): python3-jaraco-functools-3.5.0-2.el9.n 279 kB/s | 19 kB 00:00 2026-02-23T12:40:43.070 INFO:teuthology.orchestra.run.trial131.stdout:(35/42): python3-jaraco-text-4.0.0-2.el9.noarch 375 kB/s | 26 kB 00:00 2026-02-23T12:40:43.146 INFO:teuthology.orchestra.run.trial131.stdout:(36/42): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2026-02-23T12:40:43.215 INFO:teuthology.orchestra.run.trial131.stdout:(37/42): python3-portend-3.1.0-2.el9.noarch.rpm 235 kB/s | 16 kB 00:00 2026-02-23T12:40:43.292 INFO:teuthology.orchestra.run.trial131.stdout:(38/42): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2026-02-23T12:40:43.363 INFO:teuthology.orchestra.run.trial131.stdout:(39/42): python3-tempora-5.0.0-2.el9.noarch.rpm 500 kB/s | 36 kB 00:00 2026-02-23T12:40:43.434 INFO:teuthology.orchestra.run.trial131.stdout:(40/42): python3-zc-lockfile-2.0-10.el9.noarch. 283 kB/s | 20 kB 00:00 2026-02-23T12:40:45.593 INFO:teuthology.orchestra.run.trial046.stdout:(41/42): ceph-osd-classic-20.3.0-5439.ge371433f 624 kB/s | 15 MB 00:24 2026-02-23T12:40:50.127 INFO:teuthology.orchestra.run.trial131.stdout:(41/42): ceph-osd-classic-20.3.0-5439.ge371433f 640 kB/s | 15 MB 00:23 2026-02-23T12:42:51.658 INFO:teuthology.orchestra.run.trial046.stdout:(42/42): ceph-osd-crimson-20.3.0-5439.ge371433f 595 kB/s | 87 MB 02:29 2026-02-23T12:42:51.660 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-23T12:42:51.660 INFO:teuthology.orchestra.run.trial046.stdout:Total 764 kB/s | 114 MB 02:33 2026-02-23T12:42:51.780 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-23T12:42:51.799 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-23T12:42:51.800 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-23T12:42:52.195 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-23T12:42:52.195 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-23T12:42:52.648 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-23T12:42:52.650 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/42 2026-02-23T12:42:52.655 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/42 2026-02-23T12:42:52.660 INFO:teuthology.orchestra.run.trial046.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/42 2026-02-23T12:42:52.664 INFO:teuthology.orchestra.run.trial046.stdout: Installing : unzip-6.0-59.el9.x86_64 4/42 2026-02-23T12:42:52.670 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 5/42 2026-02-23T12:42:52.693 INFO:teuthology.orchestra.run.trial046.stdout: Installing : zip-3.0-35.el9.x86_64 6/42 2026-02-23T12:42:52.697 INFO:teuthology.orchestra.run.trial046.stdout: Installing : luarocks-3.9.2-5.el9.noarch 7/42 2026-02-23T12:42:52.702 INFO:teuthology.orchestra.run.trial046.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 8/42 2026-02-23T12:42:52.706 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 9/42 2026-02-23T12:42:52.712 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 10/42 2026-02-23T12:42:52.716 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 11/42 2026-02-23T12:42:52.722 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 12/42 2026-02-23T12:42:52.727 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 13/42 2026-02-23T12:42:52.731 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 14/42 2026-02-23T12:42:52.737 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 15/42 2026-02-23T12:42:52.740 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 16/42 2026-02-23T12:42:52.747 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 17/42 2026-02-23T12:42:52.750 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 18/42 2026-02-23T12:42:52.773 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 19/42 2026-02-23T12:42:52.785 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/42 2026-02-23T12:42:52.791 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/42 2026-02-23T12:42:52.800 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 22/42 2026-02-23T12:42:52.807 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-packaging-20.9-5.el9.noarch 23/42 2026-02-23T12:42:52.820 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/42 2026-02-23T12:42:52.835 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/42 2026-02-23T12:42:52.910 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/42 2026-02-23T12:42:52.918 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 27/42 2026-02-23T12:42:52.941 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/42 2026-02-23T12:42:52.970 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 29/42 2026-02-23T12:42:52.976 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/42 2026-02-23T12:42:53.027 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/42 2026-02-23T12:42:53.068 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5439.ge371433f.el9. 32/42 2026-02-23T12:42:53.069 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-mgr-2:20.3.0-5439.ge371433f.el9.x86_64 33/42 2026-02-23T12:42:53.092 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5439.ge371433f.el9.x86_64 33/42 2026-02-23T12:42:53.092 INFO:teuthology.orchestra.run.trial046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T12:42:53.092 INFO:teuthology.orchestra.run.trial046.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-23T12:42:53.092 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-23T12:42:53.092 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-23T12:42:53.092 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:42:53.096 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 34/42 2026-02-23T12:42:53.111 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/42 2026-02-23T12:42:53.111 INFO:teuthology.orchestra.run.trial046.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-23T12:42:53.112 INFO:teuthology.orchestra.run.trial046.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-23T12:42:53.112 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:42:53.119 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 35/42 2026-02-23T12:42:53.142 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/42 2026-02-23T12:42:53.142 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-23T12:42:53.142 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:42:53.743 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 36/42 2026-02-23T12:42:59.094 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-osd-classic-2:20.3.0-5439.ge371433f.el9.x86_6 37/42 2026-02-23T12:42:59.105 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-osd-crimson-2:20.3.0-5439.ge371433f.el9.x86_6 38/42 2026-02-23T12:42:59.106 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-osd-2:20.3.0-5439.ge371433f.el9.x86_64 39/42 2026-02-23T12:42:59.131 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-osd-2:20.3.0-5439.ge371433f.el9.x86_64 39/42 2026-02-23T12:42:59.131 INFO:teuthology.orchestra.run.trial046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T12:42:59.131 INFO:teuthology.orchestra.run.trial046.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-23T12:42:59.131 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-23T12:42:59.131 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-23T12:42:59.131 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:42:59.335 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-mon-2:20.3.0-5439.ge371433f.el9.x86_64 40/42 2026-02-23T12:42:59.356 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-mon-2:20.3.0-5439.ge371433f.el9.x86_64 40/42 2026-02-23T12:42:59.356 INFO:teuthology.orchestra.run.trial046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T12:42:59.356 INFO:teuthology.orchestra.run.trial046.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-23T12:42:59.356 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-23T12:42:59.356 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-23T12:42:59.356 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:42:59.438 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-mds-2:20.3.0-5439.ge371433f.el9.x86_64 41/42 2026-02-23T12:42:59.457 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-mds-2:20.3.0-5439.ge371433f.el9.x86_64 41/42 2026-02-23T12:42:59.457 INFO:teuthology.orchestra.run.trial046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T12:42:59.457 INFO:teuthology.orchestra.run.trial046.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-23T12:42:59.458 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-23T12:42:59.458 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-23T12:42:59.458 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:42:59.458 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-2:20.3.0-5439.ge371433f.el9.x86_64 42/42 2026-02-23T12:42:59.464 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5439.ge371433f.el9.x86_6 42/42 2026-02-23T12:42:59.486 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5439.ge371433f.el9.x86_6 42/42 2026-02-23T12:43:00.364 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-2:20.3.0-5439.ge371433f.el9.x86_64 42/42 2026-02-23T12:43:00.364 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-2:20.3.0-5439.ge371433f.el9.x86_64 1/42 2026-02-23T12:43:00.365 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-mds-2:20.3.0-5439.ge371433f.el9.x86_64 2/42 2026-02-23T12:43:00.365 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-mgr-2:20.3.0-5439.ge371433f.el9.x86_64 3/42 2026-02-23T12:43:00.365 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-mon-2:20.3.0-5439.ge371433f.el9.x86_64 4/42 2026-02-23T12:43:00.365 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-osd-2:20.3.0-5439.ge371433f.el9.x86_64 5/42 2026-02-23T12:43:00.365 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-osd-classic-2:20.3.0-5439.ge371433f.el9.x86_6 6/42 2026-02-23T12:43:00.365 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5439.ge371433f.el9.x86_6 7/42 2026-02-23T12:43:00.365 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5439.ge371433f.el9. 8/42 2026-02-23T12:43:00.365 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 9/42 2026-02-23T12:43:00.365 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 10/42 2026-02-23T12:43:00.365 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/42 2026-02-23T12:43:00.365 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 12/42 2026-02-23T12:43:00.366 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/42 2026-02-23T12:43:00.366 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/42 2026-02-23T12:43:00.366 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 15/42 2026-02-23T12:43:00.366 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 16/42 2026-02-23T12:43:00.366 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 17/42 2026-02-23T12:43:00.366 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : unzip-6.0-59.el9.x86_64 18/42 2026-02-23T12:43:00.366 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : zip-3.0-35.el9.x86_64 19/42 2026-02-23T12:43:00.366 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 20/42 2026-02-23T12:43:00.366 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : lua-5.4.4-4.el9.x86_64 21/42 2026-02-23T12:43:00.366 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 22/42 2026-02-23T12:43:00.366 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 23/42 2026-02-23T12:43:00.366 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 24/42 2026-02-23T12:43:00.366 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 25/42 2026-02-23T12:43:00.367 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 26/42 2026-02-23T12:43:00.367 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 27/42 2026-02-23T12:43:00.367 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 28/42 2026-02-23T12:43:00.367 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 29/42 2026-02-23T12:43:00.367 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 30/42 2026-02-23T12:43:00.367 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 31/42 2026-02-23T12:43:00.367 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 32/42 2026-02-23T12:43:00.367 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 33/42 2026-02-23T12:43:00.367 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 34/42 2026-02-23T12:43:00.367 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 35/42 2026-02-23T12:43:00.367 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 36/42 2026-02-23T12:43:00.367 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 37/42 2026-02-23T12:43:00.368 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 38/42 2026-02-23T12:43:00.368 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 39/42 2026-02-23T12:43:00.368 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 40/42 2026-02-23T12:43:00.368 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 41/42 2026-02-23T12:43:00.421 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 42/42 2026-02-23T12:43:00.421 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:43:00.421 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-23T12:43:00.421 INFO:teuthology.orchestra.run.trial046.stdout: ceph-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:43:00.421 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mds-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:43:00.421 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:43:00.421 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr-modules-core-2:20.3.0-5439.ge371433f.el9.noarch 2026-02-23T12:43:00.421 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mon-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:43:00.421 INFO:teuthology.orchestra.run.trial046.stdout: ceph-osd-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:43:00.421 INFO:teuthology.orchestra.run.trial046.stdout: ceph-osd-classic-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:43:00.422 INFO:teuthology.orchestra.run.trial046.stdout: ceph-osd-crimson-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:43:00.422 INFO:teuthology.orchestra.run.trial046.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-23T12:43:00.422 INFO:teuthology.orchestra.run.trial046.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-23T12:43:00.422 INFO:teuthology.orchestra.run.trial046.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-23T12:43:00.422 INFO:teuthology.orchestra.run.trial046.stdout: lua-5.4.4-4.el9.x86_64 2026-02-23T12:43:00.422 INFO:teuthology.orchestra.run.trial046.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-23T12:43:00.422 INFO:teuthology.orchestra.run.trial046.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-23T12:43:00.422 INFO:teuthology.orchestra.run.trial046.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-23T12:43:00.422 INFO:teuthology.orchestra.run.trial046.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-23T12:43:00.422 INFO:teuthology.orchestra.run.trial046.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-23T12:43:00.422 INFO:teuthology.orchestra.run.trial046.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-23T12:43:00.422 INFO:teuthology.orchestra.run.trial046.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-23T12:43:00.423 INFO:teuthology.orchestra.run.trial046.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-23T12:43:00.423 INFO:teuthology.orchestra.run.trial046.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-23T12:43:00.423 INFO:teuthology.orchestra.run.trial046.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-23T12:43:00.423 INFO:teuthology.orchestra.run.trial046.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-23T12:43:00.423 INFO:teuthology.orchestra.run.trial046.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-23T12:43:00.423 INFO:teuthology.orchestra.run.trial046.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-23T12:43:00.423 INFO:teuthology.orchestra.run.trial046.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-23T12:43:00.423 INFO:teuthology.orchestra.run.trial046.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-23T12:43:00.423 INFO:teuthology.orchestra.run.trial046.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-23T12:43:00.423 INFO:teuthology.orchestra.run.trial046.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-23T12:43:00.423 INFO:teuthology.orchestra.run.trial046.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-23T12:43:00.423 INFO:teuthology.orchestra.run.trial046.stdout: python3-ply-3.11-14.el9.noarch 2026-02-23T12:43:00.424 INFO:teuthology.orchestra.run.trial046.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-23T12:43:00.424 INFO:teuthology.orchestra.run.trial046.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-23T12:43:00.424 INFO:teuthology.orchestra.run.trial046.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-23T12:43:00.424 INFO:teuthology.orchestra.run.trial046.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-23T12:43:00.424 INFO:teuthology.orchestra.run.trial046.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-23T12:43:00.424 INFO:teuthology.orchestra.run.trial046.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-23T12:43:00.424 INFO:teuthology.orchestra.run.trial046.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-23T12:43:00.424 INFO:teuthology.orchestra.run.trial046.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-23T12:43:00.424 INFO:teuthology.orchestra.run.trial046.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-23T12:43:00.424 INFO:teuthology.orchestra.run.trial046.stdout: unzip-6.0-59.el9.x86_64 2026-02-23T12:43:00.424 INFO:teuthology.orchestra.run.trial046.stdout: zip-3.0-35.el9.x86_64 2026-02-23T12:43:00.424 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:43:00.424 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-23T12:43:00.464 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-base 2026-02-23T12:43:00.772 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:06:47 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:43:00.835 INFO:teuthology.orchestra.run.trial046.stdout:Package ceph-base-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T12:43:00.856 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-23T12:43:00.857 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-23T12:43:00.857 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-23T12:43:00.877 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install cephadm 2026-02-23T12:43:01.181 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:06:48 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:43:01.262 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-23T12:43:01.263 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:43:01.263 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repository Size 2026-02-23T12:43:01.263 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:43:01.263 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-23T12:43:01.263 INFO:teuthology.orchestra.run.trial046.stdout: cephadm noarch 2:20.3.0-5439.ge371433f.el9 ceph-noarch 1.0 M 2026-02-23T12:43:01.263 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:43:01.263 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-23T12:43:01.263 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:43:01.264 INFO:teuthology.orchestra.run.trial046.stdout:Install 1 Package 2026-02-23T12:43:01.264 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:43:01.264 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 1.0 M 2026-02-23T12:43:01.264 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 1.0 M 2026-02-23T12:43:01.264 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-23T12:43:03.778 INFO:teuthology.orchestra.run.trial046.stdout:cephadm-20.3.0-5439.ge371433f.el9.noarch.rpm 415 kB/s | 1.0 MB 00:02 2026-02-23T12:43:03.778 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-23T12:43:03.778 INFO:teuthology.orchestra.run.trial046.stdout:Total 415 kB/s | 1.0 MB 00:02 2026-02-23T12:43:03.778 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-23T12:43:03.781 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-23T12:43:03.781 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-23T12:43:03.785 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-23T12:43:03.785 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-23T12:43:03.803 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-23T12:43:03.863 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: cephadm-2:20.3.0-5439.ge371433f.el9.noarch 1/1 2026-02-23T12:43:03.877 INFO:teuthology.orchestra.run.trial046.stdout: Installing : cephadm-2:20.3.0-5439.ge371433f.el9.noarch 1/1 2026-02-23T12:43:03.943 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: cephadm-2:20.3.0-5439.ge371433f.el9.noarch 1/1 2026-02-23T12:43:03.999 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : cephadm-2:20.3.0-5439.ge371433f.el9.noarch 1/1 2026-02-23T12:43:04.000 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:43:04.000 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-23T12:43:04.000 INFO:teuthology.orchestra.run.trial046.stdout: cephadm-2:20.3.0-5439.ge371433f.el9.noarch 2026-02-23T12:43:04.000 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:43:04.000 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-23T12:43:04.027 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-immutable-object-cache 2026-02-23T12:43:04.338 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:06:51 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:43:04.420 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-23T12:43:04.421 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:43:04.421 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repo Size 2026-02-23T12:43:04.421 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:43:04.421 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-23T12:43:04.421 INFO:teuthology.orchestra.run.trial046.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5439.ge371433f.el9 ceph 149 k 2026-02-23T12:43:04.421 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:43:04.422 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-23T12:43:04.422 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:43:04.422 INFO:teuthology.orchestra.run.trial046.stdout:Install 1 Package 2026-02-23T12:43:04.422 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:43:04.422 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 149 k 2026-02-23T12:43:04.422 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 455 k 2026-02-23T12:43:04.422 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-23T12:43:05.544 INFO:teuthology.orchestra.run.trial046.stdout:ceph-immutable-object-cache-20.3.0-5439.ge37143 133 kB/s | 149 kB 00:01 2026-02-23T12:43:05.545 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-23T12:43:05.545 INFO:teuthology.orchestra.run.trial046.stdout:Total 133 kB/s | 149 kB 00:01 2026-02-23T12:43:05.545 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-23T12:43:05.549 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-23T12:43:05.549 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-23T12:43:05.575 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-23T12:43:05.576 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-23T12:43:05.625 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-23T12:43:05.626 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5439.ge371433f. 1/1 2026-02-23T12:43:05.649 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5439.ge371433f. 1/1 2026-02-23T12:43:05.650 INFO:teuthology.orchestra.run.trial046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T12:43:05.650 INFO:teuthology.orchestra.run.trial046.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-23T12:43:05.650 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:43:05.922 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5439.ge371433f. 1/1 2026-02-23T12:43:05.922 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:43:05.922 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-23T12:43:05.922 INFO:teuthology.orchestra.run.trial046.stdout: ceph-immutable-object-cache-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:43:05.922 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:43:05.922 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-23T12:43:05.949 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-mgr 2026-02-23T12:43:06.260 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:06:53 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:43:06.324 INFO:teuthology.orchestra.run.trial046.stdout:Package ceph-mgr-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T12:43:06.342 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-23T12:43:06.343 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-23T12:43:06.343 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-23T12:43:06.364 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-mgr-dashboard 2026-02-23T12:43:06.670 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:06:53 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:43:06.753 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-23T12:43:06.754 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:43:06.754 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repository Size 2026-02-23T12:43:06.754 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:43:06.754 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-23T12:43:06.754 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5439.ge371433f.el9 ceph-noarch 51 M 2026-02-23T12:43:06.754 INFO:teuthology.orchestra.run.trial046.stdout:Installing dependencies: 2026-02-23T12:43:06.754 INFO:teuthology.orchestra.run.trial046.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-23T12:43:06.754 INFO:teuthology.orchestra.run.trial046.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5439.ge371433f.el9 ceph-noarch 57 k 2026-02-23T12:43:06.755 INFO:teuthology.orchestra.run.trial046.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5439.ge371433f.el9 ceph-noarch 17 k 2026-02-23T12:43:06.755 INFO:teuthology.orchestra.run.trial046.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-23T12:43:06.755 INFO:teuthology.orchestra.run.trial046.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-23T12:43:06.755 INFO:teuthology.orchestra.run.trial046.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-23T12:43:06.755 INFO:teuthology.orchestra.run.trial046.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-23T12:43:06.755 INFO:teuthology.orchestra.run.trial046.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-23T12:43:06.755 INFO:teuthology.orchestra.run.trial046.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-23T12:43:06.755 INFO:teuthology.orchestra.run.trial046.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-23T12:43:06.755 INFO:teuthology.orchestra.run.trial046.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-23T12:43:06.755 INFO:teuthology.orchestra.run.trial046.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-23T12:43:06.755 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:43:06.755 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-23T12:43:06.756 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:43:06.756 INFO:teuthology.orchestra.run.trial046.stdout:Install 13 Packages 2026-02-23T12:43:06.756 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:43:06.756 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 55 M 2026-02-23T12:43:06.757 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 262 M 2026-02-23T12:43:06.757 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-23T12:43:07.595 INFO:teuthology.orchestra.run.trial046.stdout:(1/13): ceph-prometheus-alerts-20.3.0-5439.ge37 49 kB/s | 17 kB 00:00 2026-02-23T12:43:07.668 INFO:teuthology.orchestra.run.trial046.stdout:(2/13): ceph-grafana-dashboards-20.3.0-5439.ge3 134 kB/s | 57 kB 00:00 2026-02-23T12:43:08.114 INFO:teuthology.orchestra.run.trial046.stdout:(3/13): python3-jmespath-1.0.1-1.el9.noarch.rpm 91 kB/s | 48 kB 00:00 2026-02-23T12:43:08.395 INFO:teuthology.orchestra.run.trial046.stdout:(4/13): python3-protobuf-3.14.0-17.el9.noarch.r 368 kB/s | 267 kB 00:00 2026-02-23T12:43:08.649 INFO:teuthology.orchestra.run.trial046.stdout:(5/13): abseil-cpp-20211102.0-4.el9.x86_64.rpm 2.1 MB/s | 551 kB 00:00 2026-02-23T12:43:08.680 INFO:teuthology.orchestra.run.trial046.stdout:(6/13): grpc-data-1.46.7-10.el9.noarch.rpm 641 kB/s | 19 kB 00:00 2026-02-23T12:43:08.782 INFO:teuthology.orchestra.run.trial046.stdout:(7/13): python3-grpcio-1.46.7-10.el9.x86_64.rpm 20 MB/s | 2.0 MB 00:00 2026-02-23T12:43:08.813 INFO:teuthology.orchestra.run.trial046.stdout:(8/13): python3-grpcio-tools-1.46.7-10.el9.x86_ 4.5 MB/s | 144 kB 00:00 2026-02-23T12:43:08.843 INFO:teuthology.orchestra.run.trial046.stdout:(9/13): python3-repoze-lru-0.7-16.el9.noarch.rp 1.0 MB/s | 31 kB 00:00 2026-02-23T12:43:08.875 INFO:teuthology.orchestra.run.trial046.stdout:(10/13): python3-routes-2.5.1-5.el9.noarch.rpm 5.9 MB/s | 188 kB 00:00 2026-02-23T12:43:08.905 INFO:teuthology.orchestra.run.trial046.stdout:(11/13): python3-xmltodict-0.12.0-15.el9.noarch 737 kB/s | 22 kB 00:00 2026-02-23T12:43:09.020 INFO:teuthology.orchestra.run.trial046.stdout:(12/13): protobuf-compiler-3.14.0-17.el9.x86_64 952 kB/s | 862 kB 00:00 2026-02-23T12:43:20.902 INFO:teuthology.orchestra.run.trial131.stdout:(42/42): ceph-osd-crimson-20.3.0-5439.ge371433f 510 kB/s | 87 MB 02:54 2026-02-23T12:43:20.903 INFO:teuthology.orchestra.run.trial131.stdout:-------------------------------------------------------------------------------- 2026-02-23T12:43:20.903 INFO:teuthology.orchestra.run.trial131.stdout:Total 654 kB/s | 114 MB 02:59 2026-02-23T12:43:21.019 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction check 2026-02-23T12:43:21.038 INFO:teuthology.orchestra.run.trial131.stdout:Transaction check succeeded. 2026-02-23T12:43:21.038 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction test 2026-02-23T12:43:21.430 INFO:teuthology.orchestra.run.trial131.stdout:Transaction test succeeded. 2026-02-23T12:43:21.430 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction 2026-02-23T12:43:21.870 INFO:teuthology.orchestra.run.trial131.stdout: Preparing : 1/1 2026-02-23T12:43:21.872 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/42 2026-02-23T12:43:21.877 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/42 2026-02-23T12:43:21.882 INFO:teuthology.orchestra.run.trial131.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/42 2026-02-23T12:43:21.884 INFO:teuthology.orchestra.run.trial131.stdout: Installing : unzip-6.0-59.el9.x86_64 4/42 2026-02-23T12:43:21.890 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 5/42 2026-02-23T12:43:21.913 INFO:teuthology.orchestra.run.trial131.stdout: Installing : zip-3.0-35.el9.x86_64 6/42 2026-02-23T12:43:21.918 INFO:teuthology.orchestra.run.trial131.stdout: Installing : luarocks-3.9.2-5.el9.noarch 7/42 2026-02-23T12:43:21.923 INFO:teuthology.orchestra.run.trial131.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 8/42 2026-02-23T12:43:21.927 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 9/42 2026-02-23T12:43:21.933 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 10/42 2026-02-23T12:43:21.937 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 11/42 2026-02-23T12:43:21.943 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 12/42 2026-02-23T12:43:21.948 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 13/42 2026-02-23T12:43:21.951 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 14/42 2026-02-23T12:43:21.957 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 15/42 2026-02-23T12:43:21.961 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 16/42 2026-02-23T12:43:21.967 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 17/42 2026-02-23T12:43:21.971 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 18/42 2026-02-23T12:43:21.994 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 19/42 2026-02-23T12:43:22.007 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/42 2026-02-23T12:43:22.012 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/42 2026-02-23T12:43:22.021 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 22/42 2026-02-23T12:43:22.028 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-packaging-20.9-5.el9.noarch 23/42 2026-02-23T12:43:22.041 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/42 2026-02-23T12:43:22.056 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/42 2026-02-23T12:43:22.131 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/42 2026-02-23T12:43:22.139 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 27/42 2026-02-23T12:43:22.162 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/42 2026-02-23T12:43:22.190 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 29/42 2026-02-23T12:43:22.196 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/42 2026-02-23T12:43:22.248 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/42 2026-02-23T12:43:22.289 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5439.ge371433f.el9. 32/42 2026-02-23T12:43:22.290 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-mgr-2:20.3.0-5439.ge371433f.el9.x86_64 33/42 2026-02-23T12:43:22.314 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5439.ge371433f.el9.x86_64 33/42 2026-02-23T12:43:22.314 INFO:teuthology.orchestra.run.trial131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T12:43:22.314 INFO:teuthology.orchestra.run.trial131.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-23T12:43:22.314 INFO:teuthology.orchestra.run.trial131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-23T12:43:22.314 INFO:teuthology.orchestra.run.trial131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-23T12:43:22.314 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:43:22.318 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 34/42 2026-02-23T12:43:22.335 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/42 2026-02-23T12:43:22.335 INFO:teuthology.orchestra.run.trial131.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-23T12:43:22.335 INFO:teuthology.orchestra.run.trial131.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-23T12:43:22.335 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:43:22.343 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 35/42 2026-02-23T12:43:22.365 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/42 2026-02-23T12:43:22.365 INFO:teuthology.orchestra.run.trial131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-23T12:43:22.365 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:43:22.990 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 36/42 2026-02-23T12:43:28.367 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-osd-classic-2:20.3.0-5439.ge371433f.el9.x86_6 37/42 2026-02-23T12:43:28.377 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-osd-crimson-2:20.3.0-5439.ge371433f.el9.x86_6 38/42 2026-02-23T12:43:28.378 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-osd-2:20.3.0-5439.ge371433f.el9.x86_64 39/42 2026-02-23T12:43:28.401 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-osd-2:20.3.0-5439.ge371433f.el9.x86_64 39/42 2026-02-23T12:43:28.402 INFO:teuthology.orchestra.run.trial131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T12:43:28.402 INFO:teuthology.orchestra.run.trial131.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-23T12:43:28.402 INFO:teuthology.orchestra.run.trial131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-23T12:43:28.402 INFO:teuthology.orchestra.run.trial131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-23T12:43:28.402 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:43:28.610 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-mon-2:20.3.0-5439.ge371433f.el9.x86_64 40/42 2026-02-23T12:43:28.630 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-mon-2:20.3.0-5439.ge371433f.el9.x86_64 40/42 2026-02-23T12:43:28.631 INFO:teuthology.orchestra.run.trial131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T12:43:28.631 INFO:teuthology.orchestra.run.trial131.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-23T12:43:28.631 INFO:teuthology.orchestra.run.trial131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-23T12:43:28.631 INFO:teuthology.orchestra.run.trial131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-23T12:43:28.631 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:43:28.719 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-mds-2:20.3.0-5439.ge371433f.el9.x86_64 41/42 2026-02-23T12:43:28.739 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-mds-2:20.3.0-5439.ge371433f.el9.x86_64 41/42 2026-02-23T12:43:28.740 INFO:teuthology.orchestra.run.trial131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T12:43:28.740 INFO:teuthology.orchestra.run.trial131.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-23T12:43:28.740 INFO:teuthology.orchestra.run.trial131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-23T12:43:28.740 INFO:teuthology.orchestra.run.trial131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-23T12:43:28.740 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:43:28.741 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-2:20.3.0-5439.ge371433f.el9.x86_64 42/42 2026-02-23T12:43:28.747 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5439.ge371433f.el9.x86_6 42/42 2026-02-23T12:43:28.768 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5439.ge371433f.el9.x86_6 42/42 2026-02-23T12:43:29.670 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-2:20.3.0-5439.ge371433f.el9.x86_64 42/42 2026-02-23T12:43:29.670 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-2:20.3.0-5439.ge371433f.el9.x86_64 1/42 2026-02-23T12:43:29.670 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-mds-2:20.3.0-5439.ge371433f.el9.x86_64 2/42 2026-02-23T12:43:29.670 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-mgr-2:20.3.0-5439.ge371433f.el9.x86_64 3/42 2026-02-23T12:43:29.670 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-mon-2:20.3.0-5439.ge371433f.el9.x86_64 4/42 2026-02-23T12:43:29.670 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-osd-2:20.3.0-5439.ge371433f.el9.x86_64 5/42 2026-02-23T12:43:29.670 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-osd-classic-2:20.3.0-5439.ge371433f.el9.x86_6 6/42 2026-02-23T12:43:29.670 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5439.ge371433f.el9.x86_6 7/42 2026-02-23T12:43:29.671 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5439.ge371433f.el9. 8/42 2026-02-23T12:43:29.671 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 9/42 2026-02-23T12:43:29.671 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 10/42 2026-02-23T12:43:29.671 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/42 2026-02-23T12:43:29.671 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 12/42 2026-02-23T12:43:29.671 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/42 2026-02-23T12:43:29.671 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/42 2026-02-23T12:43:29.671 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 15/42 2026-02-23T12:43:29.671 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 16/42 2026-02-23T12:43:29.671 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 17/42 2026-02-23T12:43:29.671 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : unzip-6.0-59.el9.x86_64 18/42 2026-02-23T12:43:29.671 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : zip-3.0-35.el9.x86_64 19/42 2026-02-23T12:43:29.671 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 20/42 2026-02-23T12:43:29.672 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : lua-5.4.4-4.el9.x86_64 21/42 2026-02-23T12:43:29.672 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 22/42 2026-02-23T12:43:29.672 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 23/42 2026-02-23T12:43:29.672 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 24/42 2026-02-23T12:43:29.672 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 25/42 2026-02-23T12:43:29.672 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 26/42 2026-02-23T12:43:29.672 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 27/42 2026-02-23T12:43:29.672 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 28/42 2026-02-23T12:43:29.672 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 29/42 2026-02-23T12:43:29.672 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 30/42 2026-02-23T12:43:29.672 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 31/42 2026-02-23T12:43:29.672 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 32/42 2026-02-23T12:43:29.672 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 33/42 2026-02-23T12:43:29.673 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 34/42 2026-02-23T12:43:29.673 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 35/42 2026-02-23T12:43:29.673 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 36/42 2026-02-23T12:43:29.673 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 37/42 2026-02-23T12:43:29.673 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 38/42 2026-02-23T12:43:29.673 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 39/42 2026-02-23T12:43:29.673 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 40/42 2026-02-23T12:43:29.673 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 41/42 2026-02-23T12:43:29.727 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 42/42 2026-02-23T12:43:29.727 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:43:29.727 INFO:teuthology.orchestra.run.trial131.stdout:Installed: 2026-02-23T12:43:29.728 INFO:teuthology.orchestra.run.trial131.stdout: ceph-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:43:29.728 INFO:teuthology.orchestra.run.trial131.stdout: ceph-mds-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:43:29.728 INFO:teuthology.orchestra.run.trial131.stdout: ceph-mgr-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:43:29.728 INFO:teuthology.orchestra.run.trial131.stdout: ceph-mgr-modules-core-2:20.3.0-5439.ge371433f.el9.noarch 2026-02-23T12:43:29.728 INFO:teuthology.orchestra.run.trial131.stdout: ceph-mon-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:43:29.728 INFO:teuthology.orchestra.run.trial131.stdout: ceph-osd-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:43:29.728 INFO:teuthology.orchestra.run.trial131.stdout: ceph-osd-classic-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:43:29.728 INFO:teuthology.orchestra.run.trial131.stdout: ceph-osd-crimson-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:43:29.728 INFO:teuthology.orchestra.run.trial131.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-23T12:43:29.728 INFO:teuthology.orchestra.run.trial131.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-23T12:43:29.728 INFO:teuthology.orchestra.run.trial131.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-23T12:43:29.728 INFO:teuthology.orchestra.run.trial131.stdout: lua-5.4.4-4.el9.x86_64 2026-02-23T12:43:29.729 INFO:teuthology.orchestra.run.trial131.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-23T12:43:29.729 INFO:teuthology.orchestra.run.trial131.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-23T12:43:29.729 INFO:teuthology.orchestra.run.trial131.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-23T12:43:29.729 INFO:teuthology.orchestra.run.trial131.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-23T12:43:29.729 INFO:teuthology.orchestra.run.trial131.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-23T12:43:29.729 INFO:teuthology.orchestra.run.trial131.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-23T12:43:29.729 INFO:teuthology.orchestra.run.trial131.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-23T12:43:29.729 INFO:teuthology.orchestra.run.trial131.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-23T12:43:29.729 INFO:teuthology.orchestra.run.trial131.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-23T12:43:29.729 INFO:teuthology.orchestra.run.trial131.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-23T12:43:29.729 INFO:teuthology.orchestra.run.trial131.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-23T12:43:29.729 INFO:teuthology.orchestra.run.trial131.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-23T12:43:29.729 INFO:teuthology.orchestra.run.trial131.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-23T12:43:29.730 INFO:teuthology.orchestra.run.trial131.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-23T12:43:29.730 INFO:teuthology.orchestra.run.trial131.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-23T12:43:29.730 INFO:teuthology.orchestra.run.trial131.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-23T12:43:29.730 INFO:teuthology.orchestra.run.trial131.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-23T12:43:29.730 INFO:teuthology.orchestra.run.trial131.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-23T12:43:29.730 INFO:teuthology.orchestra.run.trial131.stdout: python3-ply-3.11-14.el9.noarch 2026-02-23T12:43:29.730 INFO:teuthology.orchestra.run.trial131.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-23T12:43:29.730 INFO:teuthology.orchestra.run.trial131.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-23T12:43:29.730 INFO:teuthology.orchestra.run.trial131.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-23T12:43:29.730 INFO:teuthology.orchestra.run.trial131.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-23T12:43:29.730 INFO:teuthology.orchestra.run.trial131.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-23T12:43:29.730 INFO:teuthology.orchestra.run.trial131.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-23T12:43:29.731 INFO:teuthology.orchestra.run.trial131.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-23T12:43:29.731 INFO:teuthology.orchestra.run.trial131.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-23T12:43:29.731 INFO:teuthology.orchestra.run.trial131.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-23T12:43:29.731 INFO:teuthology.orchestra.run.trial131.stdout: unzip-6.0-59.el9.x86_64 2026-02-23T12:43:29.731 INFO:teuthology.orchestra.run.trial131.stdout: zip-3.0-35.el9.x86_64 2026-02-23T12:43:29.731 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:43:29.731 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-23T12:43:29.771 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-base 2026-02-23T12:43:30.081 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:07:17 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:43:30.145 INFO:teuthology.orchestra.run.trial131.stdout:Package ceph-base-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T12:43:30.163 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-23T12:43:30.163 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-23T12:43:30.164 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-23T12:43:30.186 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install cephadm 2026-02-23T12:43:30.493 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:07:17 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:43:30.575 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-23T12:43:30.576 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:43:30.576 INFO:teuthology.orchestra.run.trial131.stdout: Package Arch Version Repository Size 2026-02-23T12:43:30.576 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:43:30.576 INFO:teuthology.orchestra.run.trial131.stdout:Installing: 2026-02-23T12:43:30.576 INFO:teuthology.orchestra.run.trial131.stdout: cephadm noarch 2:20.3.0-5439.ge371433f.el9 ceph-noarch 1.0 M 2026-02-23T12:43:30.576 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:43:30.576 INFO:teuthology.orchestra.run.trial131.stdout:Transaction Summary 2026-02-23T12:43:30.577 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:43:30.577 INFO:teuthology.orchestra.run.trial131.stdout:Install 1 Package 2026-02-23T12:43:30.577 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:43:30.577 INFO:teuthology.orchestra.run.trial131.stdout:Total download size: 1.0 M 2026-02-23T12:43:30.577 INFO:teuthology.orchestra.run.trial131.stdout:Installed size: 1.0 M 2026-02-23T12:43:30.577 INFO:teuthology.orchestra.run.trial131.stdout:Downloading Packages: 2026-02-23T12:43:34.211 INFO:teuthology.orchestra.run.trial131.stdout:cephadm-20.3.0-5439.ge371433f.el9.noarch.rpm 287 kB/s | 1.0 MB 00:03 2026-02-23T12:43:34.212 INFO:teuthology.orchestra.run.trial131.stdout:-------------------------------------------------------------------------------- 2026-02-23T12:43:34.212 INFO:teuthology.orchestra.run.trial131.stdout:Total 287 kB/s | 1.0 MB 00:03 2026-02-23T12:43:34.212 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction check 2026-02-23T12:43:34.215 INFO:teuthology.orchestra.run.trial131.stdout:Transaction check succeeded. 2026-02-23T12:43:34.215 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction test 2026-02-23T12:43:34.219 INFO:teuthology.orchestra.run.trial131.stdout:Transaction test succeeded. 2026-02-23T12:43:34.219 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction 2026-02-23T12:43:34.237 INFO:teuthology.orchestra.run.trial131.stdout: Preparing : 1/1 2026-02-23T12:43:34.295 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: cephadm-2:20.3.0-5439.ge371433f.el9.noarch 1/1 2026-02-23T12:43:34.308 INFO:teuthology.orchestra.run.trial131.stdout: Installing : cephadm-2:20.3.0-5439.ge371433f.el9.noarch 1/1 2026-02-23T12:43:34.372 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: cephadm-2:20.3.0-5439.ge371433f.el9.noarch 1/1 2026-02-23T12:43:34.426 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : cephadm-2:20.3.0-5439.ge371433f.el9.noarch 1/1 2026-02-23T12:43:34.426 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:43:34.426 INFO:teuthology.orchestra.run.trial131.stdout:Installed: 2026-02-23T12:43:34.426 INFO:teuthology.orchestra.run.trial131.stdout: cephadm-2:20.3.0-5439.ge371433f.el9.noarch 2026-02-23T12:43:34.426 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:43:34.426 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-23T12:43:34.453 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-immutable-object-cache 2026-02-23T12:43:34.772 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:07:21 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:43:34.855 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-23T12:43:34.856 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:43:34.856 INFO:teuthology.orchestra.run.trial131.stdout: Package Arch Version Repo Size 2026-02-23T12:43:34.856 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:43:34.856 INFO:teuthology.orchestra.run.trial131.stdout:Installing: 2026-02-23T12:43:34.856 INFO:teuthology.orchestra.run.trial131.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5439.ge371433f.el9 ceph 149 k 2026-02-23T12:43:34.856 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:43:34.857 INFO:teuthology.orchestra.run.trial131.stdout:Transaction Summary 2026-02-23T12:43:34.857 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:43:34.857 INFO:teuthology.orchestra.run.trial131.stdout:Install 1 Package 2026-02-23T12:43:34.857 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:43:34.857 INFO:teuthology.orchestra.run.trial131.stdout:Total download size: 149 k 2026-02-23T12:43:34.857 INFO:teuthology.orchestra.run.trial131.stdout:Installed size: 455 k 2026-02-23T12:43:34.857 INFO:teuthology.orchestra.run.trial131.stdout:Downloading Packages: 2026-02-23T12:43:35.427 INFO:teuthology.orchestra.run.trial131.stdout:ceph-immutable-object-cache-20.3.0-5439.ge37143 261 kB/s | 149 kB 00:00 2026-02-23T12:43:35.428 INFO:teuthology.orchestra.run.trial131.stdout:-------------------------------------------------------------------------------- 2026-02-23T12:43:35.428 INFO:teuthology.orchestra.run.trial131.stdout:Total 261 kB/s | 149 kB 00:00 2026-02-23T12:43:35.428 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction check 2026-02-23T12:43:35.433 INFO:teuthology.orchestra.run.trial131.stdout:Transaction check succeeded. 2026-02-23T12:43:35.433 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction test 2026-02-23T12:43:35.459 INFO:teuthology.orchestra.run.trial131.stdout:Transaction test succeeded. 2026-02-23T12:43:35.459 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction 2026-02-23T12:43:35.508 INFO:teuthology.orchestra.run.trial131.stdout: Preparing : 1/1 2026-02-23T12:43:35.510 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5439.ge371433f. 1/1 2026-02-23T12:43:35.532 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5439.ge371433f. 1/1 2026-02-23T12:43:35.532 INFO:teuthology.orchestra.run.trial131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T12:43:35.532 INFO:teuthology.orchestra.run.trial131.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-23T12:43:35.533 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:43:35.820 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5439.ge371433f. 1/1 2026-02-23T12:43:35.820 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:43:35.820 INFO:teuthology.orchestra.run.trial131.stdout:Installed: 2026-02-23T12:43:35.820 INFO:teuthology.orchestra.run.trial131.stdout: ceph-immutable-object-cache-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:43:35.820 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:43:35.821 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-23T12:43:35.846 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-mgr 2026-02-23T12:43:36.158 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:07:23 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:43:36.221 INFO:teuthology.orchestra.run.trial131.stdout:Package ceph-mgr-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T12:43:36.238 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-23T12:43:36.239 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-23T12:43:36.239 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-23T12:43:36.260 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-mgr-dashboard 2026-02-23T12:43:36.565 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:07:23 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:43:36.649 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-23T12:43:36.649 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:43:36.650 INFO:teuthology.orchestra.run.trial131.stdout: Package Arch Version Repository Size 2026-02-23T12:43:36.650 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:43:36.650 INFO:teuthology.orchestra.run.trial131.stdout:Installing: 2026-02-23T12:43:36.650 INFO:teuthology.orchestra.run.trial131.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5439.ge371433f.el9 ceph-noarch 51 M 2026-02-23T12:43:36.650 INFO:teuthology.orchestra.run.trial131.stdout:Installing dependencies: 2026-02-23T12:43:36.650 INFO:teuthology.orchestra.run.trial131.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-23T12:43:36.650 INFO:teuthology.orchestra.run.trial131.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5439.ge371433f.el9 ceph-noarch 57 k 2026-02-23T12:43:36.650 INFO:teuthology.orchestra.run.trial131.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5439.ge371433f.el9 ceph-noarch 17 k 2026-02-23T12:43:36.650 INFO:teuthology.orchestra.run.trial131.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-23T12:43:36.650 INFO:teuthology.orchestra.run.trial131.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-23T12:43:36.651 INFO:teuthology.orchestra.run.trial131.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-23T12:43:36.651 INFO:teuthology.orchestra.run.trial131.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-23T12:43:36.651 INFO:teuthology.orchestra.run.trial131.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-23T12:43:36.651 INFO:teuthology.orchestra.run.trial131.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-23T12:43:36.651 INFO:teuthology.orchestra.run.trial131.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-23T12:43:36.651 INFO:teuthology.orchestra.run.trial131.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-23T12:43:36.651 INFO:teuthology.orchestra.run.trial131.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-23T12:43:36.651 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:43:36.651 INFO:teuthology.orchestra.run.trial131.stdout:Transaction Summary 2026-02-23T12:43:36.651 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:43:36.651 INFO:teuthology.orchestra.run.trial131.stdout:Install 13 Packages 2026-02-23T12:43:36.652 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:43:36.652 INFO:teuthology.orchestra.run.trial131.stdout:Total download size: 55 M 2026-02-23T12:43:36.652 INFO:teuthology.orchestra.run.trial131.stdout:Installed size: 262 M 2026-02-23T12:43:36.652 INFO:teuthology.orchestra.run.trial131.stdout:Downloading Packages: 2026-02-23T12:43:37.206 INFO:teuthology.orchestra.run.trial131.stdout:(1/13): ceph-prometheus-alerts-20.3.0-5439.ge37 48 kB/s | 17 kB 00:00 2026-02-23T12:43:37.265 INFO:teuthology.orchestra.run.trial131.stdout:(2/13): python3-jmespath-1.0.1-1.el9.noarch.rpm 815 kB/s | 48 kB 00:00 2026-02-23T12:43:37.297 INFO:teuthology.orchestra.run.trial131.stdout:(3/13): python3-protobuf-3.14.0-17.el9.noarch.r 8.1 MB/s | 267 kB 00:00 2026-02-23T12:43:37.390 INFO:teuthology.orchestra.run.trial131.stdout:(4/13): ceph-grafana-dashboards-20.3.0-5439.ge3 105 kB/s | 57 kB 00:00 2026-02-23T12:43:37.725 INFO:teuthology.orchestra.run.trial131.stdout:(5/13): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.6 MB/s | 551 kB 00:00 2026-02-23T12:43:37.765 INFO:teuthology.orchestra.run.trial131.stdout:(6/13): grpc-data-1.46.7-10.el9.noarch.rpm 491 kB/s | 19 kB 00:00 2026-02-23T12:43:37.889 INFO:teuthology.orchestra.run.trial131.stdout:(7/13): python3-grpcio-1.46.7-10.el9.x86_64.rpm 16 MB/s | 2.0 MB 00:00 2026-02-23T12:43:37.932 INFO:teuthology.orchestra.run.trial131.stdout:(8/13): protobuf-compiler-3.14.0-17.el9.x86_64. 1.3 MB/s | 862 kB 00:00 2026-02-23T12:43:37.934 INFO:teuthology.orchestra.run.trial131.stdout:(9/13): python3-grpcio-tools-1.46.7-10.el9.x86_ 3.2 MB/s | 144 kB 00:00 2026-02-23T12:43:37.980 INFO:teuthology.orchestra.run.trial131.stdout:(10/13): python3-routes-2.5.1-5.el9.noarch.rpm 4.0 MB/s | 188 kB 00:00 2026-02-23T12:43:38.020 INFO:teuthology.orchestra.run.trial131.stdout:(11/13): python3-xmltodict-0.12.0-15.el9.noarch 551 kB/s | 22 kB 00:00 2026-02-23T12:43:38.057 INFO:teuthology.orchestra.run.trial131.stdout:(12/13): python3-repoze-lru-0.7-16.el9.noarch.r 245 kB/s | 31 kB 00:00 2026-02-23T12:45:11.983 INFO:teuthology.orchestra.run.trial046.stdout:(13/13): ceph-mgr-dashboard-20.3.0-5439.ge37143 416 kB/s | 51 MB 02:04 2026-02-23T12:45:11.986 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-23T12:45:11.987 INFO:teuthology.orchestra.run.trial046.stdout:Total 449 kB/s | 55 MB 02:05 2026-02-23T12:45:12.010 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-23T12:45:12.020 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-23T12:45:12.020 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-23T12:45:12.232 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-23T12:45:12.232 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-23T12:45:12.460 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-23T12:45:12.467 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 1/13 2026-02-23T12:45:12.478 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 2/13 2026-02-23T12:45:12.480 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 3/13 2026-02-23T12:45:12.508 INFO:teuthology.orchestra.run.trial046.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 4/13 2026-02-23T12:45:12.551 INFO:teuthology.orchestra.run.trial046.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 5/13 2026-02-23T12:45:12.560 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 6/13 2026-02-23T12:45:12.588 INFO:teuthology.orchestra.run.trial046.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 7/13 2026-02-23T12:45:12.597 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 8/13 2026-02-23T12:45:12.605 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/13 2026-02-23T12:45:12.607 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 10/13 2026-02-23T12:45:12.616 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5439.ge371433f.el9 11/13 2026-02-23T12:45:15.486 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5439.ge371433f.el 12/13 2026-02-23T12:45:15.493 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5439.ge371433f.el9.noa 13/13 2026-02-23T12:45:15.767 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5439.ge371433f.el9.noa 13/13 2026-02-23T12:45:15.768 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5439.ge371433f.el 1/13 2026-02-23T12:45:15.768 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5439.ge371433f.el9.noa 2/13 2026-02-23T12:45:15.768 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5439.ge371433f.el9 3/13 2026-02-23T12:45:15.768 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 4/13 2026-02-23T12:45:15.768 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 5/13 2026-02-23T12:45:15.768 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 6/13 2026-02-23T12:45:15.768 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 7/13 2026-02-23T12:45:15.768 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/13 2026-02-23T12:45:15.768 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/13 2026-02-23T12:45:15.768 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/13 2026-02-23T12:45:15.768 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/13 2026-02-23T12:45:15.769 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/13 2026-02-23T12:45:15.823 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 13/13 2026-02-23T12:45:15.824 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:15.824 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-23T12:45:15.824 INFO:teuthology.orchestra.run.trial046.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-23T12:45:15.824 INFO:teuthology.orchestra.run.trial046.stdout: ceph-grafana-dashboards-2:20.3.0-5439.ge371433f.el9.noarch 2026-02-23T12:45:15.824 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr-dashboard-2:20.3.0-5439.ge371433f.el9.noarch 2026-02-23T12:45:15.824 INFO:teuthology.orchestra.run.trial046.stdout: ceph-prometheus-alerts-2:20.3.0-5439.ge371433f.el9.noarch 2026-02-23T12:45:15.824 INFO:teuthology.orchestra.run.trial046.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-23T12:45:15.824 INFO:teuthology.orchestra.run.trial046.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-23T12:45:15.824 INFO:teuthology.orchestra.run.trial046.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-23T12:45:15.825 INFO:teuthology.orchestra.run.trial046.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-23T12:45:15.825 INFO:teuthology.orchestra.run.trial046.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-23T12:45:15.825 INFO:teuthology.orchestra.run.trial046.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-23T12:45:15.825 INFO:teuthology.orchestra.run.trial046.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-23T12:45:15.825 INFO:teuthology.orchestra.run.trial046.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-23T12:45:15.825 INFO:teuthology.orchestra.run.trial046.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-23T12:45:15.825 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:15.825 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-23T12:45:15.859 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-23T12:45:16.166 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:09:03 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:45:16.249 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-23T12:45:16.249 INFO:teuthology.orchestra.run.trial046.stdout:======================================================================================= 2026-02-23T12:45:16.249 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repository Size 2026-02-23T12:45:16.249 INFO:teuthology.orchestra.run.trial046.stdout:======================================================================================= 2026-02-23T12:45:16.249 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-23T12:45:16.249 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5439.ge371433f.el9 ceph-noarch 7.4 M 2026-02-23T12:45:16.249 INFO:teuthology.orchestra.run.trial046.stdout:Installing dependencies: 2026-02-23T12:45:16.249 INFO:teuthology.orchestra.run.trial046.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-23T12:45:16.249 INFO:teuthology.orchestra.run.trial046.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-23T12:45:16.249 INFO:teuthology.orchestra.run.trial046.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-23T12:45:16.250 INFO:teuthology.orchestra.run.trial046.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-23T12:45:16.250 INFO:teuthology.orchestra.run.trial046.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-23T12:45:16.250 INFO:teuthology.orchestra.run.trial046.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-23T12:45:16.250 INFO:teuthology.orchestra.run.trial046.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-23T12:45:16.250 INFO:teuthology.orchestra.run.trial046.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-23T12:45:16.250 INFO:teuthology.orchestra.run.trial046.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-23T12:45:16.250 INFO:teuthology.orchestra.run.trial046.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-23T12:45:16.250 INFO:teuthology.orchestra.run.trial046.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-23T12:45:16.250 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:16.250 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-23T12:45:16.250 INFO:teuthology.orchestra.run.trial046.stdout:======================================================================================= 2026-02-23T12:45:16.250 INFO:teuthology.orchestra.run.trial046.stdout:Install 12 Packages 2026-02-23T12:45:16.250 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:16.250 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 43 M 2026-02-23T12:45:16.250 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 234 M 2026-02-23T12:45:16.250 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-23T12:45:17.394 INFO:teuthology.orchestra.run.trial046.stdout:(1/12): libquadmath-11.5.0-14.el9.x86_64.rpm 234 kB/s | 184 kB 00:00 2026-02-23T12:45:17.653 INFO:teuthology.orchestra.run.trial046.stdout:(2/12): flexiblas-3.0.4-9.el9.x86_64.rpm 114 kB/s | 30 kB 00:00 2026-02-23T12:45:18.015 INFO:teuthology.orchestra.run.trial046.stdout:(3/12): libgfortran-11.5.0-14.el9.x86_64.rpm 563 kB/s | 794 kB 00:01 2026-02-23T12:45:18.246 INFO:teuthology.orchestra.run.trial046.stdout:(4/12): flexiblas-netlib-3.0.4-9.el9.x86_64.rpm 5.0 MB/s | 3.0 MB 00:00 2026-02-23T12:45:18.249 INFO:teuthology.orchestra.run.trial046.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-9.el9.x 64 kB/s | 15 kB 00:00 2026-02-23T12:45:18.324 INFO:teuthology.orchestra.run.trial046.stdout:(6/12): openblas-0.3.29-1.el9.x86_64.rpm 539 kB/s | 42 kB 00:00 2026-02-23T12:45:18.406 INFO:teuthology.orchestra.run.trial046.stdout:(7/12): python3-devel-3.9.25-3.el9.x86_64.rpm 2.9 MB/s | 244 kB 00:00 2026-02-23T12:45:18.627 INFO:teuthology.orchestra.run.trial046.stdout:(8/12): python3-numpy-1.23.5-2.el9.x86_64.rpm 28 MB/s | 6.1 MB 00:00 2026-02-23T12:45:18.708 INFO:teuthology.orchestra.run.trial046.stdout:(9/12): python3-numpy-f2py-1.23.5-2.el9.x86_64. 5.3 MB/s | 442 kB 00:00 2026-02-23T12:45:18.945 INFO:teuthology.orchestra.run.trial046.stdout:(10/12): openblas-openmp-0.3.29-1.el9.x86_64.rp 7.6 MB/s | 5.3 MB 00:00 2026-02-23T12:45:19.295 INFO:teuthology.orchestra.run.trial046.stdout:(11/12): python3-scipy-1.9.3-2.el9.x86_64.rpm 33 MB/s | 19 MB 00:00 2026-02-23T12:45:20.907 INFO:teuthology.orchestra.run.trial046.stdout:(12/12): ceph-mgr-diskprediction-local-20.3.0-5 1.7 MB/s | 7.4 MB 00:04 2026-02-23T12:45:20.909 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-23T12:45:20.909 INFO:teuthology.orchestra.run.trial046.stdout:Total 9.2 MB/s | 43 MB 00:04 2026-02-23T12:45:21.068 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-23T12:45:21.081 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-23T12:45:21.082 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-23T12:45:21.283 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-23T12:45:21.283 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-23T12:45:21.498 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-23T12:45:21.501 INFO:teuthology.orchestra.run.trial046.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 1/12 2026-02-23T12:45:21.507 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 2/12 2026-02-23T12:45:21.541 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 3/12 2026-02-23T12:45:21.545 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 4/12 2026-02-23T12:45:21.604 INFO:teuthology.orchestra.run.trial046.stdout: Installing : openblas-0.3.29-1.el9.x86_64 5/12 2026-02-23T12:45:21.606 INFO:teuthology.orchestra.run.trial046.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 6/12 2026-02-23T12:45:21.628 INFO:teuthology.orchestra.run.trial046.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 7/12 2026-02-23T12:45:21.948 INFO:teuthology.orchestra.run.trial046.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 8/12 2026-02-23T12:45:22.020 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 9/12 2026-02-23T12:45:22.678 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 10/12 2026-02-23T12:45:23.135 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 11/12 2026-02-23T12:45:23.136 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5439.ge3714 12/12 2026-02-23T12:45:23.421 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5439.ge3714 12/12 2026-02-23T12:45:23.421 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5439.ge3714 1/12 2026-02-23T12:45:23.422 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 2/12 2026-02-23T12:45:23.422 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 3/12 2026-02-23T12:45:23.422 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 4/12 2026-02-23T12:45:23.422 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 5/12 2026-02-23T12:45:23.422 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 6/12 2026-02-23T12:45:23.422 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 7/12 2026-02-23T12:45:23.422 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 8/12 2026-02-23T12:45:23.422 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 9/12 2026-02-23T12:45:23.422 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 10/12 2026-02-23T12:45:23.422 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 11/12 2026-02-23T12:45:23.482 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 12/12 2026-02-23T12:45:23.482 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:23.482 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-23T12:45:23.482 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5439.ge371433f.el9.noarch 2026-02-23T12:45:23.482 INFO:teuthology.orchestra.run.trial046.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-23T12:45:23.483 INFO:teuthology.orchestra.run.trial046.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-23T12:45:23.483 INFO:teuthology.orchestra.run.trial046.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-23T12:45:23.483 INFO:teuthology.orchestra.run.trial046.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-23T12:45:23.483 INFO:teuthology.orchestra.run.trial046.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-23T12:45:23.483 INFO:teuthology.orchestra.run.trial046.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-23T12:45:23.483 INFO:teuthology.orchestra.run.trial046.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-23T12:45:23.483 INFO:teuthology.orchestra.run.trial046.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-23T12:45:23.483 INFO:teuthology.orchestra.run.trial046.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-23T12:45:23.483 INFO:teuthology.orchestra.run.trial046.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-23T12:45:23.483 INFO:teuthology.orchestra.run.trial046.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-23T12:45:23.483 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:23.484 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-23T12:45:23.519 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-mgr-rook 2026-02-23T12:45:23.828 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:09:10 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:45:23.913 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-23T12:45:23.914 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:45:23.914 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repository Size 2026-02-23T12:45:23.914 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:45:23.914 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-23T12:45:23.914 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr-rook noarch 2:20.3.0-5439.ge371433f.el9 ceph-noarch 50 k 2026-02-23T12:45:23.914 INFO:teuthology.orchestra.run.trial046.stdout:Installing dependencies: 2026-02-23T12:45:23.914 INFO:teuthology.orchestra.run.trial046.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-23T12:45:23.914 INFO:teuthology.orchestra.run.trial046.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-23T12:45:23.914 INFO:teuthology.orchestra.run.trial046.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-23T12:45:23.915 INFO:teuthology.orchestra.run.trial046.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-23T12:45:23.915 INFO:teuthology.orchestra.run.trial046.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-23T12:45:23.915 INFO:teuthology.orchestra.run.trial046.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-23T12:45:23.915 INFO:teuthology.orchestra.run.trial046.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-23T12:45:23.915 INFO:teuthology.orchestra.run.trial046.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-23T12:45:23.915 INFO:teuthology.orchestra.run.trial046.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-23T12:45:23.915 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:23.915 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-23T12:45:23.915 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:45:23.915 INFO:teuthology.orchestra.run.trial046.stdout:Install 10 Packages 2026-02-23T12:45:23.915 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:23.915 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 2.0 M 2026-02-23T12:45:23.916 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 25 M 2026-02-23T12:45:23.916 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-23T12:45:24.147 INFO:teuthology.orchestra.run.trial046.stdout:(1/10): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 159 kB 00:00 2026-02-23T12:45:24.169 INFO:teuthology.orchestra.run.trial046.stdout:(2/10): python3-requests-oauthlib-1.3.0-12.el9. 2.4 MB/s | 54 kB 00:00 2026-02-23T12:45:24.171 INFO:teuthology.orchestra.run.trial046.stdout:(3/10): python3-pyasn1-modules-0.4.8-6.el9.noar 2.3 MB/s | 279 kB 00:00 2026-02-23T12:45:24.212 INFO:teuthology.orchestra.run.trial046.stdout:(4/10): python3-certifi-2023.05.07-4.el9.noarch 342 kB/s | 14 kB 00:00 2026-02-23T12:45:24.215 INFO:teuthology.orchestra.run.trial046.stdout:(5/10): python3-cachetools-4.2.4-1.el9.noarch.r 692 kB/s | 32 kB 00:00 2026-02-23T12:45:24.276 INFO:teuthology.orchestra.run.trial046.stdout:(6/10): python3-google-auth-2.45.0-1.el9.noarch 3.9 MB/s | 254 kB 00:00 2026-02-23T12:45:24.292 INFO:teuthology.orchestra.run.trial046.stdout:(7/10): python3-rsa-4.9-2.el9.noarch.rpm 3.6 MB/s | 59 kB 00:00 2026-02-23T12:45:24.299 INFO:teuthology.orchestra.run.trial046.stdout:(8/10): python3-kubernetes-26.1.0-3.el9.noarch. 12 MB/s | 1.0 MB 00:00 2026-02-23T12:45:24.309 INFO:teuthology.orchestra.run.trial046.stdout:(9/10): python3-websocket-client-1.2.3-2.el9.no 5.1 MB/s | 90 kB 00:00 2026-02-23T12:45:24.543 INFO:teuthology.orchestra.run.trial046.stdout:(10/10): ceph-mgr-rook-20.3.0-5439.ge371433f.el 103 kB/s | 50 kB 00:00 2026-02-23T12:45:24.544 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-23T12:45:24.544 INFO:teuthology.orchestra.run.trial046.stdout:Total 3.2 MB/s | 2.0 MB 00:00 2026-02-23T12:45:24.570 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-23T12:45:24.578 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-23T12:45:24.578 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-23T12:45:24.616 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-23T12:45:24.616 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-23T12:45:24.689 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-23T12:45:24.740 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/10 2026-02-23T12:45:24.753 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/10 2026-02-23T12:45:24.767 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/10 2026-02-23T12:45:24.772 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/10 2026-02-23T12:45:24.779 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/10 2026-02-23T12:45:24.818 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/10 2026-02-23T12:45:24.830 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-23T12:45:25.147 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 8/10 2026-02-23T12:45:25.162 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 9/10 2026-02-23T12:45:25.163 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-mgr-rook-2:20.3.0-5439.ge371433f.el9.noarch 10/10 2026-02-23T12:45:25.272 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5439.ge371433f.el9.noarch 10/10 2026-02-23T12:45:25.273 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5439.ge371433f.el9.noarch 1/10 2026-02-23T12:45:25.273 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 2/10 2026-02-23T12:45:25.273 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 3/10 2026-02-23T12:45:25.273 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 4/10 2026-02-23T12:45:25.273 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 5/10 2026-02-23T12:45:25.273 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 6/10 2026-02-23T12:45:25.273 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-23T12:45:25.274 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 8/10 2026-02-23T12:45:25.274 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 9/10 2026-02-23T12:45:25.329 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 10/10 2026-02-23T12:45:25.330 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:25.330 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-23T12:45:25.330 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr-rook-2:20.3.0-5439.ge371433f.el9.noarch 2026-02-23T12:45:25.330 INFO:teuthology.orchestra.run.trial046.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-23T12:45:25.330 INFO:teuthology.orchestra.run.trial046.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-23T12:45:25.331 INFO:teuthology.orchestra.run.trial046.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-23T12:45:25.332 INFO:teuthology.orchestra.run.trial046.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-23T12:45:25.332 INFO:teuthology.orchestra.run.trial046.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-23T12:45:25.332 INFO:teuthology.orchestra.run.trial046.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-23T12:45:25.332 INFO:teuthology.orchestra.run.trial046.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-23T12:45:25.332 INFO:teuthology.orchestra.run.trial046.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-23T12:45:25.332 INFO:teuthology.orchestra.run.trial046.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-23T12:45:25.332 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:25.332 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-23T12:45:25.359 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-mgr-cephadm 2026-02-23T12:45:25.665 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:09:12 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:45:25.749 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-23T12:45:25.750 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:45:25.750 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repository Size 2026-02-23T12:45:25.750 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:45:25.750 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-23T12:45:25.750 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5439.ge371433f.el9 ceph-noarch 184 k 2026-02-23T12:45:25.750 INFO:teuthology.orchestra.run.trial046.stdout:Installing dependencies: 2026-02-23T12:45:25.750 INFO:teuthology.orchestra.run.trial046.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-23T12:45:25.750 INFO:teuthology.orchestra.run.trial046.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-23T12:45:25.751 INFO:teuthology.orchestra.run.trial046.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-23T12:45:25.751 INFO:teuthology.orchestra.run.trial046.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-23T12:45:25.751 INFO:teuthology.orchestra.run.trial046.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-23T12:45:25.751 INFO:teuthology.orchestra.run.trial046.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-23T12:45:25.751 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:25.751 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-23T12:45:25.751 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:45:25.751 INFO:teuthology.orchestra.run.trial046.stdout:Install 7 Packages 2026-02-23T12:45:25.751 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:25.751 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 7.1 M 2026-02-23T12:45:25.751 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 34 M 2026-02-23T12:45:25.752 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-23T12:45:26.641 INFO:teuthology.orchestra.run.trial046.stdout:(1/7): python3-jinja2-2.11.3-8.el9.noarch.rpm 344 kB/s | 249 kB 00:00 2026-02-23T12:45:26.725 INFO:teuthology.orchestra.run.trial046.stdout:(2/7): python3-markupsafe-1.1.1-12.el9.x86_64.r 414 kB/s | 35 kB 00:00 2026-02-23T12:45:26.761 INFO:teuthology.orchestra.run.trial046.stdout:(3/7): python3-asyncssh-2.13.2-5.el9.noarch.rpm 15 MB/s | 548 kB 00:00 2026-02-23T12:45:26.765 INFO:teuthology.orchestra.run.trial046.stdout:(4/7): python3-natsort-7.1.1-5.el9.noarch.rpm 17 MB/s | 58 kB 00:00 2026-02-23T12:45:26.768 INFO:teuthology.orchestra.run.trial046.stdout:(5/7): python3-typing-extensions-4.15.0-1.el9.n 24 MB/s | 86 kB 00:00 2026-02-23T12:45:27.174 INFO:teuthology.orchestra.run.trial046.stdout:(6/7): ceph-mgr-cephadm-20.3.0-5439.ge371433f.e 147 kB/s | 184 kB 00:01 2026-02-23T12:45:32.076 INFO:teuthology.orchestra.run.trial131.stdout:(13/13): ceph-mgr-dashboard-20.3.0-5439.ge37143 451 kB/s | 51 MB 01:55 2026-02-23T12:45:32.078 INFO:teuthology.orchestra.run.trial131.stdout:-------------------------------------------------------------------------------- 2026-02-23T12:45:32.078 INFO:teuthology.orchestra.run.trial131.stdout:Total 487 kB/s | 55 MB 01:55 2026-02-23T12:45:32.101 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction check 2026-02-23T12:45:32.111 INFO:teuthology.orchestra.run.trial131.stdout:Transaction check succeeded. 2026-02-23T12:45:32.111 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction test 2026-02-23T12:45:32.325 INFO:teuthology.orchestra.run.trial131.stdout:Transaction test succeeded. 2026-02-23T12:45:32.325 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction 2026-02-23T12:45:32.553 INFO:teuthology.orchestra.run.trial131.stdout: Preparing : 1/1 2026-02-23T12:45:32.559 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 1/13 2026-02-23T12:45:32.570 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 2/13 2026-02-23T12:45:32.572 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 3/13 2026-02-23T12:45:32.600 INFO:teuthology.orchestra.run.trial131.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 4/13 2026-02-23T12:45:32.642 INFO:teuthology.orchestra.run.trial131.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 5/13 2026-02-23T12:45:32.651 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 6/13 2026-02-23T12:45:32.679 INFO:teuthology.orchestra.run.trial131.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 7/13 2026-02-23T12:45:32.690 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 8/13 2026-02-23T12:45:32.697 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/13 2026-02-23T12:45:32.700 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 10/13 2026-02-23T12:45:32.709 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5439.ge371433f.el9 11/13 2026-02-23T12:45:33.106 INFO:teuthology.orchestra.run.trial046.stdout:(7/7): python3-babel-2.9.1-2.el9.noarch.rpm 849 kB/s | 6.0 MB 00:07 2026-02-23T12:45:33.109 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-23T12:45:33.109 INFO:teuthology.orchestra.run.trial046.stdout:Total 987 kB/s | 7.1 MB 00:07 2026-02-23T12:45:33.146 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-23T12:45:33.153 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-23T12:45:33.153 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-23T12:45:33.225 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-23T12:45:33.225 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-23T12:45:33.315 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-23T12:45:33.364 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 1/7 2026-02-23T12:45:33.373 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/7 2026-02-23T12:45:33.379 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/7 2026-02-23T12:45:33.599 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-23T12:45:33.622 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 5/7 2026-02-23T12:45:33.647 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 6/7 2026-02-23T12:45:33.648 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5439.ge371433f.el9.noarch 7/7 2026-02-23T12:45:33.757 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5439.ge371433f.el9.noarch 7/7 2026-02-23T12:45:33.758 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5439.ge371433f.el9.noarch 1/7 2026-02-23T12:45:33.758 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/7 2026-02-23T12:45:33.758 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 3/7 2026-02-23T12:45:33.758 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-23T12:45:33.758 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 5/7 2026-02-23T12:45:33.758 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 6/7 2026-02-23T12:45:33.816 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 7/7 2026-02-23T12:45:33.816 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:33.816 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-23T12:45:33.816 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr-cephadm-2:20.3.0-5439.ge371433f.el9.noarch 2026-02-23T12:45:33.816 INFO:teuthology.orchestra.run.trial046.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-23T12:45:33.816 INFO:teuthology.orchestra.run.trial046.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-23T12:45:33.816 INFO:teuthology.orchestra.run.trial046.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-23T12:45:33.817 INFO:teuthology.orchestra.run.trial046.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-23T12:45:33.817 INFO:teuthology.orchestra.run.trial046.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-23T12:45:33.817 INFO:teuthology.orchestra.run.trial046.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-23T12:45:33.817 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:33.817 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-23T12:45:33.846 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-osd 2026-02-23T12:45:34.158 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:09:21 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:45:34.222 INFO:teuthology.orchestra.run.trial046.stdout:Package ceph-osd-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T12:45:34.240 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-23T12:45:34.241 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-23T12:45:34.241 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-23T12:45:34.262 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-osd-classic 2026-02-23T12:45:34.564 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:09:21 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:45:34.629 INFO:teuthology.orchestra.run.trial046.stdout:Package ceph-osd-classic-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T12:45:34.647 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-23T12:45:34.648 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-23T12:45:34.648 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-23T12:45:34.668 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-fuse 2026-02-23T12:45:34.980 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:09:21 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:45:35.063 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-23T12:45:35.064 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:45:35.064 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repo Size 2026-02-23T12:45:35.064 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:45:35.064 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-23T12:45:35.064 INFO:teuthology.orchestra.run.trial046.stdout: ceph-fuse x86_64 2:20.3.0-5439.ge371433f.el9 ceph 914 k 2026-02-23T12:45:35.064 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:35.064 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-23T12:45:35.065 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:45:35.065 INFO:teuthology.orchestra.run.trial046.stdout:Install 1 Package 2026-02-23T12:45:35.065 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:35.065 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 914 k 2026-02-23T12:45:35.065 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 2.9 M 2026-02-23T12:45:35.065 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-23T12:45:35.684 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5439.ge371433f.el 12/13 2026-02-23T12:45:35.691 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5439.ge371433f.el9.noa 13/13 2026-02-23T12:45:35.976 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5439.ge371433f.el9.noa 13/13 2026-02-23T12:45:35.976 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5439.ge371433f.el 1/13 2026-02-23T12:45:35.977 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5439.ge371433f.el9.noa 2/13 2026-02-23T12:45:35.977 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5439.ge371433f.el9 3/13 2026-02-23T12:45:35.977 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 4/13 2026-02-23T12:45:35.977 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 5/13 2026-02-23T12:45:35.977 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 6/13 2026-02-23T12:45:35.977 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 7/13 2026-02-23T12:45:35.977 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/13 2026-02-23T12:45:35.977 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/13 2026-02-23T12:45:35.977 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/13 2026-02-23T12:45:35.977 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/13 2026-02-23T12:45:35.978 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/13 2026-02-23T12:45:36.032 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 13/13 2026-02-23T12:45:36.033 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:45:36.033 INFO:teuthology.orchestra.run.trial131.stdout:Installed: 2026-02-23T12:45:36.033 INFO:teuthology.orchestra.run.trial131.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-23T12:45:36.033 INFO:teuthology.orchestra.run.trial131.stdout: ceph-grafana-dashboards-2:20.3.0-5439.ge371433f.el9.noarch 2026-02-23T12:45:36.033 INFO:teuthology.orchestra.run.trial131.stdout: ceph-mgr-dashboard-2:20.3.0-5439.ge371433f.el9.noarch 2026-02-23T12:45:36.033 INFO:teuthology.orchestra.run.trial131.stdout: ceph-prometheus-alerts-2:20.3.0-5439.ge371433f.el9.noarch 2026-02-23T12:45:36.033 INFO:teuthology.orchestra.run.trial131.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-23T12:45:36.033 INFO:teuthology.orchestra.run.trial131.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-23T12:45:36.033 INFO:teuthology.orchestra.run.trial131.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-23T12:45:36.033 INFO:teuthology.orchestra.run.trial131.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-23T12:45:36.034 INFO:teuthology.orchestra.run.trial131.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-23T12:45:36.034 INFO:teuthology.orchestra.run.trial131.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-23T12:45:36.034 INFO:teuthology.orchestra.run.trial131.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-23T12:45:36.034 INFO:teuthology.orchestra.run.trial131.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-23T12:45:36.034 INFO:teuthology.orchestra.run.trial131.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-23T12:45:36.034 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:45:36.034 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-23T12:45:36.068 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-23T12:45:36.373 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:09:23 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:45:36.456 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-23T12:45:36.456 INFO:teuthology.orchestra.run.trial131.stdout:======================================================================================= 2026-02-23T12:45:36.457 INFO:teuthology.orchestra.run.trial131.stdout: Package Arch Version Repository Size 2026-02-23T12:45:36.457 INFO:teuthology.orchestra.run.trial131.stdout:======================================================================================= 2026-02-23T12:45:36.457 INFO:teuthology.orchestra.run.trial131.stdout:Installing: 2026-02-23T12:45:36.457 INFO:teuthology.orchestra.run.trial131.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5439.ge371433f.el9 ceph-noarch 7.4 M 2026-02-23T12:45:36.457 INFO:teuthology.orchestra.run.trial131.stdout:Installing dependencies: 2026-02-23T12:45:36.457 INFO:teuthology.orchestra.run.trial131.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-23T12:45:36.457 INFO:teuthology.orchestra.run.trial131.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-23T12:45:36.457 INFO:teuthology.orchestra.run.trial131.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-23T12:45:36.457 INFO:teuthology.orchestra.run.trial131.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-23T12:45:36.458 INFO:teuthology.orchestra.run.trial131.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-23T12:45:36.458 INFO:teuthology.orchestra.run.trial131.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-23T12:45:36.458 INFO:teuthology.orchestra.run.trial131.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-23T12:45:36.458 INFO:teuthology.orchestra.run.trial131.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-23T12:45:36.458 INFO:teuthology.orchestra.run.trial131.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-23T12:45:36.458 INFO:teuthology.orchestra.run.trial131.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-23T12:45:36.458 INFO:teuthology.orchestra.run.trial131.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-23T12:45:36.458 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:45:36.458 INFO:teuthology.orchestra.run.trial131.stdout:Transaction Summary 2026-02-23T12:45:36.458 INFO:teuthology.orchestra.run.trial131.stdout:======================================================================================= 2026-02-23T12:45:36.458 INFO:teuthology.orchestra.run.trial131.stdout:Install 12 Packages 2026-02-23T12:45:36.458 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:45:36.459 INFO:teuthology.orchestra.run.trial131.stdout:Total download size: 43 M 2026-02-23T12:45:36.459 INFO:teuthology.orchestra.run.trial131.stdout:Installed size: 234 M 2026-02-23T12:45:36.459 INFO:teuthology.orchestra.run.trial131.stdout:Downloading Packages: 2026-02-23T12:45:36.837 INFO:teuthology.orchestra.run.trial131.stdout:(1/12): libquadmath-11.5.0-14.el9.x86_64.rpm 9.5 MB/s | 184 kB 00:00 2026-02-23T12:45:36.844 INFO:teuthology.orchestra.run.trial131.stdout:(2/12): libgfortran-11.5.0-14.el9.x86_64.rpm 29 MB/s | 794 kB 00:00 2026-02-23T12:45:36.868 INFO:teuthology.orchestra.run.trial131.stdout:(3/12): flexiblas-3.0.4-9.el9.x86_64.rpm 958 kB/s | 30 kB 00:00 2026-02-23T12:45:36.869 INFO:teuthology.orchestra.run.trial046.stdout:ceph-fuse-20.3.0-5439.ge371433f.el9.x86_64.rpm 506 kB/s | 914 kB 00:01 2026-02-23T12:45:36.870 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-23T12:45:36.870 INFO:teuthology.orchestra.run.trial046.stdout:Total 506 kB/s | 914 kB 00:01 2026-02-23T12:45:36.870 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-23T12:45:36.875 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-23T12:45:36.875 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-23T12:45:36.879 INFO:teuthology.orchestra.run.trial131.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-9.el9.x 1.3 MB/s | 15 kB 00:00 2026-02-23T12:45:36.896 INFO:teuthology.orchestra.run.trial131.stdout:(5/12): openblas-0.3.29-1.el9.x86_64.rpm 2.6 MB/s | 42 kB 00:00 2026-02-23T12:45:36.908 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-23T12:45:36.908 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-23T12:45:36.938 INFO:teuthology.orchestra.run.trial131.stdout:(6/12): flexiblas-netlib-3.0.4-9.el9.x86_64.rpm 32 MB/s | 3.0 MB 00:00 2026-02-23T12:45:36.951 INFO:teuthology.orchestra.run.trial131.stdout:(7/12): python3-devel-3.9.25-3.el9.x86_64.rpm 18 MB/s | 244 kB 00:00 2026-02-23T12:45:36.978 INFO:teuthology.orchestra.run.trial131.stdout:(8/12): openblas-openmp-0.3.29-1.el9.x86_64.rpm 64 MB/s | 5.3 MB 00:00 2026-02-23T12:45:36.990 INFO:teuthology.orchestra.run.trial131.stdout:(9/12): python3-numpy-1.23.5-2.el9.x86_64.rpm 160 MB/s | 6.1 MB 00:00 2026-02-23T12:45:36.992 INFO:teuthology.orchestra.run.trial131.stdout:(10/12): python3-numpy-f2py-1.23.5-2.el9.x86_64 32 MB/s | 442 kB 00:00 2026-02-23T12:45:36.996 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-23T12:45:37.013 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-fuse-2:20.3.0-5439.ge371433f.el9.x86_64 1/1 2026-02-23T12:45:37.082 INFO:teuthology.orchestra.run.trial131.stdout:(11/12): python3-scipy-1.9.3-2.el9.x86_64.rpm 209 MB/s | 19 MB 00:00 2026-02-23T12:45:37.227 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5439.ge371433f.el9.x86_64 1/1 2026-02-23T12:45:37.284 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-fuse-2:20.3.0-5439.ge371433f.el9.x86_64 1/1 2026-02-23T12:45:37.285 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:37.285 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-23T12:45:37.285 INFO:teuthology.orchestra.run.trial046.stdout: ceph-fuse-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:45:37.285 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:37.285 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-23T12:45:37.312 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-volume 2026-02-23T12:45:37.618 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:09:24 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:45:37.702 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-23T12:45:37.703 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:45:37.703 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repository Size 2026-02-23T12:45:37.704 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:45:37.704 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-23T12:45:37.704 INFO:teuthology.orchestra.run.trial046.stdout: ceph-volume noarch 2:20.3.0-5439.ge371433f.el9 ceph-noarch 301 k 2026-02-23T12:45:37.704 INFO:teuthology.orchestra.run.trial046.stdout:Installing dependencies: 2026-02-23T12:45:37.704 INFO:teuthology.orchestra.run.trial046.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-23T12:45:37.704 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:37.704 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-23T12:45:37.704 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:45:37.704 INFO:teuthology.orchestra.run.trial046.stdout:Install 2 Packages 2026-02-23T12:45:37.704 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:37.704 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 652 k 2026-02-23T12:45:37.705 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 2.2 M 2026-02-23T12:45:37.705 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-23T12:45:37.892 INFO:teuthology.orchestra.run.trial046.stdout:(1/2): cryptsetup-2.8.1-3.el9.x86_64.rpm 2.7 MB/s | 351 kB 00:00 2026-02-23T12:45:39.050 INFO:teuthology.orchestra.run.trial046.stdout:(2/2): ceph-volume-20.3.0-5439.ge371433f.el9.no 235 kB/s | 301 kB 00:01 2026-02-23T12:45:39.051 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-23T12:45:39.051 INFO:teuthology.orchestra.run.trial046.stdout:Total 484 kB/s | 652 kB 00:01 2026-02-23T12:45:39.061 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-23T12:45:39.067 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-23T12:45:39.067 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-23T12:45:39.110 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-23T12:45:39.111 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-23T12:45:39.190 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-23T12:45:39.252 INFO:teuthology.orchestra.run.trial046.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 1/2 2026-02-23T12:45:39.254 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-volume-2:20.3.0-5439.ge371433f.el9.noarch 2/2 2026-02-23T12:45:39.269 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-volume-2:20.3.0-5439.ge371433f.el9.noarch 2/2 2026-02-23T12:45:39.269 INFO:teuthology.orchestra.run.trial046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T12:45:39.269 INFO:teuthology.orchestra.run.trial046.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-23T12:45:39.270 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:39.490 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-volume-2:20.3.0-5439.ge371433f.el9.noarch 1/2 2026-02-23T12:45:39.549 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 2/2 2026-02-23T12:45:39.549 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:39.549 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-23T12:45:39.549 INFO:teuthology.orchestra.run.trial046.stdout: ceph-volume-2:20.3.0-5439.ge371433f.el9.noarch cryptsetup-2.8.1-3.el9.x86_64 2026-02-23T12:45:39.549 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:39.550 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-23T12:45:39.578 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install librados-devel 2026-02-23T12:45:39.891 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:09:26 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:45:39.976 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-23T12:45:39.977 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:45:39.977 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repo Size 2026-02-23T12:45:39.977 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:45:39.977 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-23T12:45:39.977 INFO:teuthology.orchestra.run.trial046.stdout: librados-devel x86_64 2:20.3.0-5439.ge371433f.el9 ceph 124 k 2026-02-23T12:45:39.977 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:39.977 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-23T12:45:39.977 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:45:39.977 INFO:teuthology.orchestra.run.trial046.stdout:Install 1 Package 2026-02-23T12:45:39.977 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:39.978 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 124 k 2026-02-23T12:45:39.978 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 434 k 2026-02-23T12:45:39.978 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-23T12:45:40.543 INFO:teuthology.orchestra.run.trial046.stdout:librados-devel-20.3.0-5439.ge371433f.el9.x86_64 218 kB/s | 124 kB 00:00 2026-02-23T12:45:40.544 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-23T12:45:40.544 INFO:teuthology.orchestra.run.trial046.stdout:Total 218 kB/s | 124 kB 00:00 2026-02-23T12:45:40.544 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-23T12:45:40.547 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-23T12:45:40.547 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-23T12:45:40.577 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-23T12:45:40.578 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-23T12:45:40.631 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-23T12:45:40.648 INFO:teuthology.orchestra.run.trial046.stdout: Installing : librados-devel-2:20.3.0-5439.ge371433f.el9.x86_64 1/1 2026-02-23T12:45:40.732 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: librados-devel-2:20.3.0-5439.ge371433f.el9.x86_64 1/1 2026-02-23T12:45:40.789 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : librados-devel-2:20.3.0-5439.ge371433f.el9.x86_64 1/1 2026-02-23T12:45:40.790 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:40.790 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-23T12:45:40.790 INFO:teuthology.orchestra.run.trial046.stdout: librados-devel-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:45:40.790 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:40.790 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-23T12:45:40.818 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install libcephfs2 2026-02-23T12:45:41.127 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:09:28 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:45:41.191 INFO:teuthology.orchestra.run.trial046.stdout:Package libcephfs2-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T12:45:41.209 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-23T12:45:41.210 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-23T12:45:41.210 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-23T12:45:41.230 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install libcephfs-devel 2026-02-23T12:45:41.535 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:09:28 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:45:41.619 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-23T12:45:41.619 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:45:41.619 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repo Size 2026-02-23T12:45:41.619 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:45:41.619 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-23T12:45:41.619 INFO:teuthology.orchestra.run.trial046.stdout: libcephfs-devel x86_64 2:20.3.0-5439.ge371433f.el9 ceph 37 k 2026-02-23T12:45:41.619 INFO:teuthology.orchestra.run.trial046.stdout:Installing dependencies: 2026-02-23T12:45:41.619 INFO:teuthology.orchestra.run.trial046.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5439.ge371433f.el9 ceph 26 k 2026-02-23T12:45:41.619 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:41.619 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-23T12:45:41.619 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:45:41.619 INFO:teuthology.orchestra.run.trial046.stdout:Install 2 Packages 2026-02-23T12:45:41.619 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:41.620 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 64 k 2026-02-23T12:45:41.620 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 231 k 2026-02-23T12:45:41.620 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-23T12:45:41.977 INFO:teuthology.orchestra.run.trial046.stdout:(1/2): libcephfs-devel-20.3.0-5439.ge371433f.el 104 kB/s | 37 kB 00:00 2026-02-23T12:45:41.981 INFO:teuthology.orchestra.run.trial046.stdout:(2/2): libcephfs-proxy2-20.3.0-5439.ge371433f.e 73 kB/s | 26 kB 00:00 2026-02-23T12:45:41.982 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-23T12:45:41.982 INFO:teuthology.orchestra.run.trial046.stdout:Total 175 kB/s | 64 kB 00:00 2026-02-23T12:45:41.983 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-23T12:45:41.985 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-23T12:45:41.986 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-23T12:45:42.017 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-23T12:45:42.017 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-23T12:45:42.066 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-23T12:45:42.067 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libcephfs-proxy2-2:20.3.0-5439.ge371433f.el9.x86_64 1/2 2026-02-23T12:45:42.082 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5439.ge371433f.el9.x86_64 1/2 2026-02-23T12:45:42.098 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libcephfs-devel-2:20.3.0-5439.ge371433f.el9.x86_64 2/2 2026-02-23T12:45:42.153 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5439.ge371433f.el9.x86_64 2/2 2026-02-23T12:45:42.153 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libcephfs-devel-2:20.3.0-5439.ge371433f.el9.x86_64 1/2 2026-02-23T12:45:42.210 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5439.ge371433f.el9.x86_64 2/2 2026-02-23T12:45:42.210 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:42.210 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-23T12:45:42.210 INFO:teuthology.orchestra.run.trial046.stdout: libcephfs-devel-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:45:42.210 INFO:teuthology.orchestra.run.trial046.stdout: libcephfs-proxy2-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:45:42.210 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:42.211 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-23T12:45:42.237 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install librados2 2026-02-23T12:45:42.548 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:09:29 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:45:42.615 INFO:teuthology.orchestra.run.trial046.stdout:Package librados2-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T12:45:42.633 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-23T12:45:42.634 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-23T12:45:42.634 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-23T12:45:42.656 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install librbd1 2026-02-23T12:45:42.960 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:09:29 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:45:43.025 INFO:teuthology.orchestra.run.trial046.stdout:Package librbd1-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T12:45:43.043 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-23T12:45:43.044 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-23T12:45:43.044 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-23T12:45:43.064 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install python3-rados 2026-02-23T12:45:43.372 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:09:30 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:45:43.437 INFO:teuthology.orchestra.run.trial046.stdout:Package python3-rados-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T12:45:43.456 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-23T12:45:43.456 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-23T12:45:43.456 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-23T12:45:43.477 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install python3-rgw 2026-02-23T12:45:43.783 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:09:30 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:45:43.847 INFO:teuthology.orchestra.run.trial046.stdout:Package python3-rgw-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T12:45:43.865 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-23T12:45:43.866 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-23T12:45:43.866 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-23T12:45:43.886 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install python3-cephfs 2026-02-23T12:45:44.194 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:09:31 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:45:44.260 INFO:teuthology.orchestra.run.trial046.stdout:Package python3-cephfs-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T12:45:44.278 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-23T12:45:44.279 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-23T12:45:44.279 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-23T12:45:44.300 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install python3-rbd 2026-02-23T12:45:44.605 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:09:31 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:45:44.670 INFO:teuthology.orchestra.run.trial046.stdout:Package python3-rbd-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T12:45:44.689 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-23T12:45:44.690 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-23T12:45:44.690 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-23T12:45:44.710 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install rbd-fuse 2026-02-23T12:45:45.021 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:09:32 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:45:45.105 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-23T12:45:45.105 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:45:45.105 INFO:teuthology.orchestra.run.trial046.stdout: Package Architecture Version Repository Size 2026-02-23T12:45:45.105 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:45:45.105 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-23T12:45:45.105 INFO:teuthology.orchestra.run.trial046.stdout: rbd-fuse x86_64 2:20.3.0-5439.ge371433f.el9 ceph 86 k 2026-02-23T12:45:45.105 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:45.105 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-23T12:45:45.105 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:45:45.105 INFO:teuthology.orchestra.run.trial046.stdout:Install 1 Package 2026-02-23T12:45:45.105 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:45.105 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 86 k 2026-02-23T12:45:45.105 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 236 k 2026-02-23T12:45:45.105 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-23T12:45:45.596 INFO:teuthology.orchestra.run.trial046.stdout:rbd-fuse-20.3.0-5439.ge371433f.el9.x86_64.rpm 176 kB/s | 86 kB 00:00 2026-02-23T12:45:45.597 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-23T12:45:45.597 INFO:teuthology.orchestra.run.trial046.stdout:Total 176 kB/s | 86 kB 00:00 2026-02-23T12:45:45.597 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-23T12:45:45.601 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-23T12:45:45.601 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-23T12:45:45.633 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-23T12:45:45.633 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-23T12:45:45.684 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-23T12:45:45.700 INFO:teuthology.orchestra.run.trial046.stdout: Installing : rbd-fuse-2:20.3.0-5439.ge371433f.el9.x86_64 1/1 2026-02-23T12:45:45.777 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5439.ge371433f.el9.x86_64 1/1 2026-02-23T12:45:45.837 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : rbd-fuse-2:20.3.0-5439.ge371433f.el9.x86_64 1/1 2026-02-23T12:45:45.837 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:45.838 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-23T12:45:45.838 INFO:teuthology.orchestra.run.trial046.stdout: rbd-fuse-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:45:45.838 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:45.838 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-23T12:45:45.864 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install rbd-mirror 2026-02-23T12:45:46.179 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:09:33 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:45:46.262 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-23T12:45:46.262 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:45:46.262 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repo Size 2026-02-23T12:45:46.262 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:45:46.263 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-23T12:45:46.263 INFO:teuthology.orchestra.run.trial046.stdout: rbd-mirror x86_64 2:20.3.0-5439.ge371433f.el9 ceph 2.6 M 2026-02-23T12:45:46.263 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:46.263 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-23T12:45:46.263 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:45:46.263 INFO:teuthology.orchestra.run.trial046.stdout:Install 1 Package 2026-02-23T12:45:46.263 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:46.263 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 2.6 M 2026-02-23T12:45:46.263 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 11 M 2026-02-23T12:45:46.263 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-23T12:45:51.426 INFO:teuthology.orchestra.run.trial046.stdout:rbd-mirror-20.3.0-5439.ge371433f.el9.x86_64.rpm 514 kB/s | 2.6 MB 00:05 2026-02-23T12:45:51.426 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-23T12:45:51.427 INFO:teuthology.orchestra.run.trial046.stdout:Total 514 kB/s | 2.6 MB 00:05 2026-02-23T12:45:51.427 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-23T12:45:51.432 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-23T12:45:51.432 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-23T12:45:51.470 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-23T12:45:51.470 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-23T12:45:51.634 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-23T12:45:51.636 INFO:teuthology.orchestra.run.trial046.stdout: Installing : rbd-mirror-2:20.3.0-5439.ge371433f.el9.x86_64 1/1 2026-02-23T12:45:51.659 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5439.ge371433f.el9.x86_64 1/1 2026-02-23T12:45:51.659 INFO:teuthology.orchestra.run.trial046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T12:45:51.659 INFO:teuthology.orchestra.run.trial046.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-23T12:45:51.659 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-23T12:45:51.659 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-23T12:45:51.659 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:51.947 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : rbd-mirror-2:20.3.0-5439.ge371433f.el9.x86_64 1/1 2026-02-23T12:45:51.948 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:51.948 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-23T12:45:51.948 INFO:teuthology.orchestra.run.trial046.stdout: rbd-mirror-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:45:51.948 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:51.948 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-23T12:45:51.976 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install rbd-nbd 2026-02-23T12:45:52.289 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:09:39 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:45:52.374 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-23T12:45:52.374 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:45:52.374 INFO:teuthology.orchestra.run.trial046.stdout: Package Architecture Version Repository Size 2026-02-23T12:45:52.374 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:45:52.374 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-23T12:45:52.375 INFO:teuthology.orchestra.run.trial046.stdout: rbd-nbd x86_64 2:20.3.0-5439.ge371433f.el9 ceph 166 k 2026-02-23T12:45:52.375 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:52.375 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-23T12:45:52.375 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:45:52.375 INFO:teuthology.orchestra.run.trial046.stdout:Install 1 Package 2026-02-23T12:45:52.375 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:52.375 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 166 k 2026-02-23T12:45:52.375 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 496 k 2026-02-23T12:45:52.375 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-23T12:45:53.270 INFO:teuthology.orchestra.run.trial046.stdout:rbd-nbd-20.3.0-5439.ge371433f.el9.x86_64.rpm 186 kB/s | 166 kB 00:00 2026-02-23T12:45:53.270 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-23T12:45:53.271 INFO:teuthology.orchestra.run.trial046.stdout:Total 186 kB/s | 166 kB 00:00 2026-02-23T12:45:53.271 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-23T12:45:53.275 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-23T12:45:53.275 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-23T12:45:53.307 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-23T12:45:53.307 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-23T12:45:53.362 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-23T12:45:53.379 INFO:teuthology.orchestra.run.trial046.stdout: Installing : rbd-nbd-2:20.3.0-5439.ge371433f.el9.x86_64 1/1 2026-02-23T12:45:53.465 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5439.ge371433f.el9.x86_64 1/1 2026-02-23T12:45:53.524 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : rbd-nbd-2:20.3.0-5439.ge371433f.el9.x86_64 1/1 2026-02-23T12:45:53.524 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:53.524 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-23T12:45:53.524 INFO:teuthology.orchestra.run.trial046.stdout: rbd-nbd-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:45:53.524 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:53.525 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-23T12:45:53.553 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-osd-crimson 2026-02-23T12:45:53.861 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:09:40 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:45:53.926 INFO:teuthology.orchestra.run.trial046.stdout:Package ceph-osd-crimson-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T12:45:53.944 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-23T12:45:53.945 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-23T12:45:53.945 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-23T12:45:53.967 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-osd-crimson-debuginfo 2026-02-23T12:45:54.234 INFO:teuthology.orchestra.run.trial131.stdout:(12/12): ceph-mgr-diskprediction-local-20.3.0-5 435 kB/s | 7.4 MB 00:17 2026-02-23T12:45:54.235 INFO:teuthology.orchestra.run.trial131.stdout:-------------------------------------------------------------------------------- 2026-02-23T12:45:54.235 INFO:teuthology.orchestra.run.trial131.stdout:Total 2.4 MB/s | 43 MB 00:17 2026-02-23T12:45:54.274 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:09:41 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:45:54.358 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-23T12:45:54.358 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:45:54.358 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repo Size 2026-02-23T12:45:54.358 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:45:54.358 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-23T12:45:54.358 INFO:teuthology.orchestra.run.trial046.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5439.ge371433f.el9 ceph 429 M 2026-02-23T12:45:54.359 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:54.359 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-23T12:45:54.359 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-23T12:45:54.359 INFO:teuthology.orchestra.run.trial046.stdout:Install 1 Package 2026-02-23T12:45:54.359 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:45:54.359 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 429 M 2026-02-23T12:45:54.359 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 2.6 G 2026-02-23T12:45:54.359 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-23T12:45:54.387 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction check 2026-02-23T12:45:54.400 INFO:teuthology.orchestra.run.trial131.stdout:Transaction check succeeded. 2026-02-23T12:45:54.401 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction test 2026-02-23T12:45:54.601 INFO:teuthology.orchestra.run.trial131.stdout:Transaction test succeeded. 2026-02-23T12:45:54.601 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction 2026-02-23T12:45:54.816 INFO:teuthology.orchestra.run.trial131.stdout: Preparing : 1/1 2026-02-23T12:45:54.818 INFO:teuthology.orchestra.run.trial131.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 1/12 2026-02-23T12:45:54.825 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 2/12 2026-02-23T12:45:54.858 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 3/12 2026-02-23T12:45:54.862 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 4/12 2026-02-23T12:45:54.921 INFO:teuthology.orchestra.run.trial131.stdout: Installing : openblas-0.3.29-1.el9.x86_64 5/12 2026-02-23T12:45:54.923 INFO:teuthology.orchestra.run.trial131.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 6/12 2026-02-23T12:45:54.944 INFO:teuthology.orchestra.run.trial131.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 7/12 2026-02-23T12:45:55.263 INFO:teuthology.orchestra.run.trial131.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 8/12 2026-02-23T12:45:55.334 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 9/12 2026-02-23T12:45:55.993 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 10/12 2026-02-23T12:45:56.447 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 11/12 2026-02-23T12:45:56.448 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5439.ge3714 12/12 2026-02-23T12:45:56.733 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5439.ge3714 12/12 2026-02-23T12:45:56.734 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5439.ge3714 1/12 2026-02-23T12:45:56.734 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 2/12 2026-02-23T12:45:56.734 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 3/12 2026-02-23T12:45:56.734 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 4/12 2026-02-23T12:45:56.734 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 5/12 2026-02-23T12:45:56.734 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 6/12 2026-02-23T12:45:56.734 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 7/12 2026-02-23T12:45:56.735 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 8/12 2026-02-23T12:45:56.735 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 9/12 2026-02-23T12:45:56.735 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 10/12 2026-02-23T12:45:56.735 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 11/12 2026-02-23T12:45:56.792 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 12/12 2026-02-23T12:45:56.793 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:45:56.793 INFO:teuthology.orchestra.run.trial131.stdout:Installed: 2026-02-23T12:45:56.793 INFO:teuthology.orchestra.run.trial131.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5439.ge371433f.el9.noarch 2026-02-23T12:45:56.793 INFO:teuthology.orchestra.run.trial131.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-23T12:45:56.793 INFO:teuthology.orchestra.run.trial131.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-23T12:45:56.793 INFO:teuthology.orchestra.run.trial131.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-23T12:45:56.793 INFO:teuthology.orchestra.run.trial131.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-23T12:45:56.793 INFO:teuthology.orchestra.run.trial131.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-23T12:45:56.793 INFO:teuthology.orchestra.run.trial131.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-23T12:45:56.793 INFO:teuthology.orchestra.run.trial131.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-23T12:45:56.794 INFO:teuthology.orchestra.run.trial131.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-23T12:45:56.794 INFO:teuthology.orchestra.run.trial131.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-23T12:45:56.794 INFO:teuthology.orchestra.run.trial131.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-23T12:45:56.794 INFO:teuthology.orchestra.run.trial131.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-23T12:45:56.794 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:45:56.794 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-23T12:45:56.830 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-mgr-rook 2026-02-23T12:45:57.137 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:09:44 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:45:57.221 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-23T12:45:57.222 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:45:57.222 INFO:teuthology.orchestra.run.trial131.stdout: Package Arch Version Repository Size 2026-02-23T12:45:57.222 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:45:57.223 INFO:teuthology.orchestra.run.trial131.stdout:Installing: 2026-02-23T12:45:57.223 INFO:teuthology.orchestra.run.trial131.stdout: ceph-mgr-rook noarch 2:20.3.0-5439.ge371433f.el9 ceph-noarch 50 k 2026-02-23T12:45:57.223 INFO:teuthology.orchestra.run.trial131.stdout:Installing dependencies: 2026-02-23T12:45:57.223 INFO:teuthology.orchestra.run.trial131.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-23T12:45:57.223 INFO:teuthology.orchestra.run.trial131.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-23T12:45:57.223 INFO:teuthology.orchestra.run.trial131.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-23T12:45:57.223 INFO:teuthology.orchestra.run.trial131.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-23T12:45:57.223 INFO:teuthology.orchestra.run.trial131.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-23T12:45:57.223 INFO:teuthology.orchestra.run.trial131.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-23T12:45:57.223 INFO:teuthology.orchestra.run.trial131.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-23T12:45:57.223 INFO:teuthology.orchestra.run.trial131.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-23T12:45:57.224 INFO:teuthology.orchestra.run.trial131.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-23T12:45:57.224 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:45:57.224 INFO:teuthology.orchestra.run.trial131.stdout:Transaction Summary 2026-02-23T12:45:57.224 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:45:57.224 INFO:teuthology.orchestra.run.trial131.stdout:Install 10 Packages 2026-02-23T12:45:57.224 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:45:57.224 INFO:teuthology.orchestra.run.trial131.stdout:Total download size: 2.0 M 2026-02-23T12:45:57.224 INFO:teuthology.orchestra.run.trial131.stdout:Installed size: 25 M 2026-02-23T12:45:57.224 INFO:teuthology.orchestra.run.trial131.stdout:Downloading Packages: 2026-02-23T12:45:57.406 INFO:teuthology.orchestra.run.trial131.stdout:(1/10): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.3 MB/s | 159 kB 00:00 2026-02-23T12:45:57.413 INFO:teuthology.orchestra.run.trial131.stdout:(2/10): python3-pyasn1-modules-0.4.8-6.el9.noar 5.1 MB/s | 279 kB 00:00 2026-02-23T12:45:57.416 INFO:teuthology.orchestra.run.trial131.stdout:(3/10): python3-requests-oauthlib-1.3.0-12.el9. 5.2 MB/s | 54 kB 00:00 2026-02-23T12:45:57.454 INFO:teuthology.orchestra.run.trial131.stdout:(4/10): python3-certifi-2023.05.07-4.el9.noarch 368 kB/s | 14 kB 00:00 2026-02-23T12:45:57.458 INFO:teuthology.orchestra.run.trial131.stdout:(5/10): python3-cachetools-4.2.4-1.el9.noarch.r 710 kB/s | 32 kB 00:00 2026-02-23T12:45:57.497 INFO:teuthology.orchestra.run.trial131.stdout:(6/10): python3-google-auth-2.45.0-1.el9.noarch 5.8 MB/s | 254 kB 00:00 2026-02-23T12:45:57.508 INFO:teuthology.orchestra.run.trial131.stdout:(7/10): python3-rsa-4.9-2.el9.noarch.rpm 5.2 MB/s | 59 kB 00:00 2026-02-23T12:45:57.516 INFO:teuthology.orchestra.run.trial131.stdout:(8/10): python3-kubernetes-26.1.0-3.el9.noarch. 18 MB/s | 1.0 MB 00:00 2026-02-23T12:45:57.520 INFO:teuthology.orchestra.run.trial131.stdout:(9/10): python3-websocket-client-1.2.3-2.el9.no 7.4 MB/s | 90 kB 00:00 2026-02-23T12:45:57.921 INFO:teuthology.orchestra.run.trial131.stdout:(10/10): ceph-mgr-rook-20.3.0-5439.ge371433f.el 89 kB/s | 50 kB 00:00 2026-02-23T12:45:57.923 INFO:teuthology.orchestra.run.trial131.stdout:-------------------------------------------------------------------------------- 2026-02-23T12:45:57.923 INFO:teuthology.orchestra.run.trial131.stdout:Total 2.8 MB/s | 2.0 MB 00:00 2026-02-23T12:45:57.949 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction check 2026-02-23T12:45:57.956 INFO:teuthology.orchestra.run.trial131.stdout:Transaction check succeeded. 2026-02-23T12:45:57.956 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction test 2026-02-23T12:45:57.995 INFO:teuthology.orchestra.run.trial131.stdout:Transaction test succeeded. 2026-02-23T12:45:57.995 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction 2026-02-23T12:45:58.070 INFO:teuthology.orchestra.run.trial131.stdout: Preparing : 1/1 2026-02-23T12:45:58.121 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/10 2026-02-23T12:45:58.133 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/10 2026-02-23T12:45:58.148 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/10 2026-02-23T12:45:58.153 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/10 2026-02-23T12:45:58.160 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/10 2026-02-23T12:45:58.199 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/10 2026-02-23T12:45:58.211 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-23T12:45:58.531 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 8/10 2026-02-23T12:45:58.546 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 9/10 2026-02-23T12:45:58.547 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-mgr-rook-2:20.3.0-5439.ge371433f.el9.noarch 10/10 2026-02-23T12:45:58.652 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5439.ge371433f.el9.noarch 10/10 2026-02-23T12:45:58.652 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5439.ge371433f.el9.noarch 1/10 2026-02-23T12:45:58.653 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 2/10 2026-02-23T12:45:58.653 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 3/10 2026-02-23T12:45:58.653 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 4/10 2026-02-23T12:45:58.653 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 5/10 2026-02-23T12:45:58.653 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 6/10 2026-02-23T12:45:58.653 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-23T12:45:58.653 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 8/10 2026-02-23T12:45:58.653 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 9/10 2026-02-23T12:45:58.708 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 10/10 2026-02-23T12:45:58.708 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:45:58.708 INFO:teuthology.orchestra.run.trial131.stdout:Installed: 2026-02-23T12:45:58.708 INFO:teuthology.orchestra.run.trial131.stdout: ceph-mgr-rook-2:20.3.0-5439.ge371433f.el9.noarch 2026-02-23T12:45:58.708 INFO:teuthology.orchestra.run.trial131.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-23T12:45:58.708 INFO:teuthology.orchestra.run.trial131.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-23T12:45:58.708 INFO:teuthology.orchestra.run.trial131.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-23T12:45:58.708 INFO:teuthology.orchestra.run.trial131.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-23T12:45:58.708 INFO:teuthology.orchestra.run.trial131.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-23T12:45:58.708 INFO:teuthology.orchestra.run.trial131.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-23T12:45:58.708 INFO:teuthology.orchestra.run.trial131.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-23T12:45:58.708 INFO:teuthology.orchestra.run.trial131.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-23T12:45:58.708 INFO:teuthology.orchestra.run.trial131.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-23T12:45:58.708 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:45:58.709 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-23T12:45:58.738 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-mgr-cephadm 2026-02-23T12:45:59.046 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:09:46 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:45:59.130 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-23T12:45:59.131 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:45:59.131 INFO:teuthology.orchestra.run.trial131.stdout: Package Arch Version Repository Size 2026-02-23T12:45:59.131 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:45:59.131 INFO:teuthology.orchestra.run.trial131.stdout:Installing: 2026-02-23T12:45:59.131 INFO:teuthology.orchestra.run.trial131.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5439.ge371433f.el9 ceph-noarch 184 k 2026-02-23T12:45:59.131 INFO:teuthology.orchestra.run.trial131.stdout:Installing dependencies: 2026-02-23T12:45:59.131 INFO:teuthology.orchestra.run.trial131.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-23T12:45:59.132 INFO:teuthology.orchestra.run.trial131.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-23T12:45:59.132 INFO:teuthology.orchestra.run.trial131.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-23T12:45:59.132 INFO:teuthology.orchestra.run.trial131.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-23T12:45:59.132 INFO:teuthology.orchestra.run.trial131.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-23T12:45:59.132 INFO:teuthology.orchestra.run.trial131.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-23T12:45:59.132 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:45:59.132 INFO:teuthology.orchestra.run.trial131.stdout:Transaction Summary 2026-02-23T12:45:59.132 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:45:59.132 INFO:teuthology.orchestra.run.trial131.stdout:Install 7 Packages 2026-02-23T12:45:59.132 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:45:59.132 INFO:teuthology.orchestra.run.trial131.stdout:Total download size: 7.1 M 2026-02-23T12:45:59.132 INFO:teuthology.orchestra.run.trial131.stdout:Installed size: 34 M 2026-02-23T12:45:59.133 INFO:teuthology.orchestra.run.trial131.stdout:Downloading Packages: 2026-02-23T12:45:59.413 INFO:teuthology.orchestra.run.trial131.stdout:(1/7): python3-jinja2-2.11.3-8.el9.noarch.rpm 4.4 MB/s | 249 kB 00:00 2026-02-23T12:45:59.422 INFO:teuthology.orchestra.run.trial131.stdout:(2/7): python3-markupsafe-1.1.1-12.el9.x86_64.r 3.5 MB/s | 35 kB 00:00 2026-02-23T12:45:59.450 INFO:teuthology.orchestra.run.trial131.stdout:(3/7): python3-babel-2.9.1-2.el9.noarch.rpm 64 MB/s | 6.0 MB 00:00 2026-02-23T12:45:59.735 INFO:teuthology.orchestra.run.trial131.stdout:(4/7): python3-natsort-7.1.1-5.el9.noarch.rpm 202 kB/s | 58 kB 00:00 2026-02-23T12:45:59.926 INFO:teuthology.orchestra.run.trial131.stdout:(5/7): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.1 MB/s | 548 kB 00:00 2026-02-23T12:46:00.018 INFO:teuthology.orchestra.run.trial131.stdout:(6/7): python3-typing-extensions-4.15.0-1.el9.n 306 kB/s | 86 kB 00:00 2026-02-23T12:46:00.265 INFO:teuthology.orchestra.run.trial131.stdout:(7/7): ceph-mgr-cephadm-20.3.0-5439.ge371433f.e 203 kB/s | 184 kB 00:00 2026-02-23T12:46:00.267 INFO:teuthology.orchestra.run.trial131.stdout:-------------------------------------------------------------------------------- 2026-02-23T12:46:00.268 INFO:teuthology.orchestra.run.trial131.stdout:Total 6.2 MB/s | 7.1 MB 00:01 2026-02-23T12:46:00.307 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction check 2026-02-23T12:46:00.314 INFO:teuthology.orchestra.run.trial131.stdout:Transaction check succeeded. 2026-02-23T12:46:00.314 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction test 2026-02-23T12:46:00.385 INFO:teuthology.orchestra.run.trial131.stdout:Transaction test succeeded. 2026-02-23T12:46:00.385 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction 2026-02-23T12:46:00.477 INFO:teuthology.orchestra.run.trial131.stdout: Preparing : 1/1 2026-02-23T12:46:00.526 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 1/7 2026-02-23T12:46:00.536 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/7 2026-02-23T12:46:00.542 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/7 2026-02-23T12:46:00.762 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-23T12:46:00.785 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 5/7 2026-02-23T12:46:00.810 INFO:teuthology.orchestra.run.trial131.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 6/7 2026-02-23T12:46:00.811 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5439.ge371433f.el9.noarch 7/7 2026-02-23T12:46:00.918 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5439.ge371433f.el9.noarch 7/7 2026-02-23T12:46:00.918 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5439.ge371433f.el9.noarch 1/7 2026-02-23T12:46:00.918 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/7 2026-02-23T12:46:00.918 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 3/7 2026-02-23T12:46:00.918 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-23T12:46:00.919 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 5/7 2026-02-23T12:46:00.919 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 6/7 2026-02-23T12:46:00.974 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 7/7 2026-02-23T12:46:00.975 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:46:00.975 INFO:teuthology.orchestra.run.trial131.stdout:Installed: 2026-02-23T12:46:00.975 INFO:teuthology.orchestra.run.trial131.stdout: ceph-mgr-cephadm-2:20.3.0-5439.ge371433f.el9.noarch 2026-02-23T12:46:00.975 INFO:teuthology.orchestra.run.trial131.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-23T12:46:00.975 INFO:teuthology.orchestra.run.trial131.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-23T12:46:00.975 INFO:teuthology.orchestra.run.trial131.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-23T12:46:00.975 INFO:teuthology.orchestra.run.trial131.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-23T12:46:00.975 INFO:teuthology.orchestra.run.trial131.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-23T12:46:00.975 INFO:teuthology.orchestra.run.trial131.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-23T12:46:00.975 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:46:00.976 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-23T12:46:01.006 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-osd 2026-02-23T12:46:01.315 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:09:48 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:46:01.381 INFO:teuthology.orchestra.run.trial131.stdout:Package ceph-osd-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T12:46:01.399 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-23T12:46:01.400 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-23T12:46:01.400 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-23T12:46:01.423 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-osd-classic 2026-02-23T12:46:01.727 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:09:48 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:46:01.792 INFO:teuthology.orchestra.run.trial131.stdout:Package ceph-osd-classic-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T12:46:01.810 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-23T12:46:01.810 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-23T12:46:01.811 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-23T12:46:01.831 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-fuse 2026-02-23T12:46:02.137 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:09:49 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:46:02.220 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-23T12:46:02.221 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:46:02.221 INFO:teuthology.orchestra.run.trial131.stdout: Package Arch Version Repo Size 2026-02-23T12:46:02.221 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:46:02.221 INFO:teuthology.orchestra.run.trial131.stdout:Installing: 2026-02-23T12:46:02.221 INFO:teuthology.orchestra.run.trial131.stdout: ceph-fuse x86_64 2:20.3.0-5439.ge371433f.el9 ceph 914 k 2026-02-23T12:46:02.221 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:46:02.221 INFO:teuthology.orchestra.run.trial131.stdout:Transaction Summary 2026-02-23T12:46:02.221 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:46:02.222 INFO:teuthology.orchestra.run.trial131.stdout:Install 1 Package 2026-02-23T12:46:02.222 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:46:02.222 INFO:teuthology.orchestra.run.trial131.stdout:Total download size: 914 k 2026-02-23T12:46:02.222 INFO:teuthology.orchestra.run.trial131.stdout:Installed size: 2.9 M 2026-02-23T12:46:02.222 INFO:teuthology.orchestra.run.trial131.stdout:Downloading Packages: 2026-02-23T12:46:03.872 INFO:teuthology.orchestra.run.trial131.stdout:ceph-fuse-20.3.0-5439.ge371433f.el9.x86_64.rpm 554 kB/s | 914 kB 00:01 2026-02-23T12:46:03.873 INFO:teuthology.orchestra.run.trial131.stdout:-------------------------------------------------------------------------------- 2026-02-23T12:46:03.873 INFO:teuthology.orchestra.run.trial131.stdout:Total 553 kB/s | 914 kB 00:01 2026-02-23T12:46:03.873 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction check 2026-02-23T12:46:03.878 INFO:teuthology.orchestra.run.trial131.stdout:Transaction check succeeded. 2026-02-23T12:46:03.878 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction test 2026-02-23T12:46:03.911 INFO:teuthology.orchestra.run.trial131.stdout:Transaction test succeeded. 2026-02-23T12:46:03.912 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction 2026-02-23T12:46:04.003 INFO:teuthology.orchestra.run.trial131.stdout: Preparing : 1/1 2026-02-23T12:46:04.020 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-fuse-2:20.3.0-5439.ge371433f.el9.x86_64 1/1 2026-02-23T12:46:04.236 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5439.ge371433f.el9.x86_64 1/1 2026-02-23T12:46:04.292 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-fuse-2:20.3.0-5439.ge371433f.el9.x86_64 1/1 2026-02-23T12:46:04.292 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:46:04.293 INFO:teuthology.orchestra.run.trial131.stdout:Installed: 2026-02-23T12:46:04.293 INFO:teuthology.orchestra.run.trial131.stdout: ceph-fuse-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:46:04.293 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:46:04.293 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-23T12:46:04.321 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-volume 2026-02-23T12:46:04.637 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:09:51 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:46:04.719 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-23T12:46:04.720 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:46:04.720 INFO:teuthology.orchestra.run.trial131.stdout: Package Arch Version Repository Size 2026-02-23T12:46:04.720 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:46:04.720 INFO:teuthology.orchestra.run.trial131.stdout:Installing: 2026-02-23T12:46:04.721 INFO:teuthology.orchestra.run.trial131.stdout: ceph-volume noarch 2:20.3.0-5439.ge371433f.el9 ceph-noarch 301 k 2026-02-23T12:46:04.721 INFO:teuthology.orchestra.run.trial131.stdout:Installing dependencies: 2026-02-23T12:46:04.721 INFO:teuthology.orchestra.run.trial131.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-23T12:46:04.721 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:46:04.721 INFO:teuthology.orchestra.run.trial131.stdout:Transaction Summary 2026-02-23T12:46:04.721 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:46:04.721 INFO:teuthology.orchestra.run.trial131.stdout:Install 2 Packages 2026-02-23T12:46:04.721 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:46:04.721 INFO:teuthology.orchestra.run.trial131.stdout:Total download size: 652 k 2026-02-23T12:46:04.721 INFO:teuthology.orchestra.run.trial131.stdout:Installed size: 2.2 M 2026-02-23T12:46:04.722 INFO:teuthology.orchestra.run.trial131.stdout:Downloading Packages: 2026-02-23T12:46:05.622 INFO:teuthology.orchestra.run.trial131.stdout:(1/2): cryptsetup-2.8.1-3.el9.x86_64.rpm 418 kB/s | 351 kB 00:00 2026-02-23T12:46:06.102 INFO:teuthology.orchestra.run.trial131.stdout:(2/2): ceph-volume-20.3.0-5439.ge371433f.el9.no 228 kB/s | 301 kB 00:01 2026-02-23T12:46:06.102 INFO:teuthology.orchestra.run.trial131.stdout:-------------------------------------------------------------------------------- 2026-02-23T12:46:06.102 INFO:teuthology.orchestra.run.trial131.stdout:Total 472 kB/s | 652 kB 00:01 2026-02-23T12:46:06.113 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction check 2026-02-23T12:46:06.120 INFO:teuthology.orchestra.run.trial131.stdout:Transaction check succeeded. 2026-02-23T12:46:06.120 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction test 2026-02-23T12:46:06.164 INFO:teuthology.orchestra.run.trial131.stdout:Transaction test succeeded. 2026-02-23T12:46:06.164 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction 2026-02-23T12:46:06.243 INFO:teuthology.orchestra.run.trial131.stdout: Preparing : 1/1 2026-02-23T12:46:06.307 INFO:teuthology.orchestra.run.trial131.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 1/2 2026-02-23T12:46:06.309 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-volume-2:20.3.0-5439.ge371433f.el9.noarch 2/2 2026-02-23T12:46:06.325 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-volume-2:20.3.0-5439.ge371433f.el9.noarch 2/2 2026-02-23T12:46:06.326 INFO:teuthology.orchestra.run.trial131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T12:46:06.326 INFO:teuthology.orchestra.run.trial131.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-23T12:46:06.326 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:46:06.556 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-volume-2:20.3.0-5439.ge371433f.el9.noarch 1/2 2026-02-23T12:46:06.614 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 2/2 2026-02-23T12:46:06.615 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:46:06.615 INFO:teuthology.orchestra.run.trial131.stdout:Installed: 2026-02-23T12:46:06.615 INFO:teuthology.orchestra.run.trial131.stdout: ceph-volume-2:20.3.0-5439.ge371433f.el9.noarch cryptsetup-2.8.1-3.el9.x86_64 2026-02-23T12:46:06.615 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:46:06.615 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-23T12:46:06.643 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install librados-devel 2026-02-23T12:46:06.951 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:09:53 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:46:07.034 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-23T12:46:07.035 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:46:07.035 INFO:teuthology.orchestra.run.trial131.stdout: Package Arch Version Repo Size 2026-02-23T12:46:07.035 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:46:07.035 INFO:teuthology.orchestra.run.trial131.stdout:Installing: 2026-02-23T12:46:07.035 INFO:teuthology.orchestra.run.trial131.stdout: librados-devel x86_64 2:20.3.0-5439.ge371433f.el9 ceph 124 k 2026-02-23T12:46:07.035 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:46:07.035 INFO:teuthology.orchestra.run.trial131.stdout:Transaction Summary 2026-02-23T12:46:07.035 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:46:07.036 INFO:teuthology.orchestra.run.trial131.stdout:Install 1 Package 2026-02-23T12:46:07.036 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:46:07.036 INFO:teuthology.orchestra.run.trial131.stdout:Total download size: 124 k 2026-02-23T12:46:07.036 INFO:teuthology.orchestra.run.trial131.stdout:Installed size: 434 k 2026-02-23T12:46:07.036 INFO:teuthology.orchestra.run.trial131.stdout:Downloading Packages: 2026-02-23T12:46:07.646 INFO:teuthology.orchestra.run.trial131.stdout:librados-devel-20.3.0-5439.ge371433f.el9.x86_64 202 kB/s | 124 kB 00:00 2026-02-23T12:46:07.647 INFO:teuthology.orchestra.run.trial131.stdout:-------------------------------------------------------------------------------- 2026-02-23T12:46:07.647 INFO:teuthology.orchestra.run.trial131.stdout:Total 202 kB/s | 124 kB 00:00 2026-02-23T12:46:07.647 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction check 2026-02-23T12:46:07.649 INFO:teuthology.orchestra.run.trial131.stdout:Transaction check succeeded. 2026-02-23T12:46:07.650 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction test 2026-02-23T12:46:07.680 INFO:teuthology.orchestra.run.trial131.stdout:Transaction test succeeded. 2026-02-23T12:46:07.680 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction 2026-02-23T12:46:07.733 INFO:teuthology.orchestra.run.trial131.stdout: Preparing : 1/1 2026-02-23T12:46:07.750 INFO:teuthology.orchestra.run.trial131.stdout: Installing : librados-devel-2:20.3.0-5439.ge371433f.el9.x86_64 1/1 2026-02-23T12:46:07.832 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: librados-devel-2:20.3.0-5439.ge371433f.el9.x86_64 1/1 2026-02-23T12:46:07.889 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : librados-devel-2:20.3.0-5439.ge371433f.el9.x86_64 1/1 2026-02-23T12:46:07.889 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:46:07.889 INFO:teuthology.orchestra.run.trial131.stdout:Installed: 2026-02-23T12:46:07.889 INFO:teuthology.orchestra.run.trial131.stdout: librados-devel-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:46:07.889 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:46:07.889 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-23T12:46:07.918 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install libcephfs2 2026-02-23T12:46:08.226 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:09:55 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:46:08.291 INFO:teuthology.orchestra.run.trial131.stdout:Package libcephfs2-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T12:46:08.309 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-23T12:46:08.310 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-23T12:46:08.310 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-23T12:46:08.331 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install libcephfs-devel 2026-02-23T12:46:08.641 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:09:55 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:46:08.726 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-23T12:46:08.726 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:46:08.726 INFO:teuthology.orchestra.run.trial131.stdout: Package Arch Version Repo Size 2026-02-23T12:46:08.726 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:46:08.726 INFO:teuthology.orchestra.run.trial131.stdout:Installing: 2026-02-23T12:46:08.727 INFO:teuthology.orchestra.run.trial131.stdout: libcephfs-devel x86_64 2:20.3.0-5439.ge371433f.el9 ceph 37 k 2026-02-23T12:46:08.727 INFO:teuthology.orchestra.run.trial131.stdout:Installing dependencies: 2026-02-23T12:46:08.727 INFO:teuthology.orchestra.run.trial131.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5439.ge371433f.el9 ceph 26 k 2026-02-23T12:46:08.727 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:46:08.727 INFO:teuthology.orchestra.run.trial131.stdout:Transaction Summary 2026-02-23T12:46:08.727 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:46:08.727 INFO:teuthology.orchestra.run.trial131.stdout:Install 2 Packages 2026-02-23T12:46:08.727 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:46:08.727 INFO:teuthology.orchestra.run.trial131.stdout:Total download size: 64 k 2026-02-23T12:46:08.727 INFO:teuthology.orchestra.run.trial131.stdout:Installed size: 231 k 2026-02-23T12:46:08.728 INFO:teuthology.orchestra.run.trial131.stdout:Downloading Packages: 2026-02-23T12:46:09.079 INFO:teuthology.orchestra.run.trial131.stdout:(1/2): libcephfs-proxy2-20.3.0-5439.ge371433f.e 75 kB/s | 26 kB 00:00 2026-02-23T12:46:09.217 INFO:teuthology.orchestra.run.trial131.stdout:(2/2): libcephfs-devel-20.3.0-5439.ge371433f.el 76 kB/s | 37 kB 00:00 2026-02-23T12:46:09.218 INFO:teuthology.orchestra.run.trial131.stdout:-------------------------------------------------------------------------------- 2026-02-23T12:46:09.218 INFO:teuthology.orchestra.run.trial131.stdout:Total 129 kB/s | 64 kB 00:00 2026-02-23T12:46:09.219 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction check 2026-02-23T12:46:09.221 INFO:teuthology.orchestra.run.trial131.stdout:Transaction check succeeded. 2026-02-23T12:46:09.221 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction test 2026-02-23T12:46:09.253 INFO:teuthology.orchestra.run.trial131.stdout:Transaction test succeeded. 2026-02-23T12:46:09.253 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction 2026-02-23T12:46:09.301 INFO:teuthology.orchestra.run.trial131.stdout: Preparing : 1/1 2026-02-23T12:46:09.302 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libcephfs-proxy2-2:20.3.0-5439.ge371433f.el9.x86_64 1/2 2026-02-23T12:46:09.317 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5439.ge371433f.el9.x86_64 1/2 2026-02-23T12:46:09.333 INFO:teuthology.orchestra.run.trial131.stdout: Installing : libcephfs-devel-2:20.3.0-5439.ge371433f.el9.x86_64 2/2 2026-02-23T12:46:09.387 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5439.ge371433f.el9.x86_64 2/2 2026-02-23T12:46:09.387 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libcephfs-devel-2:20.3.0-5439.ge371433f.el9.x86_64 1/2 2026-02-23T12:46:09.443 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5439.ge371433f.el9.x86_64 2/2 2026-02-23T12:46:09.444 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:46:09.444 INFO:teuthology.orchestra.run.trial131.stdout:Installed: 2026-02-23T12:46:09.444 INFO:teuthology.orchestra.run.trial131.stdout: libcephfs-devel-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:46:09.444 INFO:teuthology.orchestra.run.trial131.stdout: libcephfs-proxy2-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:46:09.444 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:46:09.444 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-23T12:46:09.472 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install librados2 2026-02-23T12:46:09.782 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:09:56 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:46:09.848 INFO:teuthology.orchestra.run.trial131.stdout:Package librados2-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T12:46:09.866 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-23T12:46:09.867 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-23T12:46:09.867 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-23T12:46:09.888 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install librbd1 2026-02-23T12:46:10.197 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:09:57 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:46:10.262 INFO:teuthology.orchestra.run.trial131.stdout:Package librbd1-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T12:46:10.281 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-23T12:46:10.282 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-23T12:46:10.282 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-23T12:46:10.303 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install python3-rados 2026-02-23T12:46:10.619 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:09:57 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:46:10.684 INFO:teuthology.orchestra.run.trial131.stdout:Package python3-rados-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T12:46:10.703 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-23T12:46:10.703 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-23T12:46:10.703 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-23T12:46:10.724 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install python3-rgw 2026-02-23T12:46:11.029 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:09:58 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:46:11.093 INFO:teuthology.orchestra.run.trial131.stdout:Package python3-rgw-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T12:46:11.111 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-23T12:46:11.112 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-23T12:46:11.112 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-23T12:46:11.133 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install python3-cephfs 2026-02-23T12:46:11.437 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:09:58 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:46:11.501 INFO:teuthology.orchestra.run.trial131.stdout:Package python3-cephfs-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T12:46:11.520 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-23T12:46:11.520 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-23T12:46:11.520 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-23T12:46:11.541 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install python3-rbd 2026-02-23T12:46:11.848 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:09:58 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:46:11.913 INFO:teuthology.orchestra.run.trial131.stdout:Package python3-rbd-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T12:46:11.932 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-23T12:46:11.932 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-23T12:46:11.933 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-23T12:46:11.954 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install rbd-fuse 2026-02-23T12:46:12.263 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:09:59 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:46:12.347 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-23T12:46:12.347 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:46:12.348 INFO:teuthology.orchestra.run.trial131.stdout: Package Architecture Version Repository Size 2026-02-23T12:46:12.348 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:46:12.348 INFO:teuthology.orchestra.run.trial131.stdout:Installing: 2026-02-23T12:46:12.348 INFO:teuthology.orchestra.run.trial131.stdout: rbd-fuse x86_64 2:20.3.0-5439.ge371433f.el9 ceph 86 k 2026-02-23T12:46:12.348 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:46:12.348 INFO:teuthology.orchestra.run.trial131.stdout:Transaction Summary 2026-02-23T12:46:12.348 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:46:12.348 INFO:teuthology.orchestra.run.trial131.stdout:Install 1 Package 2026-02-23T12:46:12.348 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:46:12.348 INFO:teuthology.orchestra.run.trial131.stdout:Total download size: 86 k 2026-02-23T12:46:12.349 INFO:teuthology.orchestra.run.trial131.stdout:Installed size: 236 k 2026-02-23T12:46:12.349 INFO:teuthology.orchestra.run.trial131.stdout:Downloading Packages: 2026-02-23T12:46:13.120 INFO:teuthology.orchestra.run.trial131.stdout:rbd-fuse-20.3.0-5439.ge371433f.el9.x86_64.rpm 112 kB/s | 86 kB 00:00 2026-02-23T12:46:13.120 INFO:teuthology.orchestra.run.trial131.stdout:-------------------------------------------------------------------------------- 2026-02-23T12:46:13.120 INFO:teuthology.orchestra.run.trial131.stdout:Total 112 kB/s | 86 kB 00:00 2026-02-23T12:46:13.120 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction check 2026-02-23T12:46:13.124 INFO:teuthology.orchestra.run.trial131.stdout:Transaction check succeeded. 2026-02-23T12:46:13.125 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction test 2026-02-23T12:46:13.154 INFO:teuthology.orchestra.run.trial131.stdout:Transaction test succeeded. 2026-02-23T12:46:13.155 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction 2026-02-23T12:46:13.205 INFO:teuthology.orchestra.run.trial131.stdout: Preparing : 1/1 2026-02-23T12:46:13.221 INFO:teuthology.orchestra.run.trial131.stdout: Installing : rbd-fuse-2:20.3.0-5439.ge371433f.el9.x86_64 1/1 2026-02-23T12:46:13.306 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5439.ge371433f.el9.x86_64 1/1 2026-02-23T12:46:13.363 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : rbd-fuse-2:20.3.0-5439.ge371433f.el9.x86_64 1/1 2026-02-23T12:46:13.364 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:46:13.364 INFO:teuthology.orchestra.run.trial131.stdout:Installed: 2026-02-23T12:46:13.364 INFO:teuthology.orchestra.run.trial131.stdout: rbd-fuse-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:46:13.364 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:46:13.364 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-23T12:46:13.392 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install rbd-mirror 2026-02-23T12:46:13.705 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:10:00 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:46:13.787 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-23T12:46:13.787 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:46:13.788 INFO:teuthology.orchestra.run.trial131.stdout: Package Arch Version Repo Size 2026-02-23T12:46:13.788 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:46:13.788 INFO:teuthology.orchestra.run.trial131.stdout:Installing: 2026-02-23T12:46:13.788 INFO:teuthology.orchestra.run.trial131.stdout: rbd-mirror x86_64 2:20.3.0-5439.ge371433f.el9 ceph 2.6 M 2026-02-23T12:46:13.788 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:46:13.788 INFO:teuthology.orchestra.run.trial131.stdout:Transaction Summary 2026-02-23T12:46:13.788 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:46:13.788 INFO:teuthology.orchestra.run.trial131.stdout:Install 1 Package 2026-02-23T12:46:13.788 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:46:13.788 INFO:teuthology.orchestra.run.trial131.stdout:Total download size: 2.6 M 2026-02-23T12:46:13.789 INFO:teuthology.orchestra.run.trial131.stdout:Installed size: 11 M 2026-02-23T12:46:13.789 INFO:teuthology.orchestra.run.trial131.stdout:Downloading Packages: 2026-02-23T12:46:20.949 INFO:teuthology.orchestra.run.trial131.stdout:rbd-mirror-20.3.0-5439.ge371433f.el9.x86_64.rpm 371 kB/s | 2.6 MB 00:07 2026-02-23T12:46:20.950 INFO:teuthology.orchestra.run.trial131.stdout:-------------------------------------------------------------------------------- 2026-02-23T12:46:20.950 INFO:teuthology.orchestra.run.trial131.stdout:Total 371 kB/s | 2.6 MB 00:07 2026-02-23T12:46:20.950 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction check 2026-02-23T12:46:20.955 INFO:teuthology.orchestra.run.trial131.stdout:Transaction check succeeded. 2026-02-23T12:46:20.955 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction test 2026-02-23T12:46:20.992 INFO:teuthology.orchestra.run.trial131.stdout:Transaction test succeeded. 2026-02-23T12:46:20.993 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction 2026-02-23T12:46:21.154 INFO:teuthology.orchestra.run.trial131.stdout: Preparing : 1/1 2026-02-23T12:46:21.156 INFO:teuthology.orchestra.run.trial131.stdout: Installing : rbd-mirror-2:20.3.0-5439.ge371433f.el9.x86_64 1/1 2026-02-23T12:46:21.179 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5439.ge371433f.el9.x86_64 1/1 2026-02-23T12:46:21.179 INFO:teuthology.orchestra.run.trial131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T12:46:21.179 INFO:teuthology.orchestra.run.trial131.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-23T12:46:21.179 INFO:teuthology.orchestra.run.trial131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-23T12:46:21.179 INFO:teuthology.orchestra.run.trial131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-23T12:46:21.179 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:46:21.503 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : rbd-mirror-2:20.3.0-5439.ge371433f.el9.x86_64 1/1 2026-02-23T12:46:21.504 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:46:21.504 INFO:teuthology.orchestra.run.trial131.stdout:Installed: 2026-02-23T12:46:21.504 INFO:teuthology.orchestra.run.trial131.stdout: rbd-mirror-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:46:21.504 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:46:21.504 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-23T12:46:21.530 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install rbd-nbd 2026-02-23T12:46:21.845 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:10:08 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:46:21.929 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-23T12:46:21.930 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:46:21.930 INFO:teuthology.orchestra.run.trial131.stdout: Package Architecture Version Repository Size 2026-02-23T12:46:21.930 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:46:21.930 INFO:teuthology.orchestra.run.trial131.stdout:Installing: 2026-02-23T12:46:21.930 INFO:teuthology.orchestra.run.trial131.stdout: rbd-nbd x86_64 2:20.3.0-5439.ge371433f.el9 ceph 166 k 2026-02-23T12:46:21.930 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:46:21.930 INFO:teuthology.orchestra.run.trial131.stdout:Transaction Summary 2026-02-23T12:46:21.930 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:46:21.930 INFO:teuthology.orchestra.run.trial131.stdout:Install 1 Package 2026-02-23T12:46:21.930 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:46:21.931 INFO:teuthology.orchestra.run.trial131.stdout:Total download size: 166 k 2026-02-23T12:46:21.931 INFO:teuthology.orchestra.run.trial131.stdout:Installed size: 496 k 2026-02-23T12:46:21.931 INFO:teuthology.orchestra.run.trial131.stdout:Downloading Packages: 2026-02-23T12:46:22.769 INFO:teuthology.orchestra.run.trial131.stdout:rbd-nbd-20.3.0-5439.ge371433f.el9.x86_64.rpm 199 kB/s | 166 kB 00:00 2026-02-23T12:46:22.771 INFO:teuthology.orchestra.run.trial131.stdout:-------------------------------------------------------------------------------- 2026-02-23T12:46:22.771 INFO:teuthology.orchestra.run.trial131.stdout:Total 198 kB/s | 166 kB 00:00 2026-02-23T12:46:22.771 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction check 2026-02-23T12:46:22.776 INFO:teuthology.orchestra.run.trial131.stdout:Transaction check succeeded. 2026-02-23T12:46:22.776 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction test 2026-02-23T12:46:22.807 INFO:teuthology.orchestra.run.trial131.stdout:Transaction test succeeded. 2026-02-23T12:46:22.807 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction 2026-02-23T12:46:22.863 INFO:teuthology.orchestra.run.trial131.stdout: Preparing : 1/1 2026-02-23T12:46:22.879 INFO:teuthology.orchestra.run.trial131.stdout: Installing : rbd-nbd-2:20.3.0-5439.ge371433f.el9.x86_64 1/1 2026-02-23T12:46:22.961 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5439.ge371433f.el9.x86_64 1/1 2026-02-23T12:46:23.019 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : rbd-nbd-2:20.3.0-5439.ge371433f.el9.x86_64 1/1 2026-02-23T12:46:23.019 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:46:23.020 INFO:teuthology.orchestra.run.trial131.stdout:Installed: 2026-02-23T12:46:23.020 INFO:teuthology.orchestra.run.trial131.stdout: rbd-nbd-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:46:23.020 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:46:23.020 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-23T12:46:23.049 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-osd-crimson 2026-02-23T12:46:23.356 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:10:10 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:46:23.420 INFO:teuthology.orchestra.run.trial131.stdout:Package ceph-osd-crimson-2:20.3.0-5439.ge371433f.el9.x86_64 is already installed. 2026-02-23T12:46:23.438 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-23T12:46:23.439 INFO:teuthology.orchestra.run.trial131.stdout:Nothing to do. 2026-02-23T12:46:23.439 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-23T12:46:23.460 DEBUG:teuthology.orchestra.run.trial131:> sudo yum -y install ceph-osd-crimson-debuginfo 2026-02-23T12:46:23.773 INFO:teuthology.orchestra.run.trial131.stdout:Last metadata expiration check: 0:10:10 ago on Mon 23 Feb 2026 12:36:13 PM UTC. 2026-02-23T12:46:23.857 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-23T12:46:23.857 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:46:23.858 INFO:teuthology.orchestra.run.trial131.stdout: Package Arch Version Repo Size 2026-02-23T12:46:23.858 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:46:23.858 INFO:teuthology.orchestra.run.trial131.stdout:Installing: 2026-02-23T12:46:23.858 INFO:teuthology.orchestra.run.trial131.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5439.ge371433f.el9 ceph 429 M 2026-02-23T12:46:23.858 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:46:23.858 INFO:teuthology.orchestra.run.trial131.stdout:Transaction Summary 2026-02-23T12:46:23.858 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-23T12:46:23.858 INFO:teuthology.orchestra.run.trial131.stdout:Install 1 Package 2026-02-23T12:46:23.858 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T12:46:23.858 INFO:teuthology.orchestra.run.trial131.stdout:Total download size: 429 M 2026-02-23T12:46:23.858 INFO:teuthology.orchestra.run.trial131.stdout:Installed size: 2.6 G 2026-02-23T12:46:23.859 INFO:teuthology.orchestra.run.trial131.stdout:Downloading Packages: 2026-02-23T12:56:00.047 INFO:teuthology.orchestra.run.trial046.stdout:ceph-osd-crimson-debuginfo-20.3.0-5439.ge371433 726 kB/s | 429 MB 10:05 2026-02-23T12:56:00.048 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-23T12:56:00.049 INFO:teuthology.orchestra.run.trial046.stdout:Total 726 kB/s | 429 MB 10:05 2026-02-23T12:56:00.049 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-23T12:56:00.051 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-23T12:56:00.051 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-23T12:56:01.337 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-23T12:56:01.338 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-23T12:56:24.836 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-23T12:56:24.970 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5439.ge371433f.e 1/1 2026-02-23T12:56:25.465 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-osd-crimson-debuginfo-2:20.3.0-5439.ge371433f.e 1/1 2026-02-23T12:56:25.523 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5439.ge371433f.e 1/1 2026-02-23T12:56:25.523 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:56:25.523 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-23T12:56:25.523 INFO:teuthology.orchestra.run.trial046.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T12:56:25.523 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T12:56:25.523 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-23T12:56:25.598 DEBUG:teuthology.parallel:result is None 2026-02-23T13:01:01.235 INFO:teuthology.orchestra.run.trial131.stdout:ceph-osd-crimson-debuginfo-20.3.0-5439.ge371433 501 kB/s | 429 MB 14:37 2026-02-23T13:01:01.236 INFO:teuthology.orchestra.run.trial131.stdout:-------------------------------------------------------------------------------- 2026-02-23T13:01:01.236 INFO:teuthology.orchestra.run.trial131.stdout:Total 501 kB/s | 429 MB 14:37 2026-02-23T13:01:01.237 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction check 2026-02-23T13:01:01.239 INFO:teuthology.orchestra.run.trial131.stdout:Transaction check succeeded. 2026-02-23T13:01:01.239 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction test 2026-02-23T13:01:02.517 INFO:teuthology.orchestra.run.trial131.stdout:Transaction test succeeded. 2026-02-23T13:01:02.517 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction 2026-02-23T13:01:25.879 INFO:teuthology.orchestra.run.trial131.stdout: Preparing : 1/1 2026-02-23T13:01:25.896 INFO:teuthology.orchestra.run.trial131.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5439.ge371433f.e 1/1 2026-02-23T13:01:26.007 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: ceph-osd-crimson-debuginfo-2:20.3.0-5439.ge371433f.e 1/1 2026-02-23T13:01:26.063 INFO:teuthology.orchestra.run.trial131.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5439.ge371433f.e 1/1 2026-02-23T13:01:26.063 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T13:01:26.063 INFO:teuthology.orchestra.run.trial131.stdout:Installed: 2026-02-23T13:01:26.063 INFO:teuthology.orchestra.run.trial131.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5439.ge371433f.el9.x86_64 2026-02-23T13:01:26.063 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T13:01:26.064 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-23T13:01:26.132 DEBUG:teuthology.parallel:result is None 2026-02-23T13:01:26.132 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d 2026-02-23T13:01:26.305 DEBUG:teuthology.orchestra.run.trial046:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-23T13:01:26.337 INFO:teuthology.orchestra.run.trial046.stdout:20.3.0-5439.ge371433f.el9 2026-02-23T13:01:26.338 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5439.ge371433f.el9 2026-02-23T13:01:26.338 INFO:teuthology.task.install:The correct ceph version 20.3.0-5439.ge371433f is installed. 2026-02-23T13:01:26.342 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d 2026-02-23T13:01:26.503 DEBUG:teuthology.orchestra.run.trial131:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-23T13:01:26.524 INFO:teuthology.orchestra.run.trial131.stdout:20.3.0-5439.ge371433f.el9 2026-02-23T13:01:26.524 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5439.ge371433f.el9 2026-02-23T13:01:26.524 INFO:teuthology.task.install:The correct ceph version 20.3.0-5439.ge371433f is installed. 2026-02-23T13:01:26.527 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-23T13:01:26.527 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-23T13:01:26.527 DEBUG:teuthology.orchestra.run.trial046:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-23T13:01:26.554 DEBUG:teuthology.orchestra.run.trial131:> set -ex 2026-02-23T13:01:26.554 DEBUG:teuthology.orchestra.run.trial131:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-23T13:01:26.590 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-23T13:01:26.590 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-23T13:01:26.590 DEBUG:teuthology.orchestra.run.trial046:> sudo dd of=/usr/bin/daemon-helper 2026-02-23T13:01:26.619 DEBUG:teuthology.orchestra.run.trial046:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-23T13:01:26.682 DEBUG:teuthology.orchestra.run.trial131:> set -ex 2026-02-23T13:01:26.682 DEBUG:teuthology.orchestra.run.trial131:> sudo dd of=/usr/bin/daemon-helper 2026-02-23T13:01:26.708 DEBUG:teuthology.orchestra.run.trial131:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-23T13:01:26.772 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-23T13:01:26.772 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-23T13:01:26.772 DEBUG:teuthology.orchestra.run.trial046:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-23T13:01:26.798 DEBUG:teuthology.orchestra.run.trial046:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-23T13:01:26.864 DEBUG:teuthology.orchestra.run.trial131:> set -ex 2026-02-23T13:01:26.864 DEBUG:teuthology.orchestra.run.trial131:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-23T13:01:26.890 DEBUG:teuthology.orchestra.run.trial131:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-23T13:01:26.954 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-23T13:01:26.954 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-23T13:01:26.954 DEBUG:teuthology.orchestra.run.trial046:> sudo dd of=/usr/bin/stdin-killer 2026-02-23T13:01:26.980 DEBUG:teuthology.orchestra.run.trial046:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-23T13:01:27.046 DEBUG:teuthology.orchestra.run.trial131:> set -ex 2026-02-23T13:01:27.046 DEBUG:teuthology.orchestra.run.trial131:> sudo dd of=/usr/bin/stdin-killer 2026-02-23T13:01:27.072 DEBUG:teuthology.orchestra.run.trial131:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-23T13:01:27.137 INFO:teuthology.run_tasks:Running task pexec... 2026-02-23T13:01:27.156 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-23T13:01:27.157 DEBUG:teuthology.orchestra.run.trial046:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-23T13:01:27.158 DEBUG:teuthology.orchestra.run.trial131:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-23T13:01:27.161 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial046.front.sepia.ceph.com 2026-02-23T13:01:27.161 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-23T13:01:27.179 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial131.front.sepia.ceph.com 2026-02-23T13:01:27.180 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-23T13:01:27.211 DEBUG:teuthology.parallel:result is None 2026-02-23T13:01:27.230 DEBUG:teuthology.parallel:result is None 2026-02-23T13:01:27.230 INFO:teuthology.run_tasks:Running task cephadm... 2026-02-23T13:01:27.359 INFO:tasks.cephadm:Config: {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1, 'debug osd': 10}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'crimson_allow_pg_split': False, 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'seastore cachepin size pershard': '64M', 'seastore max concurrent transactions': 8}}, 'osd_type': 'crimson', 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Degraded data redundancy', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', 'PG_BACKFILL_FULL', 'Low space hindering backfill .*? backfill_toofull', 'OSD_ROOT_DOWN', 'pgs degraded', 'pgs undersized', 'is active.*backfill_toofull.*'], 'sha1': 'e371433fcd1390a0b82cfb18effc422c1f5d8c1d'} 2026-02-23T13:01:27.359 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d 2026-02-23T13:01:27.362 INFO:tasks.cephadm:Cluster fsid is c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 2026-02-23T13:01:27.362 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-02-23T13:01:27.362 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '10.20.193.46'} 2026-02-23T13:01:27.363 INFO:tasks.cephadm:First mon is mon.a on trial046 2026-02-23T13:01:27.363 INFO:tasks.cephadm:First mgr is x 2026-02-23T13:01:27.363 INFO:tasks.cephadm:Normalizing hostnames... 2026-02-23T13:01:27.363 DEBUG:teuthology.orchestra.run.trial046:> sudo hostname $(hostname -s) 2026-02-23T13:01:27.388 DEBUG:teuthology.orchestra.run.trial131:> sudo hostname $(hostname -s) 2026-02-23T13:01:27.413 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2026-02-23T13:01:27.413 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d 2026-02-23T13:01:27.533 INFO:tasks.cephadm:builder_project result: [{'url': 'https://3.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/e371433fcd1390a0b82cfb18effc422c1f5d8c1d/centos/9/flavors/debug/', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-shraddhaag-enable-cephadm-tests/e371433fcd1390a0b82cfb18effc422c1f5d8c1d/centos/9/flavors/debug/', 'ref': 'wip-shraddhaag-enable-cephadm-tests', 'sha1': 'e371433fcd1390a0b82cfb18effc422c1f5d8c1d', 'distro': 'centos', 'distro_version': '9', 'distro_codename': None, 'modified': '2026-02-23 09:29:09.802677', 'status': 'ready', 'flavor': 'debug', 'project': 'ceph', 'archs': ['source', 'x86_64'], 'extra': {'version': '20.3.0-5439-ge371433f', 'package_manager_version': '20.3.0-5439.ge371433f', 'build_url': 'https://jenkins.ceph.com/job/ceph-dev-pipeline/3195/', 'root_build_cause': '', 'node_name': '10.20.192.97+toko07', 'job_name': 'ceph-dev-pipeline'}}] 2026-02-23T13:01:27.664 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-shraddhaag-enable-cephadm-tests, sha1 e371433fcd1390a0b82cfb18effc422c1f5d8c1d from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=debug&sha1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d 2026-02-23T13:01:27.666 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-shraddhaag-enable-cephadm-tests/e371433fcd1390a0b82cfb18effc422c1f5d8c1d/centos/9/x86_64/flavors/debug/cephadm 2026-02-23T13:01:27.666 INFO:tasks.cephadm:Downloading cephadm from url: https://3.chacra.ceph.com/binaries/ceph/wip-shraddhaag-enable-cephadm-tests/e371433fcd1390a0b82cfb18effc422c1f5d8c1d/centos/9/x86_64/flavors/debug/cephadm 2026-02-23T13:01:27.666 DEBUG:teuthology.orchestra.run.trial046:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-shraddhaag-enable-cephadm-tests/e371433fcd1390a0b82cfb18effc422c1f5d8c1d/centos/9/x86_64/flavors/debug/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-23T13:01:29.562 INFO:teuthology.orchestra.run.trial046.stdout:-rw-r--r--. 1 ubuntu ubuntu 1076284 Feb 23 13:01 /home/ubuntu/cephtest/cephadm 2026-02-23T13:01:29.563 DEBUG:teuthology.orchestra.run.trial131:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-shraddhaag-enable-cephadm-tests/e371433fcd1390a0b82cfb18effc422c1f5d8c1d/centos/9/x86_64/flavors/debug/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-23T13:01:31.621 INFO:teuthology.orchestra.run.trial131.stdout:-rw-r--r--. 1 ubuntu ubuntu 1076284 Feb 23 13:01 /home/ubuntu/cephtest/cephadm 2026-02-23T13:01:31.621 DEBUG:teuthology.orchestra.run.trial046:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-23T13:01:31.641 DEBUG:teuthology.orchestra.run.trial131:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-23T13:01:31.675 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d on all hosts... 2026-02-23T13:01:31.675 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d pull 2026-02-23T13:01:31.683 DEBUG:teuthology.orchestra.run.trial131:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d pull 2026-02-23T13:01:31.922 INFO:teuthology.orchestra.run.trial046.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d... 2026-02-23T13:01:31.928 INFO:teuthology.orchestra.run.trial131.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d... 2026-02-23T13:01:41.059 INFO:teuthology.orchestra.run.trial046.stdout:{ 2026-02-23T13:01:41.059 INFO:teuthology.orchestra.run.trial046.stdout: "ceph_version": "ceph version 20.3.0-5439-ge371433f (e371433fcd1390a0b82cfb18effc422c1f5d8c1d) tentacle (dev)", 2026-02-23T13:01:41.059 INFO:teuthology.orchestra.run.trial046.stdout: "image_id": "63df4b83db6f95a8ba965919b3671cb27173117c23b5c950aaadc8913f56213c", 2026-02-23T13:01:41.059 INFO:teuthology.orchestra.run.trial046.stdout: "repo_digests": [ 2026-02-23T13:01:41.059 INFO:teuthology.orchestra.run.trial046.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:49621faaa845c39b2aae72e4fa24123ee9b2ac3fb8ae834753907068ee2972ea" 2026-02-23T13:01:41.059 INFO:teuthology.orchestra.run.trial046.stdout: ] 2026-02-23T13:01:41.060 INFO:teuthology.orchestra.run.trial046.stdout:} 2026-02-23T13:01:41.104 INFO:teuthology.orchestra.run.trial131.stdout:{ 2026-02-23T13:01:41.104 INFO:teuthology.orchestra.run.trial131.stdout: "ceph_version": "ceph version 20.3.0-5439-ge371433f (e371433fcd1390a0b82cfb18effc422c1f5d8c1d) tentacle (dev)", 2026-02-23T13:01:41.105 INFO:teuthology.orchestra.run.trial131.stdout: "image_id": "63df4b83db6f95a8ba965919b3671cb27173117c23b5c950aaadc8913f56213c", 2026-02-23T13:01:41.105 INFO:teuthology.orchestra.run.trial131.stdout: "repo_digests": [ 2026-02-23T13:01:41.105 INFO:teuthology.orchestra.run.trial131.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:49621faaa845c39b2aae72e4fa24123ee9b2ac3fb8ae834753907068ee2972ea" 2026-02-23T13:01:41.105 INFO:teuthology.orchestra.run.trial131.stdout: ] 2026-02-23T13:01:41.105 INFO:teuthology.orchestra.run.trial131.stdout:} 2026-02-23T13:01:41.120 DEBUG:teuthology.orchestra.run.trial046:> sudo mkdir -p /etc/ceph 2026-02-23T13:01:41.146 DEBUG:teuthology.orchestra.run.trial131:> sudo mkdir -p /etc/ceph 2026-02-23T13:01:41.181 DEBUG:teuthology.orchestra.run.trial046:> sudo chmod 777 /etc/ceph 2026-02-23T13:01:41.209 DEBUG:teuthology.orchestra.run.trial131:> sudo chmod 777 /etc/ceph 2026-02-23T13:01:41.245 INFO:tasks.cephadm:Writing seed config... 2026-02-23T13:01:41.247 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-02-23T13:01:41.247 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-02-23T13:01:41.247 INFO:tasks.cephadm: override: [mgr] debug osd = 10 2026-02-23T13:01:41.247 INFO:tasks.cephadm: override: [client.0] debug ms = 1 2026-02-23T13:01:41.247 INFO:tasks.cephadm: override: [client.0] debug objecter = 20 2026-02-23T13:01:41.247 INFO:tasks.cephadm: override: [client.0] debug rados = 20 2026-02-23T13:01:41.247 INFO:tasks.cephadm: override: [global] crimson_allow_pg_split = False 2026-02-23T13:01:41.247 INFO:tasks.cephadm: override: [global] enable experimental unrecoverable data corrupting features = crimson 2026-02-23T13:01:41.247 INFO:tasks.cephadm: override: [global] ms client mode = crc 2026-02-23T13:01:41.248 INFO:tasks.cephadm: override: [global] ms cluster mode = crc 2026-02-23T13:01:41.248 INFO:tasks.cephadm: override: [global] ms mon client mode = crc 2026-02-23T13:01:41.248 INFO:tasks.cephadm: override: [global] ms mon cluster mode = crc 2026-02-23T13:01:41.248 INFO:tasks.cephadm: override: [global] ms mon service mode = crc 2026-02-23T13:01:41.248 INFO:tasks.cephadm: override: [global] ms service mode = crc 2026-02-23T13:01:41.248 INFO:tasks.cephadm: override: [global] osd_max_pg_log_entries = 2 2026-02-23T13:01:41.248 INFO:tasks.cephadm: override: [global] osd_min_pg_log_entries = 1 2026-02-23T13:01:41.248 INFO:tasks.cephadm: override: [global] osd_pg_log_trim_min = 0 2026-02-23T13:01:41.248 INFO:tasks.cephadm: override: [global] osd_pool_default_min_size = 2 2026-02-23T13:01:41.248 INFO:tasks.cephadm: override: [global] osd_pool_default_size = 3 2026-02-23T13:01:41.248 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-02-23T13:01:41.248 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-02-23T13:01:41.248 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-02-23T13:01:41.249 INFO:tasks.cephadm: override: [mon] mon min osdmap epochs = 50 2026-02-23T13:01:41.249 INFO:tasks.cephadm: override: [mon] mon osdmap full prune interval = 2 2026-02-23T13:01:41.249 INFO:tasks.cephadm: override: [mon] mon osdmap full prune min = 15 2026-02-23T13:01:41.249 INFO:tasks.cephadm: override: [mon] mon osdmap full prune txsize = 2 2026-02-23T13:01:41.249 INFO:tasks.cephadm: override: [mon] osd pool default crimson = True 2026-02-23T13:01:41.249 INFO:tasks.cephadm: override: [mon] paxos service trim min = 10 2026-02-23T13:01:41.249 INFO:tasks.cephadm: override: [osd] crimson cpu num = 4 2026-02-23T13:01:41.249 INFO:tasks.cephadm: override: [osd] crimson osd obc lru size = 10 2026-02-23T13:01:41.249 INFO:tasks.cephadm: override: [osd] debug ms = 20 2026-02-23T13:01:41.249 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-02-23T13:01:41.249 INFO:tasks.cephadm: override: [osd] debug seastore = 20 2026-02-23T13:01:41.249 INFO:tasks.cephadm: override: [osd] debug seastore backref = 20 2026-02-23T13:01:41.249 INFO:tasks.cephadm: override: [osd] debug seastore cache = 20 2026-02-23T13:01:41.250 INFO:tasks.cephadm: override: [osd] debug seastore cleaner = 20 2026-02-23T13:01:41.250 INFO:tasks.cephadm: override: [osd] debug seastore device = 20 2026-02-23T13:01:41.250 INFO:tasks.cephadm: override: [osd] debug seastore epm = 20 2026-02-23T13:01:41.250 INFO:tasks.cephadm: override: [osd] debug seastore fixedkv tree = 20 2026-02-23T13:01:41.250 INFO:tasks.cephadm: override: [osd] debug seastore journal = 20 2026-02-23T13:01:41.250 INFO:tasks.cephadm: override: [osd] debug seastore lba = 20 2026-02-23T13:01:41.250 INFO:tasks.cephadm: override: [osd] debug seastore odata = 20 2026-02-23T13:01:41.250 INFO:tasks.cephadm: override: [osd] debug seastore omap = 20 2026-02-23T13:01:41.250 INFO:tasks.cephadm: override: [osd] debug seastore onode = 20 2026-02-23T13:01:41.250 INFO:tasks.cephadm: override: [osd] debug seastore t = 20 2026-02-23T13:01:41.250 INFO:tasks.cephadm: override: [osd] debug seastore tm = 20 2026-02-23T13:01:41.250 INFO:tasks.cephadm: override: [osd] osd blocked scrub grace period = 3600 2026-02-23T13:01:41.250 INFO:tasks.cephadm: override: [osd] osd debug reject backfill probability = 0.3 2026-02-23T13:01:41.250 INFO:tasks.cephadm: override: [osd] osd delete sleep = 1 2026-02-23T13:01:41.251 INFO:tasks.cephadm: override: [osd] osd max backfills = 3 2026-02-23T13:01:41.251 INFO:tasks.cephadm: override: [osd] osd max markdown count = 1000 2026-02-23T13:01:41.251 INFO:tasks.cephadm: override: [osd] osd objectstore = seastore 2026-02-23T13:01:41.251 INFO:tasks.cephadm: override: [osd] osd scrub max interval = 120 2026-02-23T13:01:41.251 INFO:tasks.cephadm: override: [osd] osd scrub min interval = 60 2026-02-23T13:01:41.251 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2026-02-23T13:01:41.251 INFO:tasks.cephadm: override: [osd] osd snap trim sleep = 2 2026-02-23T13:01:41.251 INFO:tasks.cephadm: override: [osd] seastore cachepin size pershard = 64M 2026-02-23T13:01:41.251 INFO:tasks.cephadm: override: [osd] seastore max concurrent transactions = 8 2026-02-23T13:01:41.253 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-23T13:01:41.253 DEBUG:teuthology.orchestra.run.trial046:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-02-23T13:01:41.270 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 crimson_allow_pg_split = False enable experimental unrecoverable data corrupting features = crimson ms client mode = crc ms cluster mode = crc ms mon client mode = crc ms mon cluster mode = crc ms mon service mode = crc ms service mode = crc osd_max_pg_log_entries = 2 osd_min_pg_log_entries = 1 osd_pg_log_trim_min = 0 osd_pool_default_min_size = 2 osd_pool_default_size = 3 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 120 osd mclock profile = high_recovery_ops osd mclock skip benchmark = true osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true crimson cpu num = 4 crimson osd obc lru size = 10 debug ms = 20 debug osd = 20 debug seastore = 20 debug seastore backref = 20 debug seastore cache = 20 debug seastore cleaner = 20 debug seastore device = 20 debug seastore epm = 20 debug seastore fixedkv tree = 20 debug seastore journal = 20 debug seastore lba = 20 debug seastore odata = 20 debug seastore omap = 20 debug seastore onode = 20 debug seastore t = 20 debug seastore tm = 20 osd blocked scrub grace period = 3600 osd debug reject backfill probability = 0.3 osd delete sleep = 1 osd max backfills = 3 osd max markdown count = 1000 osd objectstore = seastore osd scrub min interval = 60 osd snap trim sleep = 2 seastore cachepin size pershard = 64M seastore max concurrent transactions = 8 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 debug osd = 10 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon min osdmap epochs = 50 mon osdmap full prune interval = 2 mon osdmap full prune min = 15 mon osdmap full prune txsize = 2 osd pool default crimson = True paxos service trim min = 10 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client.0] debug ms = 1 debug objecter = 20 debug rados = 20 2026-02-23T13:01:41.271 DEBUG:teuthology.orchestra.run.trial046:mon.a> sudo journalctl -f -n 0 -u ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@mon.a.service 2026-02-23T13:01:41.313 DEBUG:teuthology.orchestra.run.trial046:mgr.x> sudo journalctl -f -n 0 -u ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@mgr.x.service 2026-02-23T13:01:41.356 INFO:tasks.cephadm:Bootstrapping... 2026-02-23T13:01:41.356 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d -v bootstrap --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 10.20.193.46 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-02-23T13:01:41.495 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-23T13:01:41.495 INFO:teuthology.orchestra.run.trial046.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d', '-v', 'bootstrap', '--fsid', 'c3b3ca7d-10b7-11f1-8efe-d404e6e7d460', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '10.20.193.46', '--skip-admin-label'] 2026-02-23T13:01:41.496 INFO:teuthology.orchestra.run.trial046.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-02-23T13:01:41.496 INFO:teuthology.orchestra.run.trial046.stdout:Verifying podman|docker is present... 2026-02-23T13:01:41.512 INFO:teuthology.orchestra.run.trial046.stdout:/bin/podman: stdout 5.6.0 2026-02-23T13:01:41.512 INFO:teuthology.orchestra.run.trial046.stdout:Verifying lvm2 is present... 2026-02-23T13:01:41.512 INFO:teuthology.orchestra.run.trial046.stdout:Verifying time synchronization is in place... 2026-02-23T13:01:41.518 INFO:teuthology.orchestra.run.trial046.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-23T13:01:41.518 INFO:teuthology.orchestra.run.trial046.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-23T13:01:41.524 INFO:teuthology.orchestra.run.trial046.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-23T13:01:41.524 INFO:teuthology.orchestra.run.trial046.stdout:systemctl: stdout inactive 2026-02-23T13:01:41.529 INFO:teuthology.orchestra.run.trial046.stdout:systemctl: stdout enabled 2026-02-23T13:01:41.534 INFO:teuthology.orchestra.run.trial046.stdout:systemctl: stdout active 2026-02-23T13:01:41.534 INFO:teuthology.orchestra.run.trial046.stdout:Unit chronyd.service is enabled and running 2026-02-23T13:01:41.535 INFO:teuthology.orchestra.run.trial046.stdout:Repeating the final host check... 2026-02-23T13:01:41.550 INFO:teuthology.orchestra.run.trial046.stdout:/bin/podman: stdout 5.6.0 2026-02-23T13:01:41.550 INFO:teuthology.orchestra.run.trial046.stdout:podman (/bin/podman) version 5.6.0 is present 2026-02-23T13:01:41.551 INFO:teuthology.orchestra.run.trial046.stdout:systemctl is present 2026-02-23T13:01:41.551 INFO:teuthology.orchestra.run.trial046.stdout:lvcreate is present 2026-02-23T13:01:41.556 INFO:teuthology.orchestra.run.trial046.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-23T13:01:41.556 INFO:teuthology.orchestra.run.trial046.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-23T13:01:41.561 INFO:teuthology.orchestra.run.trial046.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-23T13:01:41.561 INFO:teuthology.orchestra.run.trial046.stdout:systemctl: stdout inactive 2026-02-23T13:01:41.567 INFO:teuthology.orchestra.run.trial046.stdout:systemctl: stdout enabled 2026-02-23T13:01:41.573 INFO:teuthology.orchestra.run.trial046.stdout:systemctl: stdout active 2026-02-23T13:01:41.573 INFO:teuthology.orchestra.run.trial046.stdout:Unit chronyd.service is enabled and running 2026-02-23T13:01:41.573 INFO:teuthology.orchestra.run.trial046.stdout:Host looks OK 2026-02-23T13:01:41.573 INFO:teuthology.orchestra.run.trial046.stdout:Cluster fsid: c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 2026-02-23T13:01:41.573 INFO:teuthology.orchestra.run.trial046.stdout:Acquiring lock 140031271807728 on /run/cephadm/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460.lock 2026-02-23T13:01:41.573 INFO:teuthology.orchestra.run.trial046.stdout:Lock 140031271807728 acquired on /run/cephadm/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460.lock 2026-02-23T13:01:41.574 INFO:teuthology.orchestra.run.trial046.stdout:Verifying IP 10.20.193.46 port 3300 ... 2026-02-23T13:01:41.574 INFO:teuthology.orchestra.run.trial046.stdout:Verifying IP 10.20.193.46 port 6789 ... 2026-02-23T13:01:41.574 INFO:teuthology.orchestra.run.trial046.stdout:Base mon IP(s) is [10.20.193.46:3300, 10.20.193.46:6789], mon addrv is [v2:10.20.193.46:3300,v1:10.20.193.46:6789] 2026-02-23T13:01:41.577 INFO:teuthology.orchestra.run.trial046.stdout:/sbin/ip: stdout default via 10.20.192.1 dev enp1s0f0 proto dhcp src 10.20.193.46 metric 102 2026-02-23T13:01:41.577 INFO:teuthology.orchestra.run.trial046.stdout:/sbin/ip: stdout 10.20.192.0/20 dev enp1s0f0 proto kernel scope link src 10.20.193.46 metric 102 2026-02-23T13:01:41.577 INFO:teuthology.orchestra.run.trial046.stdout:/sbin/ip: stdout 169.254.3.0/24 dev enp7s0f4u2u2c2 proto kernel scope link src 169.254.3.1 metric 101 2026-02-23T13:01:41.579 INFO:teuthology.orchestra.run.trial046.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2026-02-23T13:01:41.579 INFO:teuthology.orchestra.run.trial046.stdout:/sbin/ip: stdout fe80::/64 dev enp1s0f0 proto kernel metric 256 pref medium 2026-02-23T13:01:41.579 INFO:teuthology.orchestra.run.trial046.stdout:/sbin/ip: stdout fe80::/64 dev enp7s0f4u2u2c2 proto kernel metric 1024 pref medium 2026-02-23T13:01:41.582 INFO:teuthology.orchestra.run.trial046.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-02-23T13:01:41.582 INFO:teuthology.orchestra.run.trial046.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2026-02-23T13:01:41.583 INFO:teuthology.orchestra.run.trial046.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-23T13:01:41.583 INFO:teuthology.orchestra.run.trial046.stdout:/sbin/ip: stdout 2: enp7s0f4u2u2c2: mtu 1500 state UNKNOWN qlen 1000 2026-02-23T13:01:41.583 INFO:teuthology.orchestra.run.trial046.stdout:/sbin/ip: stdout inet6 fe80::db92:e4f:d12:ab04/64 scope link noprefixroute 2026-02-23T13:01:41.583 INFO:teuthology.orchestra.run.trial046.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-23T13:01:41.583 INFO:teuthology.orchestra.run.trial046.stdout:/sbin/ip: stdout 3: enp1s0f0: mtu 1500 state UP qlen 1000 2026-02-23T13:01:41.583 INFO:teuthology.orchestra.run.trial046.stdout:/sbin/ip: stdout inet6 fe80::925a:8ff:fe77:606e/64 scope link 2026-02-23T13:01:41.583 INFO:teuthology.orchestra.run.trial046.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-23T13:01:41.583 INFO:teuthology.orchestra.run.trial046.stdout:Mon IP `10.20.193.46` is in CIDR network `10.20.192.0/20` 2026-02-23T13:01:41.583 INFO:teuthology.orchestra.run.trial046.stdout:Mon IP `10.20.193.46` is in CIDR network `10.20.192.0/20` 2026-02-23T13:01:41.583 INFO:teuthology.orchestra.run.trial046.stdout:Inferred mon public CIDR from local network configuration ['10.20.192.0/20', '10.20.192.0/20'] 2026-02-23T13:01:41.583 INFO:teuthology.orchestra.run.trial046.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-02-23T13:01:41.584 INFO:teuthology.orchestra.run.trial046.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d... 2026-02-23T13:01:41.814 INFO:teuthology.orchestra.run.trial046.stdout:/bin/podman: stdout 63df4b83db6f95a8ba965919b3671cb27173117c23b5c950aaadc8913f56213c 2026-02-23T13:01:41.815 INFO:teuthology.orchestra.run.trial046.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d... 2026-02-23T13:01:41.815 INFO:teuthology.orchestra.run.trial046.stdout:/bin/podman: stderr Getting image source signatures 2026-02-23T13:01:41.815 INFO:teuthology.orchestra.run.trial046.stdout:/bin/podman: stderr Copying blob sha256:3c07feed93a72a05ea2a792fe5c53c65e7834d6d603a33f73f74750df5837c83 2026-02-23T13:01:41.815 INFO:teuthology.orchestra.run.trial046.stdout:/bin/podman: stderr Copying blob sha256:5dd85e1a50663785d86adae5ef92579a03e6f64059ca9c005010518acdd62048 2026-02-23T13:01:41.815 INFO:teuthology.orchestra.run.trial046.stdout:/bin/podman: stderr Copying config sha256:63df4b83db6f95a8ba965919b3671cb27173117c23b5c950aaadc8913f56213c 2026-02-23T13:01:41.815 INFO:teuthology.orchestra.run.trial046.stdout:/bin/podman: stderr Writing manifest to image destination 2026-02-23T13:01:41.930 INFO:teuthology.orchestra.run.trial046.stdout:ceph: stdout ceph version 20.3.0-5439-ge371433f (e371433fcd1390a0b82cfb18effc422c1f5d8c1d) tentacle (dev) 2026-02-23T13:01:41.931 INFO:teuthology.orchestra.run.trial046.stdout:Ceph version: ceph version 20.3.0-5439-ge371433f (e371433fcd1390a0b82cfb18effc422c1f5d8c1d) tentacle (dev) 2026-02-23T13:01:41.931 INFO:teuthology.orchestra.run.trial046.stdout:Extracting ceph user uid/gid from container image... 2026-02-23T13:01:42.061 INFO:teuthology.orchestra.run.trial046.stdout:stat: stdout 167 167 2026-02-23T13:01:42.061 INFO:teuthology.orchestra.run.trial046.stdout:Creating initial keys... 2026-02-23T13:01:42.190 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph-authtool: stdout AQC2T5xpGSqeChAAFDHsQr7LT77ew7PHkdjWCg== 2026-02-23T13:01:42.318 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph-authtool: stdout AQC2T5xpaE8/EhAACtT5A0X0QuwnfsTio0Sx0A== 2026-02-23T13:01:42.458 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph-authtool: stdout AQC2T5xpjLl1GRAAL6bGjqER6erjMXpmmMWDDQ== 2026-02-23T13:01:42.459 INFO:teuthology.orchestra.run.trial046.stdout:Creating initial monmap... 2026-02-23T13:01:42.597 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-23T13:01:42.598 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = tentacle 2026-02-23T13:01:42.598 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 2026-02-23T13:01:42.598 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-23T13:01:42.598 INFO:teuthology.orchestra.run.trial046.stdout:monmaptool for a [v2:10.20.193.46:3300,v1:10.20.193.46:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-23T13:01:42.598 INFO:teuthology.orchestra.run.trial046.stdout:setting min_mon_release = tentacle 2026-02-23T13:01:42.598 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/monmaptool: set fsid to c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 2026-02-23T13:01:42.598 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-23T13:01:42.598 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:01:42.598 INFO:teuthology.orchestra.run.trial046.stdout:Creating mon... 2026-02-23T13:01:42.732 INFO:teuthology.orchestra.run.trial046.stdout:create mon.a on 2026-02-23T13:01:42.908 INFO:teuthology.orchestra.run.trial046.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2026-02-23T13:01:43.008 INFO:teuthology.orchestra.run.trial046.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2026-02-23T13:01:43.110 INFO:teuthology.orchestra.run.trial046.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460.target → /etc/systemd/system/ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460.target. 2026-02-23T13:01:43.110 INFO:teuthology.orchestra.run.trial046.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460.target → /etc/systemd/system/ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460.target. 2026-02-23T13:01:43.241 INFO:teuthology.orchestra.run.trial046.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@mon.a 2026-02-23T13:01:43.241 INFO:teuthology.orchestra.run.trial046.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@mon.a.service: Unit ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@mon.a.service not loaded. 2026-02-23T13:01:43.352 INFO:teuthology.orchestra.run.trial046.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460.target.wants/ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@mon.a.service → /etc/systemd/system/ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@.service. 2026-02-23T13:01:43.493 INFO:teuthology.orchestra.run.trial046.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-23T13:01:43.493 INFO:teuthology.orchestra.run.trial046.stdout:systemctl: stdout disabled 2026-02-23T13:01:43.498 INFO:teuthology.orchestra.run.trial046.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-23T13:01:43.498 INFO:teuthology.orchestra.run.trial046.stdout:systemctl: stdout inactive 2026-02-23T13:01:43.498 INFO:teuthology.orchestra.run.trial046.stdout:firewalld.service is not enabled 2026-02-23T13:01:43.498 INFO:teuthology.orchestra.run.trial046.stdout:Not possible to enable service . firewalld.service is not available 2026-02-23T13:01:43.498 INFO:teuthology.orchestra.run.trial046.stdout:Waiting for mon to start... 2026-02-23T13:01:43.498 INFO:teuthology.orchestra.run.trial046.stdout:Waiting for mon... 2026-02-23T13:01:43.666 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout cluster: 2026-02-23T13:01:43.666 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout id: c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 2026-02-23T13:01:43.666 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-02-23T13:01:43.667 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout 2026-02-23T13:01:43.667 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout services: 2026-02-23T13:01:43.667 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.1417s) [leader: a] 2026-02-23T13:01:43.667 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-02-23T13:01:43.667 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-02-23T13:01:43.667 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout 2026-02-23T13:01:43.667 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout data: 2026-02-23T13:01:43.667 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-02-23T13:01:43.667 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-02-23T13:01:43.667 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-02-23T13:01:43.667 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout pgs: 2026-02-23T13:01:43.667 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout 2026-02-23T13:01:43.668 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:43.609+0000 7ff74613f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:43.668 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:43.613+0000 7ff74613f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:43.668 INFO:teuthology.orchestra.run.trial046.stdout:mon is available 2026-02-23T13:01:43.668 INFO:teuthology.orchestra.run.trial046.stdout:Assimilating anything we can from ceph.conf... 2026-02-23T13:01:43.808 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout 2026-02-23T13:01:43.809 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout [global] 2026-02-23T13:01:43.809 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout fsid = c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 2026-02-23T13:01:43.809 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-23T13:01:43.809 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.46:3300,v1:10.20.193.46:6789] 2026-02-23T13:01:43.809 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-23T13:01:43.809 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-23T13:01:43.809 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-23T13:01:43.809 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-23T13:01:43.809 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout 2026-02-23T13:01:43.809 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-23T13:01:43.809 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-23T13:01:43.810 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout 2026-02-23T13:01:43.810 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout [osd] 2026-02-23T13:01:43.810 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-23T13:01:43.810 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-23T13:01:43.810 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:43.752+0000 7f4d933c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:43.810 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:43.754+0000 7f4d933c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:43.810 INFO:teuthology.orchestra.run.trial046.stdout:Generating new minimal ceph.conf... 2026-02-23T13:01:43.959 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:43.895+0000 7f0efb7d4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:43.959 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:43.899+0000 7f0efb7d4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:43.959 INFO:teuthology.orchestra.run.trial046.stdout:Restarting the monitor... 2026-02-23T13:01:44.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mon-a[38143]: 2026-02-23T13:01:44.038+0000 7f66a62bf640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-23T13:01:44.478 INFO:teuthology.orchestra.run.trial046.stdout:Setting public_network to 10.20.192.0/20 in global config section 2026-02-23T13:01:44.547 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 podman[38425]: 2026-02-23 13:01:44.291977013 +0000 UTC m=+0.265846685 container died f75c2482b28440a7495e23f357f5db607044b1cc01a84d41636f1bd25b1458a0 (image=quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mon-a, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_SHA1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, ceph=True, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-23T13:01:44.547 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 podman[38425]: 2026-02-23 13:01:44.29948815 +0000 UTC m=+0.273357822 container remove f75c2482b28440a7495e23f357f5db607044b1cc01a84d41636f1bd25b1458a0 (image=quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mon-a, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, org.label-schema.build-date=20260216, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-23T13:01:44.547 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 bash[38425]: ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mon-a 2026-02-23T13:01:44.547 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 systemd[1]: ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@mon.a.service: Deactivated successfully. 2026-02-23T13:01:44.547 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 systemd[1]: Stopped Ceph mon.a for c3b3ca7d-10b7-11f1-8efe-d404e6e7d460. 2026-02-23T13:01:44.548 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 systemd[1]: Starting Ceph mon.a for c3b3ca7d-10b7-11f1-8efe-d404e6e7d460... 2026-02-23T13:01:44.548 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 podman[38549]: 2026-02-23 13:01:44.443447095 +0000 UTC m=+0.016024802 container create 7bd9b1f25d33db40c063d65960a9d2000064d0992311fc5c662109a9c18c41ba (image=quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mon-a, org.label-schema.vendor=CentOS, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, OSD_FLAVOR=default, CEPH_SHA1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260216, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-23T13:01:44.548 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 podman[38549]: 2026-02-23 13:01:44.470002514 +0000 UTC m=+0.042580180 container init 7bd9b1f25d33db40c063d65960a9d2000064d0992311fc5c662109a9c18c41ba (image=quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mon-a, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-23T13:01:44.548 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 podman[38549]: 2026-02-23 13:01:44.472328641 +0000 UTC m=+0.044906307 container start 7bd9b1f25d33db40c063d65960a9d2000064d0992311fc5c662109a9c18c41ba (image=quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d, org.label-schema.vendor=CentOS) 2026-02-23T13:01:44.548 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 bash[38549]: 7bd9b1f25d33db40c063d65960a9d2000064d0992311fc5c662109a9c18c41ba 2026-02-23T13:01:44.548 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 podman[38549]: 2026-02-23 13:01:44.437672954 +0000 UTC m=+0.010250620 image pull 63df4b83db6f95a8ba965919b3671cb27173117c23b5c950aaadc8913f56213c quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d 2026-02-23T13:01:44.548 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 systemd[1]: Started Ceph mon.a for c3b3ca7d-10b7-11f1-8efe-d404e6e7d460. 2026-02-23T13:01:44.548 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: set uid:gid to 167:167 (ceph:ceph) 2026-02-23T13:01:44.548 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: ceph version 20.3.0-5439-ge371433f (e371433fcd1390a0b82cfb18effc422c1f5d8c1d) tentacle (dev - RelWithDebInfo), process ceph-mon, pid 2 2026-02-23T13:01:44.548 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: pidfile_write: ignore empty --pid-file 2026-02-23T13:01:44.548 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: load: jerasure load: lrc 2026-02-23T13:01:44.548 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: RocksDB version: 7.9.2 2026-02-23T13:01:44.548 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Git sha 0 2026-02-23T13:01:44.549 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Compile date 2026-02-23 07:43:00 2026-02-23T13:01:44.549 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: DB SUMMARY 2026-02-23T13:01:44.549 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: DB Session ID: EH4XRMTUQI42IQVGZRRU 2026-02-23T13:01:44.549 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: CURRENT file: CURRENT 2026-02-23T13:01:44.549 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: IDENTITY file: IDENTITY 2026-02-23T13:01:44.549 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2026-02-23T13:01:44.549 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2026-02-23T13:01:44.549 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 99984 ; 2026-02-23T13:01:44.549 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.error_if_exists: 0 2026-02-23T13:01:44.549 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.create_if_missing: 0 2026-02-23T13:01:44.549 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.paranoid_checks: 1 2026-02-23T13:01:44.549 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-23T13:01:44.549 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-23T13:01:44.549 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-23T13:01:44.550 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.env: 0xed5d60 2026-02-23T13:01:44.550 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.fs: PosixFileSystem 2026-02-23T13:01:44.550 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.info_log: 0x36aeec0 2026-02-23T13:01:44.550 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.max_file_opening_threads: 16 2026-02-23T13:01:44.550 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.statistics: (nil) 2026-02-23T13:01:44.550 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.use_fsync: 0 2026-02-23T13:01:44.550 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.max_log_file_size: 0 2026-02-23T13:01:44.550 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-23T13:01:44.550 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-23T13:01:44.550 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.keep_log_file_num: 1000 2026-02-23T13:01:44.550 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.recycle_log_file_num: 0 2026-02-23T13:01:44.550 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.allow_fallocate: 1 2026-02-23T13:01:44.550 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.allow_mmap_reads: 0 2026-02-23T13:01:44.550 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.allow_mmap_writes: 0 2026-02-23T13:01:44.550 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.use_direct_reads: 0 2026-02-23T13:01:44.551 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-23T13:01:44.551 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.create_missing_column_families: 0 2026-02-23T13:01:44.551 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.db_log_dir: 2026-02-23T13:01:44.551 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.wal_dir: 2026-02-23T13:01:44.551 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-23T13:01:44.551 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-23T13:01:44.551 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-23T13:01:44.551 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-23T13:01:44.551 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-23T13:01:44.551 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-23T13:01:44.551 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.advise_random_on_open: 1 2026-02-23T13:01:44.551 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.db_write_buffer_size: 0 2026-02-23T13:01:44.551 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.write_buffer_manager: 0x36aa140 2026-02-23T13:01:44.551 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-23T13:01:44.551 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-23T13:01:44.552 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-23T13:01:44.552 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.rate_limiter: (nil) 2026-02-23T13:01:44.552 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-23T13:01:44.552 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.wal_recovery_mode: 2 2026-02-23T13:01:44.552 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.enable_thread_tracking: 0 2026-02-23T13:01:44.552 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.enable_pipelined_write: 0 2026-02-23T13:01:44.552 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.unordered_write: 0 2026-02-23T13:01:44.552 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-23T13:01:44.552 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-23T13:01:44.552 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-23T13:01:44.552 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-23T13:01:44.552 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.row_cache: None 2026-02-23T13:01:44.552 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.wal_filter: None 2026-02-23T13:01:44.552 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-23T13:01:44.552 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.allow_ingest_behind: 0 2026-02-23T13:01:44.552 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.two_write_queues: 0 2026-02-23T13:01:44.552 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.manual_wal_flush: 0 2026-02-23T13:01:44.553 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.wal_compression: 0 2026-02-23T13:01:44.553 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.atomic_flush: 0 2026-02-23T13:01:44.553 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-23T13:01:44.553 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-23T13:01:44.553 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-23T13:01:44.553 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.log_readahead_size: 0 2026-02-23T13:01:44.553 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-23T13:01:44.553 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.best_efforts_recovery: 0 2026-02-23T13:01:44.553 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-23T13:01:44.553 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-23T13:01:44.553 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.allow_data_in_errors: 0 2026-02-23T13:01:44.553 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.db_host_id: __hostname__ 2026-02-23T13:01:44.553 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-23T13:01:44.553 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.max_background_jobs: 2 2026-02-23T13:01:44.553 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.max_background_compactions: -1 2026-02-23T13:01:44.553 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.max_subcompactions: 1 2026-02-23T13:01:44.553 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-23T13:01:44.554 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-23T13:01:44.554 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-23T13:01:44.554 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.max_total_wal_size: 0 2026-02-23T13:01:44.554 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-23T13:01:44.554 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-23T13:01:44.554 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-23T13:01:44.554 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-23T13:01:44.554 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.max_open_files: -1 2026-02-23T13:01:44.554 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.bytes_per_sync: 0 2026-02-23T13:01:44.554 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-23T13:01:44.554 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-23T13:01:44.554 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.compaction_readahead_size: 0 2026-02-23T13:01:44.554 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.max_background_flushes: -1 2026-02-23T13:01:44.554 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Compression algorithms supported: 2026-02-23T13:01:44.554 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: kZSTD supported: 0 2026-02-23T13:01:44.554 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: kXpressCompression supported: 0 2026-02-23T13:01:44.554 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: kBZip2Compression supported: 0 2026-02-23T13:01:44.554 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-23T13:01:44.555 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: kLZ4Compression supported: 1 2026-02-23T13:01:44.555 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: kZlibCompression supported: 1 2026-02-23T13:01:44.555 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: kLZ4HCCompression supported: 1 2026-02-23T13:01:44.555 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: kSnappyCompression supported: 1 2026-02-23T13:01:44.555 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-23T13:01:44.555 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-23T13:01:44.555 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2026-02-23T13:01:44.555 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-23T13:01:44.555 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-23T13:01:44.555 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.merge_operator: 2026-02-23T13:01:44.555 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.compaction_filter: None 2026-02-23T13:01:44.555 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.compaction_filter_factory: None 2026-02-23T13:01:44.555 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.sst_partitioner_factory: None 2026-02-23T13:01:44.555 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-23T13:01:44.555 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-23T13:01:44.555 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x36af600) 2026-02-23T13:01:44.555 INFO:journalctl@ceph.mon.a.trial046.stdout: cache_index_and_filter_blocks: 1 2026-02-23T13:01:44.555 INFO:journalctl@ceph.mon.a.trial046.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-23T13:01:44.555 INFO:journalctl@ceph.mon.a.trial046.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-23T13:01:44.555 INFO:journalctl@ceph.mon.a.trial046.stdout: pin_top_level_index_and_filter: 1 2026-02-23T13:01:44.556 INFO:journalctl@ceph.mon.a.trial046.stdout: index_type: 0 2026-02-23T13:01:44.556 INFO:journalctl@ceph.mon.a.trial046.stdout: data_block_index_type: 0 2026-02-23T13:01:44.556 INFO:journalctl@ceph.mon.a.trial046.stdout: index_shortening: 1 2026-02-23T13:01:44.556 INFO:journalctl@ceph.mon.a.trial046.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-23T13:01:44.556 INFO:journalctl@ceph.mon.a.trial046.stdout: checksum: 4 2026-02-23T13:01:44.556 INFO:journalctl@ceph.mon.a.trial046.stdout: no_block_cache: 0 2026-02-23T13:01:44.556 INFO:journalctl@ceph.mon.a.trial046.stdout: block_cache: 0x367da50 2026-02-23T13:01:44.556 INFO:journalctl@ceph.mon.a.trial046.stdout: block_cache_name: BinnedLRUCache 2026-02-23T13:01:44.556 INFO:journalctl@ceph.mon.a.trial046.stdout: block_cache_options: 2026-02-23T13:01:44.556 INFO:journalctl@ceph.mon.a.trial046.stdout: capacity : 536870912 2026-02-23T13:01:44.556 INFO:journalctl@ceph.mon.a.trial046.stdout: num_shard_bits : 4 2026-02-23T13:01:44.556 INFO:journalctl@ceph.mon.a.trial046.stdout: strict_capacity_limit : 0 2026-02-23T13:01:44.556 INFO:journalctl@ceph.mon.a.trial046.stdout: high_pri_pool_ratio: 0.000 2026-02-23T13:01:44.556 INFO:journalctl@ceph.mon.a.trial046.stdout: block_cache_compressed: (nil) 2026-02-23T13:01:44.556 INFO:journalctl@ceph.mon.a.trial046.stdout: persistent_cache: (nil) 2026-02-23T13:01:44.556 INFO:journalctl@ceph.mon.a.trial046.stdout: block_size: 4096 2026-02-23T13:01:44.556 INFO:journalctl@ceph.mon.a.trial046.stdout: block_size_deviation: 10 2026-02-23T13:01:44.556 INFO:journalctl@ceph.mon.a.trial046.stdout: block_restart_interval: 16 2026-02-23T13:01:44.556 INFO:journalctl@ceph.mon.a.trial046.stdout: index_block_restart_interval: 1 2026-02-23T13:01:44.556 INFO:journalctl@ceph.mon.a.trial046.stdout: metadata_block_size: 4096 2026-02-23T13:01:44.556 INFO:journalctl@ceph.mon.a.trial046.stdout: partition_filters: 0 2026-02-23T13:01:44.556 INFO:journalctl@ceph.mon.a.trial046.stdout: use_delta_encoding: 1 2026-02-23T13:01:44.556 INFO:journalctl@ceph.mon.a.trial046.stdout: filter_policy: bloomfilter 2026-02-23T13:01:44.556 INFO:journalctl@ceph.mon.a.trial046.stdout: whole_key_filtering: 1 2026-02-23T13:01:44.556 INFO:journalctl@ceph.mon.a.trial046.stdout: verify_compression: 0 2026-02-23T13:01:44.557 INFO:journalctl@ceph.mon.a.trial046.stdout: read_amp_bytes_per_bit: 0 2026-02-23T13:01:44.557 INFO:journalctl@ceph.mon.a.trial046.stdout: format_version: 5 2026-02-23T13:01:44.557 INFO:journalctl@ceph.mon.a.trial046.stdout: enable_index_compression: 1 2026-02-23T13:01:44.557 INFO:journalctl@ceph.mon.a.trial046.stdout: block_align: 0 2026-02-23T13:01:44.557 INFO:journalctl@ceph.mon.a.trial046.stdout: max_auto_readahead_size: 262144 2026-02-23T13:01:44.557 INFO:journalctl@ceph.mon.a.trial046.stdout: prepopulate_block_cache: 0 2026-02-23T13:01:44.557 INFO:journalctl@ceph.mon.a.trial046.stdout: initial_auto_readahead_size: 8192 2026-02-23T13:01:44.557 INFO:journalctl@ceph.mon.a.trial046.stdout: num_file_reads_for_auto_readahead: 2 2026-02-23T13:01:44.557 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.write_buffer_size: 33554432 2026-02-23T13:01:44.557 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.max_write_buffer_number: 2 2026-02-23T13:01:44.557 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.compression: NoCompression 2026-02-23T13:01:44.557 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.bottommost_compression: Disabled 2026-02-23T13:01:44.557 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.prefix_extractor: nullptr 2026-02-23T13:01:44.557 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-23T13:01:44.557 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.num_levels: 7 2026-02-23T13:01:44.557 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-23T13:01:44.557 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-23T13:01:44.557 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-23T13:01:44.557 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-23T13:01:44.557 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-23T13:01:44.557 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-23T13:01:44.557 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-23T13:01:44.557 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-23T13:01:44.557 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-23T13:01:44.557 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-23T13:01:44.557 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-23T13:01:44.557 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-23T13:01:44.557 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-23T13:01:44.557 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.compression_opts.level: 32767 2026-02-23T13:01:44.557 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.compression_opts.strategy: 0 2026-02-23T13:01:44.557 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-23T13:01:44.557 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-23T13:01:44.557 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-23T13:01:44.557 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-23T13:01:44.557 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.compression_opts.enabled: false 2026-02-23T13:01:44.558 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-23T13:01:44.558 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-23T13:01:44.558 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-23T13:01:44.558 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-23T13:01:44.558 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.target_file_size_base: 67108864 2026-02-23T13:01:44.558 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-23T13:01:44.558 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-23T13:01:44.558 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-23T13:01:44.558 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-23T13:01:44.558 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-23T13:01:44.558 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-23T13:01:44.558 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-23T13:01:44.558 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-23T13:01:44.558 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-23T13:01:44.558 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-23T13:01:44.558 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-23T13:01:44.558 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-23T13:01:44.558 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-23T13:01:44.558 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-23T13:01:44.558 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.arena_block_size: 1048576 2026-02-23T13:01:44.559 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-23T13:01:44.559 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-23T13:01:44.559 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.disable_auto_compactions: 0 2026-02-23T13:01:44.559 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-23T13:01:44.559 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-23T13:01:44.559 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-23T13:01:44.559 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-23T13:01:44.559 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-23T13:01:44.559 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-23T13:01:44.559 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-23T13:01:44.559 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-23T13:01:44.559 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-23T13:01:44.559 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-23T13:01:44.559 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-23T13:01:44.559 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.inplace_update_support: 0 2026-02-23T13:01:44.559 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-23T13:01:44.559 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-23T13:01:44.559 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-23T13:01:44.559 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-23T13:01:44.559 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.bloom_locality: 0 2026-02-23T13:01:44.559 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.max_successive_merges: 0 2026-02-23T13:01:44.559 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-23T13:01:44.559 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.paranoid_file_checks: 0 2026-02-23T13:01:44.559 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.force_consistency_checks: 1 2026-02-23T13:01:44.559 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.report_bg_io_stats: 0 2026-02-23T13:01:44.560 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.ttl: 2592000 2026-02-23T13:01:44.560 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-23T13:01:44.560 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-23T13:01:44.560 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-23T13:01:44.560 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.enable_blob_files: false 2026-02-23T13:01:44.560 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.min_blob_size: 0 2026-02-23T13:01:44.560 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.blob_file_size: 268435456 2026-02-23T13:01:44.560 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-23T13:01:44.560 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-23T13:01:44.560 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-23T13:01:44.560 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-23T13:01:44.560 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-23T13:01:44.560 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.blob_file_starting_level: 0 2026-02-23T13:01:44.560 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-23T13:01:44.560 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2026-02-23T13:01:44.560 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2026-02-23T13:01:44.560 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 448b5497-9811-467a-84d8-8cf19056937c 2026-02-23T13:01:44.560 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771851704488699, "job": 1, "event": "recovery_started", "wal_files": [9]} 2026-02-23T13:01:44.560 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2026-02-23T13:01:44.560 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771851704489616, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 94578, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 325, "table_properties": {"data_size": 92516, "index_size": 255, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 15701, "raw_average_key_size": 53, "raw_value_size": 84320, "raw_average_value_size": 284, "num_data_blocks": 9, "num_entries": 296, "num_filter_entries": 296, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1771851704, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "448b5497-9811-467a-84d8-8cf19056937c", "db_session_id": "EH4XRMTUQI42IQVGZRRU", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2026-02-23T13:01:44.560 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771851704489687, "job": 1, "event": "recovery_finished"} 2026-02-23T13:01:44.560 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2026-02-23T13:01:44.560 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-23T13:01:44.560 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x36cae00 2026-02-23T13:01:44.560 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: DB pointer 0x44bc000 2026-02-23T13:01:44.560 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-23T13:01:44.560 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-23T13:01:44.560 INFO:journalctl@ceph.mon.a.trial046.stdout: ** DB Stats ** 2026-02-23T13:01:44.560 INFO:journalctl@ceph.mon.a.trial046.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-23T13:01:44.560 INFO:journalctl@ceph.mon.a.trial046.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-23T13:01:44.560 INFO:journalctl@ceph.mon.a.trial046.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-23T13:01:44.560 INFO:journalctl@ceph.mon.a.trial046.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-23T13:01:44.560 INFO:journalctl@ceph.mon.a.trial046.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-23T13:01:44.560 INFO:journalctl@ceph.mon.a.trial046.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-23T13:01:44.561 INFO:journalctl@ceph.mon.a.trial046.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-23T13:01:44.561 INFO:journalctl@ceph.mon.a.trial046.stdout: 2026-02-23T13:01:44.561 INFO:journalctl@ceph.mon.a.trial046.stdout: ** Compaction Stats [default] ** 2026-02-23T13:01:44.561 INFO:journalctl@ceph.mon.a.trial046.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-23T13:01:44.561 INFO:journalctl@ceph.mon.a.trial046.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-23T13:01:44.561 INFO:journalctl@ceph.mon.a.trial046.stdout: L0 2/0 94.23 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 157.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-23T13:01:44.561 INFO:journalctl@ceph.mon.a.trial046.stdout: Sum 2/0 94.23 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 157.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-23T13:01:44.561 INFO:journalctl@ceph.mon.a.trial046.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 157.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-23T13:01:44.561 INFO:journalctl@ceph.mon.a.trial046.stdout: 2026-02-23T13:01:44.561 INFO:journalctl@ceph.mon.a.trial046.stdout: ** Compaction Stats [default] ** 2026-02-23T13:01:44.561 INFO:journalctl@ceph.mon.a.trial046.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-23T13:01:44.561 INFO:journalctl@ceph.mon.a.trial046.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-23T13:01:44.561 INFO:journalctl@ceph.mon.a.trial046.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 157.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-23T13:01:44.561 INFO:journalctl@ceph.mon.a.trial046.stdout: 2026-02-23T13:01:44.561 INFO:journalctl@ceph.mon.a.trial046.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-23T13:01:44.561 INFO:journalctl@ceph.mon.a.trial046.stdout: 2026-02-23T13:01:44.561 INFO:journalctl@ceph.mon.a.trial046.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-23T13:01:44.561 INFO:journalctl@ceph.mon.a.trial046.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-23T13:01:44.561 INFO:journalctl@ceph.mon.a.trial046.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-23T13:01:44.561 INFO:journalctl@ceph.mon.a.trial046.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-23T13:01:44.561 INFO:journalctl@ceph.mon.a.trial046.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-23T13:01:44.561 INFO:journalctl@ceph.mon.a.trial046.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-23T13:01:44.561 INFO:journalctl@ceph.mon.a.trial046.stdout: Cumulative compaction: 0.00 GB write, 26.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-23T13:01:44.561 INFO:journalctl@ceph.mon.a.trial046.stdout: Interval compaction: 0.00 GB write, 26.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-23T13:01:44.561 INFO:journalctl@ceph.mon.a.trial046.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-23T13:01:44.561 INFO:journalctl@ceph.mon.a.trial046.stdout: Block cache BinnedLRUCache@0x367da50#2 capacity: 512.00 MB usage: 6.98 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2026-02-23T13:01:44.561 INFO:journalctl@ceph.mon.a.trial046.stdout: Block cache entry stats(count,size,portion): DataBlock(2,5.53 KB,0.001055%) FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.44 KB,8.34465e-05%) Misc(1,0.00 KB,0%) 2026-02-23T13:01:44.561 INFO:journalctl@ceph.mon.a.trial046.stdout: 2026-02-23T13:01:44.561 INFO:journalctl@ceph.mon.a.trial046.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-23T13:01:44.561 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: starting mon.a rank 0 at public addrs [v2:10.20.193.46:3300/0,v1:10.20.193.46:6789/0] at bind addrs [v2:10.20.193.46:3300/0,v1:10.20.193.46:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 2026-02-23T13:01:44.561 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: mon.a@-1(???) e1 preinit fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 2026-02-23T13:01:44.561 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: mon.a@-1(???).mds e1 new map 2026-02-23T13:01:44.561 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: mon.a@-1(???).mds e1 print_map 2026-02-23T13:01:44.561 INFO:journalctl@ceph.mon.a.trial046.stdout: e1 2026-02-23T13:01:44.562 INFO:journalctl@ceph.mon.a.trial046.stdout: btime 2026-02-23T13:01:43:504930+0000 2026-02-23T13:01:44.562 INFO:journalctl@ceph.mon.a.trial046.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-23T13:01:44.562 INFO:journalctl@ceph.mon.a.trial046.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-23T13:01:44.562 INFO:journalctl@ceph.mon.a.trial046.stdout: legacy client fscid: -1 2026-02-23T13:01:44.562 INFO:journalctl@ceph.mon.a.trial046.stdout: 2026-02-23T13:01:44.562 INFO:journalctl@ceph.mon.a.trial046.stdout: No filesystems configured 2026-02-23T13:01:44.562 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-23T13:01:44.562 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-23T13:01:44.562 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-23T13:01:44.562 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-23T13:01:44.562 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2026-02-23T13:01:44.562 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mon-a[38571]: 2026-02-23T13:01:44.491+0000 7f3c9172dc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:44.562 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-23T13:01:44.562 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: monmap epoch 1 2026-02-23T13:01:44.562 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 2026-02-23T13:01:44.562 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: last_changed 2026-02-23T13:01:42.577208+0000 2026-02-23T13:01:44.562 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: created 2026-02-23T13:01:42.577208+0000 2026-02-23T13:01:44.562 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: min_mon_release 20 (tentacle) 2026-02-23T13:01:44.562 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: election_strategy: 1 2026-02-23T13:01:44.562 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: 0: [v2:10.20.193.46:3300/0,v1:10.20.193.46:6789/0] mon.a 2026-02-23T13:01:44.562 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: fsmap 2026-02-23T13:01:44.562 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: osdmap e1: 0 total, 0 up, 0 in 2026-02-23T13:01:44.562 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:44 trial046 ceph-mon[38575]: mgrmap e1: no daemons active 2026-02-23T13:01:44.634 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:44.575+0000 7f2f68d7e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:44.634 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:44.581+0000 7f2f68d7e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:44.634 INFO:teuthology.orchestra.run.trial046.stdout:Wrote config to /etc/ceph/ceph.conf 2026-02-23T13:01:44.635 INFO:teuthology.orchestra.run.trial046.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-02-23T13:01:44.635 INFO:teuthology.orchestra.run.trial046.stdout:Creating mgr... 2026-02-23T13:01:44.635 INFO:teuthology.orchestra.run.trial046.stdout:Verifying port 0.0.0.0:9283 ... 2026-02-23T13:01:44.635 INFO:teuthology.orchestra.run.trial046.stdout:Verifying port 0.0.0.0:8765 ... 2026-02-23T13:01:44.760 INFO:teuthology.orchestra.run.trial046.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@mgr.x 2026-02-23T13:01:44.760 INFO:teuthology.orchestra.run.trial046.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@mgr.x.service: Unit ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@mgr.x.service not loaded. 2026-02-23T13:01:44.871 INFO:teuthology.orchestra.run.trial046.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460.target.wants/ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@mgr.x.service → /etc/systemd/system/ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@.service. 2026-02-23T13:01:45.012 INFO:teuthology.orchestra.run.trial046.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-23T13:01:45.012 INFO:teuthology.orchestra.run.trial046.stdout:systemctl: stdout disabled 2026-02-23T13:01:45.018 INFO:teuthology.orchestra.run.trial046.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-23T13:01:45.018 INFO:teuthology.orchestra.run.trial046.stdout:systemctl: stdout inactive 2026-02-23T13:01:45.018 INFO:teuthology.orchestra.run.trial046.stdout:firewalld.service is not enabled 2026-02-23T13:01:45.018 INFO:teuthology.orchestra.run.trial046.stdout:Not possible to enable service . firewalld.service is not available 2026-02-23T13:01:45.024 INFO:teuthology.orchestra.run.trial046.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-23T13:01:45.024 INFO:teuthology.orchestra.run.trial046.stdout:systemctl: stdout disabled 2026-02-23T13:01:45.031 INFO:teuthology.orchestra.run.trial046.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-23T13:01:45.031 INFO:teuthology.orchestra.run.trial046.stdout:systemctl: stdout inactive 2026-02-23T13:01:45.031 INFO:teuthology.orchestra.run.trial046.stdout:firewalld.service is not enabled 2026-02-23T13:01:45.031 INFO:teuthology.orchestra.run.trial046.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2026-02-23T13:01:45.031 INFO:teuthology.orchestra.run.trial046.stdout:Waiting for mgr to start... 2026-02-23T13:01:45.031 INFO:teuthology.orchestra.run.trial046.stdout:Waiting for mgr... 2026-02-23T13:01:45.191 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout 2026-02-23T13:01:45.191 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout { 2026-02-23T13:01:45.191 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "fsid": "c3b3ca7d-10b7-11f1-8efe-d404e6e7d460", 2026-02-23T13:01:45.191 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "health": { 2026-02-23T13:01:45.191 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-23T13:01:45.191 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-23T13:01:45.191 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-23T13:01:45.191 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout }, 2026-02-23T13:01:45.191 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-23T13:01:45.191 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-23T13:01:45.191 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout 0 2026-02-23T13:01:45.191 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout ], 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "a" 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout ], 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "quorum_age": 0, 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout }, 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout }, 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout }, 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "btime": "2026-02-23T13:01:43:504930+0000", 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout }, 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout ], 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout }, 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "modified": "2026-02-23T13:01:43.505322+0000", 2026-02-23T13:01:45.192 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-23T13:01:45.193 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout }, 2026-02-23T13:01:45.193 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-23T13:01:45.193 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout } 2026-02-23T13:01:45.193 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:45.137+0000 7f1970c1d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:45.193 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:45.139+0000 7f1970c1d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:45.193 INFO:teuthology.orchestra.run.trial046.stdout:mgr not available, waiting (1/15)... 2026-02-23T13:01:46.000 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:45 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3256048937' entity='client.admin' 2026-02-23T13:01:46.000 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:45 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2692228576' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-23T13:01:46.289 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:01:46 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: from numpy import show_config as show_numpy_config 2026-02-23T13:01:47.353 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout 2026-02-23T13:01:47.353 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout { 2026-02-23T13:01:47.353 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "fsid": "c3b3ca7d-10b7-11f1-8efe-d404e6e7d460", 2026-02-23T13:01:47.353 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "health": { 2026-02-23T13:01:47.353 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-23T13:01:47.353 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-23T13:01:47.353 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-23T13:01:47.353 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout }, 2026-02-23T13:01:47.354 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-23T13:01:47.354 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-23T13:01:47.354 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout 0 2026-02-23T13:01:47.354 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout ], 2026-02-23T13:01:47.354 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-23T13:01:47.354 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "a" 2026-02-23T13:01:47.354 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout ], 2026-02-23T13:01:47.354 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2026-02-23T13:01:47.354 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-23T13:01:47.354 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-23T13:01:47.354 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-23T13:01:47.354 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-23T13:01:47.354 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout }, 2026-02-23T13:01:47.355 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-23T13:01:47.355 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-23T13:01:47.355 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-23T13:01:47.355 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-23T13:01:47.355 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-23T13:01:47.355 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-23T13:01:47.355 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-23T13:01:47.355 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-23T13:01:47.355 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout }, 2026-02-23T13:01:47.355 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-23T13:01:47.355 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-23T13:01:47.355 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-23T13:01:47.355 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-23T13:01:47.356 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-23T13:01:47.356 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-23T13:01:47.356 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-23T13:01:47.356 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-23T13:01:47.356 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-23T13:01:47.356 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout }, 2026-02-23T13:01:47.356 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-23T13:01:47.356 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-23T13:01:47.356 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "btime": "2026-02-23T13:01:43:504930+0000", 2026-02-23T13:01:47.356 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-23T13:01:47.356 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-23T13:01:47.356 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout }, 2026-02-23T13:01:47.356 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-23T13:01:47.357 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-23T13:01:47.357 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-23T13:01:47.357 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-23T13:01:47.357 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-23T13:01:47.357 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-23T13:01:47.357 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout ], 2026-02-23T13:01:47.357 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-23T13:01:47.357 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout }, 2026-02-23T13:01:47.357 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-23T13:01:47.357 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-23T13:01:47.357 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "modified": "2026-02-23T13:01:43.505322+0000", 2026-02-23T13:01:47.357 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-23T13:01:47.357 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout }, 2026-02-23T13:01:47.358 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-23T13:01:47.358 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout } 2026-02-23T13:01:47.358 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:47.289+0000 7f1205faa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:47.358 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:47.292+0000 7f1205faa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:47.358 INFO:teuthology.orchestra.run.trial046.stdout:mgr not available, waiting (2/15)... 2026-02-23T13:01:47.539 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:47 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2120371379' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-23T13:01:48.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:48 trial046 ceph-mon[38575]: Activating manager daemon x 2026-02-23T13:01:48.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:48 trial046 ceph-mon[38575]: mgrmap e2: x(active, starting, since 0.00283955s) 2026-02-23T13:01:48.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:48 trial046 ceph-mon[38575]: from='mgr.14100 10.20.193.46:0/1077991781' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-23T13:01:48.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:48 trial046 ceph-mon[38575]: from='mgr.14100 10.20.193.46:0/1077991781' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-23T13:01:48.790 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:48 trial046 ceph-mon[38575]: from='mgr.14100 10.20.193.46:0/1077991781' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-23T13:01:48.790 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:48 trial046 ceph-mon[38575]: from='mgr.14100 10.20.193.46:0/1077991781' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-23T13:01:48.790 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:48 trial046 ceph-mon[38575]: from='mgr.14100 10.20.193.46:0/1077991781' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-23T13:01:48.790 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:48 trial046 ceph-mon[38575]: Manager daemon x is now available 2026-02-23T13:01:48.790 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:48 trial046 ceph-mon[38575]: from='mgr.14100 10.20.193.46:0/1077991781' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-23T13:01:48.790 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:48 trial046 ceph-mon[38575]: from='mgr.14100 10.20.193.46:0/1077991781' entity='mgr.x' 2026-02-23T13:01:48.790 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:48 trial046 ceph-mon[38575]: from='mgr.14100 10.20.193.46:0/1077991781' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-23T13:01:48.790 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:48 trial046 ceph-mon[38575]: from='mgr.14100 10.20.193.46:0/1077991781' entity='mgr.x' 2026-02-23T13:01:48.790 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:48 trial046 ceph-mon[38575]: from='mgr.14100 10.20.193.46:0/1077991781' entity='mgr.x' 2026-02-23T13:01:49.635 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout 2026-02-23T13:01:49.635 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout { 2026-02-23T13:01:49.635 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "fsid": "c3b3ca7d-10b7-11f1-8efe-d404e6e7d460", 2026-02-23T13:01:49.635 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "health": { 2026-02-23T13:01:49.636 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-23T13:01:49.636 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-23T13:01:49.636 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-23T13:01:49.636 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout }, 2026-02-23T13:01:49.636 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-23T13:01:49.636 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-23T13:01:49.636 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout 0 2026-02-23T13:01:49.636 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout ], 2026-02-23T13:01:49.636 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-23T13:01:49.636 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "a" 2026-02-23T13:01:49.636 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout ], 2026-02-23T13:01:49.636 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2026-02-23T13:01:49.637 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-23T13:01:49.637 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-23T13:01:49.637 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-23T13:01:49.637 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-23T13:01:49.637 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout }, 2026-02-23T13:01:49.637 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-23T13:01:49.637 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-23T13:01:49.637 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-23T13:01:49.637 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-23T13:01:49.637 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-23T13:01:49.637 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-23T13:01:49.637 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-23T13:01:49.637 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-23T13:01:49.638 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout }, 2026-02-23T13:01:49.638 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-23T13:01:49.638 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-23T13:01:49.638 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-23T13:01:49.638 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-23T13:01:49.638 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-23T13:01:49.638 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-23T13:01:49.638 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-23T13:01:49.638 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-23T13:01:49.638 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-23T13:01:49.638 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout }, 2026-02-23T13:01:49.638 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-23T13:01:49.638 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-23T13:01:49.639 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "btime": "2026-02-23T13:01:43:504930+0000", 2026-02-23T13:01:49.639 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-23T13:01:49.639 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-23T13:01:49.639 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout }, 2026-02-23T13:01:49.639 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-23T13:01:49.639 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-23T13:01:49.639 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-23T13:01:49.639 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-23T13:01:49.639 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-23T13:01:49.639 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-23T13:01:49.639 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout ], 2026-02-23T13:01:49.639 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-23T13:01:49.639 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout }, 2026-02-23T13:01:49.640 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-23T13:01:49.640 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-23T13:01:49.640 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "modified": "2026-02-23T13:01:43.505322+0000", 2026-02-23T13:01:49.640 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-23T13:01:49.640 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout }, 2026-02-23T13:01:49.640 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-23T13:01:49.640 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout } 2026-02-23T13:01:49.640 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:49.448+0000 7f942fd40640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:49.640 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:49.451+0000 7f942fd40640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:49.640 INFO:teuthology.orchestra.run.trial046.stdout:mgr is available 2026-02-23T13:01:49.857 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout 2026-02-23T13:01:49.857 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout [global] 2026-02-23T13:01:49.857 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout fsid = c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 2026-02-23T13:01:49.858 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-23T13:01:49.858 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.46:3300,v1:10.20.193.46:6789] 2026-02-23T13:01:49.858 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-23T13:01:49.858 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-23T13:01:49.858 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-23T13:01:49.858 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-23T13:01:49.858 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout 2026-02-23T13:01:49.859 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-23T13:01:49.859 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-23T13:01:49.859 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout 2026-02-23T13:01:49.859 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout [osd] 2026-02-23T13:01:49.859 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-23T13:01:49.859 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-23T13:01:49.859 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:49.723+0000 7f2d22829640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:49.859 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:49.726+0000 7f2d22829640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:49.859 INFO:teuthology.orchestra.run.trial046.stdout:Enabling cephadm module... 2026-02-23T13:01:49.877 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:49 trial046 ceph-mon[38575]: mgrmap e3: x(active, since 1.00512s) 2026-02-23T13:01:49.877 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:49 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2130788179' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-23T13:01:50.781 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:49.944+0000 7ff0263b3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:50.781 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:49.949+0000 7ff0263b3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:51.022 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:50 trial046 ceph-mon[38575]: mgrmap e4: x(active, since 2s) 2026-02-23T13:01:51.022 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:50 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4048306605' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2026-02-23T13:01:51.022 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:50 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/857905982' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2026-02-23T13:01:51.022 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:01:50 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ignoring --setuser ceph since I am not root 2026-02-23T13:01:51.023 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:01:50 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ignoring --setgroup ceph since I am not root 2026-02-23T13:01:51.023 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:01:50 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: 2026-02-23T13:01:50.798+0000 7f819f4f8fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:51.023 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:01:50 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: 2026-02-23T13:01:50.800+0000 7f819f4f8fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:51.023 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:01:50 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: 2026-02-23T13:01:50.800+0000 7f819f4f8fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:51.045 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout { 2026-02-23T13:01:51.045 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "epoch": 5, 2026-02-23T13:01:51.045 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-23T13:01:51.045 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "active_name": "x", 2026-02-23T13:01:51.045 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-23T13:01:51.046 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout } 2026-02-23T13:01:51.046 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:50.876+0000 7f3ef2603640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:51.046 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:50.879+0000 7f3ef2603640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:51.046 INFO:teuthology.orchestra.run.trial046.stdout:Waiting for the mgr to restart... 2026-02-23T13:01:51.046 INFO:teuthology.orchestra.run.trial046.stdout:Waiting for mgr epoch 5... 2026-02-23T13:01:52.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:51 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/857905982' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-23T13:01:52.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:51 trial046 ceph-mon[38575]: mgrmap e5: x(active, since 3s) 2026-02-23T13:01:52.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:51 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4131987833' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-23T13:01:52.040 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:01:51 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-23T13:01:52.040 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:01:51 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-23T13:01:52.040 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:01:51 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: from numpy import show_config as show_numpy_config 2026-02-23T13:01:54.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:53 trial046 ceph-mon[38575]: Active manager daemon x restarted 2026-02-23T13:01:54.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:53 trial046 ceph-mon[38575]: Activating manager daemon x 2026-02-23T13:01:54.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:53 trial046 ceph-mon[38575]: osdmap e2: 0 total, 0 up, 0 in 2026-02-23T13:01:54.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:53 trial046 ceph-mon[38575]: mgrmap e6: x(active, starting, since 0.00252688s) 2026-02-23T13:01:54.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:53 trial046 ceph-mon[38575]: from='mgr.14118 10.20.193.46:0/1974273639' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-23T13:01:54.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:53 trial046 ceph-mon[38575]: from='mgr.14118 10.20.193.46:0/1974273639' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-23T13:01:54.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:53 trial046 ceph-mon[38575]: from='mgr.14118 10.20.193.46:0/1974273639' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-23T13:01:54.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:53 trial046 ceph-mon[38575]: from='mgr.14118 10.20.193.46:0/1974273639' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-23T13:01:54.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:53 trial046 ceph-mon[38575]: from='mgr.14118 10.20.193.46:0/1974273639' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-23T13:01:54.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:53 trial046 ceph-mon[38575]: Manager daemon x is now available 2026-02-23T13:01:54.565 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout { 2026-02-23T13:01:54.565 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2026-02-23T13:01:54.565 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-23T13:01:54.565 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout } 2026-02-23T13:01:54.565 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:51.147+0000 7f3b2ad15640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:54.565 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:51.150+0000 7f3b2ad15640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:54.565 INFO:teuthology.orchestra.run.trial046.stdout:mgr epoch 5 is available 2026-02-23T13:01:54.566 INFO:teuthology.orchestra.run.trial046.stdout:Verifying orchestrator module is enabled... 2026-02-23T13:01:55.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:54 trial046 ceph-mon[38575]: from='mgr.14118 10.20.193.46:0/1974273639' entity='mgr.x' 2026-02-23T13:01:55.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:54 trial046 ceph-mon[38575]: from='mgr.14118 10.20.193.46:0/1974273639' entity='mgr.x' 2026-02-23T13:01:55.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:54 trial046 ceph-mon[38575]: Found migration_current of "None". Setting to last migration. 2026-02-23T13:01:55.290 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:54 trial046 ceph-mon[38575]: from='mgr.14118 10.20.193.46:0/1974273639' entity='mgr.x' 2026-02-23T13:01:55.290 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:54 trial046 ceph-mon[38575]: from='mgr.14118 10.20.193.46:0/1974273639' entity='mgr.x' 2026-02-23T13:01:55.290 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:54 trial046 ceph-mon[38575]: from='mgr.14118 10.20.193.46:0/1974273639' entity='mgr.x' 2026-02-23T13:01:55.290 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:54 trial046 ceph-mon[38575]: from='mgr.14118 10.20.193.46:0/1974273639' entity='mgr.x' 2026-02-23T13:01:55.290 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:54 trial046 ceph-mon[38575]: from='mgr.14118 10.20.193.46:0/1974273639' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-23T13:01:55.290 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:54 trial046 ceph-mon[38575]: from='mgr.14118 10.20.193.46:0/1974273639' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-23T13:01:55.290 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:54 trial046 ceph-mon[38575]: from='mgr.14118 10.20.193.46:0/1974273639' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-23T13:01:55.290 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:54 trial046 ceph-mon[38575]: from='mgr.14118 10.20.193.46:0/1974273639' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-23T13:01:55.290 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:54 trial046 ceph-mon[38575]: from='mgr.14118 10.20.193.46:0/1974273639' entity='mgr.x' 2026-02-23T13:01:55.290 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:54 trial046 ceph-mon[38575]: from='mgr.14118 10.20.193.46:0/1974273639' entity='mgr.x' 2026-02-23T13:01:55.290 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:54 trial046 ceph-mon[38575]: [23/Feb/2026:13:01:54] ENGINE Bus STARTING 2026-02-23T13:01:55.291 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:54 trial046 ceph-mon[38575]: mgrmap e7: x(active, since 1.0042s) 2026-02-23T13:01:55.291 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:54 trial046 ceph-mon[38575]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-23T13:01:55.291 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:54 trial046 ceph-mon[38575]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-23T13:01:55.291 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:54 trial046 ceph-mon[38575]: [23/Feb/2026:13:01:54] ENGINE Serving on https://10.20.193.46:7150 2026-02-23T13:01:55.291 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:54 trial046 ceph-mon[38575]: [23/Feb/2026:13:01:54] ENGINE Client ('10.20.193.46', 56362) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-23T13:01:55.291 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:54 trial046 ceph-mon[38575]: [23/Feb/2026:13:01:54] ENGINE Serving on http://10.20.193.46:8765 2026-02-23T13:01:55.291 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:54 trial046 ceph-mon[38575]: [23/Feb/2026:13:01:54] ENGINE Bus STARTED 2026-02-23T13:01:55.291 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:54 trial046 ceph-mon[38575]: from='mgr.14118 10.20.193.46:0/1974273639' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-23T13:01:55.291 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:54 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/248439258' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2026-02-23T13:01:55.581 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:54.653+0000 7fb5d4e50640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:55.581 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:54.657+0000 7fb5d4e50640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:55.582 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2026-02-23T13:01:55.582 INFO:teuthology.orchestra.run.trial046.stdout:Setting orchestrator backend to cephadm... 2026-02-23T13:01:55.817 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:55.667+0000 7f2b7b169640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:55.818 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:55.671+0000 7f2b7b169640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:56.035 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout value unchanged 2026-02-23T13:01:56.035 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:55.903+0000 7f5013a97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:56.035 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:55.906+0000 7f5013a97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:56.036 INFO:teuthology.orchestra.run.trial046.stdout:Generating ssh key... 2026-02-23T13:01:56.278 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:56.122+0000 7f0431b1d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:56.278 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:56.125+0000 7f0431b1d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:56.324 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:01:56 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: Generating public/private ed25519 key pair. 2026-02-23T13:01:56.324 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:01:56 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: Your identification has been saved in /tmp/tmpr30hm3ob/key 2026-02-23T13:01:56.324 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:01:56 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: Your public key has been saved in /tmp/tmpr30hm3ob/key.pub 2026-02-23T13:01:56.324 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:01:56 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: The key fingerprint is: 2026-02-23T13:01:56.324 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:01:56 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: SHA256:2YORBaZzOLwFK9v3tG5W5V+4yLoV1hUtvDeYySB3sxs ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 2026-02-23T13:01:56.324 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:01:56 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: The key's randomart image is: 2026-02-23T13:01:56.324 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:01:56 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: +--[ED25519 256]--+ 2026-02-23T13:01:56.324 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:01:56 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: | . o.. . ..| 2026-02-23T13:01:56.324 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:01:56 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: | . * + o oo o| 2026-02-23T13:01:56.325 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:01:56 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: | . B = o + *o.| 2026-02-23T13:01:56.325 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:01:56 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: | + * = Eoo.| 2026-02-23T13:01:56.325 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:01:56 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: | . o S + oo+o.| 2026-02-23T13:01:56.325 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:01:56 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: | . o +.oo .| 2026-02-23T13:01:56.325 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:01:56 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: | oo.. o.| 2026-02-23T13:01:56.325 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:01:56 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: | .o.o . .| 2026-02-23T13:01:56.325 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:01:56 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: | o+o | 2026-02-23T13:01:56.325 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:01:56 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: +----[SHA256]-----+ 2026-02-23T13:01:56.508 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINHaz0d5Wb5r2YEkVIez6LnPJxqgIRZD0LXyiA3VO15L ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 2026-02-23T13:01:56.508 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:56.373+0000 7ff5d006b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:56.508 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:56.376+0000 7ff5d006b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:56.508 INFO:teuthology.orchestra.run.trial046.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2026-02-23T13:01:56.508 INFO:teuthology.orchestra.run.trial046.stdout:Adding key to root@localhost authorized_keys... 2026-02-23T13:01:56.509 INFO:teuthology.orchestra.run.trial046.stdout:Adding host trial046... 2026-02-23T13:01:56.605 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:56 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/248439258' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2026-02-23T13:01:56.606 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:56 trial046 ceph-mon[38575]: mgrmap e8: x(active, since 2s) 2026-02-23T13:01:56.606 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:56 trial046 ceph-mon[38575]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-23T13:01:56.606 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:56 trial046 ceph-mon[38575]: from='mgr.14118 10.20.193.46:0/1974273639' entity='mgr.x' 2026-02-23T13:01:56.606 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:56 trial046 ceph-mon[38575]: from='mgr.14118 10.20.193.46:0/1974273639' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-23T13:01:56.606 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:56 trial046 ceph-mon[38575]: from='mgr.14118 10.20.193.46:0/1974273639' entity='mgr.x' 2026-02-23T13:01:56.606 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:56 trial046 ceph-mon[38575]: from='mgr.14118 10.20.193.46:0/1974273639' entity='mgr.x' 2026-02-23T13:01:57.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:57 trial046 ceph-mon[38575]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-23T13:01:57.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:57 trial046 ceph-mon[38575]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-23T13:01:57.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:57 trial046 ceph-mon[38575]: Generating ssh key... 2026-02-23T13:01:57.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:57 trial046 ceph-mon[38575]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-23T13:01:57.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:57 trial046 ceph-mon[38575]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial046", "addr": "10.20.193.46", "target": ["mon-mgr", ""]}]: dispatch 2026-02-23T13:01:58.335 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout Added host 'trial046' with addr '10.20.193.46' 2026-02-23T13:01:58.335 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:56.603+0000 7fda1507b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:58.336 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:56.608+0000 7fda1507b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:58.336 INFO:teuthology.orchestra.run.trial046.stdout:Deploying unmanaged mon service... 2026-02-23T13:01:58.656 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-02-23T13:01:58.656 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:58.435+0000 7f820b7eb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:58.656 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:58.439+0000 7f820b7eb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:58.656 INFO:teuthology.orchestra.run.trial046.stdout:Deploying unmanaged mgr service... 2026-02-23T13:01:58.873 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:58 trial046 ceph-mon[38575]: Deploying cephadm binary to trial046 2026-02-23T13:01:58.874 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:58 trial046 ceph-mon[38575]: from='mgr.14118 10.20.193.46:0/1974273639' entity='mgr.x' 2026-02-23T13:01:58.874 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:58 trial046 ceph-mon[38575]: from='mgr.14118 10.20.193.46:0/1974273639' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-23T13:01:58.895 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-02-23T13:01:58.895 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:58.744+0000 7f60262ca640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:58.895 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:58.748+0000 7f60262ca640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:59.124 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:58.983+0000 7f0fb2063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:59.124 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:58.988+0000 7f0fb2063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:59.360 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:59.217+0000 7fcdb4cd4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:59.360 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:59.222+0000 7fcdb4cd4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:01:59.360 INFO:teuthology.orchestra.run.trial046.stdout:Enabling the dashboard module... 2026-02-23T13:01:59.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:59 trial046 ceph-mon[38575]: Added host trial046 2026-02-23T13:01:59.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:59 trial046 ceph-mon[38575]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-23T13:01:59.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:59 trial046 ceph-mon[38575]: Saving service mon spec with placement count:5 2026-02-23T13:01:59.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:59 trial046 ceph-mon[38575]: from='mgr.14118 10.20.193.46:0/1974273639' entity='mgr.x' 2026-02-23T13:01:59.790 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:59 trial046 ceph-mon[38575]: from='mgr.14118 10.20.193.46:0/1974273639' entity='mgr.x' 2026-02-23T13:01:59.790 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:59 trial046 ceph-mon[38575]: from='mgr.14118 10.20.193.46:0/1974273639' entity='mgr.x' 2026-02-23T13:01:59.790 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:59 trial046 ceph-mon[38575]: from='mgr.14118 10.20.193.46:0/1974273639' entity='mgr.x' 2026-02-23T13:01:59.790 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:59 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/227647159' entity='client.admin' 2026-02-23T13:01:59.790 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:59 trial046 ceph-mon[38575]: from='mgr.14118 10.20.193.46:0/1974273639' entity='mgr.x' 2026-02-23T13:01:59.790 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:01:59 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/646001406' entity='client.admin' 2026-02-23T13:02:00.587 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:00 trial046 ceph-mon[38575]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-23T13:02:00.587 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:00 trial046 ceph-mon[38575]: Saving service mgr spec with placement count:2 2026-02-23T13:02:00.587 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:00 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/650405857' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2026-02-23T13:02:00.587 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:00 trial046 ceph-mon[38575]: from='mgr.14118 10.20.193.46:0/1974273639' entity='mgr.x' 2026-02-23T13:02:00.591 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:59.459+0000 7f6fa930d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:00.591 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:01:59.464+0000 7f6fa930d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:00.839 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:02:00 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ignoring --setuser ceph since I am not root 2026-02-23T13:02:00.840 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:02:00 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ignoring --setgroup ceph since I am not root 2026-02-23T13:02:00.840 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:02:00 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: 2026-02-23T13:02:00.610+0000 7f7040919fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:00.840 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:02:00 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: 2026-02-23T13:02:00.612+0000 7f7040919fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:00.840 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:02:00 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: 2026-02-23T13:02:00.612+0000 7f7040919fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:00.854 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout { 2026-02-23T13:02:00.854 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "epoch": 9, 2026-02-23T13:02:00.854 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-23T13:02:00.854 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "active_name": "x", 2026-02-23T13:02:00.854 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-23T13:02:00.855 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout } 2026-02-23T13:02:00.855 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:02:00.686+0000 7f614e980640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:00.855 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:02:00.689+0000 7f614e980640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:00.855 INFO:teuthology.orchestra.run.trial046.stdout:Waiting for the mgr to restart... 2026-02-23T13:02:00.855 INFO:teuthology.orchestra.run.trial046.stdout:Waiting for mgr epoch 9... 2026-02-23T13:02:02.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:01 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/650405857' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2026-02-23T13:02:02.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:01 trial046 ceph-mon[38575]: mgrmap e9: x(active, since 7s) 2026-02-23T13:02:02.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:01 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2074084394' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-23T13:02:02.040 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:02:01 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-23T13:02:02.040 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:02:01 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-23T13:02:02.040 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:02:01 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: from numpy import show_config as show_numpy_config 2026-02-23T13:02:03.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:03 trial046 ceph-mon[38575]: Active manager daemon x restarted 2026-02-23T13:02:03.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:03 trial046 ceph-mon[38575]: Activating manager daemon x 2026-02-23T13:02:03.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:03 trial046 ceph-mon[38575]: osdmap e3: 0 total, 0 up, 0 in 2026-02-23T13:02:03.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:03 trial046 ceph-mon[38575]: mgrmap e10: x(active, starting, since 0.00284644s) 2026-02-23T13:02:03.790 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:03 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-23T13:02:03.790 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:03 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-23T13:02:03.790 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:03 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-23T13:02:03.790 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:03 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-23T13:02:03.790 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:03 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-23T13:02:03.790 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:03 trial046 ceph-mon[38575]: Manager daemon x is now available 2026-02-23T13:02:04.648 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:04 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-23T13:02:04.648 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:04 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-23T13:02:04.648 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:04 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-23T13:02:04.648 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:04 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:04.648 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:04 trial046 ceph-mon[38575]: mgrmap e11: x(active, since 1.00405s) 2026-02-23T13:02:04.651 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout { 2026-02-23T13:02:04.651 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2026-02-23T13:02:04.651 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-23T13:02:04.651 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout } 2026-02-23T13:02:04.652 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:02:00.952+0000 7f969589d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:04.652 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:02:00.956+0000 7f969589d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:04.652 INFO:teuthology.orchestra.run.trial046.stdout:mgr epoch 9 is available 2026-02-23T13:02:04.652 INFO:teuthology.orchestra.run.trial046.stdout:Using certmgr to generate dashboard self-signed certificate... 2026-02-23T13:02:05.317 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIFHzCCAwegAwIBAgIUTp3qN5A+EpHQjZc9khTTqa5MDpkwDQYJKoZIhvcNAQEL\nBQAwPDE6MDgGA1UEAwwxY2VwaGFkbS1yb290LWMzYjNjYTdkLTEwYjctMTFmMS04\nZWZlLWQ0MDRlNmU3ZDQ2MDAeFw0yNjAyMjMxMzAyMDVaFw0yOTAyMjIxMzAyMDVa\nMBcxFTATBgNVBAMMDDEwLjIwLjE5My40NjCCAiIwDQYJKoZIhvcNAQEBBQADggIP\nADCCAgoCggIBAJ+p+VSNd0YMpzKuT7M6hRDGIx9ApozCirD+XKvx9BoQMAKI+VxX\nTe4HCUA6cBwSpHq1ds6lPCidfCag6gLs3FYmS2egKLK1ujCflD2awPZXXG03xgvi\nIg1ACOgYhlO3mqxBkZtgxR/+zTFiUpnNjzprkqeondW3uPivMVdgRL/K5jXfX4Bq\nBw3WCGT/wERHMjr1PwQRAgLxvXJxVgRSrF4yM4vLeSF4uUGJiTSq7jOE/qwWZLS1\nYJ+ivMa6cST+viyx9+tXkHS5FIzDz7eOK+bcnWxnw/TP6C+rlDZZwlxwBfDucFkq\nFOOt/23aeZwhVLMri6dS3GHbJZLrn9p6g/A5arzajDiXIupV/pdeQ29oQGIWCD/v\n3Ghn4zGYFIc5FVqkBQORCUlu48rBKyB2FxGUlwDpXgRPUxB6sFUMMThgi5UaWKkc\n9qaWk1VYuQZq76NQYBFtoEm9lgxkq97+Nv0AsSMnIIgNBa4PceVw9x2L3Ec/LVoY\nCf+YgsVdpg3p186L+98QZD4xLMMIo8vB1b26SnN5ClS9OeDY+hay0Z36rDSXuGAN\n+MozSw+r6Ykqk0aRtEgcaEtC477flQPrHFi6G0oHObakXIJ3ySVnCH1QS6GkGTnq\npmrHSX6Dw1kNP5Nj2cAHl3L5Mj86zhpHLUYmveEFpzLS+tKWsvxz0ya7AgMBAAGj\nPjA8MCwGA1UdEQQlMCOCCHRyaWFsMDQ2ghFkYXNoYm9hcmRfc2VydmVyc4cEChTB\nLjAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBCwUAA4ICAQBXPRVzCs8gZKcPgi0z\n+LStKBzlgqA/FWDvJXbHd4fyGVsRvGD/AtSovE5pqhFyoxN1t8TL7Sz/d8nClNoK\nzfyqkV26N7X3FocVJbLE2Xx5doOuDtO6QFL5qkO6zBRysOf6OkCVVyxun/kIrD02\nBOp3vuOvvz3NxZNuVM+HzFPIrZBQaFpqkI+xSHHIKLOBzfnE3SYVSGzeAQIsF7FQ\n5Rld169lo3dB4OG5za8ew1TnQe0b/5JzHYotmyHwl5f7FLC1DnlBYeYmeH0kG0a3\nR9s67j79n18VS8Mx1jfvPKbljsZqTras88wOlOgMNXK2ilJL+3jrnRjlCwKaZaBp\nx40BblDq5i0GrLTk1BiYjty2tCAxQXZjsIwJ8LSLq5XE+6k3rh1fek0dZdg0ZEmD\ntSFOlAVHjMulIzdIgPtOzjpmcy5Iwht3XRvWfU2+ab82L460PCc7MWgb7DXZ9JGC\n2o7ozhGWV75Ana2SG6A1Y51n+nHXGWsKByO2cp9nNgSL6m7E8E6bbDs83YqgRtHk\n3XKRq/poRhudaQjaI/2naLx9750qCqbq0GAiFSltiDR4ElN0NrC8W6p6Xa3vgvBj\n+zgQdObgpXAzyuVpHf5htbq68fYo1zxcSGaZD5iqkNeEUjDTQkud8NQbZ383h2uw\nX4Sq0mkYgSFmQ/yWoApEYF5PtA==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJJgIBAAKCAgEAn6n5VI13RgynMq5PszqFEMYjH0CmjMKKsP5cq/H0GhAwAoj5\nXFdN7gcJQDpwHBKkerV2zqU8KJ18JqDqAuzcViZLZ6AosrW6MJ+UPZrA9ldcbTfG\nC+IiDUAI6BiGU7earEGRm2DFH/7NMWJSmc2POmuSp6id1be4+K8xV2BEv8rmNd9f\ngGoHDdYIZP/AREcyOvU/BBECAvG9cnFWBFKsXjIzi8t5IXi5QYmJNKruM4T+rBZk\ntLVgn6K8xrpxJP6+LLH361eQdLkUjMPPt44r5tydbGfD9M/oL6uUNlnCXHAF8O5w\nWSoU463/bdp5nCFUsyuLp1LcYdslkuuf2nqD8DlqvNqMOJci6lX+l15Db2hAYhYI\nP+/caGfjMZgUhzkVWqQFA5EJSW7jysErIHYXEZSXAOleBE9TEHqwVQwxOGCLlRpY\nqRz2ppaTVVi5Bmrvo1BgEW2gSb2WDGSr3v42/QCxIycgiA0Frg9x5XD3HYvcRz8t\nWhgJ/5iCxV2mDenXzov73xBkPjEswwijy8HVvbpKc3kKVL054Nj6FrLRnfqsNJe4\nYA34yjNLD6vpiSqTRpG0SBxoS0Ljvt+VA+scWLobSgc5tqRcgnfJJWcIfVBLoaQZ\nOeqmasdJfoPDWQ0/k2PZwAeXcvkyPzrOGkctRia94QWnMtL60pay/HPTJrsCAwEA\nAQKCAf8b24xP3wmbL0SnkxeqLeEJtt2/QN3OXCMsE+AXdXUhwbFJapzCKnluY8vk\nE6N77Roa+Y5r1RNUrXr77ReSFcGxRlKMbLqtHl1eHnm+8Ja6ZIO73/9YvhvdiU6v\nMELqWHP5miHNpRS/1bVM6IWA+wdX1MJsflRg9a1QYUDlUzwA5WXwAF6pXoEx6NDj\neRFoLa6V8DRj1pPYmlUeTVK0w7f6DMhG8TmGnYm1OvS1kR1T3+CPe1jBhDlXoQ1O\n9I4ekP6deG/JStM+37a2Lh66kr5riWfuLNdZNO1ODqHNhIZk79Fu4tYMuKBBxBoi\nZfwnQamFmWjEc7Cqt5HWu0XTg4zWwOgfJCIHA5WEndqSuGg2q6hJS5guj8Mi73zT\niHgr5J62jBJWKEXe5oy0LndDDeH/A4Zpqr2RBDWqM25ECpnIital51hsmdAT5lDq\nL5BoPbNJwF9Ub0WfHHIrJE348V0lhvdMyFAREw3+zkgy79K1Y62Nkuys0qNReDrn\nKCBj+oON9A77mW1BTjDKwEqrINwiNdtNUNV+XiD3Hkxuo4qiYq4tGnx7sN+p/UJt\nu4RpKO2CQBM0+wHgRVMYV4WlnNmoAjyBAjXn8t7a7DmclQ4ZYX8Iun87fNLmmpRP\nKtq8REAciJbUWKr1tPddg98M0BBJ/Z8W4eCUnk+TmRgk2hqRAoIBAQDgjTNK1L45\nwSTyMrFXtOUUKP9OXyXs3D39TLM/WcIzGXghMVPqnJ1/EQ+Dv1Ye4Z1PHkN/Ik1k\ndRwPq0m/puN25OYLvlfzfVQ+JOcS24Q7LH10x3aXIpVZAGQiMGtLE+7wzpDLhetW\nj+uMv26Qv/au2PQciRr9KMtadtz4oWQ2gG6wBsTOrAgf1Dp0blugl0vZ3AJ+DJJ4\nxz/RUus/aGA8rL2chpKphd2VxDdjHwrzXrvCtAaLn/zEyqJ35rQ48425BcfYrbkc\nXEllnPcwoI5kNbbYwopPUDONzG8tKvtgPFr7IZMD4LfXsdLo3sV4PzcGo26H3EeQ\n/zibwN5JnZRNAoIBAQC2Bl9B1v1X946/Rv17NSDPGYsrr+tERqwmDk53gyZKC4Pw\n9NSMAYak0S1/UGm/dDXRxJ+oZlEldrTuSvdmJCv5MQ4lkMu9IV90vdKPid8BS5P8\nG/W8Hdw6KvrcbWyM6TqgbwZtG3oEF799SVzJKeaZ17byDc3tJSv72+voq45aGRhn\nuj6bEtYrcriskKUgIElawXmLZ+0NTGwIDRbLcTpW8Mh1fMS8MdhivcNQvjWPDlJi\nlI+TYA3aj19Fk6ESp0BZlHsL4nMQ7FUAhNG0fsY3AG881P/vEwjVTcwDgf9ew+tR\nmXA/6I70Ex0ko369FZhdwDJ4QJ/R448KNI1HW0snAoIBADXAly6qjn60xWtUxy7/\nlnak+biA/ksczZn86kuX6Ozig+cuL7BRnUH1i4k2HB94UnfF/tJIG86YWgdGMXk3\nMewcDxVwkw0uSyQ1ITtaYOTpWX7C4Jh9JtMPTOkCPizSsLfkOrT9ccBe4zvl90mf\nKiXguU67Y0KGqWcWXP8HYz3IsLZiaGowtCEqZHPKlxRyIy4bhF04FTfkOlqZRsb+\n7UqY7yqw7Bq4eLqJJdkMbUqkur146rgxrAhPmWSqTSn041APGi+8Jjuru8YfNOzn\nAi7qzMJGj2U9BZpD/bkKOPJogD7tYovjFx8C6kHkUdDfEQT9yk+rY1ZKQfrGyG9G\n0WECggEAFuteey/S3oyxUKxjpmveIbWZrHqOKR6s9m2+u5Wr8I7aojBxwt8+UOp1\nzB4X8p9zV2JmqBGaDhmQVqDh3d6YGtxuZ5R/0uSs3Eo6hRBbIBKgI5Jxsqof3MMk\nqzSsAmIrm5/fM0XOa02CMwhVwo6gFqbuxjOuxjlz/FaIsddIKVgXlpgA4g3RIc9k\nKXZdFFp8Yg0SfNctJguFXs4nHJ65NdFDrGd1bizojiZOvY/1tnmbLgZ+vZPOqsJ6\nwIwCMBMXKzBi/fAZhPv9B/+xWATOeIZ5ezNmtnezGQies6JewVPyAWhMlf92YI03\nkjFz9+MMOGHG+RVKCmeYzzQmxeFc6QKCAQBUJ8mqx+JhdtYQWpwJ9ZT0nCDuqzEn\nGDF5IBDpsr0tmMCwdXsEKYDNBLzmOStbtx8QebxJo+7tRcy4YvPvLRtSGHSM5WY6\nbbLOhKoY1IH5jze0leOURsoJBnQOrIY0s14L1jVyQqfv1s/Rxanrix85T0bXmq0o\nJBW4daWHNw7JFQ2Bqc8QFmSBn+Z4k7i6XCC1ofbuPOhHFOBPNFA4we1aVaZLJT82\nrgBlOkzf7XKzHNbBHOhLsw4cgiOXVGz+YEgeC6xlToEKzL+95MDJGcPuOX/Iy1kJ\nBVIbylnz6S2Ja3boMaEUceIItxspY12AqAWkDZrp+prh9d8cVWgRvMVW\n-----END RSA PRIVATE KEY-----\n"} 2026-02-23T13:02:05.317 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:02:04.744+0000 7f3a6490c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:05.317 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:02:04.749+0000 7f3a6490c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:05.546 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:05 trial046 ceph-mon[38575]: [23/Feb/2026:13:02:03] ENGINE Bus STARTING 2026-02-23T13:02:05.547 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:05 trial046 ceph-mon[38575]: [23/Feb/2026:13:02:03] ENGINE Serving on http://10.20.193.46:8765 2026-02-23T13:02:05.547 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:05 trial046 ceph-mon[38575]: [23/Feb/2026:13:02:03] ENGINE Serving on https://10.20.193.46:7150 2026-02-23T13:02:05.547 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:05 trial046 ceph-mon[38575]: [23/Feb/2026:13:02:03] ENGINE Bus STARTED 2026-02-23T13:02:05.547 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:05 trial046 ceph-mon[38575]: [23/Feb/2026:13:02:03] ENGINE Client ('10.20.193.46', 50014) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-23T13:02:05.547 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:05 trial046 ceph-mon[38575]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-23T13:02:05.547 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:05 trial046 ceph-mon[38575]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-23T13:02:05.547 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:05 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:05.549 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout SSL certificate updated 2026-02-23T13:02:05.549 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:02:05.404+0000 7f7f731e5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:05.549 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:02:05.408+0000 7f7f731e5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:05.789 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2026-02-23T13:02:05.789 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:02:05.645+0000 7f36cf96a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:05.789 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:02:05.648+0000 7f36cf96a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:05.789 INFO:teuthology.orchestra.run.trial046.stdout:Creating initial admin user... 2026-02-23T13:02:06.230 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$kvvy3x5RVLR3zFMFjK0gUevShd681pToG2RpT6eIxLx0SNmvMAl9m", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1771851726, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2026-02-23T13:02:06.230 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:02:05.882+0000 7fdca0bb0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:06.230 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:02:05.888+0000 7fdca0bb0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:06.230 INFO:teuthology.orchestra.run.trial046.stdout:Fetching dashboard port number... 2026-02-23T13:02:06.448 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stdout 8443 2026-02-23T13:02:06.448 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:02:06.314+0000 7f8803112640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:06.448 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:02:06.318+0000 7f8803112640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:06.456 INFO:teuthology.orchestra.run.trial046.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-23T13:02:06.456 INFO:teuthology.orchestra.run.trial046.stdout:systemctl: stdout disabled 2026-02-23T13:02:06.461 INFO:teuthology.orchestra.run.trial046.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-23T13:02:06.462 INFO:teuthology.orchestra.run.trial046.stdout:systemctl: stdout inactive 2026-02-23T13:02:06.462 INFO:teuthology.orchestra.run.trial046.stdout:firewalld.service is not enabled 2026-02-23T13:02:06.462 INFO:teuthology.orchestra.run.trial046.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2026-02-23T13:02:06.462 INFO:teuthology.orchestra.run.trial046.stdout:Ceph Dashboard is now available at: 2026-02-23T13:02:06.463 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:02:06.463 INFO:teuthology.orchestra.run.trial046.stdout: URL: https://trial046:8443/ 2026-02-23T13:02:06.463 INFO:teuthology.orchestra.run.trial046.stdout: User: admin 2026-02-23T13:02:06.463 INFO:teuthology.orchestra.run.trial046.stdout: Password: wrut46600x 2026-02-23T13:02:06.463 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:02:06.463 INFO:teuthology.orchestra.run.trial046.stdout:Saving cluster configuration to /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/config directory 2026-02-23T13:02:06.739 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:06 trial046 ceph-mon[38575]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2026-02-23T13:02:06.739 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:06 trial046 ceph-mon[38575]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2026-02-23T13:02:06.739 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:06 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:06.740 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:06 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:06.740 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:06 trial046 ceph-mon[38575]: mgrmap e12: x(active, since 2s) 2026-02-23T13:02:06.740 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:06 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:06.740 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:06 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4219474149' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2026-02-23T13:02:06.745 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:02:06.558+0000 7fcdeee21640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:06.745 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr 2026-02-23T13:02:06.562+0000 7fcdeee21640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:06.745 INFO:teuthology.orchestra.run.trial046.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-02-23T13:02:06.745 INFO:teuthology.orchestra.run.trial046.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-02-23T13:02:06.746 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:02:06.746 INFO:teuthology.orchestra.run.trial046.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-02-23T13:02:06.746 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:02:06.746 INFO:teuthology.orchestra.run.trial046.stdout:Or, if you are only running a single cluster on this host: 2026-02-23T13:02:06.746 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:02:06.746 INFO:teuthology.orchestra.run.trial046.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2026-02-23T13:02:06.746 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:02:06.746 INFO:teuthology.orchestra.run.trial046.stdout:Please consider enabling telemetry to help improve Ceph: 2026-02-23T13:02:06.746 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:02:06.746 INFO:teuthology.orchestra.run.trial046.stdout: ceph telemetry on 2026-02-23T13:02:06.746 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:02:06.746 INFO:teuthology.orchestra.run.trial046.stdout:For more information see: 2026-02-23T13:02:06.747 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:02:06.747 INFO:teuthology.orchestra.run.trial046.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-02-23T13:02:06.747 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:02:06.747 INFO:teuthology.orchestra.run.trial046.stdout:Bootstrap complete. 2026-02-23T13:02:06.752 INFO:teuthology.orchestra.run.trial046.stdout:systemctl: stdout static 2026-02-23T13:02:06.758 INFO:teuthology.orchestra.run.trial046.stdout:Non-zero exit code 3 from systemctl is-active logrotate 2026-02-23T13:02:06.758 INFO:teuthology.orchestra.run.trial046.stdout:systemctl: stdout inactive 2026-02-23T13:02:06.758 INFO:teuthology.orchestra.run.trial046.stdout:Enabling the logrotate.timer service to perform daily log rotation. 2026-02-23T13:02:06.898 INFO:tasks.cephadm:Fetching config... 2026-02-23T13:02:06.898 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-23T13:02:06.898 DEBUG:teuthology.orchestra.run.trial046:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-02-23T13:02:06.914 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-02-23T13:02:06.914 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-23T13:02:06.914 DEBUG:teuthology.orchestra.run.trial046:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-02-23T13:02:06.971 INFO:tasks.cephadm:Fetching mon keyring... 2026-02-23T13:02:06.971 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-23T13:02:06.971 DEBUG:teuthology.orchestra.run.trial046:> sudo dd if=/var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/keyring of=/dev/stdout 2026-02-23T13:02:07.038 INFO:tasks.cephadm:Fetching pub ssh key... 2026-02-23T13:02:07.038 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-23T13:02:07.038 DEBUG:teuthology.orchestra.run.trial046:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2026-02-23T13:02:07.096 INFO:tasks.cephadm:Installing pub ssh key for root users... 2026-02-23T13:02:07.096 DEBUG:teuthology.orchestra.run.trial046:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINHaz0d5Wb5r2YEkVIez6LnPJxqgIRZD0LXyiA3VO15L ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-23T13:02:07.168 INFO:teuthology.orchestra.run.trial046.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINHaz0d5Wb5r2YEkVIez6LnPJxqgIRZD0LXyiA3VO15L ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 2026-02-23T13:02:07.179 DEBUG:teuthology.orchestra.run.trial131:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINHaz0d5Wb5r2YEkVIez6LnPJxqgIRZD0LXyiA3VO15L ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-23T13:02:07.214 INFO:teuthology.orchestra.run.trial131.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINHaz0d5Wb5r2YEkVIez6LnPJxqgIRZD0LXyiA3VO15L ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 2026-02-23T13:02:07.225 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-02-23T13:02:07.342 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:02:07.449 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:07.447+0000 7fa57568c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:07.449 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:07.447+0000 7fa57568c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:07.598 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-02-23T13:02:07.599 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-02-23T13:02:07.623 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:07 trial046 ceph-mon[38575]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-23T13:02:07.623 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:07 trial046 ceph-mon[38575]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-23T13:02:07.623 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:07 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2364242019' entity='client.admin' 2026-02-23T13:02:07.718 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:02:07.833 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:07.831+0000 7f022a972640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:07.833 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:07.831+0000 7f022a972640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:07.986 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial131 2026-02-23T13:02:07.986 DEBUG:teuthology.orchestra.run.trial131:> set -ex 2026-02-23T13:02:07.986 DEBUG:teuthology.orchestra.run.trial131:> dd of=/etc/ceph/ceph.conf 2026-02-23T13:02:08.004 DEBUG:teuthology.orchestra.run.trial131:> set -ex 2026-02-23T13:02:08.004 DEBUG:teuthology.orchestra.run.trial131:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-23T13:02:08.060 INFO:tasks.cephadm:Adding host trial131 to orchestrator... 2026-02-23T13:02:08.060 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph orch host add trial131 2026-02-23T13:02:08.179 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:02:08.281 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:08.279+0000 7f6b93ca4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:08.281 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:08.279+0000 7f6b93ca4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:09.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:08 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2787133703' entity='client.admin' 2026-02-23T13:02:09.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:08 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:10.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:09 trial046 ceph-mon[38575]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-23T13:02:10.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:09 trial046 ceph-mon[38575]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial131", "target": ["mon-mgr", ""]}]: dispatch 2026-02-23T13:02:10.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:09 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:10.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:09 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:10.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:09 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial046", "name": "osd_memory_target"} : dispatch 2026-02-23T13:02:10.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:09 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:02:10.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:09 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-23T13:02:10.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:09 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:10.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:09 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:10.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:09 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:10.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:09 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-23T13:02:10.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:09 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:02:10.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:09 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-23T13:02:10.041 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:09 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:10.085 INFO:teuthology.orchestra.run.trial046.stdout:Added host 'trial131' with addr '10.20.193.131' 2026-02-23T13:02:10.128 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-23T13:02:10.245 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:02:10.346 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:10.345+0000 7f04b3d28640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:10.346 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:10.345+0000 7f04b3d28640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:10.459 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:02:10.459 INFO:teuthology.orchestra.run.trial046.stdout:[{"addr": "10.20.193.46", "hostname": "trial046", "labels": [], "status": ""}, {"addr": "10.20.193.131", "hostname": "trial131", "labels": [], "status": ""}] 2026-02-23T13:02:10.496 INFO:tasks.cephadm:Setting crush tunables to default 2026-02-23T13:02:10.496 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd crush tunables default 2026-02-23T13:02:10.612 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:02:10.634 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:10 trial046 ceph-mon[38575]: Updating trial046:/etc/ceph/ceph.conf 2026-02-23T13:02:10.634 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:10 trial046 ceph-mon[38575]: Updating trial046:/var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/config/ceph.conf 2026-02-23T13:02:10.634 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:10 trial046 ceph-mon[38575]: Deploying cephadm binary to trial131 2026-02-23T13:02:10.634 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:10 trial046 ceph-mon[38575]: Updating trial046:/etc/ceph/ceph.client.admin.keyring 2026-02-23T13:02:10.634 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:10 trial046 ceph-mon[38575]: Updating trial046:/var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-23T13:02:10.635 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:10 trial046 ceph-mon[38575]: Certificate for "cephadm-signed_agent_cert (trial046)" is still valid for 1824 days. 2026-02-23T13:02:10.635 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:10 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:10.635 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:10 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-23T13:02:10.635 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:10 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:10.635 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:10 trial046 ceph-mon[38575]: mgrmap e13: x(active, since 6s) 2026-02-23T13:02:10.635 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:10 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:10.723 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:10.722+0000 7f7919ec3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:10.723 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:10.722+0000 7f7919ec3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:11.559 INFO:teuthology.orchestra.run.trial046.stderr:adjusted tunables profile to default 2026-02-23T13:02:11.599 INFO:tasks.cephadm:Adding mon.a on trial046 2026-02-23T13:02:11.600 DEBUG:teuthology.orchestra.run.trial131:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph orch apply mon '1;trial046:10.20.193.46=a' 2026-02-23T13:02:11.721 INFO:teuthology.orchestra.run.trial131.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-23T13:02:11.721 INFO:teuthology.orchestra.run.trial131.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-23T13:02:11.827 INFO:teuthology.orchestra.run.trial131.stderr:2026-02-23T13:02:11.825+0000 7ff1462bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:11.828 INFO:teuthology.orchestra.run.trial131.stderr:2026-02-23T13:02:11.825+0000 7ff1462bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:11.949 INFO:teuthology.orchestra.run.trial131.stdout:Scheduled mon update... 2026-02-23T13:02:11.988 INFO:tasks.cephadm:Waiting for 1 mons in monmap... 2026-02-23T13:02:11.989 DEBUG:teuthology.orchestra.run.trial131:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph mon dump -f json 2026-02-23T13:02:12.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:11 trial046 ceph-mon[38575]: Added host trial131 2026-02-23T13:02:12.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:11 trial046 ceph-mon[38575]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:02:12.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:11 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2106176172' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2026-02-23T13:02:12.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:11 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:12.103 INFO:teuthology.orchestra.run.trial131.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-23T13:02:12.103 INFO:teuthology.orchestra.run.trial131.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-23T13:02:12.208 INFO:teuthology.orchestra.run.trial131.stderr:2026-02-23T13:02:12.206+0000 7fb872fc7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:12.208 INFO:teuthology.orchestra.run.trial131.stderr:2026-02-23T13:02:12.206+0000 7fb872fc7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:12.361 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T13:02:12.361 INFO:teuthology.orchestra.run.trial131.stdout:{"epoch":1,"fsid":"c3b3ca7d-10b7-11f1-8efe-d404e6e7d460","modified":"2026-02-23T13:01:42.577208Z","created":"2026-02-23T13:01:42.577208Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:3300","nonce":0},{"type":"v1","addr":"10.20.193.46:6789","nonce":0}]},"addr":"10.20.193.46:6789/0","public_addr":"10.20.193.46:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T13:01:42:577218+0000","crush_location":[]}],"quorum":[0]} 2026-02-23T13:02:12.361 INFO:teuthology.orchestra.run.trial131.stderr:dumped monmap epoch 1 2026-02-23T13:02:12.402 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-02-23T13:02:12.402 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph config generate-minimal-conf 2026-02-23T13:02:12.519 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:02:12.618 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:12.617+0000 7f757f6ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:12.618 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:12.617+0000 7f757f6ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:12.731 INFO:teuthology.orchestra.run.trial046.stdout:# minimal ceph.conf for c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 2026-02-23T13:02:12.731 INFO:teuthology.orchestra.run.trial046.stdout:[global] 2026-02-23T13:02:12.731 INFO:teuthology.orchestra.run.trial046.stdout: fsid = c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 2026-02-23T13:02:12.731 INFO:teuthology.orchestra.run.trial046.stdout: mon_host = [v2:10.20.193.46:3300/0,v1:10.20.193.46:6789/0] 2026-02-23T13:02:12.731 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:12 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2106176172' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-23T13:02:12.731 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:12 trial046 ceph-mon[38575]: osdmap e4: 0 total, 0 up, 0 in 2026-02-23T13:02:12.731 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:12 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:12.731 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:12 trial046 ceph-mon[38575]: from='client.? 10.20.193.131:0/1989563830' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-23T13:02:12.731 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:12 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:12.731 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:12 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:12.732 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:12 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:12.732 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:12 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:12.732 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:12 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial131", "name": "osd_memory_target"} : dispatch 2026-02-23T13:02:12.732 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:12 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:02:12.732 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:12 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-23T13:02:12.794 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-02-23T13:02:12.794 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-23T13:02:12.794 DEBUG:teuthology.orchestra.run.trial046:> sudo dd of=/etc/ceph/ceph.conf 2026-02-23T13:02:12.821 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-23T13:02:12.821 DEBUG:teuthology.orchestra.run.trial046:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-23T13:02:12.886 DEBUG:teuthology.orchestra.run.trial131:> set -ex 2026-02-23T13:02:12.886 DEBUG:teuthology.orchestra.run.trial131:> sudo dd of=/etc/ceph/ceph.conf 2026-02-23T13:02:12.911 DEBUG:teuthology.orchestra.run.trial131:> set -ex 2026-02-23T13:02:12.911 DEBUG:teuthology.orchestra.run.trial131:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-23T13:02:12.976 INFO:tasks.cephadm:Adding mgr.x on trial046 2026-02-23T13:02:12.977 DEBUG:teuthology.orchestra.run.trial131:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph orch apply mgr '1;trial046=x' 2026-02-23T13:02:13.129 INFO:teuthology.orchestra.run.trial131.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/config/ceph.conf 2026-02-23T13:02:13.246 INFO:teuthology.orchestra.run.trial131.stderr:2026-02-23T13:02:13.243+0000 7f55a8a93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:13.246 INFO:teuthology.orchestra.run.trial131.stderr:2026-02-23T13:02:13.243+0000 7f55a8a93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:13.365 INFO:teuthology.orchestra.run.trial131.stdout:Scheduled mgr update... 2026-02-23T13:02:13.413 DEBUG:tasks.cephadm:set 0 configs 2026-02-23T13:02:13.414 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph config dump 2026-02-23T13:02:13.527 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:02:13.633 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:13.632+0000 7f3c2738e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:13.633 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:13.632+0000 7f3c2738e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:13.744 INFO:teuthology.orchestra.run.trial046.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-23T13:02:13.744 INFO:teuthology.orchestra.run.trial046.stdout:global dev auth_debug true 2026-02-23T13:02:13.745 INFO:teuthology.orchestra.run.trial046.stdout:global basic container_image quay.ceph.io/ceph-ci/ceph@sha256:49621faaa845c39b2aae72e4fa24123ee9b2ac3fb8ae834753907068ee2972ea * 2026-02-23T13:02:13.745 INFO:teuthology.orchestra.run.trial046.stdout:global advanced crimson_allow_pg_split false 2026-02-23T13:02:13.745 INFO:teuthology.orchestra.run.trial046.stdout:global dev debug_asserts_on_shutdown true 2026-02-23T13:02:13.745 INFO:teuthology.orchestra.run.trial046.stdout:global advanced enable_experimental_unrecoverable_data_corrupting_features crimson 2026-02-23T13:02:13.745 INFO:teuthology.orchestra.run.trial046.stdout:global basic log_to_file true 2026-02-23T13:02:13.745 INFO:teuthology.orchestra.run.trial046.stdout:global basic log_to_journald false 2026-02-23T13:02:13.745 INFO:teuthology.orchestra.run.trial046.stdout:global basic log_to_stderr false 2026-02-23T13:02:13.745 INFO:teuthology.orchestra.run.trial046.stdout:global advanced mon_allow_pool_delete true 2026-02-23T13:02:13.745 INFO:teuthology.orchestra.run.trial046.stdout:global advanced mon_clock_drift_allowed 1.000000 2026-02-23T13:02:13.745 INFO:teuthology.orchestra.run.trial046.stdout:global advanced mon_cluster_log_to_file true 2026-02-23T13:02:13.746 INFO:teuthology.orchestra.run.trial046.stdout:global advanced mon_max_pg_per_osd 10000 2026-02-23T13:02:13.746 INFO:teuthology.orchestra.run.trial046.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2026-02-23T13:02:13.746 INFO:teuthology.orchestra.run.trial046.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2026-02-23T13:02:13.746 INFO:teuthology.orchestra.run.trial046.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2026-02-23T13:02:13.746 INFO:teuthology.orchestra.run.trial046.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2026-02-23T13:02:13.746 INFO:teuthology.orchestra.run.trial046.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2026-02-23T13:02:13.746 INFO:teuthology.orchestra.run.trial046.stdout:global advanced mon_warn_on_too_few_osds false 2026-02-23T13:02:13.746 INFO:teuthology.orchestra.run.trial046.stdout:global basic ms_client_mode crc * 2026-02-23T13:02:13.746 INFO:teuthology.orchestra.run.trial046.stdout:global basic ms_cluster_mode crc * 2026-02-23T13:02:13.746 INFO:teuthology.orchestra.run.trial046.stdout:global dev ms_die_on_bug true 2026-02-23T13:02:13.746 INFO:teuthology.orchestra.run.trial046.stdout:global dev ms_die_on_old_message true 2026-02-23T13:02:13.747 INFO:teuthology.orchestra.run.trial046.stdout:global basic ms_mon_client_mode crc * 2026-02-23T13:02:13.747 INFO:teuthology.orchestra.run.trial046.stdout:global basic ms_mon_cluster_mode crc * 2026-02-23T13:02:13.747 INFO:teuthology.orchestra.run.trial046.stdout:global basic ms_mon_service_mode crc * 2026-02-23T13:02:13.747 INFO:teuthology.orchestra.run.trial046.stdout:global basic ms_service_mode crc * 2026-02-23T13:02:13.747 INFO:teuthology.orchestra.run.trial046.stdout:global dev osd_max_pg_log_entries 2 2026-02-23T13:02:13.747 INFO:teuthology.orchestra.run.trial046.stdout:global dev osd_min_pg_log_entries 1 2026-02-23T13:02:13.747 INFO:teuthology.orchestra.run.trial046.stdout:global dev osd_pg_log_trim_min 0 2026-02-23T13:02:13.747 INFO:teuthology.orchestra.run.trial046.stdout:global advanced osd_pool_default_erasure_code_profile plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-23T13:02:13.747 INFO:teuthology.orchestra.run.trial046.stdout:global advanced osd_pool_default_min_size 2 2026-02-23T13:02:13.747 INFO:teuthology.orchestra.run.trial046.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2026-02-23T13:02:13.747 INFO:teuthology.orchestra.run.trial046.stdout:global advanced osd_pool_default_size 3 2026-02-23T13:02:13.747 INFO:teuthology.orchestra.run.trial046.stdout:global advanced public_network 10.20.192.0/20 * 2026-02-23T13:02:13.748 INFO:teuthology.orchestra.run.trial046.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2026-02-23T13:02:13.748 INFO:teuthology.orchestra.run.trial046.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2026-02-23T13:02:13.748 INFO:teuthology.orchestra.run.trial046.stdout:mon advanced auth_service_ticket_ttl 240.000000 2026-02-23T13:02:13.748 INFO:teuthology.orchestra.run.trial046.stdout:mon advanced debug_mon 20/20 2026-02-23T13:02:13.748 INFO:teuthology.orchestra.run.trial046.stdout:mon advanced debug_ms 1/1 2026-02-23T13:02:13.748 INFO:teuthology.orchestra.run.trial046.stdout:mon advanced debug_paxos 20/20 2026-02-23T13:02:13.748 INFO:teuthology.orchestra.run.trial046.stdout:mon advanced mon_data_avail_warn 5 2026-02-23T13:02:13.748 INFO:teuthology.orchestra.run.trial046.stdout:mon advanced mon_mgr_mkfs_grace 240 2026-02-23T13:02:13.749 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:13 trial046 ceph-mon[38575]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "1;trial046:10.20.193.46=a", "target": ["mon-mgr", ""]}]: dispatch 2026-02-23T13:02:13.749 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:13 trial046 ceph-mon[38575]: Saving service mon spec with placement trial046:10.20.193.46=a;count:1 2026-02-23T13:02:13.749 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:13 trial046 ceph-mon[38575]: Updating trial131:/etc/ceph/ceph.conf 2026-02-23T13:02:13.749 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:13 trial046 ceph-mon[38575]: Updating trial131:/var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/config/ceph.conf 2026-02-23T13:02:13.749 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:13 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1873482758' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:02:13.749 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:13 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:13.749 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:13 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:13.749 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:13 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:13.749 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:13 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:13.749 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:13 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-23T13:02:13.750 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:13 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-23T13:02:13.750 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:13 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:02:13.750 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:13 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:13.750 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:13 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:13.750 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:13 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-23T13:02:13.750 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:13 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:02:13.750 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:13 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-23T13:02:13.750 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:13 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:13.750 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:13 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:13.750 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:13 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-23T13:02:13.750 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:13 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:02:13.750 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:13 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-23T13:02:13.750 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:13 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:13.751 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:13 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:13.751 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:13 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-23T13:02:13.751 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:13 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-23T13:02:13.751 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:13 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:02:13.751 INFO:teuthology.orchestra.run.trial046.stdout:mon advanced mon_min_osdmap_epochs 50 2026-02-23T13:02:13.751 INFO:teuthology.orchestra.run.trial046.stdout:mon dev mon_osd_prime_pg_temp true 2026-02-23T13:02:13.752 INFO:teuthology.orchestra.run.trial046.stdout:mon advanced mon_osd_reporter_subtree_level osd 2026-02-23T13:02:13.752 INFO:teuthology.orchestra.run.trial046.stdout:mon advanced mon_osdmap_full_prune_interval 2 2026-02-23T13:02:13.752 INFO:teuthology.orchestra.run.trial046.stdout:mon advanced mon_osdmap_full_prune_min 15 2026-02-23T13:02:13.752 INFO:teuthology.orchestra.run.trial046.stdout:mon advanced mon_osdmap_full_prune_txsize 2 2026-02-23T13:02:13.752 INFO:teuthology.orchestra.run.trial046.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2026-02-23T13:02:13.752 INFO:teuthology.orchestra.run.trial046.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2026-02-23T13:02:13.752 INFO:teuthology.orchestra.run.trial046.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2026-02-23T13:02:13.752 INFO:teuthology.orchestra.run.trial046.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2026-02-23T13:02:13.752 INFO:teuthology.orchestra.run.trial046.stdout:mon advanced osd_pool_default_crimson true 2026-02-23T13:02:13.752 INFO:teuthology.orchestra.run.trial046.stdout:mon advanced paxos_service_trim_min 10 2026-02-23T13:02:13.752 INFO:teuthology.orchestra.run.trial046.stdout:mgr advanced debug_mgr 20/20 2026-02-23T13:02:13.752 INFO:teuthology.orchestra.run.trial046.stdout:mgr advanced debug_ms 1/1 2026-02-23T13:02:13.752 INFO:teuthology.orchestra.run.trial046.stdout:mgr advanced debug_osd 10/10 2026-02-23T13:02:13.753 INFO:teuthology.orchestra.run.trial046.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2026-02-23T13:02:13.753 INFO:teuthology.orchestra.run.trial046.stdout:mgr advanced mgr/cephadm/container_init True * 2026-02-23T13:02:13.753 INFO:teuthology.orchestra.run.trial046.stdout:mgr advanced mgr/cephadm/migration_current 8 * 2026-02-23T13:02:13.753 INFO:teuthology.orchestra.run.trial046.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2026-02-23T13:02:13.753 INFO:teuthology.orchestra.run.trial046.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2026-02-23T13:02:13.753 INFO:teuthology.orchestra.run.trial046.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2026-02-23T13:02:13.753 INFO:teuthology.orchestra.run.trial046.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2026-02-23T13:02:13.753 INFO:teuthology.orchestra.run.trial046.stdout:osd dev bdev_debug_aio true 2026-02-23T13:02:13.753 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced crimson_cpu_num 4 * 2026-02-23T13:02:13.753 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced crimson_osd_obc_lru_size 10 2026-02-23T13:02:13.753 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced debug_ms 20/20 2026-02-23T13:02:13.753 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced debug_osd 20/20 2026-02-23T13:02:13.753 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced debug_seastore 20/20 2026-02-23T13:02:13.754 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced debug_seastore_backref 20/20 2026-02-23T13:02:13.754 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced debug_seastore_cache 20/20 2026-02-23T13:02:13.754 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced debug_seastore_cleaner 20/20 2026-02-23T13:02:13.754 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced debug_seastore_device 20/20 2026-02-23T13:02:13.754 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced debug_seastore_epm 20/20 2026-02-23T13:02:13.754 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced debug_seastore_fixedkv_tree 20/20 2026-02-23T13:02:13.754 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced debug_seastore_journal 20/20 2026-02-23T13:02:13.754 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced debug_seastore_lba 20/20 2026-02-23T13:02:13.754 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced debug_seastore_odata 20/20 2026-02-23T13:02:13.754 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced debug_seastore_omap 20/20 2026-02-23T13:02:13.754 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced debug_seastore_onode 20/20 2026-02-23T13:02:13.754 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced debug_seastore_t 20/20 2026-02-23T13:02:13.755 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced debug_seastore_tm 20/20 2026-02-23T13:02:13.755 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced osd_blocked_scrub_grace_period 3600 2026-02-23T13:02:13.755 INFO:teuthology.orchestra.run.trial046.stdout:osd dev osd_debug_misdirected_ops true 2026-02-23T13:02:13.755 INFO:teuthology.orchestra.run.trial046.stdout:osd dev osd_debug_op_order true 2026-02-23T13:02:13.755 INFO:teuthology.orchestra.run.trial046.stdout:osd dev osd_debug_pg_log_writeout true 2026-02-23T13:02:13.755 INFO:teuthology.orchestra.run.trial046.stdout:osd dev osd_debug_reject_backfill_probability 0.300000 2026-02-23T13:02:13.755 INFO:teuthology.orchestra.run.trial046.stdout:osd dev osd_debug_shutdown true 2026-02-23T13:02:13.755 INFO:teuthology.orchestra.run.trial046.stdout:osd dev osd_debug_verify_cached_snaps true 2026-02-23T13:02:13.755 INFO:teuthology.orchestra.run.trial046.stdout:osd dev osd_debug_verify_missing_on_start true 2026-02-23T13:02:13.755 INFO:teuthology.orchestra.run.trial046.stdout:osd dev osd_debug_verify_stray_on_activate true 2026-02-23T13:02:13.755 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2026-02-23T13:02:13.755 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced osd_delete_sleep 1.000000 2026-02-23T13:02:13.756 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced osd_max_backfills 3 2026-02-23T13:02:13.756 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced osd_max_markdown_count 1000 2026-02-23T13:02:13.756 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced osd_mclock_profile high_recovery_ops 2026-02-23T13:02:13.756 INFO:teuthology.orchestra.run.trial046.stdout:osd dev osd_mclock_skip_benchmark true 2026-02-23T13:02:13.756 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced osd_memory_target_autotune true 2026-02-23T13:02:13.756 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced osd_objectstore seastore * 2026-02-23T13:02:13.756 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced osd_op_queue debug_random * 2026-02-23T13:02:13.756 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced osd_op_queue_cut_off debug_random * 2026-02-23T13:02:13.756 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced osd_recover_clone_overlap true 2026-02-23T13:02:13.756 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced osd_recovery_max_chunk 1048576 2026-02-23T13:02:13.756 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced osd_scrub_load_threshold 5.000000 2026-02-23T13:02:13.756 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced osd_scrub_max_interval 120.000000 2026-02-23T13:02:13.756 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced osd_scrub_min_interval 60.000000 2026-02-23T13:02:13.757 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced osd_shutdown_pgref_assert true 2026-02-23T13:02:13.757 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced osd_snap_trim_sleep 2.000000 2026-02-23T13:02:13.757 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced seastore_cachepin_size_pershard 67108864 2026-02-23T13:02:13.757 INFO:teuthology.orchestra.run.trial046.stdout:osd advanced seastore_max_concurrent_transactions 8 2026-02-23T13:02:13.757 INFO:teuthology.orchestra.run.trial046.stdout:client.0 advanced debug_ms 1/1 2026-02-23T13:02:13.757 INFO:teuthology.orchestra.run.trial046.stdout:client.0 advanced debug_objecter 20/20 2026-02-23T13:02:13.757 INFO:teuthology.orchestra.run.trial046.stdout:client.0 advanced debug_rados 20/20 2026-02-23T13:02:13.757 INFO:teuthology.orchestra.run.trial046.stdout:client.rgw advanced rgw_cache_enabled true 2026-02-23T13:02:13.757 INFO:teuthology.orchestra.run.trial046.stdout:client.rgw advanced rgw_enable_ops_log true 2026-02-23T13:02:13.758 INFO:teuthology.orchestra.run.trial046.stdout:client.rgw advanced rgw_enable_usage_log true 2026-02-23T13:02:13.781 INFO:tasks.cephadm:Enabling crimson flags... 2026-02-23T13:02:13.781 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd set-allow-crimson --yes-i-really-mean-it 2026-02-23T13:02:13.897 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:02:13.995 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:13.994+0000 7fa9e307d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:13.995 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:13.994+0000 7fa9e307d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:14.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:14 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mon-a[38571]: 2026-02-23T13:02:14.110+0000 7f3c8a59a640 -1 WARNING: experimental feature 'crimson' is enabled 2026-02-23T13:02:14.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:14 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mon-a[38571]: Please be aware that this feature is experimental, untested, 2026-02-23T13:02:14.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:14 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mon-a[38571]: unsupported, and may result in data corruption, data loss, 2026-02-23T13:02:14.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:14 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mon-a[38571]: and/or irreparable damage to your cluster. Do not use 2026-02-23T13:02:14.290 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:14 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mon-a[38571]: feature with important data. 2026-02-23T13:02:14.290 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:14 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mon-a[38571]: 2026-02-23T13:02:14.721 INFO:tasks.cephadm:Deploying OSDs... 2026-02-23T13:02:14.722 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-23T13:02:14.722 DEBUG:teuthology.orchestra.run.trial046:> dd if=/scratch_devs of=/dev/stdout 2026-02-23T13:02:14.740 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-23T13:02:14.740 DEBUG:teuthology.orchestra.run.trial046:> stat /dev/vg_nvme/lv_1 2026-02-23T13:02:14.797 INFO:teuthology.orchestra.run.trial046.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-23T13:02:14.798 INFO:teuthology.orchestra.run.trial046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-23T13:02:14.798 INFO:teuthology.orchestra.run.trial046.stdout:Device: 6h/6d Inode: 914 Links: 1 2026-02-23T13:02:14.798 INFO:teuthology.orchestra.run.trial046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-23T13:02:14.798 INFO:teuthology.orchestra.run.trial046.stdout:Context: system_u:object_r:device_t:s0 2026-02-23T13:02:14.798 INFO:teuthology.orchestra.run.trial046.stdout:Access: 2026-02-23 13:02:08.454339131 +0000 2026-02-23T13:02:14.798 INFO:teuthology.orchestra.run.trial046.stdout:Modify: 2026-02-23 12:35:47.212937352 +0000 2026-02-23T13:02:14.798 INFO:teuthology.orchestra.run.trial046.stdout:Change: 2026-02-23 12:35:47.212937352 +0000 2026-02-23T13:02:14.798 INFO:teuthology.orchestra.run.trial046.stdout: Birth: 2026-02-23 12:35:47.212937352 +0000 2026-02-23T13:02:14.799 DEBUG:teuthology.orchestra.run.trial046:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-23T13:02:14.859 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:14 trial046 ceph-mon[38575]: Updating trial131:/etc/ceph/ceph.client.admin.keyring 2026-02-23T13:02:14.859 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:14 trial046 ceph-mon[38575]: Updating trial131:/var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-23T13:02:14.859 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:14 trial046 ceph-mon[38575]: Reconfiguring mon.a (unknown last config time)... 2026-02-23T13:02:14.860 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:14 trial046 ceph-mon[38575]: Reconfiguring daemon mon.a on trial046 2026-02-23T13:02:14.860 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:14 trial046 ceph-mon[38575]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "1;trial046=x", "target": ["mon-mgr", ""]}]: dispatch 2026-02-23T13:02:14.860 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:14 trial046 ceph-mon[38575]: Saving service mgr spec with placement trial046=x;count:1 2026-02-23T13:02:14.860 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:14 trial046 ceph-mon[38575]: Reconfiguring mgr.x (unknown last config time)... 2026-02-23T13:02:14.860 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:14 trial046 ceph-mon[38575]: Reconfiguring daemon mgr.x on trial046 2026-02-23T13:02:14.860 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:14 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:14.860 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:14 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:14.860 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:14 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1023482172' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-23T13:02:14.860 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:14 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2165532177' entity='client.admin' cmd={"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true} : dispatch 2026-02-23T13:02:14.861 INFO:teuthology.orchestra.run.trial046.stderr:1+0 records in 2026-02-23T13:02:14.861 INFO:teuthology.orchestra.run.trial046.stderr:1+0 records out 2026-02-23T13:02:14.861 INFO:teuthology.orchestra.run.trial046.stderr:512 bytes copied, 0.000179352 s, 2.9 MB/s 2026-02-23T13:02:14.863 DEBUG:teuthology.orchestra.run.trial046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-23T13:02:14.920 DEBUG:teuthology.orchestra.run.trial046:> stat /dev/vg_nvme/lv_2 2026-02-23T13:02:14.975 INFO:teuthology.orchestra.run.trial046.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-23T13:02:14.975 INFO:teuthology.orchestra.run.trial046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-23T13:02:14.975 INFO:teuthology.orchestra.run.trial046.stdout:Device: 6h/6d Inode: 942 Links: 1 2026-02-23T13:02:14.975 INFO:teuthology.orchestra.run.trial046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-23T13:02:14.975 INFO:teuthology.orchestra.run.trial046.stdout:Context: system_u:object_r:device_t:s0 2026-02-23T13:02:14.975 INFO:teuthology.orchestra.run.trial046.stdout:Access: 2026-02-23 13:02:08.487338341 +0000 2026-02-23T13:02:14.975 INFO:teuthology.orchestra.run.trial046.stdout:Modify: 2026-02-23 12:35:47.442931517 +0000 2026-02-23T13:02:14.975 INFO:teuthology.orchestra.run.trial046.stdout:Change: 2026-02-23 12:35:47.442931517 +0000 2026-02-23T13:02:14.975 INFO:teuthology.orchestra.run.trial046.stdout: Birth: 2026-02-23 12:35:47.442931517 +0000 2026-02-23T13:02:14.975 DEBUG:teuthology.orchestra.run.trial046:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-23T13:02:15.041 INFO:teuthology.orchestra.run.trial046.stderr:1+0 records in 2026-02-23T13:02:15.041 INFO:teuthology.orchestra.run.trial046.stderr:1+0 records out 2026-02-23T13:02:15.041 INFO:teuthology.orchestra.run.trial046.stderr:512 bytes copied, 0.000135962 s, 3.8 MB/s 2026-02-23T13:02:15.042 DEBUG:teuthology.orchestra.run.trial046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-23T13:02:15.101 DEBUG:teuthology.orchestra.run.trial046:> stat /dev/vg_nvme/lv_3 2026-02-23T13:02:15.158 INFO:teuthology.orchestra.run.trial046.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-23T13:02:15.159 INFO:teuthology.orchestra.run.trial046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-23T13:02:15.159 INFO:teuthology.orchestra.run.trial046.stdout:Device: 6h/6d Inode: 971 Links: 1 2026-02-23T13:02:15.159 INFO:teuthology.orchestra.run.trial046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-23T13:02:15.159 INFO:teuthology.orchestra.run.trial046.stdout:Context: system_u:object_r:device_t:s0 2026-02-23T13:02:15.159 INFO:teuthology.orchestra.run.trial046.stdout:Access: 2026-02-23 13:02:08.520337551 +0000 2026-02-23T13:02:15.159 INFO:teuthology.orchestra.run.trial046.stdout:Modify: 2026-02-23 12:35:47.672925682 +0000 2026-02-23T13:02:15.159 INFO:teuthology.orchestra.run.trial046.stdout:Change: 2026-02-23 12:35:47.672925682 +0000 2026-02-23T13:02:15.159 INFO:teuthology.orchestra.run.trial046.stdout: Birth: 2026-02-23 12:35:47.672925682 +0000 2026-02-23T13:02:15.160 DEBUG:teuthology.orchestra.run.trial046:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-23T13:02:15.223 INFO:teuthology.orchestra.run.trial046.stderr:1+0 records in 2026-02-23T13:02:15.223 INFO:teuthology.orchestra.run.trial046.stderr:1+0 records out 2026-02-23T13:02:15.223 INFO:teuthology.orchestra.run.trial046.stderr:512 bytes copied, 0.000154406 s, 3.3 MB/s 2026-02-23T13:02:15.224 DEBUG:teuthology.orchestra.run.trial046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-23T13:02:15.283 DEBUG:teuthology.orchestra.run.trial046:> stat /dev/vg_nvme/lv_4 2026-02-23T13:02:15.339 INFO:teuthology.orchestra.run.trial046.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-23T13:02:15.339 INFO:teuthology.orchestra.run.trial046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-23T13:02:15.340 INFO:teuthology.orchestra.run.trial046.stdout:Device: 6h/6d Inode: 1002 Links: 1 2026-02-23T13:02:15.340 INFO:teuthology.orchestra.run.trial046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-23T13:02:15.340 INFO:teuthology.orchestra.run.trial046.stdout:Context: system_u:object_r:device_t:s0 2026-02-23T13:02:15.340 INFO:teuthology.orchestra.run.trial046.stdout:Access: 2026-02-23 13:02:08.554336737 +0000 2026-02-23T13:02:15.340 INFO:teuthology.orchestra.run.trial046.stdout:Modify: 2026-02-23 12:35:47.878920456 +0000 2026-02-23T13:02:15.340 INFO:teuthology.orchestra.run.trial046.stdout:Change: 2026-02-23 12:35:47.878920456 +0000 2026-02-23T13:02:15.340 INFO:teuthology.orchestra.run.trial046.stdout: Birth: 2026-02-23 12:35:47.878920456 +0000 2026-02-23T13:02:15.340 DEBUG:teuthology.orchestra.run.trial046:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-23T13:02:15.402 INFO:teuthology.orchestra.run.trial046.stderr:1+0 records in 2026-02-23T13:02:15.402 INFO:teuthology.orchestra.run.trial046.stderr:1+0 records out 2026-02-23T13:02:15.403 INFO:teuthology.orchestra.run.trial046.stderr:512 bytes copied, 0.000149126 s, 3.4 MB/s 2026-02-23T13:02:15.404 DEBUG:teuthology.orchestra.run.trial046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-23T13:02:15.460 DEBUG:teuthology.orchestra.run.trial131:> set -ex 2026-02-23T13:02:15.460 DEBUG:teuthology.orchestra.run.trial131:> dd if=/scratch_devs of=/dev/stdout 2026-02-23T13:02:15.478 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-23T13:02:15.478 DEBUG:teuthology.orchestra.run.trial131:> stat /dev/vg_nvme/lv_1 2026-02-23T13:02:15.536 INFO:teuthology.orchestra.run.trial131.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-23T13:02:15.536 INFO:teuthology.orchestra.run.trial131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-23T13:02:15.536 INFO:teuthology.orchestra.run.trial131.stdout:Device: 6h/6d Inode: 907 Links: 1 2026-02-23T13:02:15.536 INFO:teuthology.orchestra.run.trial131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-23T13:02:15.536 INFO:teuthology.orchestra.run.trial131.stdout:Context: system_u:object_r:device_t:s0 2026-02-23T13:02:15.536 INFO:teuthology.orchestra.run.trial131.stdout:Access: 2026-02-23 13:02:12.138938494 +0000 2026-02-23T13:02:15.537 INFO:teuthology.orchestra.run.trial131.stdout:Modify: 2026-02-23 12:35:47.401947131 +0000 2026-02-23T13:02:15.537 INFO:teuthology.orchestra.run.trial131.stdout:Change: 2026-02-23 12:35:47.401947131 +0000 2026-02-23T13:02:15.537 INFO:teuthology.orchestra.run.trial131.stdout: Birth: 2026-02-23 12:35:47.401947131 +0000 2026-02-23T13:02:15.537 DEBUG:teuthology.orchestra.run.trial131:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-23T13:02:15.601 INFO:teuthology.orchestra.run.trial131.stderr:1+0 records in 2026-02-23T13:02:15.601 INFO:teuthology.orchestra.run.trial131.stderr:1+0 records out 2026-02-23T13:02:15.601 INFO:teuthology.orchestra.run.trial131.stderr:512 bytes copied, 0.000142326 s, 3.6 MB/s 2026-02-23T13:02:15.603 DEBUG:teuthology.orchestra.run.trial131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-23T13:02:15.660 DEBUG:teuthology.orchestra.run.trial131:> stat /dev/vg_nvme/lv_2 2026-02-23T13:02:15.716 INFO:teuthology.orchestra.run.trial131.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-23T13:02:15.716 INFO:teuthology.orchestra.run.trial131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-23T13:02:15.716 INFO:teuthology.orchestra.run.trial131.stdout:Device: 6h/6d Inode: 938 Links: 1 2026-02-23T13:02:15.716 INFO:teuthology.orchestra.run.trial131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-23T13:02:15.717 INFO:teuthology.orchestra.run.trial131.stdout:Context: system_u:object_r:device_t:s0 2026-02-23T13:02:15.717 INFO:teuthology.orchestra.run.trial131.stdout:Access: 2026-02-23 13:02:12.166938204 +0000 2026-02-23T13:02:15.717 INFO:teuthology.orchestra.run.trial131.stdout:Modify: 2026-02-23 12:35:47.630939585 +0000 2026-02-23T13:02:15.717 INFO:teuthology.orchestra.run.trial131.stdout:Change: 2026-02-23 12:35:47.630939585 +0000 2026-02-23T13:02:15.717 INFO:teuthology.orchestra.run.trial131.stdout: Birth: 2026-02-23 12:35:47.630939585 +0000 2026-02-23T13:02:15.717 DEBUG:teuthology.orchestra.run.trial131:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-23T13:02:15.779 INFO:teuthology.orchestra.run.trial131.stderr:1+0 records in 2026-02-23T13:02:15.779 INFO:teuthology.orchestra.run.trial131.stderr:1+0 records out 2026-02-23T13:02:15.779 INFO:teuthology.orchestra.run.trial131.stderr:512 bytes copied, 0.000156433 s, 3.3 MB/s 2026-02-23T13:02:15.780 DEBUG:teuthology.orchestra.run.trial131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-23T13:02:15.837 DEBUG:teuthology.orchestra.run.trial131:> stat /dev/vg_nvme/lv_3 2026-02-23T13:02:15.893 INFO:teuthology.orchestra.run.trial131.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-23T13:02:15.893 INFO:teuthology.orchestra.run.trial131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-23T13:02:15.894 INFO:teuthology.orchestra.run.trial131.stdout:Device: 6h/6d Inode: 966 Links: 1 2026-02-23T13:02:15.894 INFO:teuthology.orchestra.run.trial131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-23T13:02:15.894 INFO:teuthology.orchestra.run.trial131.stdout:Context: system_u:object_r:device_t:s0 2026-02-23T13:02:15.894 INFO:teuthology.orchestra.run.trial131.stdout:Access: 2026-02-23 13:02:12.195937904 +0000 2026-02-23T13:02:15.894 INFO:teuthology.orchestra.run.trial131.stdout:Modify: 2026-02-23 12:35:47.856932137 +0000 2026-02-23T13:02:15.894 INFO:teuthology.orchestra.run.trial131.stdout:Change: 2026-02-23 12:35:47.856932137 +0000 2026-02-23T13:02:15.894 INFO:teuthology.orchestra.run.trial131.stdout: Birth: 2026-02-23 12:35:47.856932137 +0000 2026-02-23T13:02:15.895 DEBUG:teuthology.orchestra.run.trial131:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-23T13:02:15.956 INFO:teuthology.orchestra.run.trial131.stderr:1+0 records in 2026-02-23T13:02:15.956 INFO:teuthology.orchestra.run.trial131.stderr:1+0 records out 2026-02-23T13:02:15.956 INFO:teuthology.orchestra.run.trial131.stderr:512 bytes copied, 0.000147697 s, 3.5 MB/s 2026-02-23T13:02:15.957 DEBUG:teuthology.orchestra.run.trial131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-23T13:02:16.015 DEBUG:teuthology.orchestra.run.trial131:> stat /dev/vg_nvme/lv_4 2026-02-23T13:02:16.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:15 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2165532177' entity='client.admin' cmd='[{"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true}]': finished 2026-02-23T13:02:16.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:15 trial046 ceph-mon[38575]: osdmap e5: 0 total, 0 up, 0 in 2026-02-23T13:02:16.072 INFO:teuthology.orchestra.run.trial131.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-23T13:02:16.072 INFO:teuthology.orchestra.run.trial131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-23T13:02:16.072 INFO:teuthology.orchestra.run.trial131.stdout:Device: 6h/6d Inode: 995 Links: 1 2026-02-23T13:02:16.072 INFO:teuthology.orchestra.run.trial131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-23T13:02:16.072 INFO:teuthology.orchestra.run.trial131.stdout:Context: system_u:object_r:device_t:s0 2026-02-23T13:02:16.072 INFO:teuthology.orchestra.run.trial131.stdout:Access: 2026-02-23 13:02:12.224937604 +0000 2026-02-23T13:02:16.072 INFO:teuthology.orchestra.run.trial131.stdout:Modify: 2026-02-23 12:35:48.072925019 +0000 2026-02-23T13:02:16.072 INFO:teuthology.orchestra.run.trial131.stdout:Change: 2026-02-23 12:35:48.072925019 +0000 2026-02-23T13:02:16.072 INFO:teuthology.orchestra.run.trial131.stdout: Birth: 2026-02-23 12:35:48.072925019 +0000 2026-02-23T13:02:16.073 DEBUG:teuthology.orchestra.run.trial131:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-23T13:02:16.136 INFO:teuthology.orchestra.run.trial131.stderr:1+0 records in 2026-02-23T13:02:16.136 INFO:teuthology.orchestra.run.trial131.stderr:1+0 records out 2026-02-23T13:02:16.137 INFO:teuthology.orchestra.run.trial131.stderr:512 bytes copied, 0.000155671 s, 3.3 MB/s 2026-02-23T13:02:16.138 DEBUG:teuthology.orchestra.run.trial131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-23T13:02:16.195 INFO:tasks.cephadm:Deploying osd.0 on trial046 with /dev/vg_nvme/lv_4... 2026-02-23T13:02:16.196 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-23T13:02:16.313 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:02:16.781 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:02:16.797 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph orch daemon add osd trial046:vg_nvme/lv_4 --skip-validation 2026-02-23T13:02:16.916 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:02:17.020 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:17.018+0000 7fd643cf8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:17.020 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:17.019+0000 7fd643cf8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:18.539 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:18 trial046 ceph-mon[38575]: from='client.14198 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial046:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-23T13:02:18.539 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:18 trial046 ceph-mon[38575]: osd.default does not exist. Creating it now. 2026-02-23T13:02:18.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:18 trial046 ceph-mon[38575]: Creating OSDs with service ID: default on trial046:['vg_nvme/lv_4'] 2026-02-23T13:02:18.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:18 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:18.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:18 trial046 ceph-mon[38575]: Marking host: trial046 for OSDSpec preview refresh. 2026-02-23T13:02:18.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:18 trial046 ceph-mon[38575]: Saving service osd.default spec with placement trial046 2026-02-23T13:02:18.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:18 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:18.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:18 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-23T13:02:18.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:18 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-23T13:02:18.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:18 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-23T13:02:18.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:18 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:18.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:18 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:02:18.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:18 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:18.541 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:18 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:02:18.541 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:18 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-23T13:02:18.541 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:18 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:18.541 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:18 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-23T13:02:18.541 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:18 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-23T13:02:18.541 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:18 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:02:18.541 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:18 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/670124552' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "80ca734b-d032-47a7-be2b-bcab1f5b06bf"} : dispatch 2026-02-23T13:02:18.541 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:18 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/670124552' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "80ca734b-d032-47a7-be2b-bcab1f5b06bf"}]': finished 2026-02-23T13:02:18.541 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:18 trial046 ceph-mon[38575]: osdmap e6: 1 total, 0 up, 1 in 2026-02-23T13:02:18.541 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:18 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-23T13:02:18.541 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:18 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/694078406' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-23T13:02:19.857 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:19 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-23T13:02:19.857 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:19 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:02:21.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:20 trial046 ceph-mon[38575]: Deploying daemon osd.0 on trial046 2026-02-23T13:02:21.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:20 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-23T13:02:21.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:20 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:02:21.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:20 trial046 ceph-mon[38575]: Deploying daemon osd.0 on trial046 2026-02-23T13:02:22.606 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:22 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:22.606 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:22 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:23.841 INFO:teuthology.orchestra.run.trial046.stdout:Created osd(s) 0 on host 'trial046' 2026-02-23T13:02:23.884 DEBUG:teuthology.orchestra.run.trial046:osd.0> sudo journalctl -f -n 0 -u ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@osd.0.service 2026-02-23T13:02:23.886 INFO:tasks.cephadm:Deploying osd.1 on trial046 with /dev/vg_nvme/lv_3... 2026-02-23T13:02:23.887 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-23T13:02:24.042 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:02:24.321 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:24 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:24.322 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:24 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:24.322 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:24 trial046 ceph-mon[38575]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-23T13:02:24.322 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:24 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:24.322 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:24 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:24.322 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:24 trial046 ceph-mon[38575]: from='osd.0 [v2:10.20.193.46:6802/3215761192,v1:10.20.193.46:6803/3215761192]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-23T13:02:24.765 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:02:24.783 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph orch daemon add osd trial046:vg_nvme/lv_3 --skip-validation 2026-02-23T13:02:24.900 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:02:25.013 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:25.011+0000 7faeca1ba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:25.013 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:25.011+0000 7faeca1ba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:25.539 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:25 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:25.539 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:25 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:25.539 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:25 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-23T13:02:25.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:25 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:25.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:25 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:25.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:25 trial046 ceph-mon[38575]: from='osd.0 [v2:10.20.193.46:6802/3215761192,v1:10.20.193.46:6803/3215761192]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-23T13:02:25.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:25 trial046 ceph-mon[38575]: osdmap e7: 1 total, 0 up, 1 in 2026-02-23T13:02:25.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:25 trial046 ceph-mon[38575]: from='osd.0 [v2:10.20.193.46:6802/3215761192,v1:10.20.193.46:6803/3215761192]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial046", "root=default"]} : dispatch 2026-02-23T13:02:25.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:25 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-23T13:02:25.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:25 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:25.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:25 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:25.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:25 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-23T13:02:25.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:25 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-23T13:02:25.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:25 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:02:26.052 INFO:journalctl@ceph.osd.0.trial046.stdout:Feb 23 13:02:25 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-0[54899]: 2026-02-23T13:02:25.846+0000 7f16ee447640 -1 osd.0 0 waiting for initial osdmap 2026-02-23T13:02:26.052 INFO:journalctl@ceph.osd.0.trial046.stdout:Feb 23 13:02:25 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-0[54899]: 2026-02-23T13:02:25.848+0000 7f16e6306640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-23T13:02:26.635 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:26 trial046 ceph-mon[38575]: from='client.14208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial046:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-23T13:02:26.636 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:26 trial046 ceph-mon[38575]: osd.default does not exist. Creating it now. 2026-02-23T13:02:26.636 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:26 trial046 ceph-mon[38575]: Creating OSDs with service ID: default on trial046:['vg_nvme/lv_3'] 2026-02-23T13:02:26.636 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:26 trial046 ceph-mon[38575]: Marking host: trial046 for OSDSpec preview refresh. 2026-02-23T13:02:26.636 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:26 trial046 ceph-mon[38575]: Saving service osd.default spec with placement trial046 2026-02-23T13:02:26.636 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:26 trial046 ceph-mon[38575]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-23T13:02:26.636 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:26 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:26.636 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:26 trial046 ceph-mon[38575]: from='osd.0 [v2:10.20.193.46:6802/3215761192,v1:10.20.193.46:6803/3215761192]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial046", "root=default"]}]': finished 2026-02-23T13:02:26.636 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:26 trial046 ceph-mon[38575]: osdmap e8: 1 total, 0 up, 1 in 2026-02-23T13:02:26.636 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:26 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-23T13:02:26.636 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:26 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:26.637 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:26 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:26.637 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:26 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:26.637 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:26 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-23T13:02:26.637 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:26 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-23T13:02:26.637 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:26 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:26.637 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:26 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:02:26.637 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:26 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-23T13:02:26.637 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:26 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:26.637 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:26 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-23T13:02:26.637 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:26 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-23T13:02:26.637 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:26 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:02:26.637 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:26 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/232369261' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "da77bcad-edc4-46df-a2e0-63010b9b6274"} : dispatch 2026-02-23T13:02:26.638 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:26 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/232369261' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "da77bcad-edc4-46df-a2e0-63010b9b6274"}]': finished 2026-02-23T13:02:26.638 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:26 trial046 ceph-mon[38575]: osd.0 [v2:10.20.193.46:6802/3215761192,v1:10.20.193.46:6803/3215761192] boot 2026-02-23T13:02:26.638 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:26 trial046 ceph-mon[38575]: osdmap e9: 2 total, 1 up, 2 in 2026-02-23T13:02:26.638 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:26 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-23T13:02:26.638 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:26 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-23T13:02:27.632 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:27 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:02:27.632 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:27 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:02:27.632 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:27 trial046 ceph-mon[38575]: Detected new or changed devices on trial046 2026-02-23T13:02:27.632 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:27 trial046 ceph-mon[38575]: Adjusting osd_memory_target on trial046 to 84047M 2026-02-23T13:02:27.632 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:27 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3635328534' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-23T13:02:28.446 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:28 trial046 ceph-mon[38575]: pgmap v11: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-23T13:02:28.446 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:28 trial046 ceph-mon[38575]: osdmap e10: 2 total, 1 up, 2 in 2026-02-23T13:02:28.446 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:28 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-23T13:02:28.446 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:28 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-23T13:02:28.446 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:28 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:02:29.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:29 trial046 ceph-mon[38575]: Deploying daemon osd.1 on trial046 2026-02-23T13:02:29.790 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:29 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-23T13:02:29.790 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:29 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:02:30.692 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:30 trial046 ceph-mon[38575]: Deploying daemon osd.1 on trial046 2026-02-23T13:02:30.692 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:30 trial046 ceph-mon[38575]: pgmap v13: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-23T13:02:30.692 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:30 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:30.692 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:30 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:32.454 INFO:teuthology.orchestra.run.trial046.stdout:Created osd(s) 1 on host 'trial046' 2026-02-23T13:02:32.499 DEBUG:teuthology.orchestra.run.trial046:osd.1> sudo journalctl -f -n 0 -u ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@osd.1.service 2026-02-23T13:02:32.500 INFO:tasks.cephadm:Deploying osd.2 on trial131 with /dev/vg_nvme/lv_4... 2026-02-23T13:02:32.500 DEBUG:teuthology.orchestra.run.trial131:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-23T13:02:32.615 INFO:teuthology.orchestra.run.trial131.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/config/ceph.conf 2026-02-23T13:02:32.757 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:32 trial046 ceph-mon[38575]: pgmap v14: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-23T13:02:32.758 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:32 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:32.758 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:32 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:32.758 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:32 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:32.758 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:32 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:32.758 INFO:journalctl@ceph.osd.1.trial046.stdout:Feb 23 13:02:32 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-1[62961]: 2026-02-23T13:02:32.559+0000 7f3d7d251780 -1 osd.1 0 log_to_monitors true 2026-02-23T13:02:33.132 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T13:02:33.149 DEBUG:teuthology.orchestra.run.trial131:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph orch daemon add osd trial131:vg_nvme/lv_4 --skip-validation 2026-02-23T13:02:33.306 INFO:teuthology.orchestra.run.trial131.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/config/ceph.conf 2026-02-23T13:02:33.418 INFO:teuthology.orchestra.run.trial131.stderr:2026-02-23T13:02:33.416+0000 7f42d72be640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:33.418 INFO:teuthology.orchestra.run.trial131.stderr:2026-02-23T13:02:33.417+0000 7f42d72be640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:33.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:33 trial046 ceph-mon[38575]: from='osd.1 [v2:10.20.193.46:6810/2402797949,v1:10.20.193.46:6811/2402797949]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-23T13:02:33.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:33 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:33.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:33 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:33.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:33 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-23T13:02:33.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:33 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:33.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:33 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:34.504 INFO:journalctl@ceph.osd.1.trial046.stdout:Feb 23 13:02:34 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-1[62961]: 2026-02-23T13:02:34.191+0000 7f3d791d3640 -1 osd.1 0 waiting for initial osdmap 2026-02-23T13:02:34.504 INFO:journalctl@ceph.osd.1.trial046.stdout:Feb 23 13:02:34 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-1[62961]: 2026-02-23T13:02:34.194+0000 7f3d71092640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-23T13:02:34.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:34 trial046 ceph-mon[38575]: pgmap v15: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-23T13:02:34.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:34 trial046 ceph-mon[38575]: from='osd.1 [v2:10.20.193.46:6810/2402797949,v1:10.20.193.46:6811/2402797949]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-23T13:02:34.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:34 trial046 ceph-mon[38575]: osdmap e11: 2 total, 1 up, 2 in 2026-02-23T13:02:34.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:34 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-23T13:02:34.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:34 trial046 ceph-mon[38575]: from='osd.1 [v2:10.20.193.46:6810/2402797949,v1:10.20.193.46:6811/2402797949]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial046", "root=default"]} : dispatch 2026-02-23T13:02:34.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:34 trial046 ceph-mon[38575]: from='client.14218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial131:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-23T13:02:34.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:34 trial046 ceph-mon[38575]: osd.default does not exist. Creating it now. 2026-02-23T13:02:34.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:34 trial046 ceph-mon[38575]: Creating OSDs with service ID: default on trial131:['vg_nvme/lv_4'] 2026-02-23T13:02:34.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:34 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:34.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:34 trial046 ceph-mon[38575]: Marking host: trial131 for OSDSpec preview refresh. 2026-02-23T13:02:34.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:34 trial046 ceph-mon[38575]: Saving service osd.default spec with placement trial131 2026-02-23T13:02:34.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:34 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:34.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:34 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-23T13:02:34.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:34 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-23T13:02:34.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:34 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:02:34.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:34 trial046 ceph-mon[38575]: from='client.? 10.20.193.131:0/3224562787' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5a84a299-c810-46ba-8968-8cd5bccf127b"} : dispatch 2026-02-23T13:02:34.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:34 trial046 ceph-mon[38575]: from='osd.1 [v2:10.20.193.46:6810/2402797949,v1:10.20.193.46:6811/2402797949]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial046", "root=default"]}]': finished 2026-02-23T13:02:34.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:34 trial046 ceph-mon[38575]: from='client.? 10.20.193.131:0/3224562787' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5a84a299-c810-46ba-8968-8cd5bccf127b"}]': finished 2026-02-23T13:02:34.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:34 trial046 ceph-mon[38575]: osdmap e12: 3 total, 1 up, 3 in 2026-02-23T13:02:34.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:34 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-23T13:02:34.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:34 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-23T13:02:34.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:34 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-23T13:02:34.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:34 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:34.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:34 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:34.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:34 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-23T13:02:34.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:34 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-23T13:02:34.790 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:34 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:34.790 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:34 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:02:34.790 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:34 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-23T13:02:34.790 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:34 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:34.790 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:34 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-23T13:02:34.790 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:34 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-23T13:02:34.790 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:34 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:02:34.790 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:34 trial046 ceph-mon[38575]: from='client.? 10.20.193.131:0/3320916663' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-23T13:02:35.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:35 trial046 ceph-mon[38575]: Detected new or changed devices on trial046 2026-02-23T13:02:35.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:35 trial046 ceph-mon[38575]: Adjusting osd_memory_target on trial046 to 42023M 2026-02-23T13:02:35.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:35 trial046 ceph-mon[38575]: osd.1 [v2:10.20.193.46:6810/2402797949,v1:10.20.193.46:6811/2402797949] boot 2026-02-23T13:02:35.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:35 trial046 ceph-mon[38575]: osdmap e13: 3 total, 2 up, 3 in 2026-02-23T13:02:35.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:35 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-23T13:02:35.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:35 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-23T13:02:36.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:36 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:02:36.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:36 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:02:36.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:36 trial046 ceph-mon[38575]: pgmap v19: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-23T13:02:36.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:36 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-23T13:02:36.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:36 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:02:36.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:36 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-23T13:02:36.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:36 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:02:37.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:37 trial046 ceph-mon[38575]: Deploying daemon osd.2 on trial131 2026-02-23T13:02:37.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:37 trial046 ceph-mon[38575]: Deploying daemon osd.2 on trial131 2026-02-23T13:02:37.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:37 trial046 ceph-mon[38575]: osdmap e14: 3 total, 2 up, 3 in 2026-02-23T13:02:37.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:37 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-23T13:02:38.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:38 trial046 ceph-mon[38575]: pgmap v21: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-23T13:02:38.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:38 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:38.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:38 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:40.649 INFO:teuthology.orchestra.run.trial131.stdout:Created osd(s) 2 on host 'trial131' 2026-02-23T13:02:40.689 DEBUG:teuthology.orchestra.run.trial131:osd.2> sudo journalctl -f -n 0 -u ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@osd.2.service 2026-02-23T13:02:40.691 INFO:tasks.cephadm:Deploying osd.3 on trial131 with /dev/vg_nvme/lv_3... 2026-02-23T13:02:40.691 DEBUG:teuthology.orchestra.run.trial131:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-23T13:02:40.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:40 trial046 ceph-mon[38575]: pgmap v22: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-23T13:02:40.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:40 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:40.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:40 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:40.848 INFO:teuthology.orchestra.run.trial131.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/config/ceph.conf 2026-02-23T13:02:40.870 INFO:journalctl@ceph.osd.2.trial131.stdout:Feb 23 13:02:40 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-2[46347]: 2026-02-23T13:02:40.748+0000 7f9a34ebd780 -1 osd.2 0 log_to_monitors true 2026-02-23T13:02:41.639 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-23T13:02:41.657 DEBUG:teuthology.orchestra.run.trial131:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph orch daemon add osd trial131:vg_nvme/lv_3 --skip-validation 2026-02-23T13:02:41.779 INFO:teuthology.orchestra.run.trial131.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/config/ceph.conf 2026-02-23T13:02:41.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:41 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:41.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:41 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:41.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:41 trial046 ceph-mon[38575]: from='osd.2 [v2:10.20.193.131:6800/1243371431,v1:10.20.193.131:6801/1243371431]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-23T13:02:41.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:41 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:41.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:41 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:41.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:41 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-23T13:02:41.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:41 trial046 ceph-mon[38575]: pgmap v23: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-23T13:02:41.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:41 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:41.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:41 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:41.883 INFO:teuthology.orchestra.run.trial131.stderr:2026-02-23T13:02:41.882+0000 7eff1b3e9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:41.884 INFO:teuthology.orchestra.run.trial131.stderr:2026-02-23T13:02:41.882+0000 7eff1b3e9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:42.772 INFO:journalctl@ceph.osd.2.trial131.stdout:Feb 23 13:02:42 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-2[46347]: 2026-02-23T13:02:42.653+0000 7f9a30e3f640 -1 osd.2 0 waiting for initial osdmap 2026-02-23T13:02:42.772 INFO:journalctl@ceph.osd.2.trial131.stdout:Feb 23 13:02:42 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-2[46347]: 2026-02-23T13:02:42.655+0000 7f9a2cd06640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-23T13:02:43.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:42 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:43.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:42 trial046 ceph-mon[38575]: from='osd.2 [v2:10.20.193.131:6800/1243371431,v1:10.20.193.131:6801/1243371431]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-23T13:02:43.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:42 trial046 ceph-mon[38575]: osdmap e15: 3 total, 2 up, 3 in 2026-02-23T13:02:43.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:42 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-23T13:02:43.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:42 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:43.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:42 trial046 ceph-mon[38575]: from='osd.2 [v2:10.20.193.131:6800/1243371431,v1:10.20.193.131:6801/1243371431]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial131", "root=default"]} : dispatch 2026-02-23T13:02:43.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:42 trial046 ceph-mon[38575]: from='client.14228 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial131:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-23T13:02:43.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:42 trial046 ceph-mon[38575]: osd.default does not exist. Creating it now. 2026-02-23T13:02:43.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:42 trial046 ceph-mon[38575]: Creating OSDs with service ID: default on trial131:['vg_nvme/lv_3'] 2026-02-23T13:02:43.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:42 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:43.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:42 trial046 ceph-mon[38575]: Marking host: trial131 for OSDSpec preview refresh. 2026-02-23T13:02:43.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:42 trial046 ceph-mon[38575]: Saving service osd.default spec with placement trial131 2026-02-23T13:02:43.041 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:42 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:43.041 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:42 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-23T13:02:43.041 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:42 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-23T13:02:43.041 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:42 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:02:43.041 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:42 trial046 ceph-mon[38575]: Detected new or changed devices on trial131 2026-02-23T13:02:43.041 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:42 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:43.041 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:42 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:43.041 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:42 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:43.041 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:42 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:43.041 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:42 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:43.041 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:42 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:43.041 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:42 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-23T13:02:43.041 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:42 trial046 ceph-mon[38575]: Adjusting osd_memory_target on trial131 to 89167M 2026-02-23T13:02:43.042 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:42 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:43.042 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:42 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:02:43.042 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:42 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-23T13:02:43.042 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:42 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:43.042 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:42 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-23T13:02:43.042 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:42 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-23T13:02:43.042 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:42 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:02:44.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:43 trial046 ceph-mon[38575]: from='osd.2 [v2:10.20.193.131:6800/1243371431,v1:10.20.193.131:6801/1243371431]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial131", "root=default"]}]': finished 2026-02-23T13:02:44.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:43 trial046 ceph-mon[38575]: osdmap e16: 3 total, 2 up, 3 in 2026-02-23T13:02:44.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:43 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-23T13:02:44.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:43 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-23T13:02:44.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:43 trial046 ceph-mon[38575]: from='client.? 10.20.193.131:0/4124602171' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e53b2547-061e-4bfd-aca1-a53b0e860d05"} : dispatch 2026-02-23T13:02:44.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:43 trial046 ceph-mon[38575]: from='client.? 10.20.193.131:0/4124602171' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e53b2547-061e-4bfd-aca1-a53b0e860d05"}]': finished 2026-02-23T13:02:44.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:43 trial046 ceph-mon[38575]: osd.2 [v2:10.20.193.131:6800/1243371431,v1:10.20.193.131:6801/1243371431] boot 2026-02-23T13:02:44.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:43 trial046 ceph-mon[38575]: osdmap e17: 4 total, 3 up, 4 in 2026-02-23T13:02:44.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:43 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-23T13:02:44.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:43 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-23T13:02:44.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:43 trial046 ceph-mon[38575]: pgmap v27: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-23T13:02:44.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:43 trial046 ceph-mon[38575]: from='client.? 10.20.193.131:0/766252888' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-23T13:02:44.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:43 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-23T13:02:45.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:44 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:02:45.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:44 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:02:45.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:44 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-23T13:02:45.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:44 trial046 ceph-mon[38575]: osdmap e18: 4 total, 3 up, 4 in 2026-02-23T13:02:45.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:44 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-23T13:02:45.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:44 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-23T13:02:46.134 INFO:journalctl@ceph.osd.2.trial131.stdout:Feb 23 13:02:46 trial131 sudo[52796]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-23T13:02:46.135 INFO:journalctl@ceph.osd.2.trial131.stdout:Feb 23 13:02:46 trial131 sudo[52796]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-23T13:02:46.135 INFO:journalctl@ceph.osd.2.trial131.stdout:Feb 23 13:02:46 trial131 sudo[52796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-23T13:02:46.135 INFO:journalctl@ceph.osd.2.trial131.stdout:Feb 23 13:02:46 trial131 sudo[52796]: pam_unix(sudo:session): session closed for user root 2026-02-23T13:02:46.135 INFO:journalctl@ceph.osd.2.trial131.stdout:Feb 23 13:02:46 trial131 sudo[52800]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-23T13:02:46.135 INFO:journalctl@ceph.osd.2.trial131.stdout:Feb 23 13:02:46 trial131 sudo[52800]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-23T13:02:46.135 INFO:journalctl@ceph.osd.2.trial131.stdout:Feb 23 13:02:46 trial131 sudo[52800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-23T13:02:46.135 INFO:journalctl@ceph.osd.2.trial131.stdout:Feb 23 13:02:46 trial131 sudo[52800]: pam_unix(sudo:session): session closed for user root 2026-02-23T13:02:46.289 INFO:journalctl@ceph.osd.0.trial046.stdout:Feb 23 13:02:45 trial046 sudo[70471]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-23T13:02:46.289 INFO:journalctl@ceph.osd.0.trial046.stdout:Feb 23 13:02:45 trial046 sudo[70471]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-23T13:02:46.290 INFO:journalctl@ceph.osd.0.trial046.stdout:Feb 23 13:02:45 trial046 sudo[70471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-23T13:02:46.290 INFO:journalctl@ceph.osd.0.trial046.stdout:Feb 23 13:02:45 trial046 sudo[70471]: pam_unix(sudo:session): session closed for user root 2026-02-23T13:02:46.290 INFO:journalctl@ceph.osd.0.trial046.stdout:Feb 23 13:02:46 trial046 sudo[70475]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-23T13:02:46.290 INFO:journalctl@ceph.osd.0.trial046.stdout:Feb 23 13:02:46 trial046 sudo[70475]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-23T13:02:46.290 INFO:journalctl@ceph.osd.0.trial046.stdout:Feb 23 13:02:46 trial046 sudo[70475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-23T13:02:46.290 INFO:journalctl@ceph.osd.0.trial046.stdout:Feb 23 13:02:46 trial046 sudo[70475]: pam_unix(sudo:session): session closed for user root 2026-02-23T13:02:46.291 INFO:journalctl@ceph.osd.1.trial046.stdout:Feb 23 13:02:46 trial046 sudo[70479]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-23T13:02:46.291 INFO:journalctl@ceph.osd.1.trial046.stdout:Feb 23 13:02:46 trial046 sudo[70479]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-23T13:02:46.291 INFO:journalctl@ceph.osd.1.trial046.stdout:Feb 23 13:02:46 trial046 sudo[70479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-23T13:02:46.291 INFO:journalctl@ceph.osd.1.trial046.stdout:Feb 23 13:02:46 trial046 sudo[70479]: pam_unix(sudo:session): session closed for user root 2026-02-23T13:02:46.291 INFO:journalctl@ceph.osd.1.trial046.stdout:Feb 23 13:02:46 trial046 sudo[70483]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-23T13:02:46.291 INFO:journalctl@ceph.osd.1.trial046.stdout:Feb 23 13:02:46 trial046 sudo[70483]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-23T13:02:46.291 INFO:journalctl@ceph.osd.1.trial046.stdout:Feb 23 13:02:46 trial046 sudo[70483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-23T13:02:46.292 INFO:journalctl@ceph.osd.1.trial046.stdout:Feb 23 13:02:46 trial046 sudo[70483]: pam_unix(sudo:session): session closed for user root 2026-02-23T13:02:46.292 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:46 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-23T13:02:46.292 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:46 trial046 ceph-mon[38575]: osdmap e19: 4 total, 3 up, 4 in 2026-02-23T13:02:46.292 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:46 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-23T13:02:46.292 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:46 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-23T13:02:46.292 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:46 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:02:46.292 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:46 trial046 ceph-mon[38575]: Deploying daemon osd.3 on trial131 2026-02-23T13:02:46.292 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:46 trial046 ceph-mon[38575]: pgmap v30: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-23T13:02:46.292 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:46 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-23T13:02:46.293 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:46 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:02:46.293 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:46 trial046 ceph-mon[38575]: Deploying daemon osd.3 on trial131 2026-02-23T13:02:46.293 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:46 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:46.293 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:46 trial046 sudo[70487]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2026-02-23T13:02:46.293 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:46 trial046 sudo[70487]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-23T13:02:46.293 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:46 trial046 sudo[70487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-23T13:02:46.293 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:46 trial046 sudo[70487]: pam_unix(sudo:session): session closed for user root 2026-02-23T13:02:46.293 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:46 trial046 sudo[70491]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme0n1 2026-02-23T13:02:46.293 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:46 trial046 sudo[70491]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-23T13:02:46.293 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:46 trial046 sudo[70491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-23T13:02:46.293 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:46 trial046 sudo[70491]: pam_unix(sudo:session): session closed for user root 2026-02-23T13:02:47.539 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:47 trial046 ceph-mon[38575]: osdmap e20: 4 total, 3 up, 4 in 2026-02-23T13:02:47.539 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:47 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-23T13:02:47.539 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:47 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:47.539 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:47 trial046 ceph-mon[38575]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-23T13:02:47.539 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:47 trial046 ceph-mon[38575]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-23T13:02:47.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:47 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-23T13:02:47.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:47 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:47.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:47 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:47.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:47 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:48.539 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:48 trial046 ceph-mon[38575]: pgmap v32: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-23T13:02:49.142 INFO:teuthology.orchestra.run.trial131.stdout:Created osd(s) 3 on host 'trial131' 2026-02-23T13:02:49.183 DEBUG:teuthology.orchestra.run.trial131:osd.3> sudo journalctl -f -n 0 -u ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@osd.3.service 2026-02-23T13:02:49.185 INFO:tasks.cephadm:Waiting for 4 OSDs to come up... 2026-02-23T13:02:49.185 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd stat -f json 2026-02-23T13:02:49.309 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:02:49.360 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:49 trial046 ceph-mon[38575]: mgrmap e14: x(active, since 44s) 2026-02-23T13:02:49.360 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:49 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:49.360 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:49 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:49.412 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:49.410+0000 7fba67d98640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:49.413 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:49.411+0000 7fba67d98640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:49.522 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:02:49.554 INFO:journalctl@ceph.osd.3.trial131.stdout:Feb 23 13:02:49 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-3[54059]: 2026-02-23T13:02:49.266+0000 7f1ca4b6e780 -1 osd.3 0 log_to_monitors true 2026-02-23T13:02:49.558 INFO:teuthology.orchestra.run.trial046.stdout:{"epoch":20,"num_osds":4,"num_up_osds":3,"osd_up_since":1771851763,"num_in_osds":4,"osd_in_since":1771851763,"num_remapped_pgs":0} 2026-02-23T13:02:50.539 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:50 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:50.539 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:50 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:50.539 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:50 trial046 ceph-mon[38575]: from='osd.3 [v2:10.20.193.131:6808/2723309313,v1:10.20.193.131:6809/2723309313]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-23T13:02:50.539 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:50 trial046 ceph-mon[38575]: pgmap v33: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-23T13:02:50.539 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:50 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3575890890' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-23T13:02:50.539 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:50 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:50.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:50 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:50.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:50 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-23T13:02:50.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:50 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:50.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:50 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:50.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:50 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:50.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:50 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:50.559 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd stat -f json 2026-02-23T13:02:50.677 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:02:50.785 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:50.784+0000 7fe752339640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:50.786 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:50.784+0000 7fe752339640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:50.896 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:02:50.936 INFO:teuthology.orchestra.run.trial046.stdout:{"epoch":21,"num_osds":4,"num_up_osds":3,"osd_up_since":1771851763,"num_in_osds":4,"osd_in_since":1771851763,"num_remapped_pgs":0} 2026-02-23T13:02:51.146 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:51 trial046 ceph-mon[38575]: from='osd.3 [v2:10.20.193.131:6808/2723309313,v1:10.20.193.131:6809/2723309313]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-23T13:02:51.147 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:51 trial046 ceph-mon[38575]: osdmap e21: 4 total, 3 up, 4 in 2026-02-23T13:02:51.147 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:51 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-23T13:02:51.147 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:51 trial046 ceph-mon[38575]: from='osd.3 [v2:10.20.193.131:6808/2723309313,v1:10.20.193.131:6809/2723309313]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial131", "root=default"]} : dispatch 2026-02-23T13:02:51.147 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:51 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:51.147 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:51 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:51.147 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:51 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:51.147 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:51 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:51.147 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:51 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-23T13:02:51.147 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:51 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-23T13:02:51.148 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:51 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:51.148 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:51 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1530681737' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-23T13:02:51.148 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:51 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:51.461 INFO:journalctl@ceph.osd.3.trial131.stdout:Feb 23 13:02:51 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-3[54059]: 2026-02-23T13:02:51.148+0000 7f1ca0af0640 -1 osd.3 0 waiting for initial osdmap 2026-02-23T13:02:51.461 INFO:journalctl@ceph.osd.3.trial131.stdout:Feb 23 13:02:51 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-3[54059]: 2026-02-23T13:02:51.151+0000 7f1c989af640 -1 osd.3 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-23T13:02:51.539 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:51 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:51.539 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:51 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:02:51.539 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:51 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-23T13:02:51.539 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:51 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:51.539 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:51 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-23T13:02:51.539 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:51 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-23T13:02:51.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:51 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:02:51.937 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd stat -f json 2026-02-23T13:02:52.057 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:02:52.155 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:52.153+0000 7f7ac2b59640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:52.155 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:52.154+0000 7f7ac2b59640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:52.263 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:02:52.263 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:52 trial046 ceph-mon[38575]: Detected new or changed devices on trial131 2026-02-23T13:02:52.264 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:52 trial046 ceph-mon[38575]: Adjusting osd_memory_target on trial131 to 44583M 2026-02-23T13:02:52.264 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:52 trial046 ceph-mon[38575]: from='osd.3 [v2:10.20.193.131:6808/2723309313,v1:10.20.193.131:6809/2723309313]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial131", "root=default"]}]': finished 2026-02-23T13:02:52.264 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:52 trial046 ceph-mon[38575]: osdmap e22: 4 total, 3 up, 4 in 2026-02-23T13:02:52.264 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:52 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-23T13:02:52.264 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:52 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-23T13:02:52.264 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:52 trial046 ceph-mon[38575]: pgmap v36: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-23T13:02:52.309 INFO:teuthology.orchestra.run.trial046.stdout:{"epoch":23,"num_osds":4,"num_up_osds":4,"osd_up_since":1771851772,"num_in_osds":4,"osd_in_since":1771851763,"num_remapped_pgs":1} 2026-02-23T13:02:52.309 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd dump --format=json 2026-02-23T13:02:52.425 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:02:52.535 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:52.534+0000 7efc546e2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:52.535 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:52.534+0000 7efc546e2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:52.647 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:02:52.647 INFO:teuthology.orchestra.run.trial046.stdout:{"epoch":23,"fsid":"c3b3ca7d-10b7-11f1-8efe-d404e6e7d460","created":"2026-02-23T13:01:43.505063+0000","modified":"2026-02-23T13:02:52.145963+0000","last_up_change":"2026-02-23T13:02:52.145963+0000","last_in_change":"2026-02-23T13:02:43.100090+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":10,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-23T13:02:43.566068+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"80ca734b-d032-47a7-be2b-bcab1f5b06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6802","nonce":3215761192},{"type":"v1","addr":"10.20.193.46:6803","nonce":3215761192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6804","nonce":3215761192},{"type":"v1","addr":"10.20.193.46:6805","nonce":3215761192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6808","nonce":3215761192},{"type":"v1","addr":"10.20.193.46:6809","nonce":3215761192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6806","nonce":3215761192},{"type":"v1","addr":"10.20.193.46:6807","nonce":3215761192}]},"public_addr":"10.20.193.46:6803/3215761192","cluster_addr":"10.20.193.46:6805/3215761192","heartbeat_back_addr":"10.20.193.46:6809/3215761192","heartbeat_front_addr":"10.20.193.46:6807/3215761192","state":["exists","up"]},{"osd":1,"uuid":"da77bcad-edc4-46df-a2e0-63010b9b6274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6810","nonce":2402797949},{"type":"v1","addr":"10.20.193.46:6811","nonce":2402797949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6812","nonce":2402797949},{"type":"v1","addr":"10.20.193.46:6813","nonce":2402797949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6816","nonce":2402797949},{"type":"v1","addr":"10.20.193.46:6817","nonce":2402797949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6814","nonce":2402797949},{"type":"v1","addr":"10.20.193.46:6815","nonce":2402797949}]},"public_addr":"10.20.193.46:6811/2402797949","cluster_addr":"10.20.193.46:6813/2402797949","heartbeat_back_addr":"10.20.193.46:6817/2402797949","heartbeat_front_addr":"10.20.193.46:6815/2402797949","state":["exists","up"]},{"osd":2,"uuid":"5a84a299-c810-46ba-8968-8cd5bccf127b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6800","nonce":1243371431},{"type":"v1","addr":"10.20.193.131:6801","nonce":1243371431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6802","nonce":1243371431},{"type":"v1","addr":"10.20.193.131:6803","nonce":1243371431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6806","nonce":1243371431},{"type":"v1","addr":"10.20.193.131:6807","nonce":1243371431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6804","nonce":1243371431},{"type":"v1","addr":"10.20.193.131:6805","nonce":1243371431}]},"public_addr":"10.20.193.131:6801/1243371431","cluster_addr":"10.20.193.131:6803/1243371431","heartbeat_back_addr":"10.20.193.131:6807/1243371431","heartbeat_front_addr":"10.20.193.131:6805/1243371431","state":["exists","up"]},{"osd":3,"uuid":"e53b2547-061e-4bfd-aca1-a53b0e860d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6808","nonce":2723309313},{"type":"v1","addr":"10.20.193.131:6809","nonce":2723309313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6810","nonce":2723309313},{"type":"v1","addr":"10.20.193.131:6811","nonce":2723309313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6814","nonce":2723309313},{"type":"v1","addr":"10.20.193.131:6815","nonce":2723309313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6812","nonce":2723309313},{"type":"v1","addr":"10.20.193.131:6813","nonce":2723309313}]},"public_addr":"10.20.193.131:6809/2723309313","cluster_addr":"10.20.193.131:6811/2723309313","heartbeat_back_addr":"10.20.193.131:6815/2723309313","heartbeat_front_addr":"10.20.193.131:6813/2723309313","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T13:02:24.940735+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T13:02:33.513948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T13:02:41.716506+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"1.0","osds":[0,2,1]}],"primary_temp":[],"blocklist":{"10.20.193.46:0/3352548256":"2026-02-24T13:02:03.355584+0000","10.20.193.46:0/3910278239":"2026-02-24T13:02:03.355584+0000","10.20.193.46:6801/3808210501":"2026-02-24T13:02:03.355584+0000","10.20.193.46:6800/3808210501":"2026-02-24T13:02:03.355584+0000","10.20.193.46:0/460416185":"2026-02-24T13:01:53.536089+0000","10.20.193.46:0/2607309055":"2026-02-24T13:02:03.355584+0000","10.20.193.46:0/4291592014":"2026-02-24T13:01:53.536089+0000","10.20.193.46:6800/999693074":"2026-02-24T13:01:53.536089+0000","10.20.193.46:6801/999693074":"2026-02-24T13:01:53.536089+0000","10.20.193.46:0/62318855":"2026-02-24T13:01:53.536089+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-23T13:02:52.688 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-23T13:02:43.566068+0000', 'flags': 262145, 'flags_names': 'hashpspool,crimson', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.75, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-23T13:02:52.688 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool get .mgr pg_num 2026-02-23T13:02:52.804 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:02:52.909 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:52.908+0000 7f9b7e007640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:52.909 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:52.909+0000 7f9b7e007640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:53.017 INFO:teuthology.orchestra.run.trial046.stdout:pg_num: 1 2026-02-23T13:02:53.054 INFO:tasks.cephadm:Adding prometheus.a on trial131 2026-02-23T13:02:53.054 DEBUG:teuthology.orchestra.run.trial131:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph orch apply prometheus '1;trial131=a' 2026-02-23T13:02:53.174 INFO:teuthology.orchestra.run.trial131.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/config/ceph.conf 2026-02-23T13:02:53.274 INFO:teuthology.orchestra.run.trial131.stderr:2026-02-23T13:02:53.273+0000 7fc24bb93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:53.274 INFO:teuthology.orchestra.run.trial131.stderr:2026-02-23T13:02:53.273+0000 7fc24bb93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:53.394 INFO:teuthology.orchestra.run.trial131.stdout:Scheduled prometheus update... 2026-02-23T13:02:53.431 DEBUG:teuthology.orchestra.run.trial131:prometheus.a> sudo journalctl -f -n 0 -u ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@prometheus.a.service 2026-02-23T13:02:53.433 INFO:tasks.cephadm:Adding node-exporter.a on trial046 2026-02-23T13:02:53.434 INFO:tasks.cephadm:Adding node-exporter.b on trial131 2026-02-23T13:02:53.434 DEBUG:teuthology.orchestra.run.trial131:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph orch apply node-exporter '2;trial046=a;trial131=b' 2026-02-23T13:02:53.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:53 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:02:53.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:53 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:02:53.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:53 trial046 ceph-mon[38575]: osd.3 [v2:10.20.193.131:6808/2723309313,v1:10.20.193.131:6809/2723309313] boot 2026-02-23T13:02:53.541 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:53 trial046 ceph-mon[38575]: osdmap e23: 4 total, 4 up, 4 in 2026-02-23T13:02:53.541 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:53 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-23T13:02:53.541 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:53 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-23T13:02:53.541 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:53 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/737137815' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-23T13:02:53.541 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:53 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:53.541 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:53 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:53.541 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:53 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2869883334' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-23T13:02:53.542 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:53 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1118850671' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-23T13:02:53.591 INFO:teuthology.orchestra.run.trial131.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/config/ceph.conf 2026-02-23T13:02:53.703 INFO:teuthology.orchestra.run.trial131.stderr:2026-02-23T13:02:53.702+0000 7f8d75349640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:53.704 INFO:teuthology.orchestra.run.trial131.stderr:2026-02-23T13:02:53.702+0000 7f8d75349640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:53.822 INFO:teuthology.orchestra.run.trial131.stdout:Scheduled node-exporter update... 2026-02-23T13:02:53.860 DEBUG:teuthology.orchestra.run.trial046:node-exporter.a> sudo journalctl -f -n 0 -u ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@node-exporter.a.service 2026-02-23T13:02:53.863 DEBUG:teuthology.orchestra.run.trial131:node-exporter.b> sudo journalctl -f -n 0 -u ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@node-exporter.b.service 2026-02-23T13:02:53.870 INFO:tasks.cephadm:Setting up client nodes... 2026-02-23T13:02:53.870 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-23T13:02:54.020 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:02:54.121 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:54.120+0000 7fcfee7f9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:54.121 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:54.120+0000 7fcfee7f9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:54.273 INFO:teuthology.orchestra.run.trial046.stdout:[client.0] 2026-02-23T13:02:54.273 INFO:teuthology.orchestra.run.trial046.stdout: key = AQD+T5xptzw7EBAAStkfhlm3eXDXHCJjpaLrlA== 2026-02-23T13:02:54.311 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-23T13:02:54.311 DEBUG:teuthology.orchestra.run.trial046:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2026-02-23T13:02:54.311 DEBUG:teuthology.orchestra.run.trial046:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-23T13:02:54.345 DEBUG:teuthology.orchestra.run.trial131:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-23T13:02:54.465 INFO:teuthology.orchestra.run.trial131.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/config/ceph.conf 2026-02-23T13:02:54.539 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:54 trial046 ceph-mon[38575]: 1.0 starting backfill to osd.3 from (0'0,0'0] MAX to 20'92 2026-02-23T13:02:54.539 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:54 trial046 ceph-mon[38575]: osdmap e24: 4 total, 4 up, 4 in 2026-02-23T13:02:54.539 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:54 trial046 ceph-mon[38575]: pgmap v39: 1 pgs: 1 unknown; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-23T13:02:54.539 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:54 trial046 ceph-mon[38575]: from='client.14251 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;trial131=a", "target": ["mon-mgr", ""]}]: dispatch 2026-02-23T13:02:54.539 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:54 trial046 ceph-mon[38575]: Saving service prometheus spec with placement trial131=a;count:1 2026-02-23T13:02:54.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:54 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:54.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:54 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-23T13:02:54.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:54 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:54.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:54 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:54.540 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:54 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:54.570 INFO:teuthology.orchestra.run.trial131.stderr:2026-02-23T13:02:54.568+0000 7f7e4f5f3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:54.570 INFO:teuthology.orchestra.run.trial131.stderr:2026-02-23T13:02:54.569+0000 7f7e4f5f3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:54.726 INFO:teuthology.orchestra.run.trial131.stdout:[client.1] 2026-02-23T13:02:54.726 INFO:teuthology.orchestra.run.trial131.stdout: key = AQD+T5xpeiQ9KxAAXIAOi7Nj8TWHgBh2JP6cQg== 2026-02-23T13:02:54.764 DEBUG:teuthology.orchestra.run.trial131:> set -ex 2026-02-23T13:02:54.764 DEBUG:teuthology.orchestra.run.trial131:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2026-02-23T13:02:54.764 DEBUG:teuthology.orchestra.run.trial131:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2026-02-23T13:02:54.801 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph config log 1 --format=json 2026-02-23T13:02:54.917 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:02:55.027 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:55.026+0000 7f99acb63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:55.027 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:55.026+0000 7f99acb63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:55.135 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:02:55.174 INFO:teuthology.orchestra.run.trial046.stdout:[{"version":13,"timestamp":"2026-02-23T13:02:50.880860+0000","name":"","changes":[{"name":"osd/host:trial131/osd_memory_target","previous_value":"93498640793","new_value":"46749320396"}]}] 2026-02-23T13:02:55.175 INFO:tasks.ceph_manager:config epoch is 13 2026-02-23T13:02:55.175 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-23T13:02:55.175 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-02-23T13:02:55.175 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph mgr dump --format=json 2026-02-23T13:02:55.290 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:02:55.395 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:55.394+0000 7fb280377640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:55.395 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:55.394+0000 7fb280377640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:55.396 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:55 trial046 ceph-mon[38575]: from='client.14253 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;trial046=a;trial131=b", "target": ["mon-mgr", ""]}]: dispatch 2026-02-23T13:02:55.396 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:55 trial046 ceph-mon[38575]: Saving service node-exporter spec with placement trial046=a;trial131=b;count:2 2026-02-23T13:02:55.396 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:55 trial046 ceph-mon[38575]: osdmap e25: 4 total, 4 up, 4 in 2026-02-23T13:02:55.396 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:55 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3366764519' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-23T13:02:55.396 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:55 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3366764519' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-23T13:02:55.396 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:55 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:55.396 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:55 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:55.397 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:55 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:02:55.397 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:55 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-23T13:02:55.397 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:55 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:55.397 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:55 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-23T13:02:55.397 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:55 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:55.397 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:55 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:55.397 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:55 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:55.397 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:55 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:55.397 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:55 trial046 ceph-mon[38575]: from='client.? 10.20.193.131:0/4245471674' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-23T13:02:55.397 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:55 trial046 ceph-mon[38575]: from='client.? 10.20.193.131:0/4245471674' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-23T13:02:55.397 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:55 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1352161686' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-23T13:02:55.536 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:02:55.570 INFO:teuthology.orchestra.run.trial046.stdout:{"epoch":14,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6800","nonce":2807562704},{"type":"v1","addr":"10.20.193.46:6801","nonce":2807562704}]},"active_addr":"10.20.193.46:6801/2807562704","active_change":"2026-02-23T13:02:03.355688+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["cephadm","dashboard","iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://10.20.193.46:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.46:0","nonce":1308119843}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.46:0","nonce":1237070006}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.46:0","nonce":3264800521}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.46:0","nonce":2765809326}]}]} 2026-02-23T13:02:55.638 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-02-23T13:02:55.638 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-02-23T13:02:55.638 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd dump --format=json 2026-02-23T13:02:55.754 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:02:55.862 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:55.860+0000 7fe581a27640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:55.862 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:55.861+0000 7fe581a27640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:55.972 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:02:55.972 INFO:teuthology.orchestra.run.trial046.stdout:{"epoch":26,"fsid":"c3b3ca7d-10b7-11f1-8efe-d404e6e7d460","created":"2026-02-23T13:01:43.505063+0000","modified":"2026-02-23T13:02:55.153842+0000","last_up_change":"2026-02-23T13:02:52.145963+0000","last_in_change":"2026-02-23T13:02:43.100090+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":10,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-23T13:02:43.566068+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"80ca734b-d032-47a7-be2b-bcab1f5b06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6802","nonce":3215761192},{"type":"v1","addr":"10.20.193.46:6803","nonce":3215761192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6804","nonce":3215761192},{"type":"v1","addr":"10.20.193.46:6805","nonce":3215761192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6808","nonce":3215761192},{"type":"v1","addr":"10.20.193.46:6809","nonce":3215761192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6806","nonce":3215761192},{"type":"v1","addr":"10.20.193.46:6807","nonce":3215761192}]},"public_addr":"10.20.193.46:6803/3215761192","cluster_addr":"10.20.193.46:6805/3215761192","heartbeat_back_addr":"10.20.193.46:6809/3215761192","heartbeat_front_addr":"10.20.193.46:6807/3215761192","state":["exists","up"]},{"osd":1,"uuid":"da77bcad-edc4-46df-a2e0-63010b9b6274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6810","nonce":2402797949},{"type":"v1","addr":"10.20.193.46:6811","nonce":2402797949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6812","nonce":2402797949},{"type":"v1","addr":"10.20.193.46:6813","nonce":2402797949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6816","nonce":2402797949},{"type":"v1","addr":"10.20.193.46:6817","nonce":2402797949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6814","nonce":2402797949},{"type":"v1","addr":"10.20.193.46:6815","nonce":2402797949}]},"public_addr":"10.20.193.46:6811/2402797949","cluster_addr":"10.20.193.46:6813/2402797949","heartbeat_back_addr":"10.20.193.46:6817/2402797949","heartbeat_front_addr":"10.20.193.46:6815/2402797949","state":["exists","up"]},{"osd":2,"uuid":"5a84a299-c810-46ba-8968-8cd5bccf127b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6800","nonce":1243371431},{"type":"v1","addr":"10.20.193.131:6801","nonce":1243371431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6802","nonce":1243371431},{"type":"v1","addr":"10.20.193.131:6803","nonce":1243371431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6806","nonce":1243371431},{"type":"v1","addr":"10.20.193.131:6807","nonce":1243371431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6804","nonce":1243371431},{"type":"v1","addr":"10.20.193.131:6805","nonce":1243371431}]},"public_addr":"10.20.193.131:6801/1243371431","cluster_addr":"10.20.193.131:6803/1243371431","heartbeat_back_addr":"10.20.193.131:6807/1243371431","heartbeat_front_addr":"10.20.193.131:6805/1243371431","state":["exists","up"]},{"osd":3,"uuid":"e53b2547-061e-4bfd-aca1-a53b0e860d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6808","nonce":2723309313},{"type":"v1","addr":"10.20.193.131:6809","nonce":2723309313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6810","nonce":2723309313},{"type":"v1","addr":"10.20.193.131:6811","nonce":2723309313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6814","nonce":2723309313},{"type":"v1","addr":"10.20.193.131:6815","nonce":2723309313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6812","nonce":2723309313},{"type":"v1","addr":"10.20.193.131:6813","nonce":2723309313}]},"public_addr":"10.20.193.131:6809/2723309313","cluster_addr":"10.20.193.131:6811/2723309313","heartbeat_back_addr":"10.20.193.131:6815/2723309313","heartbeat_front_addr":"10.20.193.131:6813/2723309313","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T13:02:24.940735+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T13:02:33.513948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T13:02:41.716506+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T13:02:50.241323+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.46:0/3352548256":"2026-02-24T13:02:03.355584+0000","10.20.193.46:0/3910278239":"2026-02-24T13:02:03.355584+0000","10.20.193.46:6801/3808210501":"2026-02-24T13:02:03.355584+0000","10.20.193.46:6800/3808210501":"2026-02-24T13:02:03.355584+0000","10.20.193.46:0/460416185":"2026-02-24T13:01:53.536089+0000","10.20.193.46:0/2607309055":"2026-02-24T13:02:03.355584+0000","10.20.193.46:0/4291592014":"2026-02-24T13:01:53.536089+0000","10.20.193.46:6800/999693074":"2026-02-24T13:01:53.536089+0000","10.20.193.46:6801/999693074":"2026-02-24T13:01:53.536089+0000","10.20.193.46:0/62318855":"2026-02-24T13:01:53.536089+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-23T13:02:56.008 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-02-23T13:02:56.008 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd dump --format=json 2026-02-23T13:02:56.124 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:02:56.236 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:56.235+0000 7f7131832640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:56.236 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:56.235+0000 7f7131832640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:56.236 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:56 trial046 ceph-mon[38575]: Deploying daemon prometheus.a on trial131 2026-02-23T13:02:56.237 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:56 trial046 ceph-mon[38575]: osdmap e26: 4 total, 4 up, 4 in 2026-02-23T13:02:56.237 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:56 trial046 ceph-mon[38575]: pgmap v42: 1 pgs: 1 unknown; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-23T13:02:56.237 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:56 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3143874558' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-23T13:02:56.237 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:56 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4193923789' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-23T13:02:56.346 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:02:56.347 INFO:teuthology.orchestra.run.trial046.stdout:{"epoch":26,"fsid":"c3b3ca7d-10b7-11f1-8efe-d404e6e7d460","created":"2026-02-23T13:01:43.505063+0000","modified":"2026-02-23T13:02:55.153842+0000","last_up_change":"2026-02-23T13:02:52.145963+0000","last_in_change":"2026-02-23T13:02:43.100090+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":10,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-23T13:02:43.566068+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"80ca734b-d032-47a7-be2b-bcab1f5b06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6802","nonce":3215761192},{"type":"v1","addr":"10.20.193.46:6803","nonce":3215761192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6804","nonce":3215761192},{"type":"v1","addr":"10.20.193.46:6805","nonce":3215761192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6808","nonce":3215761192},{"type":"v1","addr":"10.20.193.46:6809","nonce":3215761192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6806","nonce":3215761192},{"type":"v1","addr":"10.20.193.46:6807","nonce":3215761192}]},"public_addr":"10.20.193.46:6803/3215761192","cluster_addr":"10.20.193.46:6805/3215761192","heartbeat_back_addr":"10.20.193.46:6809/3215761192","heartbeat_front_addr":"10.20.193.46:6807/3215761192","state":["exists","up"]},{"osd":1,"uuid":"da77bcad-edc4-46df-a2e0-63010b9b6274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6810","nonce":2402797949},{"type":"v1","addr":"10.20.193.46:6811","nonce":2402797949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6812","nonce":2402797949},{"type":"v1","addr":"10.20.193.46:6813","nonce":2402797949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6816","nonce":2402797949},{"type":"v1","addr":"10.20.193.46:6817","nonce":2402797949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6814","nonce":2402797949},{"type":"v1","addr":"10.20.193.46:6815","nonce":2402797949}]},"public_addr":"10.20.193.46:6811/2402797949","cluster_addr":"10.20.193.46:6813/2402797949","heartbeat_back_addr":"10.20.193.46:6817/2402797949","heartbeat_front_addr":"10.20.193.46:6815/2402797949","state":["exists","up"]},{"osd":2,"uuid":"5a84a299-c810-46ba-8968-8cd5bccf127b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6800","nonce":1243371431},{"type":"v1","addr":"10.20.193.131:6801","nonce":1243371431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6802","nonce":1243371431},{"type":"v1","addr":"10.20.193.131:6803","nonce":1243371431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6806","nonce":1243371431},{"type":"v1","addr":"10.20.193.131:6807","nonce":1243371431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6804","nonce":1243371431},{"type":"v1","addr":"10.20.193.131:6805","nonce":1243371431}]},"public_addr":"10.20.193.131:6801/1243371431","cluster_addr":"10.20.193.131:6803/1243371431","heartbeat_back_addr":"10.20.193.131:6807/1243371431","heartbeat_front_addr":"10.20.193.131:6805/1243371431","state":["exists","up"]},{"osd":3,"uuid":"e53b2547-061e-4bfd-aca1-a53b0e860d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6808","nonce":2723309313},{"type":"v1","addr":"10.20.193.131:6809","nonce":2723309313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6810","nonce":2723309313},{"type":"v1","addr":"10.20.193.131:6811","nonce":2723309313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6814","nonce":2723309313},{"type":"v1","addr":"10.20.193.131:6815","nonce":2723309313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6812","nonce":2723309313},{"type":"v1","addr":"10.20.193.131:6813","nonce":2723309313}]},"public_addr":"10.20.193.131:6809/2723309313","cluster_addr":"10.20.193.131:6811/2723309313","heartbeat_back_addr":"10.20.193.131:6815/2723309313","heartbeat_front_addr":"10.20.193.131:6813/2723309313","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T13:02:24.940735+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T13:02:33.513948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T13:02:41.716506+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T13:02:50.241323+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.46:0/3352548256":"2026-02-24T13:02:03.355584+0000","10.20.193.46:0/3910278239":"2026-02-24T13:02:03.355584+0000","10.20.193.46:6801/3808210501":"2026-02-24T13:02:03.355584+0000","10.20.193.46:6800/3808210501":"2026-02-24T13:02:03.355584+0000","10.20.193.46:0/460416185":"2026-02-24T13:01:53.536089+0000","10.20.193.46:0/2607309055":"2026-02-24T13:02:03.355584+0000","10.20.193.46:0/4291592014":"2026-02-24T13:01:53.536089+0000","10.20.193.46:6800/999693074":"2026-02-24T13:01:53.536089+0000","10.20.193.46:6801/999693074":"2026-02-24T13:01:53.536089+0000","10.20.193.46:0/62318855":"2026-02-24T13:01:53.536089+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-23T13:02:56.383 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph tell osd.0 flush_pg_stats 2026-02-23T13:02:56.383 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph tell osd.1 flush_pg_stats 2026-02-23T13:02:56.383 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph tell osd.2 flush_pg_stats 2026-02-23T13:02:56.383 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph tell osd.3 flush_pg_stats 2026-02-23T13:02:56.501 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:02:56.501 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:02:56.502 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:02:56.508 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:02:56.613 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:56.612+0000 7fe3dea31640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:56.613 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:56.612+0000 7fe3dea31640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:56.614 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:56.612+0000 7f27c0122640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:56.614 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:56.612+0000 7ffabc540640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:56.614 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:56.613+0000 7f27c0122640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:56.615 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:56.613+0000 7ffabc540640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:56.615 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:56.614+0000 7f2a17fef640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:56.615 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:56.614+0000 7f2a17fef640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:56.668 INFO:teuthology.orchestra.run.trial046.stdout:98784247810 2026-02-23T13:02:56.669 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-23T13:02:56.672 INFO:teuthology.orchestra.run.trial046.stdout:38654705671 2026-02-23T13:02:56.673 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-23T13:02:56.682 INFO:teuthology.orchestra.run.trial046.stdout:55834574855 2026-02-23T13:02:56.683 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-23T13:02:56.684 INFO:teuthology.orchestra.run.trial046.stdout:73014444037 2026-02-23T13:02:56.685 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-23T13:02:56.730 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:02:56 trial131 systemd[1]: Started Ceph prometheus.a for c3b3ca7d-10b7-11f1-8efe-d404e6e7d460. 2026-02-23T13:02:56.787 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:02:56.796 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:02:56.840 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:02:56.843 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:02:56.902 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:56.901+0000 7f77f1873640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:56.903 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:56.901+0000 7f77f1873640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:56.903 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:56.902+0000 7f4de64f6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:56.903 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:56.902+0000 7f4de64f6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:56.943 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:56.943+0000 7f750c89c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:56.944 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:56.943+0000 7f750c89c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:56.944 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:56.943+0000 7ff242da4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:56.944 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:56.944+0000 7ff242da4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:57.015 INFO:teuthology.orchestra.run.trial046.stdout:98784247809 2026-02-23T13:02:57.017 INFO:teuthology.orchestra.run.trial046.stdout:38654705670 2026-02-23T13:02:57.056 INFO:teuthology.orchestra.run.trial046.stdout:73014444036 2026-02-23T13:02:57.058 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247810 got 98784247809 for osd.3 2026-02-23T13:02:57.061 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:02:56 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[63213]: time=2026-02-23T13:02:56.729Z level=INFO source=main.go:1545 msg="updated GOGC" old=100 new=75 2026-02-23T13:02:57.061 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:02:56 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[63213]: time=2026-02-23T13:02:56.729Z level=INFO source=main.go:677 msg="Leaving GOMAXPROCS=24: CPU quota undefined" component=automaxprocs 2026-02-23T13:02:57.061 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:02:56 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[63213]: time=2026-02-23T13:02:56.729Z level=INFO source=memlimit.go:198 msg="GOMEMLIMIT is updated" component=automemlimit package=github.com/KimMachineGun/automemlimit/memlimit GOMEMLIMIT=120212538163 previous=9223372036854775807 2026-02-23T13:02:57.061 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:02:56 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[63213]: time=2026-02-23T13:02:56.729Z level=INFO source=main.go:770 msg="Starting Prometheus Server" mode=server version="(version=3.6.0, branch=HEAD, revision=491734606591ef8c188f5489c70380805bc868c0)" 2026-02-23T13:02:57.061 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:02:56 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[63213]: time=2026-02-23T13:02:56.729Z level=INFO source=main.go:775 msg="operational information" build_context="(go=go1.24.7, platform=linux/amd64, user=root@bfdf1aa26e4d, date=20250921-19:51:16, tags=netgo,builtinassets)" host_details="(Linux 5.14.0-681.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026 x86_64 trial131 (none))" fd_limits="(soft=1048576, hard=1048576)" vm_limits="(soft=unlimited, hard=unlimited)" 2026-02-23T13:02:57.061 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:02:56 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[63213]: time=2026-02-23T13:02:56.730Z level=INFO source=web.go:659 msg="Start listening for connections" component=web address=:9095 2026-02-23T13:02:57.062 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:02:56 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[63213]: time=2026-02-23T13:02:56.731Z level=INFO source=main.go:1289 msg="Starting TSDB ..." 2026-02-23T13:02:57.062 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:02:56 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[63213]: time=2026-02-23T13:02:56.732Z level=INFO source=tls_config.go:347 msg="Listening on" component=web address=[::]:9095 2026-02-23T13:02:57.062 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:02:56 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[63213]: time=2026-02-23T13:02:56.732Z level=INFO source=tls_config.go:350 msg="TLS is disabled." component=web http2=false address=[::]:9095 2026-02-23T13:02:57.062 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:02:56 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[63213]: time=2026-02-23T13:02:56.733Z level=INFO source=head.go:667 msg="Replaying on-disk memory mappable chunks if any" component=tsdb 2026-02-23T13:02:57.062 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:02:56 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[63213]: time=2026-02-23T13:02:56.733Z level=INFO source=head.go:754 msg="On-disk memory mappable chunks replay completed" component=tsdb duration=862ns 2026-02-23T13:02:57.062 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:02:56 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[63213]: time=2026-02-23T13:02:56.733Z level=INFO source=head.go:762 msg="Replaying WAL, this may take a while" component=tsdb 2026-02-23T13:02:57.062 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:02:56 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[63213]: time=2026-02-23T13:02:56.734Z level=INFO source=head.go:835 msg="WAL segment loaded" component=tsdb segment=0 maxSegment=0 duration=229.709µs 2026-02-23T13:02:57.062 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:02:56 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[63213]: time=2026-02-23T13:02:56.734Z level=INFO source=head.go:872 msg="WAL replay completed" component=tsdb checkpoint_replay_duration=32.23µs wal_replay_duration=241.232µs wbl_replay_duration=120ns chunk_snapshot_load_duration=0s mmap_chunk_replay_duration=862ns total_replay_duration=298.949µs 2026-02-23T13:02:57.062 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:02:56 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[63213]: time=2026-02-23T13:02:56.735Z level=INFO source=main.go:1310 msg="filesystem information" fs_type=XFS_SUPER_MAGIC 2026-02-23T13:02:57.062 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:02:56 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[63213]: time=2026-02-23T13:02:56.735Z level=INFO source=main.go:1313 msg="TSDB started" 2026-02-23T13:02:57.062 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:02:56 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[63213]: time=2026-02-23T13:02:56.735Z level=INFO source=main.go:1498 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2026-02-23T13:02:57.063 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:02:56 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[63213]: time=2026-02-23T13:02:56.746Z level=INFO source=main.go:1538 msg="Completed loading of configuration file" db_storage=822ns remote_storage=761ns web_handler=320ns query_engine=531ns scrape=296.554µs scrape_sd=44.814µs notify=531ns notify_sd=401ns rules=10.602264ms tracing=5.25µs filename=/etc/prometheus/prometheus.yml totalDuration=11.096629ms 2026-02-23T13:02:57.063 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:02:56 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[63213]: time=2026-02-23T13:02:56.746Z level=INFO source=main.go:1274 msg="Server is ready to receive web requests." 2026-02-23T13:02:57.063 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:02:56 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[63213]: time=2026-02-23T13:02:56.746Z level=INFO source=manager.go:176 msg="Starting rule manager..." component="rule manager" 2026-02-23T13:02:57.066 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705671 got 38654705670 for osd.0 2026-02-23T13:02:57.066 INFO:teuthology.orchestra.run.trial046.stdout:55834574854 2026-02-23T13:02:57.098 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444037 got 73014444036 for osd.2 2026-02-23T13:02:57.107 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2026-02-23T13:02:57.362 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:57 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3603949690' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-23T13:02:57.362 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:57 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:57.362 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:57 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:57.362 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:57 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' 2026-02-23T13:02:57.363 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:57 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd={"prefix": "mgr module enable", "module": "prometheus"} : dispatch 2026-02-23T13:02:57.363 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:57 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/29934895' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-23T13:02:57.363 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:57 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/822247298' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-23T13:02:57.363 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:57 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2512807098' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-23T13:02:57.363 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:57 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2248671306' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-23T13:02:58.039 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:02:57 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ignoring --setuser ceph since I am not root 2026-02-23T13:02:58.040 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:02:57 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ignoring --setgroup ceph since I am not root 2026-02-23T13:02:58.040 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:02:57 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: 2026-02-23T13:02:57.794+0000 7f5be7e58fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:58.040 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:02:57 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: 2026-02-23T13:02:57.797+0000 7f5be7e58fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:58.040 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:02:57 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: 2026-02-23T13:02:57.797+0000 7f5be7e58fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:58.059 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-23T13:02:58.066 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-23T13:02:58.099 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-23T13:02:58.108 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-23T13:02:58.180 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:02:58.219 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:02:58.220 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:02:58.268 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:02:58.294 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:58.293+0000 7ff15cd1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:58.294 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:58.293+0000 7ff15cd1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:58.313 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:58.312+0000 7f4ba018d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:58.313 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:58.312+0000 7f4ba018d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:58.317 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:58.316+0000 7f32d786c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:58.317 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:58.317+0000 7f32d786c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:58.331 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:58 trial046 ceph-mon[38575]: pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 111 KiB/s, 0 objects/s recovering 2026-02-23T13:02:58.332 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:58 trial046 ceph-mon[38575]: from='mgr.14152 10.20.193.46:0/2202678112' entity='mgr.x' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2026-02-23T13:02:58.332 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:58 trial046 ceph-mon[38575]: mgrmap e15: x(active, since 54s) 2026-02-23T13:02:58.381 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:58.380+0000 7fca70dd4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:58.381 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:58.380+0000 7fca70dd4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:58.412 INFO:teuthology.orchestra.run.trial046.stdout:98784247810 2026-02-23T13:02:58.427 INFO:teuthology.orchestra.run.trial046.stdout:38654705672 2026-02-23T13:02:58.438 INFO:teuthology.orchestra.run.trial046.stdout:73014444037 2026-02-23T13:02:58.457 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247810 got 98784247810 for osd.3 2026-02-23T13:02:58.457 DEBUG:teuthology.parallel:result is None 2026-02-23T13:02:58.471 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705671 got 38654705672 for osd.0 2026-02-23T13:02:58.471 DEBUG:teuthology.parallel:result is None 2026-02-23T13:02:58.479 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444037 got 73014444037 for osd.2 2026-02-23T13:02:58.480 DEBUG:teuthology.parallel:result is None 2026-02-23T13:02:58.502 INFO:teuthology.orchestra.run.trial046.stdout:55834574855 2026-02-23T13:02:58.541 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2026-02-23T13:02:58.541 DEBUG:teuthology.parallel:result is None 2026-02-23T13:02:58.541 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-23T13:02:58.541 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:02:58.698 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:02:58.805 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:58.804+0000 7f7a87627640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:58.805 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:02:58.804+0000 7f7a87627640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:02:59.039 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:02:58 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-23T13:02:59.039 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:02:58 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-23T13:02:59.039 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:02:58 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: from numpy import show_config as show_numpy_config 2026-02-23T13:02:59.539 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:59 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/213082084' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-23T13:02:59.539 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:59 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1512890316' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-23T13:02:59.539 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:59 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/865208376' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-23T13:02:59.539 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:02:59 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3738154606' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-23T13:03:01.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:00 trial046 ceph-mon[38575]: Active manager daemon x restarted 2026-02-23T13:03:01.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:00 trial046 ceph-mon[38575]: Activating manager daemon x 2026-02-23T13:03:01.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:00 trial046 ceph-mon[38575]: osdmap e27: 4 total, 4 up, 4 in 2026-02-23T13:03:01.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:00 trial046 ceph-mon[38575]: mgrmap e16: x(active, starting, since 0.00318378s) 2026-02-23T13:03:01.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:00 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-23T13:03:01.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:00 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-23T13:03:01.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:00 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-23T13:03:01.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:00 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-23T13:03:01.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:00 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-23T13:03:01.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:00 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-23T13:03:01.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:00 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-23T13:03:01.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:00 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-23T13:03:01.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:00 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-23T13:03:01.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:00 trial046 ceph-mon[38575]: Manager daemon x is now available 2026-02-23T13:03:01.591 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:03:01.591 INFO:teuthology.orchestra.run.trial046.stderr:Warning: due to ceph-mgr restart, some PG states may not be up to date 2026-02-23T13:03:01.592 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:03:01.630 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":false,"pg_map":{"version":2,"stamp":"2026-02-23T13:03:00.591072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:03:00.585612+0000","last_change":"2026-02-23T13:03:00.585612+0000","last_active":"2026-02-23T13:03:00.585612+0000","last_peered":"2026-02-23T13:03:00.585612+0000","last_clean":"2026-02-23T13:03:00.585612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:03:00.585612+0000","last_undegraded":"2026-02-23T13:03:00.585612+0000","last_fullsized":"2026-02-23T13:03:00.585612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:00.585612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:00.585612+0000","last_clean_scrub_stamp":"2026-02-23T13:03:00.585612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0}],"osd_stats":[],"pool_statfs":[]}} 2026-02-23T13:03:01.630 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:03:01.751 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:01.857 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:01.856+0000 7f3bfc523640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:01.857 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:01.856+0000 7f3bfc523640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:01.858 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:01 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-23T13:03:01.858 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:01 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:01.858 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:01 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:03:01.858 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:01 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "orch get-security-config"} : dispatch 2026-02-23T13:03:01.858 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:01 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-23T13:03:01.858 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:01 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-23T13:03:01.858 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:01 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:01.858 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:01 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:01.859 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:01 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:01.859 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:01 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:01.859 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:01 trial046 ceph-mon[38575]: mgrmap e17: x(active, since 1.00483s) 2026-02-23T13:03:01.859 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:03:01 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: [23/Feb/2026:13:03:01] ENGINE Bus STARTING 2026-02-23T13:03:01.859 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:03:01 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: CherryPy Checker: 2026-02-23T13:03:01.859 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:03:01 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: The Application mounted at '' has an empty config. 2026-02-23T13:03:01.859 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:03:01 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: 2026-02-23T13:03:01.859 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:03:01 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: [23/Feb/2026:13:03:01] ENGINE Serving on http://:::9283 2026-02-23T13:03:01.859 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:03:01 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: [23/Feb/2026:13:03:01] ENGINE Bus STARTED 2026-02-23T13:03:01.972 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:03:01.973 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:03:02.012 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":3,"stamp":"2026-02-23T13:03:01.591860+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":2936012800,"kb_used":110484,"kb_used_data":2628,"kb_used_omap":44,"kb_used_meta":107731,"kb_avail":2935902316,"statfs":{"total":3006477107200,"available":3006363971584,"internally_reserved":0,"allocated":2691072,"data_stored":2086861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45529,"internal_metadata":110317095},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"20'92","reported_seq":155,"reported_epoch":26,"state":"active+clean","last_fresh":"2026-02-23T13:02:55.158967+0000","last_change":"2026-02-23T13:02:55.158696+0000","last_active":"2026-02-23T13:02:55.158967+0000","last_peered":"2026-02-23T13:02:55.158967+0000","last_clean":"2026-02-23T13:02:55.158967+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:02:55.158967+0000","last_undegraded":"2026-02-23T13:02:55.158967+0000","last_fullsized":"2026-02-23T13:02:55.158967+0000","mapping_epoch":25,"log_start":"20'90","ondisk_log_start":"20'90","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:02:44.100679+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":90,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:07.625581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247811,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":666089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6165,"internal_metadata":27584491},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444038,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":10,"kb_used_meta":26933,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":670380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10725,"internal_metadata":27579931},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27188,"kb_used_data":224,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":733976012,"statfs":{"total":751619276800,"available":751591436288,"internally_reserved":0,"allocated":229376,"data_stored":80012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13343,"internal_metadata":27577313},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":14,"kb_used_meta":26929,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":670380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15296,"internal_metadata":27575360},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:03:02.013 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-23T13:03:02.013 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-23T13:03:02.013 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-02-23T13:03:02.014 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph health --format=json 2026-02-23T13:03:02.131 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:02.233 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:02.232+0000 7f06774c5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:02.233 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:02.232+0000 7f06774c5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:02.372 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:03:02.373 INFO:teuthology.orchestra.run.trial046.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-23T13:03:02.504 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2026-02-23T13:03:02.505 INFO:tasks.cephadm:Setup complete, yielding 2026-02-23T13:03:02.505 INFO:teuthology.run_tasks:Running task cephadm.shell... 2026-02-23T13:03:02.519 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@trial046.front.sepia.ceph.com 2026-02-23T13:03:02.519 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- bash -c 'ceph orch status' 2026-02-23T13:03:02.710 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:02.734 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:02 trial046 bash[78560]: Trying to pull quay.io/prometheus/node-exporter:v1.9.1... 2026-02-23T13:03:02.734 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:02 trial046 ceph-mon[38575]: [23/Feb/2026:13:03:00] ENGINE Bus STARTING 2026-02-23T13:03:02.734 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:02 trial046 ceph-mon[38575]: [23/Feb/2026:13:03:01] ENGINE Serving on http://10.20.193.46:8765 2026-02-23T13:03:02.735 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:02 trial046 ceph-mon[38575]: [23/Feb/2026:13:03:01] ENGINE Serving on https://10.20.193.46:7150 2026-02-23T13:03:02.735 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:02 trial046 ceph-mon[38575]: [23/Feb/2026:13:03:01] ENGINE Bus STARTED 2026-02-23T13:03:02.735 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:02 trial046 ceph-mon[38575]: [23/Feb/2026:13:03:01] ENGINE Client ('10.20.193.46', 47730) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-23T13:03:02.735 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:02 trial046 ceph-mon[38575]: from='client.14293 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:03:02.735 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:02 trial046 ceph-mon[38575]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch get-security-config"}]: dispatch 2026-02-23T13:03:02.735 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:02 trial046 ceph-mon[38575]: pgmap v3: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-23T13:03:02.736 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:02 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:02.736 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:02 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:02.736 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:02 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:02.736 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:02 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:02.736 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:02 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-23T13:03:02.736 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:02 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-23T13:03:02.736 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:02 trial046 ceph-mon[38575]: Adjusting osd_memory_target on trial131 to 44071M 2026-02-23T13:03:02.737 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:02 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:02.737 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:02 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:03:02.737 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:02 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-23T13:03:02.737 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:02 trial046 ceph-mon[38575]: Updating trial046:/etc/ceph/ceph.conf 2026-02-23T13:03:02.737 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:02 trial046 ceph-mon[38575]: Updating trial131:/etc/ceph/ceph.conf 2026-02-23T13:03:02.737 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:02 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:02.737 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:02 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:02.738 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:02 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:02.738 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:02 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:02.738 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:02 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:02.738 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:02 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-23T13:03:02.738 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:02 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:02.738 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:02 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:02.738 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:02 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4252941705' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-23T13:03:02.818 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:02.816+0000 7f855aa19640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:02.818 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:02.817+0000 7f855aa19640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:02.933 INFO:teuthology.orchestra.run.trial046.stdout:Backend: cephadm 2026-02-23T13:03:02.933 INFO:teuthology.orchestra.run.trial046.stdout:Available: Yes 2026-02-23T13:03:02.933 INFO:teuthology.orchestra.run.trial046.stdout:Paused: No 2026-02-23T13:03:02.970 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- bash -c 'ceph orch ps' 2026-02-23T13:03:03.090 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:03.200 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:03.199+0000 7fc370448640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:03.200 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:03.199+0000 7fc370448640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:03.289 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 bash[78560]: Getting image source signatures 2026-02-23T13:03:03.289 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 bash[78560]: Copying blob sha256:1617e25568b2231fdd0d5caff63b06f6f7738d8d961f031c80e47d35aaec9733 2026-02-23T13:03:03.289 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 bash[78560]: Copying blob sha256:c6e37428e3b36731b2b7a99979e0dbb27ce0849df0c23fb2b73e99bdbcd7ca33 2026-02-23T13:03:03.289 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 bash[78560]: Copying blob sha256:9fa9226be034e47923c0457d916aa68474cdfb23af8d4525e9baeebc4760977a 2026-02-23T13:03:03.323 INFO:teuthology.orchestra.run.trial046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-23T13:03:03.323 INFO:teuthology.orchestra.run.trial046.stdout:mgr.x trial046 *:9283,8765 running (78s) 2s ago 78s 510M - 20.3.0-5439-ge371433f 63df4b83db6f 2dfbc97b0cf5 2026-02-23T13:03:03.323 INFO:teuthology.orchestra.run.trial046.stdout:mon.a trial046 running (78s) 2s ago 79s 45.4M 2048M 20.3.0-5439-ge371433f 63df4b83db6f 7bd9b1f25d33 2026-02-23T13:03:03.323 INFO:teuthology.orchestra.run.trial046.stdout:osd.0 trial046 running (40s) 2s ago 41s 39.5M 41.0G 20.3.0-5439-ge371433f 63df4b83db6f c8d7c8c97f3d 2026-02-23T13:03:03.324 INFO:teuthology.orchestra.run.trial046.stdout:osd.1 trial046 running (31s) 2s ago 33s 42.4M 41.0G 20.3.0-5439-ge371433f 63df4b83db6f edf2794db8f5 2026-02-23T13:03:03.324 INFO:teuthology.orchestra.run.trial046.stdout:osd.2 trial131 running (23s) 1s ago 25s 42.9M 43.0G 20.3.0-5439-ge371433f 63df4b83db6f fc4215fe470d 2026-02-23T13:03:03.324 INFO:teuthology.orchestra.run.trial046.stdout:osd.3 trial131 running (14s) 1s ago 16s 37.4M 43.0G 20.3.0-5439-ge371433f 63df4b83db6f 406e7fbcce7d 2026-02-23T13:03:03.324 INFO:teuthology.orchestra.run.trial046.stdout:prometheus.a trial131 *:9095 running (6s) 1s ago 6s 32.1M - 3.6.0 4fcecf061b74 9bbeb29bf075 2026-02-23T13:03:03.381 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- bash -c 'ceph orch ls' 2026-02-23T13:03:03.498 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:03.600 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:03.598+0000 7f3964ad7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:03.600 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:03.599+0000 7f3964ad7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:03.601 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 bash[78560]: Copying config sha256:255ec253085fb105696533b31864a5e3b64f1f1e2147b5ec368100cbf3ec9b80 2026-02-23T13:03:03.601 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 bash[78560]: Writing manifest to image destination 2026-02-23T13:03:03.601 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 podman[78560]: 2026-02-23 13:03:03.328482574 +0000 UTC m=+0.631195506 container create 61d859e8cf06e70e690be6f76b220a10a10f8e13ecc5b485fb6819880faf5158 (image=quay.io/prometheus/node-exporter:v1.9.1, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a, maintainer=The Prometheus Authors ) 2026-02-23T13:03:03.601 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 podman[78560]: 2026-02-23 13:03:03.362590836 +0000 UTC m=+0.665303758 container init 61d859e8cf06e70e690be6f76b220a10a10f8e13ecc5b485fb6819880faf5158 (image=quay.io/prometheus/node-exporter:v1.9.1, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a, maintainer=The Prometheus Authors ) 2026-02-23T13:03:03.601 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 podman[78560]: 2026-02-23 13:03:03.365345557 +0000 UTC m=+0.668058489 container start 61d859e8cf06e70e690be6f76b220a10a10f8e13ecc5b485fb6819880faf5158 (image=quay.io/prometheus/node-exporter:v1.9.1, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a, maintainer=The Prometheus Authors ) 2026-02-23T13:03:03.601 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 bash[78560]: 61d859e8cf06e70e690be6f76b220a10a10f8e13ecc5b485fb6819880faf5158 2026-02-23T13:03:03.601 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 podman[78560]: 2026-02-23 13:03:03.322220019 +0000 UTC m=+0.624932941 image pull 255ec253085fb105696533b31864a5e3b64f1f1e2147b5ec368100cbf3ec9b80 quay.io/prometheus/node-exporter:v1.9.1 2026-02-23T13:03:03.602 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 systemd[1]: Started Ceph node-exporter.a for c3b3ca7d-10b7-11f1-8efe-d404e6e7d460. 2026-02-23T13:03:03.602 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.369Z level=INFO source=node_exporter.go:216 msg="Starting node_exporter" version="(version=1.9.1, branch=HEAD, revision=f2ec547b49af53815038a50265aa2adcd1275959)" 2026-02-23T13:03:03.602 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.369Z level=INFO source=node_exporter.go:217 msg="Build context" build_context="(go=go1.23.7, platform=linux/amd64, user=root@7023beaa563a, date=20250401-15:19:01, tags=unknown)" 2026-02-23T13:03:03.602 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.370Z level=INFO source=diskstats_common.go:110 msg="Parsed flag --collector.diskstats.device-exclude" collector=diskstats flag=^(z?ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2026-02-23T13:03:03.602 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.370Z level=ERROR source=diskstats_linux.go:264 msg="Failed to open directory, disabling udev device properties" collector=diskstats path=/run/udev/data 2026-02-23T13:03:03.602 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.370Z level=INFO source=filesystem_common.go:265 msg="Parsed flag --collector.filesystem.mount-points-exclude" collector=filesystem flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2026-02-23T13:03:03.602 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.370Z level=INFO source=filesystem_common.go:294 msg="Parsed flag --collector.filesystem.fs-types-exclude" collector=filesystem flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2026-02-23T13:03:03.602 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.370Z level=INFO source=node_exporter.go:135 msg="Enabled collectors" 2026-02-23T13:03:03.602 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=arp 2026-02-23T13:03:03.602 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=bcache 2026-02-23T13:03:03.602 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=bonding 2026-02-23T13:03:03.603 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=btrfs 2026-02-23T13:03:03.603 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=conntrack 2026-02-23T13:03:03.603 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=cpu 2026-02-23T13:03:03.603 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=cpufreq 2026-02-23T13:03:03.603 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=diskstats 2026-02-23T13:03:03.603 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=dmi 2026-02-23T13:03:03.603 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=edac 2026-02-23T13:03:03.603 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=entropy 2026-02-23T13:03:03.603 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=fibrechannel 2026-02-23T13:03:03.603 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=filefd 2026-02-23T13:03:03.603 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=filesystem 2026-02-23T13:03:03.603 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=hwmon 2026-02-23T13:03:03.604 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=infiniband 2026-02-23T13:03:03.604 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=ipvs 2026-02-23T13:03:03.604 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=loadavg 2026-02-23T13:03:03.604 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=mdadm 2026-02-23T13:03:03.604 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=meminfo 2026-02-23T13:03:03.604 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=netclass 2026-02-23T13:03:03.604 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=netdev 2026-02-23T13:03:03.604 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=netstat 2026-02-23T13:03:03.604 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=nfs 2026-02-23T13:03:03.604 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=nfsd 2026-02-23T13:03:03.605 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=nvme 2026-02-23T13:03:03.605 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=os 2026-02-23T13:03:03.605 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=powersupplyclass 2026-02-23T13:03:03.605 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=pressure 2026-02-23T13:03:03.605 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=rapl 2026-02-23T13:03:03.605 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=schedstat 2026-02-23T13:03:03.605 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=selinux 2026-02-23T13:03:03.605 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=sockstat 2026-02-23T13:03:03.605 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=softnet 2026-02-23T13:03:03.605 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=stat 2026-02-23T13:03:03.605 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=tapestats 2026-02-23T13:03:03.605 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=textfile 2026-02-23T13:03:03.606 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=thermal_zone 2026-02-23T13:03:03.606 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=time 2026-02-23T13:03:03.606 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=udp_queues 2026-02-23T13:03:03.606 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=uname 2026-02-23T13:03:03.606 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=vmstat 2026-02-23T13:03:03.606 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=watchdog 2026-02-23T13:03:03.606 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=xfs 2026-02-23T13:03:03.606 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=node_exporter.go:141 msg=zfs 2026-02-23T13:03:03.606 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=tls_config.go:347 msg="Listening on" address=[::]:9100 2026-02-23T13:03:03.606 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a[78873]: time=2026-02-23T13:03:03.371Z level=INFO source=tls_config.go:350 msg="TLS is disabled." http2=false address=[::]:9100 2026-02-23T13:03:03.714 INFO:teuthology.orchestra.run.trial046.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2026-02-23T13:03:03.714 INFO:teuthology.orchestra.run.trial046.stdout:mgr 1/1 2s ago 50s trial046=x;count:1 2026-02-23T13:03:03.714 INFO:teuthology.orchestra.run.trial046.stdout:mon 1/1 2s ago 51s trial046:10.20.193.46=a;count:1 2026-02-23T13:03:03.714 INFO:teuthology.orchestra.run.trial046.stdout:node-exporter ?:9100 0/2 - 9s trial046=a;trial131=b;count:2 2026-02-23T13:03:03.714 INFO:teuthology.orchestra.run.trial046.stdout:osd.default 4 2s ago 21s trial131 2026-02-23T13:03:03.714 INFO:teuthology.orchestra.run.trial046.stdout:prometheus ?:9095 1/1 2s ago 10s trial131=a;count:1 2026-02-23T13:03:03.751 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- bash -c 'ceph orch host ls' 2026-02-23T13:03:03.868 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:03.891 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-mon[38575]: Updating trial046:/var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/config/ceph.conf 2026-02-23T13:03:03.892 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-mon[38575]: Updating trial131:/var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/config/ceph.conf 2026-02-23T13:03:03.892 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-mon[38575]: Updating trial046:/etc/ceph/ceph.client.admin.keyring 2026-02-23T13:03:03.892 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-mon[38575]: Updating trial131:/etc/ceph/ceph.client.admin.keyring 2026-02-23T13:03:03.892 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-mon[38575]: from='client.14301 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:03:03.892 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-mon[38575]: Updating trial046:/var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-23T13:03:03.892 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-mon[38575]: Updating trial131:/var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-23T13:03:03.892 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-mon[38575]: Deploying daemon node-exporter.a on trial046 2026-02-23T13:03:03.892 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-mon[38575]: pgmap v4: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-23T13:03:03.892 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-mon[38575]: mgrmap e18: x(active, since 2s) 2026-02-23T13:03:03.892 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:03.893 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:03.893 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:03 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:03.975 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:03.974+0000 7f5958114640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:03.975 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:03.974+0000 7f5958114640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:04.092 INFO:teuthology.orchestra.run.trial046.stdout:HOST ADDR LABELS STATUS 2026-02-23T13:03:04.092 INFO:teuthology.orchestra.run.trial046.stdout:trial046 10.20.193.46 2026-02-23T13:03:04.092 INFO:teuthology.orchestra.run.trial046.stdout:trial131 10.20.193.131 2026-02-23T13:03:04.092 INFO:teuthology.orchestra.run.trial046.stdout:2 hosts in cluster 2026-02-23T13:03:04.129 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- bash -c 'ceph orch device ls' 2026-02-23T13:03:04.243 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:04.244 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 bash[64595]: Copying blob sha256:1617e25568b2231fdd0d5caff63b06f6f7738d8d961f031c80e47d35aaec9733 2026-02-23T13:03:04.343 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:04.342+0000 7fb143937640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:04.343 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:04.342+0000 7fb143937640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:04.455 INFO:teuthology.orchestra.run.trial046.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2026-02-23T13:03:04.455 INFO:teuthology.orchestra.run.trial046.stdout:trial046 /dev/nvme0n1 ssd MTFDKCC1T9TGP-1BK1JABYY_112510AB5151 1788G No 13s ago Has a FileSystem, LVM detected 2026-02-23T13:03:04.455 INFO:teuthology.orchestra.run.trial046.stdout:trial046 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_112510AB50FD 1788G No 13s ago Has a FileSystem, LVM detected 2026-02-23T13:03:04.455 INFO:teuthology.orchestra.run.trial046.stdout:trial131 /dev/nvme1n1 ssd MTFDKCC1T9TGP-1BK1JABYY_112510AB50E8 1788G No 9s ago Has a FileSystem, LVM detected 2026-02-23T13:03:04.455 INFO:teuthology.orchestra.run.trial046.stdout:trial131 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_112510AB51FA 1788G No 9s ago Has a FileSystem, LVM detected 2026-02-23T13:03:04.492 INFO:teuthology.run_tasks:Running task thrashosds... 2026-02-23T13:03:04.512 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_down': 0, 'chance_inject_pause_short': 0, 'chance_pgnum_grow': 2, 'chance_pgpnum_fix': 1, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'dump_ops_enable': False, 'min_in': 2, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400, 'optrack_toggle_delay': 2.0, 'random_eio': 0.0} 2026-02-23T13:03:04.512 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'crimson_allow_pg_split': False, 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'seastore cachepin size pershard': '64M', 'seastore max concurrent transactions': 8}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Degraded data redundancy', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', 'PG_BACKFILL_FULL', 'Low space hindering backfill .*? backfill_toofull', 'OSD_ROOT_DOWN', 'pgs degraded', 'pgs undersized', 'is active.*backfill_toofull.*'], 'sha1': 'e371433fcd1390a0b82cfb18effc422c1f5d8c1d'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'debug', 'sha1': 'e371433fcd1390a0b82cfb18effc422c1f5d8c1d'}}, 'thrashosds': {'min_in': 4}, 'workunit': {'branch': 'wip-shraddhaag-enable-cephadm-tests', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': 'a78040ddef3ba5a489697ca2fe95df59a7d8bd08'}} 2026-02-23T13:03:04.512 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_down': 0, 'chance_inject_pause_short': 0, 'chance_pgnum_grow': 2, 'chance_pgpnum_fix': 1, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'dump_ops_enable': False, 'min_in': 4, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400, 'optrack_toggle_delay': 2.0, 'random_eio': 0.0} 2026-02-23T13:03:04.512 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2026-02-23T13:03:04.560 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 bash[64595]: Copying config sha256:255ec253085fb105696533b31864a5e3b64f1f1e2147b5ec368100cbf3ec9b80 2026-02-23T13:03:04.560 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 bash[64595]: Writing manifest to image destination 2026-02-23T13:03:04.560 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 podman[64595]: 2026-02-23 13:03:04.418279959 +0000 UTC m=+0.500952464 container create 96a9e80b9e44d4b784c18884dabf845de6bdb98dac35803921649e2cb830801a (image=quay.io/prometheus/node-exporter:v1.9.1, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b, maintainer=The Prometheus Authors ) 2026-02-23T13:03:04.560 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 podman[64595]: 2026-02-23 13:03:04.412913389 +0000 UTC m=+0.495585904 image pull 255ec253085fb105696533b31864a5e3b64f1f1e2147b5ec368100cbf3ec9b80 quay.io/prometheus/node-exporter:v1.9.1 2026-02-23T13:03:04.560 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 podman[64595]: 2026-02-23 13:03:04.439636371 +0000 UTC m=+0.522308886 container init 96a9e80b9e44d4b784c18884dabf845de6bdb98dac35803921649e2cb830801a (image=quay.io/prometheus/node-exporter:v1.9.1, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b, maintainer=The Prometheus Authors ) 2026-02-23T13:03:04.560 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 podman[64595]: 2026-02-23 13:03:04.441631544 +0000 UTC m=+0.524304059 container start 96a9e80b9e44d4b784c18884dabf845de6bdb98dac35803921649e2cb830801a (image=quay.io/prometheus/node-exporter:v1.9.1, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b, maintainer=The Prometheus Authors ) 2026-02-23T13:03:04.561 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 bash[64595]: 96a9e80b9e44d4b784c18884dabf845de6bdb98dac35803921649e2cb830801a 2026-02-23T13:03:04.561 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 systemd[1]: Started Ceph node-exporter.b for c3b3ca7d-10b7-11f1-8efe-d404e6e7d460. 2026-02-23T13:03:04.561 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.444Z level=INFO source=node_exporter.go:216 msg="Starting node_exporter" version="(version=1.9.1, branch=HEAD, revision=f2ec547b49af53815038a50265aa2adcd1275959)" 2026-02-23T13:03:04.561 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.444Z level=INFO source=node_exporter.go:217 msg="Build context" build_context="(go=go1.23.7, platform=linux/amd64, user=root@7023beaa563a, date=20250401-15:19:01, tags=unknown)" 2026-02-23T13:03:04.561 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.445Z level=INFO source=filesystem_common.go:265 msg="Parsed flag --collector.filesystem.mount-points-exclude" collector=filesystem flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2026-02-23T13:03:04.561 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.445Z level=INFO source=filesystem_common.go:294 msg="Parsed flag --collector.filesystem.fs-types-exclude" collector=filesystem flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2026-02-23T13:03:04.561 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.445Z level=INFO source=diskstats_common.go:110 msg="Parsed flag --collector.diskstats.device-exclude" collector=diskstats flag=^(z?ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2026-02-23T13:03:04.561 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.445Z level=ERROR source=diskstats_linux.go:264 msg="Failed to open directory, disabling udev device properties" collector=diskstats path=/run/udev/data 2026-02-23T13:03:04.561 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.445Z level=INFO source=node_exporter.go:135 msg="Enabled collectors" 2026-02-23T13:03:04.561 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.445Z level=INFO source=node_exporter.go:141 msg=arp 2026-02-23T13:03:04.561 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.445Z level=INFO source=node_exporter.go:141 msg=bcache 2026-02-23T13:03:04.561 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.445Z level=INFO source=node_exporter.go:141 msg=bonding 2026-02-23T13:03:04.561 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.445Z level=INFO source=node_exporter.go:141 msg=btrfs 2026-02-23T13:03:04.561 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.445Z level=INFO source=node_exporter.go:141 msg=conntrack 2026-02-23T13:03:04.561 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.445Z level=INFO source=node_exporter.go:141 msg=cpu 2026-02-23T13:03:04.561 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.445Z level=INFO source=node_exporter.go:141 msg=cpufreq 2026-02-23T13:03:04.561 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.445Z level=INFO source=node_exporter.go:141 msg=diskstats 2026-02-23T13:03:04.561 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.445Z level=INFO source=node_exporter.go:141 msg=dmi 2026-02-23T13:03:04.561 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.445Z level=INFO source=node_exporter.go:141 msg=edac 2026-02-23T13:03:04.561 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.445Z level=INFO source=node_exporter.go:141 msg=entropy 2026-02-23T13:03:04.561 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.445Z level=INFO source=node_exporter.go:141 msg=fibrechannel 2026-02-23T13:03:04.561 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.445Z level=INFO source=node_exporter.go:141 msg=filefd 2026-02-23T13:03:04.561 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.445Z level=INFO source=node_exporter.go:141 msg=filesystem 2026-02-23T13:03:04.561 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.445Z level=INFO source=node_exporter.go:141 msg=hwmon 2026-02-23T13:03:04.561 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.445Z level=INFO source=node_exporter.go:141 msg=infiniband 2026-02-23T13:03:04.561 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.445Z level=INFO source=node_exporter.go:141 msg=ipvs 2026-02-23T13:03:04.561 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.445Z level=INFO source=node_exporter.go:141 msg=loadavg 2026-02-23T13:03:04.561 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.445Z level=INFO source=node_exporter.go:141 msg=mdadm 2026-02-23T13:03:04.561 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.445Z level=INFO source=node_exporter.go:141 msg=meminfo 2026-02-23T13:03:04.561 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.445Z level=INFO source=node_exporter.go:141 msg=netclass 2026-02-23T13:03:04.561 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.445Z level=INFO source=node_exporter.go:141 msg=netdev 2026-02-23T13:03:04.561 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.445Z level=INFO source=node_exporter.go:141 msg=netstat 2026-02-23T13:03:04.561 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.445Z level=INFO source=node_exporter.go:141 msg=nfs 2026-02-23T13:03:04.562 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.445Z level=INFO source=node_exporter.go:141 msg=nfsd 2026-02-23T13:03:04.562 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.445Z level=INFO source=node_exporter.go:141 msg=nvme 2026-02-23T13:03:04.562 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.446Z level=INFO source=node_exporter.go:141 msg=os 2026-02-23T13:03:04.562 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.446Z level=INFO source=node_exporter.go:141 msg=powersupplyclass 2026-02-23T13:03:04.562 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.446Z level=INFO source=node_exporter.go:141 msg=pressure 2026-02-23T13:03:04.562 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.446Z level=INFO source=node_exporter.go:141 msg=rapl 2026-02-23T13:03:04.562 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.446Z level=INFO source=node_exporter.go:141 msg=schedstat 2026-02-23T13:03:04.562 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.446Z level=INFO source=node_exporter.go:141 msg=selinux 2026-02-23T13:03:04.562 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.446Z level=INFO source=node_exporter.go:141 msg=sockstat 2026-02-23T13:03:04.562 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.446Z level=INFO source=node_exporter.go:141 msg=softnet 2026-02-23T13:03:04.562 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.446Z level=INFO source=node_exporter.go:141 msg=stat 2026-02-23T13:03:04.562 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.446Z level=INFO source=node_exporter.go:141 msg=tapestats 2026-02-23T13:03:04.562 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.446Z level=INFO source=node_exporter.go:141 msg=textfile 2026-02-23T13:03:04.562 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.446Z level=INFO source=node_exporter.go:141 msg=thermal_zone 2026-02-23T13:03:04.562 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.446Z level=INFO source=node_exporter.go:141 msg=time 2026-02-23T13:03:04.562 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.446Z level=INFO source=node_exporter.go:141 msg=udp_queues 2026-02-23T13:03:04.562 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.446Z level=INFO source=node_exporter.go:141 msg=uname 2026-02-23T13:03:04.562 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.446Z level=INFO source=node_exporter.go:141 msg=vmstat 2026-02-23T13:03:04.562 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.446Z level=INFO source=node_exporter.go:141 msg=watchdog 2026-02-23T13:03:04.562 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.446Z level=INFO source=node_exporter.go:141 msg=xfs 2026-02-23T13:03:04.562 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.446Z level=INFO source=node_exporter.go:141 msg=zfs 2026-02-23T13:03:04.562 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.446Z level=INFO source=tls_config.go:347 msg="Listening on" address=[::]:9100 2026-02-23T13:03:04.562 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:03:04 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b[64644]: time=2026-02-23T13:03:04.446Z level=INFO source=tls_config.go:350 msg="TLS is disabled." http2=false address=[::]:9100 2026-02-23T13:03:04.628 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:04.741 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:04.739+0000 7f5990a10640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:04.742 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:04 trial046 ceph-mon[38575]: from='client.14307 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-02-23T13:03:04.742 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:04 trial046 ceph-mon[38575]: from='client.14309 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-02-23T13:03:04.742 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:04 trial046 ceph-mon[38575]: Deploying daemon node-exporter.b on trial131 2026-02-23T13:03:04.742 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:04 trial046 ceph-mon[38575]: from='client.14311 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-23T13:03:04.742 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:04 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:04.742 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:04 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:04.742 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:04 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:04.743 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:04 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:04.743 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:04 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:04.743 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:04 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-23T13:03:04.743 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:04.739+0000 7f5990a10640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:04.900 INFO:tasks.thrashosds:Beginning thrashosds... 2026-02-23T13:03:04.900 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-23T13:03:04.900 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:03:05.016 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:05.128 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:05.125+0000 7f023d28f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:05.128 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:05.126+0000 7f023d28f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:05.235 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:03:05.236 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:03:05.257 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:03:05 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: [23/Feb/2026:13:03:05] ENGINE Bus STOPPING 2026-02-23T13:03:05.257 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:03:05 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: [23/Feb/2026:13:03:05] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2026-02-23T13:03:05.258 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:03:05 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: [23/Feb/2026:13:03:05] ENGINE Bus STOPPED 2026-02-23T13:03:05.258 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:03:05 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: [23/Feb/2026:13:03:05] ENGINE Bus STARTING 2026-02-23T13:03:05.271 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2026-02-23T13:03:04.590969+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":2936012800,"kb_used":110484,"kb_used_data":2628,"kb_used_omap":44,"kb_used_meta":107731,"kb_avail":2935902316,"statfs":{"total":3006477107200,"available":3006363971584,"internally_reserved":0,"allocated":2691072,"data_stored":2086861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45529,"internal_metadata":110317095},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.999109"},"pg_stats":[{"pgid":"1.0","version":"20'92","reported_seq":155,"reported_epoch":26,"state":"active+clean","last_fresh":"2026-02-23T13:02:55.158967+0000","last_change":"2026-02-23T13:02:55.158696+0000","last_active":"2026-02-23T13:02:55.158967+0000","last_peered":"2026-02-23T13:02:55.158967+0000","last_clean":"2026-02-23T13:02:55.158967+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:02:55.158967+0000","last_undegraded":"2026-02-23T13:02:55.158967+0000","last_fullsized":"2026-02-23T13:02:55.158967+0000","mapping_epoch":25,"log_start":"20'90","ondisk_log_start":"20'90","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:02:44.100679+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":90,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:07.625581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247811,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":666089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6165,"internal_metadata":27584491},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444038,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":10,"kb_used_meta":26933,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":670380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10725,"internal_metadata":27579931},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27188,"kb_used_data":224,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":733976012,"statfs":{"total":751619276800,"available":751591436288,"internally_reserved":0,"allocated":229376,"data_stored":80012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13343,"internal_metadata":27577313},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":14,"kb_used_meta":26929,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":670380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15296,"internal_metadata":27575360},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:03:05.272 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:03:05.389 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:05.488 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:05.486+0000 7f78bdf51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:05.488 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:05.486+0000 7f78bdf51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:05.532 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 systemd[1]: Stopping Ceph prometheus.a for c3b3ca7d-10b7-11f1-8efe-d404e6e7d460... 2026-02-23T13:03:05.532 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[63213]: time=2026-02-23T13:03:05.464Z level=WARN source=main.go:1076 msg="Received an OS signal, exiting gracefully..." signal=terminated 2026-02-23T13:03:05.532 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[63213]: time=2026-02-23T13:03:05.464Z level=INFO source=main.go:1101 msg="Stopping scrape discovery manager..." 2026-02-23T13:03:05.532 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[63213]: time=2026-02-23T13:03:05.464Z level=INFO source=main.go:1115 msg="Stopping notify discovery manager..." 2026-02-23T13:03:05.533 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[63213]: time=2026-02-23T13:03:05.464Z level=INFO source=manager.go:190 msg="Stopping rule manager..." component="rule manager" 2026-02-23T13:03:05.533 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[63213]: time=2026-02-23T13:03:05.464Z level=INFO source=main.go:1097 msg="Scrape discovery manager stopped" 2026-02-23T13:03:05.533 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[63213]: time=2026-02-23T13:03:05.465Z level=INFO source=manager.go:206 msg="Rule manager stopped" component="rule manager" 2026-02-23T13:03:05.533 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[63213]: time=2026-02-23T13:03:05.465Z level=INFO source=main.go:1111 msg="Notify discovery manager stopped" 2026-02-23T13:03:05.533 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[63213]: time=2026-02-23T13:03:05.465Z level=INFO source=main.go:1152 msg="Stopping scrape manager..." 2026-02-23T13:03:05.533 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[63213]: time=2026-02-23T13:03:05.465Z level=INFO source=main.go:1144 msg="Scrape manager stopped" 2026-02-23T13:03:05.533 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[63213]: time=2026-02-23T13:03:05.465Z level=INFO source=manager.go:543 msg="Stopping notification manager..." component=notifier 2026-02-23T13:03:05.533 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[63213]: time=2026-02-23T13:03:05.465Z level=INFO source=manager.go:285 msg="Draining any remaining notifications..." component=notifier 2026-02-23T13:03:05.533 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[63213]: time=2026-02-23T13:03:05.465Z level=INFO source=manager.go:291 msg="Remaining notifications drained" component=notifier 2026-02-23T13:03:05.533 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[63213]: time=2026-02-23T13:03:05.465Z level=INFO source=manager.go:218 msg="Notification manager stopped" component=notifier 2026-02-23T13:03:05.533 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[63213]: time=2026-02-23T13:03:05.465Z level=INFO source=main.go:1422 msg="Notifier manager stopped" 2026-02-23T13:03:05.533 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[63213]: time=2026-02-23T13:03:05.465Z level=INFO source=main.go:1436 msg="See you next time!" 2026-02-23T13:03:05.534 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 podman[65294]: 2026-02-23 13:03:05.47475908 +0000 UTC m=+0.022323293 container died 9bbeb29bf0751128facb445ead50e86ad4cef81200129d982a1dfdbdb9fe658c (image=quay.io/prometheus/prometheus:v3.6.0, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a, maintainer=The Prometheus Authors , org.opencontainers.image.source=https://github.com/prometheus/prometheus) 2026-02-23T13:03:05.534 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 podman[65294]: 2026-02-23 13:03:05.482571495 +0000 UTC m=+0.030135698 container remove 9bbeb29bf0751128facb445ead50e86ad4cef81200129d982a1dfdbdb9fe658c (image=quay.io/prometheus/prometheus:v3.6.0, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a, maintainer=The Prometheus Authors , org.opencontainers.image.source=https://github.com/prometheus/prometheus) 2026-02-23T13:03:05.534 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 bash[65294]: ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a 2026-02-23T13:03:05.539 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:03:05 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: [23/Feb/2026:13:03:05] ENGINE Serving on http://:::9283 2026-02-23T13:03:05.539 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:03:05 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: [23/Feb/2026:13:03:05] ENGINE Bus STARTED 2026-02-23T13:03:05.600 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:03:05.600 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:03:05.638 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2026-02-23T13:03:04.590969+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":2936012800,"kb_used":110484,"kb_used_data":2628,"kb_used_omap":44,"kb_used_meta":107731,"kb_avail":2935902316,"statfs":{"total":3006477107200,"available":3006363971584,"internally_reserved":0,"allocated":2691072,"data_stored":2086861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45529,"internal_metadata":110317095},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.999109"},"pg_stats":[{"pgid":"1.0","version":"20'92","reported_seq":155,"reported_epoch":26,"state":"active+clean","last_fresh":"2026-02-23T13:02:55.158967+0000","last_change":"2026-02-23T13:02:55.158696+0000","last_active":"2026-02-23T13:02:55.158967+0000","last_peered":"2026-02-23T13:02:55.158967+0000","last_clean":"2026-02-23T13:02:55.158967+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:02:55.158967+0000","last_undegraded":"2026-02-23T13:02:55.158967+0000","last_fullsized":"2026-02-23T13:02:55.158967+0000","mapping_epoch":25,"log_start":"20'90","ondisk_log_start":"20'90","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:02:44.100679+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":90,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:07.625581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247811,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":666089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6165,"internal_metadata":27584491},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444038,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":10,"kb_used_meta":26933,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":670380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10725,"internal_metadata":27579931},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27188,"kb_used_data":224,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":733976012,"statfs":{"total":751619276800,"available":751591436288,"internally_reserved":0,"allocated":229376,"data_stored":80012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13343,"internal_metadata":27577313},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":14,"kb_used_meta":26929,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":670380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15296,"internal_metadata":27575360},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:03:05.639 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-23T13:03:05.639 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd dump 2026-02-23T13:03:05.757 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:05.811 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 systemd[1]: ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@prometheus.a.service: Deactivated successfully. 2026-02-23T13:03:05.811 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 systemd[1]: Stopped Ceph prometheus.a for c3b3ca7d-10b7-11f1-8efe-d404e6e7d460. 2026-02-23T13:03:05.812 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 systemd[1]: Starting Ceph prometheus.a for c3b3ca7d-10b7-11f1-8efe-d404e6e7d460... 2026-02-23T13:03:05.812 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 podman[65420]: 2026-02-23 13:03:05.638735901 +0000 UTC m=+0.017470164 container create 9f37fc66bd1b86995911e3ab5489ef478d0c9f3fb65b754243836ef46d8bd3ce (image=quay.io/prometheus/prometheus:v3.6.0, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a, org.opencontainers.image.source=https://github.com/prometheus/prometheus, maintainer=The Prometheus Authors ) 2026-02-23T13:03:05.812 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 podman[65420]: 2026-02-23 13:03:05.669986433 +0000 UTC m=+0.048720706 container init 9f37fc66bd1b86995911e3ab5489ef478d0c9f3fb65b754243836ef46d8bd3ce (image=quay.io/prometheus/prometheus:v3.6.0, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a, org.opencontainers.image.source=https://github.com/prometheus/prometheus, maintainer=The Prometheus Authors ) 2026-02-23T13:03:05.812 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 podman[65420]: 2026-02-23 13:03:05.672532026 +0000 UTC m=+0.051266279 container start 9f37fc66bd1b86995911e3ab5489ef478d0c9f3fb65b754243836ef46d8bd3ce (image=quay.io/prometheus/prometheus:v3.6.0, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a, maintainer=The Prometheus Authors , org.opencontainers.image.source=https://github.com/prometheus/prometheus) 2026-02-23T13:03:05.812 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 bash[65420]: 9f37fc66bd1b86995911e3ab5489ef478d0c9f3fb65b754243836ef46d8bd3ce 2026-02-23T13:03:05.812 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 podman[65420]: 2026-02-23 13:03:05.631223607 +0000 UTC m=+0.009957880 image pull 4fcecf061b747d0b5dc55bc7efdba26f87768d058d403b5bcc3f0904cf49f973 quay.io/prometheus/prometheus:v3.6.0 2026-02-23T13:03:05.812 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 systemd[1]: Started Ceph prometheus.a for c3b3ca7d-10b7-11f1-8efe-d404e6e7d460. 2026-02-23T13:03:05.812 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:03:05.698Z level=INFO source=main.go:1545 msg="updated GOGC" old=100 new=75 2026-02-23T13:03:05.812 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:03:05.699Z level=INFO source=main.go:677 msg="Leaving GOMAXPROCS=24: CPU quota undefined" component=automaxprocs 2026-02-23T13:03:05.812 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:03:05.699Z level=INFO source=memlimit.go:198 msg="GOMEMLIMIT is updated" component=automemlimit package=github.com/KimMachineGun/automemlimit/memlimit GOMEMLIMIT=120212538163 previous=9223372036854775807 2026-02-23T13:03:05.813 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:03:05.699Z level=INFO source=main.go:770 msg="Starting Prometheus Server" mode=server version="(version=3.6.0, branch=HEAD, revision=491734606591ef8c188f5489c70380805bc868c0)" 2026-02-23T13:03:05.813 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:03:05.699Z level=INFO source=main.go:775 msg="operational information" build_context="(go=go1.24.7, platform=linux/amd64, user=root@bfdf1aa26e4d, date=20250921-19:51:16, tags=netgo,builtinassets)" host_details="(Linux 5.14.0-681.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026 x86_64 trial131 (none))" fd_limits="(soft=1048576, hard=1048576)" vm_limits="(soft=unlimited, hard=unlimited)" 2026-02-23T13:03:05.813 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:03:05.700Z level=INFO source=web.go:659 msg="Start listening for connections" component=web address=:9095 2026-02-23T13:03:05.813 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:03:05.701Z level=INFO source=main.go:1289 msg="Starting TSDB ..." 2026-02-23T13:03:05.813 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:03:05.701Z level=INFO source=tls_config.go:347 msg="Listening on" component=web address=[::]:9095 2026-02-23T13:03:05.813 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:03:05.701Z level=INFO source=tls_config.go:350 msg="TLS is disabled." component=web http2=false address=[::]:9095 2026-02-23T13:03:05.813 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:03:05.703Z level=INFO source=head.go:667 msg="Replaying on-disk memory mappable chunks if any" component=tsdb 2026-02-23T13:03:05.813 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:03:05.703Z level=INFO source=head.go:754 msg="On-disk memory mappable chunks replay completed" component=tsdb duration=561ns 2026-02-23T13:03:05.813 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:03:05.703Z level=INFO source=head.go:762 msg="Replaying WAL, this may take a while" component=tsdb 2026-02-23T13:03:05.813 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:03:05.703Z level=INFO source=head.go:835 msg="WAL segment loaded" component=tsdb segment=0 maxSegment=1 duration=196.738µs 2026-02-23T13:03:05.813 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:03:05.703Z level=INFO source=head.go:835 msg="WAL segment loaded" component=tsdb segment=1 maxSegment=1 duration=124.954µs 2026-02-23T13:03:05.813 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:03:05.703Z level=INFO source=head.go:872 msg="WAL replay completed" component=tsdb checkpoint_replay_duration=14.918µs wal_replay_duration=338.023µs wbl_replay_duration=130ns chunk_snapshot_load_duration=0s mmap_chunk_replay_duration=561ns total_replay_duration=378.278µs 2026-02-23T13:03:05.814 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:03:05.704Z level=INFO source=main.go:1310 msg="filesystem information" fs_type=XFS_SUPER_MAGIC 2026-02-23T13:03:05.814 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:03:05.704Z level=INFO source=main.go:1313 msg="TSDB started" 2026-02-23T13:03:05.814 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:03:05.704Z level=INFO source=main.go:1498 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2026-02-23T13:03:05.814 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:03:05.714Z level=INFO source=main.go:1538 msg="Completed loading of configuration file" db_storage=572ns remote_storage=771ns web_handler=221ns query_engine=320ns scrape=350.826µs scrape_sd=47.719µs notify=631ns notify_sd=621ns rules=9.091849ms tracing=2.885µs filename=/etc/prometheus/prometheus.yml totalDuration=9.652387ms 2026-02-23T13:03:05.814 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:03:05.714Z level=INFO source=main.go:1274 msg="Server is ready to receive web requests." 2026-02-23T13:03:05.814 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:03:05.714Z level=INFO source=manager.go:176 msg="Starting rule manager..." component="rule manager" 2026-02-23T13:03:05.855 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:05.853+0000 7f9a7f8f2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:05.856 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:03:05 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: [23/Feb/2026:13:03:05] ENGINE Bus STOPPING 2026-02-23T13:03:05.856 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:05.853+0000 7f9a7f8f2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:05.856 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:05 trial046 ceph-mon[38575]: from='client.14313 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-23T13:03:05.857 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:05 trial046 ceph-mon[38575]: from='client.14315 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-23T13:03:05.857 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:05 trial046 ceph-mon[38575]: pgmap v5: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-23T13:03:05.857 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:05 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4141354672' entity='client.admin' 2026-02-23T13:03:05.857 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:05 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:05.857 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:05 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:05.857 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:05 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:05.857 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:05 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:05.857 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:05 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:03:05.857 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:05 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-23T13:03:05.857 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:05 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:05.857 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:05 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-23T13:03:05.858 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:05 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "orch get-security-config"} : dispatch 2026-02-23T13:03:05.858 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:05 trial046 ceph-mon[38575]: mgrmap e19: x(active, since 4s) 2026-02-23T13:03:05.967 INFO:teuthology.orchestra.run.trial046.stdout:epoch 27 2026-02-23T13:03:05.967 INFO:teuthology.orchestra.run.trial046.stdout:fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 2026-02-23T13:03:05.968 INFO:teuthology.orchestra.run.trial046.stdout:created 2026-02-23T13:01:43.505063+0000 2026-02-23T13:03:05.968 INFO:teuthology.orchestra.run.trial046.stdout:modified 2026-02-23T13:03:00.585612+0000 2026-02-23T13:03:05.968 INFO:teuthology.orchestra.run.trial046.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2026-02-23T13:03:05.968 INFO:teuthology.orchestra.run.trial046.stdout:crush_version 10 2026-02-23T13:03:05.968 INFO:teuthology.orchestra.run.trial046.stdout:full_ratio 0.95 2026-02-23T13:03:05.968 INFO:teuthology.orchestra.run.trial046.stdout:backfillfull_ratio 0.9 2026-02-23T13:03:05.968 INFO:teuthology.orchestra.run.trial046.stdout:nearfull_ratio 0.85 2026-02-23T13:03:05.968 INFO:teuthology.orchestra.run.trial046.stdout:require_min_compat_client luminous 2026-02-23T13:03:05.968 INFO:teuthology.orchestra.run.trial046.stdout:min_compat_client jewel 2026-02-23T13:03:05.968 INFO:teuthology.orchestra.run.trial046.stdout:require_osd_release tentacle 2026-02-23T13:03:05.969 INFO:teuthology.orchestra.run.trial046.stdout:stretch_mode_enabled false 2026-02-23T13:03:05.969 INFO:teuthology.orchestra.run.trial046.stdout:allow_crimson=true 2026-02-23T13:03:05.969 INFO:teuthology.orchestra.run.trial046.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 20 flags hashpspool,crimson stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 4.00 2026-02-23T13:03:05.969 INFO:teuthology.orchestra.run.trial046.stdout:max_osd 4 2026-02-23T13:03:05.969 INFO:teuthology.orchestra.run.trial046.stdout:osd.0 up in weight 1 up_from 9 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:10.20.193.46:6802/3215761192,v1:10.20.193.46:6803/3215761192] [v2:10.20.193.46:6804/3215761192,v1:10.20.193.46:6805/3215761192] exists,up 80ca734b-d032-47a7-be2b-bcab1f5b06bf 2026-02-23T13:03:05.969 INFO:teuthology.orchestra.run.trial046.stdout:osd.1 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:10.20.193.46:6810/2402797949,v1:10.20.193.46:6811/2402797949] [v2:10.20.193.46:6812/2402797949,v1:10.20.193.46:6813/2402797949] exists,up da77bcad-edc4-46df-a2e0-63010b9b6274 2026-02-23T13:03:05.969 INFO:teuthology.orchestra.run.trial046.stdout:osd.2 up in weight 1 up_from 17 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:10.20.193.131:6800/1243371431,v1:10.20.193.131:6801/1243371431] [v2:10.20.193.131:6802/1243371431,v1:10.20.193.131:6803/1243371431] exists,up 5a84a299-c810-46ba-8968-8cd5bccf127b 2026-02-23T13:03:05.969 INFO:teuthology.orchestra.run.trial046.stdout:osd.3 up in weight 1 up_from 23 up_thru 25 down_at 0 last_clean_interval [0,0) [v2:10.20.193.131:6808/2723309313,v1:10.20.193.131:6809/2723309313] [v2:10.20.193.131:6810/2723309313,v1:10.20.193.131:6811/2723309313] exists,up e53b2547-061e-4bfd-aca1-a53b0e860d05 2026-02-23T13:03:05.969 INFO:teuthology.orchestra.run.trial046.stdout:blocklist 10.20.193.46:6801/2807562704 expires 2026-02-24T13:03:00.585589+0000 2026-02-23T13:03:05.969 INFO:teuthology.orchestra.run.trial046.stdout:blocklist 10.20.193.46:6800/2807562704 expires 2026-02-24T13:03:00.585589+0000 2026-02-23T13:03:05.969 INFO:teuthology.orchestra.run.trial046.stdout:blocklist 10.20.193.46:0/1237070006 expires 2026-02-24T13:03:00.585589+0000 2026-02-23T13:03:05.970 INFO:teuthology.orchestra.run.trial046.stdout:blocklist 10.20.193.46:0/62318855 expires 2026-02-24T13:01:53.536089+0000 2026-02-23T13:03:05.970 INFO:teuthology.orchestra.run.trial046.stdout:blocklist 10.20.193.46:6801/999693074 expires 2026-02-24T13:01:53.536089+0000 2026-02-23T13:03:05.970 INFO:teuthology.orchestra.run.trial046.stdout:blocklist 10.20.193.46:0/2765809326 expires 2026-02-24T13:03:00.585589+0000 2026-02-23T13:03:05.970 INFO:teuthology.orchestra.run.trial046.stdout:blocklist 10.20.193.46:6800/999693074 expires 2026-02-24T13:01:53.536089+0000 2026-02-23T13:03:05.970 INFO:teuthology.orchestra.run.trial046.stdout:blocklist 10.20.193.46:0/3264800521 expires 2026-02-24T13:03:00.585589+0000 2026-02-23T13:03:05.970 INFO:teuthology.orchestra.run.trial046.stdout:blocklist 10.20.193.46:0/4291592014 expires 2026-02-24T13:01:53.536089+0000 2026-02-23T13:03:05.970 INFO:teuthology.orchestra.run.trial046.stdout:blocklist 10.20.193.46:0/2607309055 expires 2026-02-24T13:02:03.355584+0000 2026-02-23T13:03:05.970 INFO:teuthology.orchestra.run.trial046.stdout:blocklist 10.20.193.46:0/460416185 expires 2026-02-24T13:01:53.536089+0000 2026-02-23T13:03:05.970 INFO:teuthology.orchestra.run.trial046.stdout:blocklist 10.20.193.46:6800/3808210501 expires 2026-02-24T13:02:03.355584+0000 2026-02-23T13:03:05.970 INFO:teuthology.orchestra.run.trial046.stdout:blocklist 10.20.193.46:6801/3808210501 expires 2026-02-24T13:02:03.355584+0000 2026-02-23T13:03:05.970 INFO:teuthology.orchestra.run.trial046.stdout:blocklist 10.20.193.46:0/3910278239 expires 2026-02-24T13:02:03.355584+0000 2026-02-23T13:03:05.970 INFO:teuthology.orchestra.run.trial046.stdout:blocklist 10.20.193.46:0/3352548256 expires 2026-02-24T13:02:03.355584+0000 2026-02-23T13:03:05.970 INFO:teuthology.orchestra.run.trial046.stdout:blocklist 10.20.193.46:0/1308119843 expires 2026-02-24T13:03:00.585589+0000 2026-02-23T13:03:06.005 INFO:tasks.cephadm.ceph_manager.ceph:['osd.0 up in weight 1 up_from 9 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:10.20.193.46:6802/3215761192,v1:10.20.193.46:6803/3215761192] [v2:10.20.193.46:6804/3215761192,v1:10.20.193.46:6805/3215761192] exists,up 80ca734b-d032-47a7-be2b-bcab1f5b06bf', 'osd.1 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:10.20.193.46:6810/2402797949,v1:10.20.193.46:6811/2402797949] [v2:10.20.193.46:6812/2402797949,v1:10.20.193.46:6813/2402797949] exists,up da77bcad-edc4-46df-a2e0-63010b9b6274', 'osd.2 up in weight 1 up_from 17 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:10.20.193.131:6800/1243371431,v1:10.20.193.131:6801/1243371431] [v2:10.20.193.131:6802/1243371431,v1:10.20.193.131:6803/1243371431] exists,up 5a84a299-c810-46ba-8968-8cd5bccf127b', 'osd.3 up in weight 1 up_from 23 up_thru 25 down_at 0 last_clean_interval [0,0) [v2:10.20.193.131:6808/2723309313,v1:10.20.193.131:6809/2723309313] [v2:10.20.193.131:6810/2723309313,v1:10.20.193.131:6811/2723309313] exists,up e53b2547-061e-4bfd-aca1-a53b0e860d05'] 2026-02-23T13:03:06.006 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph daemon mon.a config show 2026-02-23T13:03:06.122 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:06.226 INFO:teuthology.orchestra.run.trial046.stdout:{ 2026-02-23T13:03:06.227 INFO:teuthology.orchestra.run.trial046.stdout: "name": "mon.a", 2026-02-23T13:03:06.227 INFO:teuthology.orchestra.run.trial046.stdout: "cluster": "ceph", 2026-02-23T13:03:06.227 INFO:teuthology.orchestra.run.trial046.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2026-02-23T13:03:06.227 INFO:teuthology.orchestra.run.trial046.stdout: "admin_socket_mode": "", 2026-02-23T13:03:06.227 INFO:teuthology.orchestra.run.trial046.stdout: "auth_allow_insecure_global_id_reclaim": "false", 2026-02-23T13:03:06.227 INFO:teuthology.orchestra.run.trial046.stdout: "auth_client_required": "cephx, none", 2026-02-23T13:03:06.227 INFO:teuthology.orchestra.run.trial046.stdout: "auth_cluster_required": "cephx", 2026-02-23T13:03:06.227 INFO:teuthology.orchestra.run.trial046.stdout: "auth_debug": "true", 2026-02-23T13:03:06.227 INFO:teuthology.orchestra.run.trial046.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2026-02-23T13:03:06.227 INFO:teuthology.orchestra.run.trial046.stdout: "auth_mon_ticket_ttl": "660.000000", 2026-02-23T13:03:06.228 INFO:teuthology.orchestra.run.trial046.stdout: "auth_service_required": "cephx", 2026-02-23T13:03:06.228 INFO:teuthology.orchestra.run.trial046.stdout: "auth_service_ticket_ttl": "240.000000", 2026-02-23T13:03:06.228 INFO:teuthology.orchestra.run.trial046.stdout: "auth_supported": "", 2026-02-23T13:03:06.228 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_aio": "true", 2026-02-23T13:03:06.228 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_aio_max_queue_depth": "1024", 2026-02-23T13:03:06.228 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_aio_poll_ms": "250", 2026-02-23T13:03:06.228 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_aio_reap_max": "16", 2026-02-23T13:03:06.228 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_aio_submit_retry_initial_delay_us": "125", 2026-02-23T13:03:06.228 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_aio_submit_retry_max": "16", 2026-02-23T13:03:06.228 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_async_discard": "false", 2026-02-23T13:03:06.228 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_async_discard_max_pending": "1000000", 2026-02-23T13:03:06.229 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_async_discard_threads": "0", 2026-02-23T13:03:06.229 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_block_size": "4096", 2026-02-23T13:03:06.229 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_debug_aio": "false", 2026-02-23T13:03:06.229 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_debug_aio_log_age": "5.000000", 2026-02-23T13:03:06.229 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2026-02-23T13:03:06.229 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_debug_discard_sleep": "0", 2026-02-23T13:03:06.229 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_debug_inflight_ios": "false", 2026-02-23T13:03:06.229 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_discard_max_bytes": "10737418240", 2026-02-23T13:03:06.229 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_enable_discard": "false", 2026-02-23T13:03:06.229 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_flock_retry": "3", 2026-02-23T13:03:06.229 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_flock_retry_interval": "0.100000", 2026-02-23T13:03:06.229 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_inject_crash": "0", 2026-02-23T13:03:06.230 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_inject_crash_flush_delay": "2", 2026-02-23T13:03:06.230 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_ioring": "false", 2026-02-23T13:03:06.230 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_ioring_hipri": "false", 2026-02-23T13:03:06.230 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_ioring_sqthread_poll": "false", 2026-02-23T13:03:06.230 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_max_discard_length": "2147483648", 2026-02-23T13:03:06.230 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_nvme_unbind_from_kernel": "false", 2026-02-23T13:03:06.230 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_read_buffer_alignment": "4096", 2026-02-23T13:03:06.230 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_read_preallocated_huge_buffers": "", 2026-02-23T13:03:06.230 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2026-02-23T13:03:06.230 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_stalled_read_warn_threshold": "1", 2026-02-23T13:03:06.230 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_type": "", 2026-02-23T13:03:06.230 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_alloc_size": "1048576", 2026-02-23T13:03:06.230 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_allocator": "hybrid", 2026-02-23T13:03:06.231 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_buffered_io": "true", 2026-02-23T13:03:06.231 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_check_for_zeros": "false", 2026-02-23T13:03:06.231 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_check_volume_selector_often": "false", 2026-02-23T13:03:06.231 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_check_volume_selector_on_umount": "false", 2026-02-23T13:03:06.231 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_compact_log_sync": "false", 2026-02-23T13:03:06.231 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2026-02-23T13:03:06.231 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2026-02-23T13:03:06.231 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_log_compact_min_size": "16777216", 2026-02-23T13:03:06.231 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_log_replay_check_allocations": "true", 2026-02-23T13:03:06.231 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_max_log_runway": "4194304", 2026-02-23T13:03:06.231 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_max_prefetch": "1048576", 2026-02-23T13:03:06.231 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_min_flush_size": "524288", 2026-02-23T13:03:06.232 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_min_log_runway": "1048576", 2026-02-23T13:03:06.232 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_replay_recovery": "false", 2026-02-23T13:03:06.232 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_replay_recovery_disable_compact": "false", 2026-02-23T13:03:06.232 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_shared_alloc_size": "65536", 2026-02-23T13:03:06.232 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_sync_write": "false", 2026-02-23T13:03:06.232 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_wal_envelope_mode": "true", 2026-02-23T13:03:06.232 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2026-02-23T13:03:06.232 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2026-02-23T13:03:06.232 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2026-02-23T13:03:06.232 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_allocation_from_file": "true", 2026-02-23T13:03:06.232 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_allocator": "hybrid", 2026-02-23T13:03:06.232 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_allocator_lookup_policy": "auto", 2026-02-23T13:03:06.233 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_async_db_compaction": "true", 2026-02-23T13:03:06.233 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2026-02-23T13:03:06.233 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2026-02-23T13:03:06.233 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2026-02-23T13:03:06.233 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2026-02-23T13:03:06.233 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_bdev_label_multi": "true", 2026-02-23T13:03:06.233 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2026-02-23T13:03:06.233 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_bdev_label_require_all": "true", 2026-02-23T13:03:06.233 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2026-02-23T13:03:06.233 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_bitmapallocator_span_size": "1024", 2026-02-23T13:03:06.233 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_blobid_prealloc": "10240", 2026-02-23T13:03:06.233 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_block_create": "true", 2026-02-23T13:03:06.233 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_block_db_create": "false", 2026-02-23T13:03:06.234 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_block_db_path": "", 2026-02-23T13:03:06.234 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_block_db_size": "0", 2026-02-23T13:03:06.234 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_block_path": "", 2026-02-23T13:03:06.234 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_block_preallocate_file": "false", 2026-02-23T13:03:06.234 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_block_size": "107374182400", 2026-02-23T13:03:06.234 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_block_wal_create": "false", 2026-02-23T13:03:06.234 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_block_wal_path": "", 2026-02-23T13:03:06.234 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_block_wal_size": "100663296", 2026-02-23T13:03:06.234 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_bluefs": "true", 2026-02-23T13:03:06.234 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2026-02-23T13:03:06.234 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_bluefs_env_mirror": "false", 2026-02-23T13:03:06.234 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_bluefs_max_free": "10737418240", 2026-02-23T13:03:06.235 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_btree2_alloc_weight_factor": "2.000000", 2026-02-23T13:03:06.235 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2026-02-23T13:03:06.235 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2026-02-23T13:03:06.235 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2026-02-23T13:03:06.235 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2026-02-23T13:03:06.235 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2026-02-23T13:03:06.235 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_cache_autotune": "true", 2026-02-23T13:03:06.235 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_cache_autotune_interval": "5.000000", 2026-02-23T13:03:06.235 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2026-02-23T13:03:06.235 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_cache_kv_ratio": "0.450000", 2026-02-23T13:03:06.235 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_cache_meta_ratio": "0.450000", 2026-02-23T13:03:06.235 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_cache_size": "0", 2026-02-23T13:03:06.235 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_cache_size_hdd": "1073741824", 2026-02-23T13:03:06.236 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_cache_size_ssd": "3221225472", 2026-02-23T13:03:06.236 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_cache_trim_interval": "0.050000", 2026-02-23T13:03:06.236 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2026-02-23T13:03:06.236 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_cache_type": "2q", 2026-02-23T13:03:06.236 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2026-02-23T13:03:06.236 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_clone_cow": "true", 2026-02-23T13:03:06.236 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_compression_algorithm": "snappy", 2026-02-23T13:03:06.236 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_compression_max_blob_size": "0", 2026-02-23T13:03:06.236 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2026-02-23T13:03:06.236 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2026-02-23T13:03:06.236 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_compression_min_blob_size": "0", 2026-02-23T13:03:06.236 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2026-02-23T13:03:06.236 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2026-02-23T13:03:06.237 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_compression_mode": "none", 2026-02-23T13:03:06.237 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_compression_required_ratio": "0.875000", 2026-02-23T13:03:06.237 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_csum_type": "crc32c", 2026-02-23T13:03:06.237 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2026-02-23T13:03:06.237 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_enforce_settings": "default", 2026-02-23T13:03:06.237 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_extent_map_encode_check": "false", 2026-02-23T13:03:06.237 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_freelist": "false", 2026-02-23T13:03:06.237 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_fsck_abort": "false", 2026-02-23T13:03:06.237 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2026-02-23T13:03:06.237 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2026-02-23T13:03:06.237 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_inject_read_err": "false", 2026-02-23T13:03:06.237 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_legacy_omap": "false", 2026-02-23T13:03:06.237 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_no_reuse_blocks": "false", 2026-02-23T13:03:06.238 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_omit_block_device_write": "false", 2026-02-23T13:03:06.238 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_omit_kv_commit": "false", 2026-02-23T13:03:06.238 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_onode_segmentation_random": "false", 2026-02-23T13:03:06.238 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2026-02-23T13:03:06.238 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_prefragment_max": "1048576", 2026-02-23T13:03:06.238 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_random_read_err": "0.000000", 2026-02-23T13:03:06.238 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2026-02-23T13:03:06.238 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_small_allocations": "0", 2026-02-23T13:03:06.238 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2026-02-23T13:03:06.238 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_default_buffered_read": "true", 2026-02-23T13:03:06.239 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_default_buffered_write": "false", 2026-02-23T13:03:06.239 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_deferred_batch_ops": "0", 2026-02-23T13:03:06.239 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2026-02-23T13:03:06.239 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2026-02-23T13:03:06.239 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_discard_on_mkfs": "true", 2026-02-23T13:03:06.239 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_elastic_shared_blobs": "true", 2026-02-23T13:03:06.239 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2026-02-23T13:03:06.239 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_extent_map_shard_max_size": "1200", 2026-02-23T13:03:06.239 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_extent_map_shard_min_size": "150", 2026-02-23T13:03:06.239 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_extent_map_shard_target_size": "500", 2026-02-23T13:03:06.239 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2026-02-23T13:03:06.239 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_fail_eio": "false", 2026-02-23T13:03:06.239 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_fragmentation_check_period": "3600", 2026-02-23T13:03:06.240 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_freelist_blocks_per_key": "128", 2026-02-23T13:03:06.240 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2026-02-23T13:03:06.240 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2026-02-23T13:03:06.240 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2026-02-23T13:03:06.240 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_fsck_on_mkfs": "true", 2026-02-23T13:03:06.240 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2026-02-23T13:03:06.240 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_fsck_on_mount": "false", 2026-02-23T13:03:06.240 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_fsck_on_mount_deep": "false", 2026-02-23T13:03:06.240 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_fsck_on_umount": "false", 2026-02-23T13:03:06.240 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_fsck_on_umount_deep": "false", 2026-02-23T13:03:06.240 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2026-02-23T13:03:06.240 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_fsck_quick_fix_threads": "2", 2026-02-23T13:03:06.241 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2026-02-23T13:03:06.241 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2026-02-23T13:03:06.241 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_gc_enable_blob_threshold": "0", 2026-02-23T13:03:06.241 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_gc_enable_total_threshold": "0", 2026-02-23T13:03:06.241 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2026-02-23T13:03:06.241 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_ignore_data_csum": "false", 2026-02-23T13:03:06.241 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2026-02-23T13:03:06.241 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_kvbackend": "rocksdb", 2026-02-23T13:03:06.241 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_log_collection_list_age": "60.000000", 2026-02-23T13:03:06.241 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2026-02-23T13:03:06.241 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_log_op_age": "5.000000", 2026-02-23T13:03:06.243 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_max_alloc_size": "0", 2026-02-23T13:03:06.243 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_max_blob_size": "0", 2026-02-23T13:03:06.243 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_max_blob_size_hdd": "65536", 2026-02-23T13:03:06.243 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_max_blob_size_ssd": "65536", 2026-02-23T13:03:06.243 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_max_defer_interval": "3.000000", 2026-02-23T13:03:06.243 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_max_deferred_txc": "32", 2026-02-23T13:03:06.244 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_min_alloc_size": "0", 2026-02-23T13:03:06.244 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_min_alloc_size_hdd": "4096", 2026-02-23T13:03:06.244 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_min_alloc_size_ssd": "4096", 2026-02-23T13:03:06.244 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_nid_prealloc": "1024", 2026-02-23T13:03:06.244 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_onode_segment_size": "0", 2026-02-23T13:03:06.244 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_prefer_deferred_size": "0", 2026-02-23T13:03:06.244 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2026-02-23T13:03:06.244 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2026-02-23T13:03:06.244 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_qfsck_on_mount": "true", 2026-02-23T13:03:06.244 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_recompression_min_gain": "1.200000", 2026-02-23T13:03:06.244 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_retry_disk_reads": "3", 2026-02-23T13:03:06.245 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_rocksdb_cf": "true", 2026-02-23T13:03:06.245 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-23T13:03:06.245 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2026-02-23T13:03:06.245 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_rocksdb_options_annex": "", 2026-02-23T13:03:06.245 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2026-02-23T13:03:06.245 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_slow_ops_warn_threshold": "1", 2026-02-23T13:03:06.245 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_spdk_coremask": "0x1", 2026-02-23T13:03:06.245 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_spdk_io_sleep": "5", 2026-02-23T13:03:06.245 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_spdk_max_io_completion": "0", 2026-02-23T13:03:06.245 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_spdk_mem": "512", 2026-02-23T13:03:06.245 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_sync_submit_transaction": "false", 2026-02-23T13:03:06.245 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_throttle_bytes": "67108864", 2026-02-23T13:03:06.246 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_throttle_cost_per_io": "0", 2026-02-23T13:03:06.246 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2026-02-23T13:03:06.246 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2026-02-23T13:03:06.246 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2026-02-23T13:03:06.246 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_throttle_trace_rate": "0.000000", 2026-02-23T13:03:06.246 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_tracing": "false", 2026-02-23T13:03:06.246 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2026-02-23T13:03:06.246 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2026-02-23T13:03:06.246 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_volume_selection_reserved": "0", 2026-02-23T13:03:06.246 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2026-02-23T13:03:06.246 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2026-02-23T13:03:06.246 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_warn_on_free_fragmentation": "0.800000", 2026-02-23T13:03:06.246 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_warn_on_legacy_statfs": "true", 2026-02-23T13:03:06.247 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2026-02-23T13:03:06.247 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2026-02-23T13:03:06.247 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2026-02-23T13:03:06.247 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_write_v2": "false", 2026-02-23T13:03:06.247 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_write_v2_random": "false", 2026-02-23T13:03:06.247 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_zero_block_detection": "false", 2026-02-23T13:03:06.247 INFO:teuthology.orchestra.run.trial046.stdout: "breakpad": "false", 2026-02-23T13:03:06.247 INFO:teuthology.orchestra.run.trial046.stdout: "ceph_assert_supresssions": "", 2026-02-23T13:03:06.247 INFO:teuthology.orchestra.run.trial046.stdout: "cephadm_path": "/usr/sbin/cephadm", 2026-02-23T13:03:06.247 INFO:teuthology.orchestra.run.trial046.stdout: "cephfs_mirror_action_update_interval": "2", 2026-02-23T13:03:06.247 INFO:teuthology.orchestra.run.trial046.stdout: "cephfs_mirror_directory_scan_interval": "10", 2026-02-23T13:03:06.247 INFO:teuthology.orchestra.run.trial046.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2026-02-23T13:03:06.248 INFO:teuthology.orchestra.run.trial046.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2026-02-23T13:03:06.248 INFO:teuthology.orchestra.run.trial046.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2026-02-23T13:03:06.248 INFO:teuthology.orchestra.run.trial046.stdout: "cephfs_mirror_mount_timeout": "10", 2026-02-23T13:03:06.248 INFO:teuthology.orchestra.run.trial046.stdout: "cephfs_mirror_perf_stats_prio": "5", 2026-02-23T13:03:06.248 INFO:teuthology.orchestra.run.trial046.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2026-02-23T13:03:06.248 INFO:teuthology.orchestra.run.trial046.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2026-02-23T13:03:06.248 INFO:teuthology.orchestra.run.trial046.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2026-02-23T13:03:06.248 INFO:teuthology.orchestra.run.trial046.stdout: "cephsqlite_blocklist_dead_locker": "true", 2026-02-23T13:03:06.248 INFO:teuthology.orchestra.run.trial046.stdout: "cephsqlite_lock_renewal_interval": "2000", 2026-02-23T13:03:06.248 INFO:teuthology.orchestra.run.trial046.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2026-02-23T13:03:06.248 INFO:teuthology.orchestra.run.trial046.stdout: "cephx_cluster_require_signatures": "false", 2026-02-23T13:03:06.248 INFO:teuthology.orchestra.run.trial046.stdout: "cephx_cluster_require_version": "2", 2026-02-23T13:03:06.248 INFO:teuthology.orchestra.run.trial046.stdout: "cephx_require_signatures": "false", 2026-02-23T13:03:06.249 INFO:teuthology.orchestra.run.trial046.stdout: "cephx_require_version": "2", 2026-02-23T13:03:06.249 INFO:teuthology.orchestra.run.trial046.stdout: "cephx_service_require_signatures": "false", 2026-02-23T13:03:06.249 INFO:teuthology.orchestra.run.trial046.stdout: "cephx_service_require_version": "2", 2026-02-23T13:03:06.249 INFO:teuthology.orchestra.run.trial046.stdout: "cephx_sign_messages": "true", 2026-02-23T13:03:06.249 INFO:teuthology.orchestra.run.trial046.stdout: "chdir": "", 2026-02-23T13:03:06.249 INFO:teuthology.orchestra.run.trial046.stdout: "client_acl_type": "", 2026-02-23T13:03:06.249 INFO:teuthology.orchestra.run.trial046.stdout: "client_asio_thread_count": "2", 2026-02-23T13:03:06.249 INFO:teuthology.orchestra.run.trial046.stdout: "client_cache_mid": "0.750000", 2026-02-23T13:03:06.249 INFO:teuthology.orchestra.run.trial046.stdout: "client_cache_size": "16384", 2026-02-23T13:03:06.249 INFO:teuthology.orchestra.run.trial046.stdout: "client_caps_release_delay": "5", 2026-02-23T13:03:06.250 INFO:teuthology.orchestra.run.trial046.stdout: "client_check_pool_perm": "true", 2026-02-23T13:03:06.250 INFO:teuthology.orchestra.run.trial046.stdout: "client_collect_and_send_global_metrics": "false", 2026-02-23T13:03:06.250 INFO:teuthology.orchestra.run.trial046.stdout: "client_debug_force_sync_read": "false", 2026-02-23T13:03:06.250 INFO:teuthology.orchestra.run.trial046.stdout: "client_debug_getattr_caps": "false", 2026-02-23T13:03:06.250 INFO:teuthology.orchestra.run.trial046.stdout: "client_debug_inject_features": "", 2026-02-23T13:03:06.250 INFO:teuthology.orchestra.run.trial046.stdout: "client_debug_inject_tick_delay": "0", 2026-02-23T13:03:06.250 INFO:teuthology.orchestra.run.trial046.stdout: "client_die_on_failed_dentry_invalidate": "true", 2026-02-23T13:03:06.250 INFO:teuthology.orchestra.run.trial046.stdout: "client_die_on_failed_remount": "false", 2026-02-23T13:03:06.250 INFO:teuthology.orchestra.run.trial046.stdout: "client_dirsize_rbytes": "true", 2026-02-23T13:03:06.250 INFO:teuthology.orchestra.run.trial046.stdout: "client_file_blockdiff_max_concurrent_object_scans": "16", 2026-02-23T13:03:06.250 INFO:teuthology.orchestra.run.trial046.stdout: "client_force_lazyio": "false", 2026-02-23T13:03:06.250 INFO:teuthology.orchestra.run.trial046.stdout: "client_fs": "", 2026-02-23T13:03:06.251 INFO:teuthology.orchestra.run.trial046.stdout: "client_fscrypt_as": "true", 2026-02-23T13:03:06.251 INFO:teuthology.orchestra.run.trial046.stdout: "client_fscrypt_dummy_encryption": "false", 2026-02-23T13:03:06.251 INFO:teuthology.orchestra.run.trial046.stdout: "client_inject_fixed_oldest_tid": "false", 2026-02-23T13:03:06.251 INFO:teuthology.orchestra.run.trial046.stdout: "client_inject_release_failure": "false", 2026-02-23T13:03:06.251 INFO:teuthology.orchestra.run.trial046.stdout: "client_inject_write_delay_secs": "0", 2026-02-23T13:03:06.251 INFO:teuthology.orchestra.run.trial046.stdout: "client_max_inline_size": "4096", 2026-02-23T13:03:06.251 INFO:teuthology.orchestra.run.trial046.stdout: "client_max_retries_on_remount_failure": "5", 2026-02-23T13:03:06.251 INFO:teuthology.orchestra.run.trial046.stdout: "client_mds_namespace": "", 2026-02-23T13:03:06.251 INFO:teuthology.orchestra.run.trial046.stdout: "client_metadata": "", 2026-02-23T13:03:06.251 INFO:teuthology.orchestra.run.trial046.stdout: "client_mount_gid": "-1", 2026-02-23T13:03:06.251 INFO:teuthology.orchestra.run.trial046.stdout: "client_mount_timeout": "300", 2026-02-23T13:03:06.251 INFO:teuthology.orchestra.run.trial046.stdout: "client_mount_uid": "-1", 2026-02-23T13:03:06.251 INFO:teuthology.orchestra.run.trial046.stdout: "client_mountpoint": "/", 2026-02-23T13:03:06.252 INFO:teuthology.orchestra.run.trial046.stdout: "client_notify_timeout": "10", 2026-02-23T13:03:06.252 INFO:teuthology.orchestra.run.trial046.stdout: "client_oc": "true", 2026-02-23T13:03:06.252 INFO:teuthology.orchestra.run.trial046.stdout: "client_oc_max_dirty": "104857600", 2026-02-23T13:03:06.252 INFO:teuthology.orchestra.run.trial046.stdout: "client_oc_max_dirty_age": "5.000000", 2026-02-23T13:03:06.252 INFO:teuthology.orchestra.run.trial046.stdout: "client_oc_max_objects": "1000", 2026-02-23T13:03:06.252 INFO:teuthology.orchestra.run.trial046.stdout: "client_oc_size": "209715200", 2026-02-23T13:03:06.252 INFO:teuthology.orchestra.run.trial046.stdout: "client_oc_target_dirty": "8388608", 2026-02-23T13:03:06.252 INFO:teuthology.orchestra.run.trial046.stdout: "client_permissions": "true", 2026-02-23T13:03:06.252 INFO:teuthology.orchestra.run.trial046.stdout: "client_quota": "true", 2026-02-23T13:03:06.252 INFO:teuthology.orchestra.run.trial046.stdout: "client_quota_df": "true", 2026-02-23T13:03:06.252 INFO:teuthology.orchestra.run.trial046.stdout: "client_readahead_max_bytes": "0", 2026-02-23T13:03:06.252 INFO:teuthology.orchestra.run.trial046.stdout: "client_readahead_max_periods": "4", 2026-02-23T13:03:06.252 INFO:teuthology.orchestra.run.trial046.stdout: "client_readahead_min": "131072", 2026-02-23T13:03:06.253 INFO:teuthology.orchestra.run.trial046.stdout: "client_reconnect_stale": "false", 2026-02-23T13:03:06.253 INFO:teuthology.orchestra.run.trial046.stdout: "client_respect_subvolume_snapshot_visibility": "false", 2026-02-23T13:03:06.253 INFO:teuthology.orchestra.run.trial046.stdout: "client_shutdown_timeout": "30", 2026-02-23T13:03:06.253 INFO:teuthology.orchestra.run.trial046.stdout: "client_snapdir": ".snap", 2026-02-23T13:03:06.253 INFO:teuthology.orchestra.run.trial046.stdout: "client_tick_interval": "1", 2026-02-23T13:03:06.253 INFO:teuthology.orchestra.run.trial046.stdout: "client_trace": "", 2026-02-23T13:03:06.253 INFO:teuthology.orchestra.run.trial046.stdout: "client_try_dentry_invalidate": "false", 2026-02-23T13:03:06.253 INFO:teuthology.orchestra.run.trial046.stdout: "client_use_faked_inos": "false", 2026-02-23T13:03:06.253 INFO:teuthology.orchestra.run.trial046.stdout: "client_use_random_mds": "false", 2026-02-23T13:03:06.253 INFO:teuthology.orchestra.run.trial046.stdout: "clog_to_graylog": "false", 2026-02-23T13:03:06.253 INFO:teuthology.orchestra.run.trial046.stdout: "clog_to_graylog_host": "127.0.0.1", 2026-02-23T13:03:06.253 INFO:teuthology.orchestra.run.trial046.stdout: "clog_to_graylog_port": "12201", 2026-02-23T13:03:06.254 INFO:teuthology.orchestra.run.trial046.stdout: "clog_to_monitors": "default=true", 2026-02-23T13:03:06.254 INFO:teuthology.orchestra.run.trial046.stdout: "clog_to_syslog": "false", 2026-02-23T13:03:06.254 INFO:teuthology.orchestra.run.trial046.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2026-02-23T13:03:06.254 INFO:teuthology.orchestra.run.trial046.stdout: "clog_to_syslog_level": "info", 2026-02-23T13:03:06.254 INFO:teuthology.orchestra.run.trial046.stdout: "cluster_addr": "-", 2026-02-23T13:03:06.254 INFO:teuthology.orchestra.run.trial046.stdout: "cluster_network": "", 2026-02-23T13:03:06.254 INFO:teuthology.orchestra.run.trial046.stdout: "cluster_network_interface": "", 2026-02-23T13:03:06.254 INFO:teuthology.orchestra.run.trial046.stdout: "compressor_zlib_isal": "false", 2026-02-23T13:03:06.254 INFO:teuthology.orchestra.run.trial046.stdout: "compressor_zlib_level": "5", 2026-02-23T13:03:06.254 INFO:teuthology.orchestra.run.trial046.stdout: "compressor_zlib_winsize": "-15", 2026-02-23T13:03:06.254 INFO:teuthology.orchestra.run.trial046.stdout: "compressor_zstd_level": "1", 2026-02-23T13:03:06.254 INFO:teuthology.orchestra.run.trial046.stdout: "container_image": "quay.ceph.io/ceph-ci/ceph@sha256:49621faaa845c39b2aae72e4fa24123ee9b2ac3fb8ae834753907068ee2972ea", 2026-02-23T13:03:06.254 INFO:teuthology.orchestra.run.trial046.stdout: "crash_dir": "/var/lib/ceph/crash", 2026-02-23T13:03:06.255 INFO:teuthology.orchestra.run.trial046.stdout: "crimson_allow_pg_split": "false", 2026-02-23T13:03:06.255 INFO:teuthology.orchestra.run.trial046.stdout: "crimson_bluestore_cpu_set": "", 2026-02-23T13:03:06.255 INFO:teuthology.orchestra.run.trial046.stdout: "crimson_bluestore_num_threads": "6", 2026-02-23T13:03:06.255 INFO:teuthology.orchestra.run.trial046.stdout: "crimson_cpu_num": "0", 2026-02-23T13:03:06.255 INFO:teuthology.orchestra.run.trial046.stdout: "crimson_cpu_set": "", 2026-02-23T13:03:06.255 INFO:teuthology.orchestra.run.trial046.stdout: "crimson_osd_obc_lru_size": "512", 2026-02-23T13:03:06.255 INFO:teuthology.orchestra.run.trial046.stdout: "crimson_osd_scheduler_concurrency": "0", 2026-02-23T13:03:06.255 INFO:teuthology.orchestra.run.trial046.stdout: "crimson_osd_stat_interval": "0", 2026-02-23T13:03:06.255 INFO:teuthology.orchestra.run.trial046.stdout: "crimson_poll_mode": "false", 2026-02-23T13:03:06.255 INFO:teuthology.orchestra.run.trial046.stdout: "crimson_reactor_backend": "", 2026-02-23T13:03:06.255 INFO:teuthology.orchestra.run.trial046.stdout: "crimson_reactor_idle_poll_time_us": "200", 2026-02-23T13:03:06.255 INFO:teuthology.orchestra.run.trial046.stdout: "crimson_reactor_io_latency_goal_ms": "0.000000", 2026-02-23T13:03:06.256 INFO:teuthology.orchestra.run.trial046.stdout: "crimson_reactor_task_quota_ms": "0.500000", 2026-02-23T13:03:06.256 INFO:teuthology.orchestra.run.trial046.stdout: "crush_location": "", 2026-02-23T13:03:06.256 INFO:teuthology.orchestra.run.trial046.stdout: "crush_location_hook": "", 2026-02-23T13:03:06.256 INFO:teuthology.orchestra.run.trial046.stdout: "crush_location_hook_timeout": "10", 2026-02-23T13:03:06.256 INFO:teuthology.orchestra.run.trial046.stdout: "d4n_writecache_enabled": "false", 2026-02-23T13:03:06.256 INFO:teuthology.orchestra.run.trial046.stdout: "daemonize": "false", 2026-02-23T13:03:06.256 INFO:teuthology.orchestra.run.trial046.stdout: "daos_pool": "tank", 2026-02-23T13:03:06.256 INFO:teuthology.orchestra.run.trial046.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2026-02-23T13:03:06.256 INFO:teuthology.orchestra.run.trial046.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2026-02-23T13:03:06.256 INFO:teuthology.orchestra.run.trial046.stdout: "dbstore_db_name_prefix": "dbstore", 2026-02-23T13:03:06.256 INFO:teuthology.orchestra.run.trial046.stdout: "debug_alienstore": "0/5", 2026-02-23T13:03:06.257 INFO:teuthology.orchestra.run.trial046.stdout: "debug_allow_any_pool_priority": "false", 2026-02-23T13:03:06.257 INFO:teuthology.orchestra.run.trial046.stdout: "debug_asok": "1/5", 2026-02-23T13:03:06.257 INFO:teuthology.orchestra.run.trial046.stdout: "debug_asok_assert_abort": "false", 2026-02-23T13:03:06.257 INFO:teuthology.orchestra.run.trial046.stdout: "debug_asserts_on_shutdown": "true", 2026-02-23T13:03:06.257 INFO:teuthology.orchestra.run.trial046.stdout: "debug_auth": "1/5", 2026-02-23T13:03:06.257 INFO:teuthology.orchestra.run.trial046.stdout: "debug_bdev": "1/3", 2026-02-23T13:03:06.257 INFO:teuthology.orchestra.run.trial046.stdout: "debug_bluefs": "1/5", 2026-02-23T13:03:06.257 INFO:teuthology.orchestra.run.trial046.stdout: "debug_bluestore": "1/5", 2026-02-23T13:03:06.257 INFO:teuthology.orchestra.run.trial046.stdout: "debug_bluestore_compression": "1/5", 2026-02-23T13:03:06.257 INFO:teuthology.orchestra.run.trial046.stdout: "debug_buffer": "0/1", 2026-02-23T13:03:06.257 INFO:teuthology.orchestra.run.trial046.stdout: "debug_ceph_dedup": "0/5", 2026-02-23T13:03:06.257 INFO:teuthology.orchestra.run.trial046.stdout: "debug_ceph_exporter": "1/5", 2026-02-23T13:03:06.257 INFO:teuthology.orchestra.run.trial046.stdout: "debug_cephfs_mirror": "0/5", 2026-02-23T13:03:06.258 INFO:teuthology.orchestra.run.trial046.stdout: "debug_cephsqlite": "0/5", 2026-02-23T13:03:06.258 INFO:teuthology.orchestra.run.trial046.stdout: "debug_client": "0/5", 2026-02-23T13:03:06.258 INFO:teuthology.orchestra.run.trial046.stdout: "debug_compressor": "1/5", 2026-02-23T13:03:06.258 INFO:teuthology.orchestra.run.trial046.stdout: "debug_context": "0/1", 2026-02-23T13:03:06.258 INFO:teuthology.orchestra.run.trial046.stdout: "debug_crimson_interrupt": "0/5", 2026-02-23T13:03:06.258 INFO:teuthology.orchestra.run.trial046.stdout: "debug_crush": "1/1", 2026-02-23T13:03:06.258 INFO:teuthology.orchestra.run.trial046.stdout: "debug_crypto": "1/5", 2026-02-23T13:03:06.258 INFO:teuthology.orchestra.run.trial046.stdout: "debug_cyanstore": "0/5", 2026-02-23T13:03:06.258 INFO:teuthology.orchestra.run.trial046.stdout: "debug_deliberately_leak_memory": "false", 2026-02-23T13:03:06.258 INFO:teuthology.orchestra.run.trial046.stdout: "debug_disable_randomized_ping": "false", 2026-02-23T13:03:06.258 INFO:teuthology.orchestra.run.trial046.stdout: "debug_dpdk": "1/5", 2026-02-23T13:03:06.258 INFO:teuthology.orchestra.run.trial046.stdout: "debug_eventtrace": "1/5", 2026-02-23T13:03:06.258 INFO:teuthology.orchestra.run.trial046.stdout: "debug_filer": "0/1", 2026-02-23T13:03:06.259 INFO:teuthology.orchestra.run.trial046.stdout: "debug_filestore": "1/3", 2026-02-23T13:03:06.259 INFO:teuthology.orchestra.run.trial046.stdout: "debug_finisher": "1/1", 2026-02-23T13:03:06.259 INFO:teuthology.orchestra.run.trial046.stdout: "debug_fuse": "1/5", 2026-02-23T13:03:06.259 INFO:teuthology.orchestra.run.trial046.stdout: "debug_heartbeat_testing_span": "0", 2026-02-23T13:03:06.259 INFO:teuthology.orchestra.run.trial046.stdout: "debug_heartbeatmap": "1/5", 2026-02-23T13:03:06.259 INFO:teuthology.orchestra.run.trial046.stdout: "debug_immutable_obj_cache": "0/5", 2026-02-23T13:03:06.259 INFO:teuthology.orchestra.run.trial046.stdout: "debug_javaclient": "1/5", 2026-02-23T13:03:06.259 INFO:teuthology.orchestra.run.trial046.stdout: "debug_journal": "1/3", 2026-02-23T13:03:06.259 INFO:teuthology.orchestra.run.trial046.stdout: "debug_journaler": "0/5", 2026-02-23T13:03:06.259 INFO:teuthology.orchestra.run.trial046.stdout: "debug_kstore": "1/5", 2026-02-23T13:03:06.259 INFO:teuthology.orchestra.run.trial046.stdout: "debug_lockdep": "0/1", 2026-02-23T13:03:06.260 INFO:teuthology.orchestra.run.trial046.stdout: "debug_mclock": "1/5", 2026-02-23T13:03:06.260 INFO:teuthology.orchestra.run.trial046.stdout: "debug_mds": "1/5", 2026-02-23T13:03:06.260 INFO:teuthology.orchestra.run.trial046.stdout: "debug_mds_balancer": "1/5", 2026-02-23T13:03:06.260 INFO:teuthology.orchestra.run.trial046.stdout: "debug_mds_locker": "1/5", 2026-02-23T13:03:06.260 INFO:teuthology.orchestra.run.trial046.stdout: "debug_mds_log": "1/5", 2026-02-23T13:03:06.260 INFO:teuthology.orchestra.run.trial046.stdout: "debug_mds_log_expire": "1/5", 2026-02-23T13:03:06.260 INFO:teuthology.orchestra.run.trial046.stdout: "debug_mds_migrator": "1/5", 2026-02-23T13:03:06.260 INFO:teuthology.orchestra.run.trial046.stdout: "debug_mds_quiesce": "3/5", 2026-02-23T13:03:06.260 INFO:teuthology.orchestra.run.trial046.stdout: "debug_memstore": "1/5", 2026-02-23T13:03:06.260 INFO:teuthology.orchestra.run.trial046.stdout: "debug_mgr": "2/5", 2026-02-23T13:03:06.260 INFO:teuthology.orchestra.run.trial046.stdout: "debug_mgrc": "1/5", 2026-02-23T13:03:06.260 INFO:teuthology.orchestra.run.trial046.stdout: "debug_mon": "20/20", 2026-02-23T13:03:06.260 INFO:teuthology.orchestra.run.trial046.stdout: "debug_monc": "0/10", 2026-02-23T13:03:06.260 INFO:teuthology.orchestra.run.trial046.stdout: "debug_ms": "1/1", 2026-02-23T13:03:06.261 INFO:teuthology.orchestra.run.trial046.stdout: "debug_none": "0/5", 2026-02-23T13:03:06.261 INFO:teuthology.orchestra.run.trial046.stdout: "debug_objclass": "0/5", 2026-02-23T13:03:06.261 INFO:teuthology.orchestra.run.trial046.stdout: "debug_objectcacher": "0/5", 2026-02-23T13:03:06.261 INFO:teuthology.orchestra.run.trial046.stdout: "debug_objecter": "0/1", 2026-02-23T13:03:06.261 INFO:teuthology.orchestra.run.trial046.stdout: "debug_optracker": "0/5", 2026-02-23T13:03:06.261 INFO:teuthology.orchestra.run.trial046.stdout: "debug_osd": "1/5", 2026-02-23T13:03:06.261 INFO:teuthology.orchestra.run.trial046.stdout: "debug_paxos": "20/20", 2026-02-23T13:03:06.261 INFO:teuthology.orchestra.run.trial046.stdout: "debug_perfcounter": "1/5", 2026-02-23T13:03:06.261 INFO:teuthology.orchestra.run.trial046.stdout: "debug_prioritycache": "1/5", 2026-02-23T13:03:06.261 INFO:teuthology.orchestra.run.trial046.stdout: "debug_rados": "0/5", 2026-02-23T13:03:06.261 INFO:teuthology.orchestra.run.trial046.stdout: "debug_rbd": "0/5", 2026-02-23T13:03:06.261 INFO:teuthology.orchestra.run.trial046.stdout: "debug_rbd_mirror": "0/5", 2026-02-23T13:03:06.261 INFO:teuthology.orchestra.run.trial046.stdout: "debug_rbd_pwl": "0/5", 2026-02-23T13:03:06.261 INFO:teuthology.orchestra.run.trial046.stdout: "debug_rbd_replay": "0/5", 2026-02-23T13:03:06.262 INFO:teuthology.orchestra.run.trial046.stdout: "debug_refs": "0/0", 2026-02-23T13:03:06.262 INFO:teuthology.orchestra.run.trial046.stdout: "debug_reserver": "1/1", 2026-02-23T13:03:06.262 INFO:teuthology.orchestra.run.trial046.stdout: "debug_rgw": "1/5", 2026-02-23T13:03:06.262 INFO:teuthology.orchestra.run.trial046.stdout: "debug_rgw_access": "1/5", 2026-02-23T13:03:06.262 INFO:teuthology.orchestra.run.trial046.stdout: "debug_rgw_bucket_logging": "1/5", 2026-02-23T13:03:06.262 INFO:teuthology.orchestra.run.trial046.stdout: "debug_rgw_datacache": "1/5", 2026-02-23T13:03:06.262 INFO:teuthology.orchestra.run.trial046.stdout: "debug_rgw_dbstore": "1/5", 2026-02-23T13:03:06.262 INFO:teuthology.orchestra.run.trial046.stdout: "debug_rgw_dedup": "1/5", 2026-02-23T13:03:06.262 INFO:teuthology.orchestra.run.trial046.stdout: "debug_rgw_flight": "1/5", 2026-02-23T13:03:06.262 INFO:teuthology.orchestra.run.trial046.stdout: "debug_rgw_lifecycle": "1/5", 2026-02-23T13:03:06.262 INFO:teuthology.orchestra.run.trial046.stdout: "debug_rgw_notification": "1/5", 2026-02-23T13:03:06.262 INFO:teuthology.orchestra.run.trial046.stdout: "debug_rgw_restore": "1/5", 2026-02-23T13:03:06.262 INFO:teuthology.orchestra.run.trial046.stdout: "debug_rgw_sync": "1/5", 2026-02-23T13:03:06.262 INFO:teuthology.orchestra.run.trial046.stdout: "debug_rocksdb": "4/5", 2026-02-23T13:03:06.262 INFO:teuthology.orchestra.run.trial046.stdout: "debug_seastore": "0/5", 2026-02-23T13:03:06.263 INFO:teuthology.orchestra.run.trial046.stdout: "debug_seastore_backref": "0/5", 2026-02-23T13:03:06.263 INFO:teuthology.orchestra.run.trial046.stdout: "debug_seastore_cache": "0/5", 2026-02-23T13:03:06.263 INFO:teuthology.orchestra.run.trial046.stdout: "debug_seastore_cleaner": "0/5", 2026-02-23T13:03:06.263 INFO:teuthology.orchestra.run.trial046.stdout: "debug_seastore_device": "0/5", 2026-02-23T13:03:06.263 INFO:teuthology.orchestra.run.trial046.stdout: "debug_seastore_epm": "0/5", 2026-02-23T13:03:06.263 INFO:teuthology.orchestra.run.trial046.stdout: "debug_seastore_fixedkv_tree": "0/5", 2026-02-23T13:03:06.263 INFO:teuthology.orchestra.run.trial046.stdout: "debug_seastore_journal": "0/5", 2026-02-23T13:03:06.263 INFO:teuthology.orchestra.run.trial046.stdout: "debug_seastore_lba": "0/5", 2026-02-23T13:03:06.263 INFO:teuthology.orchestra.run.trial046.stdout: "debug_seastore_odata": "0/5", 2026-02-23T13:03:06.263 INFO:teuthology.orchestra.run.trial046.stdout: "debug_seastore_omap": "0/5", 2026-02-23T13:03:06.263 INFO:teuthology.orchestra.run.trial046.stdout: "debug_seastore_onode": "0/5", 2026-02-23T13:03:06.263 INFO:teuthology.orchestra.run.trial046.stdout: "debug_seastore_t": "0/5", 2026-02-23T13:03:06.263 INFO:teuthology.orchestra.run.trial046.stdout: "debug_seastore_tm": "0/5", 2026-02-23T13:03:06.263 INFO:teuthology.orchestra.run.trial046.stdout: "debug_striper": "0/1", 2026-02-23T13:03:06.264 INFO:teuthology.orchestra.run.trial046.stdout: "debug_test": "0/5", 2026-02-23T13:03:06.264 INFO:teuthology.orchestra.run.trial046.stdout: "debug_throttle": "1/1", 2026-02-23T13:03:06.264 INFO:teuthology.orchestra.run.trial046.stdout: "debug_timer": "0/1", 2026-02-23T13:03:06.264 INFO:teuthology.orchestra.run.trial046.stdout: "debug_tp": "0/5", 2026-02-23T13:03:06.264 INFO:teuthology.orchestra.run.trial046.stdout: "debug_trace": "1/5", 2026-02-23T13:03:06.264 INFO:teuthology.orchestra.run.trial046.stdout: "defer_client_eviction_on_laggy_osds": "false", 2026-02-23T13:03:06.264 INFO:teuthology.orchestra.run.trial046.stdout: "device_failure_prediction_mode": "none", 2026-02-23T13:03:06.264 INFO:teuthology.orchestra.run.trial046.stdout: "ec_extent_cache_size": "10485760", 2026-02-23T13:03:06.264 INFO:teuthology.orchestra.run.trial046.stdout: "ec_pdw_write_mode": "0", 2026-02-23T13:03:06.264 INFO:teuthology.orchestra.run.trial046.stdout: "enable_availability_tracking": "false", 2026-02-23T13:03:06.264 INFO:teuthology.orchestra.run.trial046.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "crimson", 2026-02-23T13:03:06.264 INFO:teuthology.orchestra.run.trial046.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2026-02-23T13:03:06.264 INFO:teuthology.orchestra.run.trial046.stdout: "err_to_graylog": "false", 2026-02-23T13:03:06.264 INFO:teuthology.orchestra.run.trial046.stdout: "err_to_journald": "false", 2026-02-23T13:03:06.265 INFO:teuthology.orchestra.run.trial046.stdout: "err_to_stderr": "true", 2026-02-23T13:03:06.265 INFO:teuthology.orchestra.run.trial046.stdout: "err_to_syslog": "false", 2026-02-23T13:03:06.265 INFO:teuthology.orchestra.run.trial046.stdout: "event_tracing": "false", 2026-02-23T13:03:06.265 INFO:teuthology.orchestra.run.trial046.stdout: "exporter_addr": "0.0.0.0", 2026-02-23T13:03:06.265 INFO:teuthology.orchestra.run.trial046.stdout: "exporter_cert_file": "", 2026-02-23T13:03:06.265 INFO:teuthology.orchestra.run.trial046.stdout: "exporter_http_port": "9926", 2026-02-23T13:03:06.265 INFO:teuthology.orchestra.run.trial046.stdout: "exporter_key_file": "", 2026-02-23T13:03:06.265 INFO:teuthology.orchestra.run.trial046.stdout: "exporter_prio_limit": "5", 2026-02-23T13:03:06.265 INFO:teuthology.orchestra.run.trial046.stdout: "exporter_sock_dir": "/var/run/ceph/", 2026-02-23T13:03:06.265 INFO:teuthology.orchestra.run.trial046.stdout: "exporter_sort_metrics": "true", 2026-02-23T13:03:06.265 INFO:teuthology.orchestra.run.trial046.stdout: "exporter_stats_period": "5", 2026-02-23T13:03:06.265 INFO:teuthology.orchestra.run.trial046.stdout: "fake_statfs_for_testing": "0", 2026-02-23T13:03:06.265 INFO:teuthology.orchestra.run.trial046.stdout: "fatal_signal_handlers": "true", 2026-02-23T13:03:06.265 INFO:teuthology.orchestra.run.trial046.stdout: "filer_max_purge_ops": "10", 2026-02-23T13:03:06.266 INFO:teuthology.orchestra.run.trial046.stdout: "filer_max_truncate_ops": "128", 2026-02-23T13:03:06.266 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_apply_finisher_threads": "1", 2026-02-23T13:03:06.266 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_blackhole": "false", 2026-02-23T13:03:06.266 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_btrfs_clone_range": "true", 2026-02-23T13:03:06.266 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_btrfs_snap": "true", 2026-02-23T13:03:06.266 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_caller_concurrency": "10", 2026-02-23T13:03:06.266 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_collect_device_partition_information": "true", 2026-02-23T13:03:06.266 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_commit_timeout": "600.000000", 2026-02-23T13:03:06.266 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_debug_inject_read_err": "false", 2026-02-23T13:03:06.266 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_debug_omap_check": "false", 2026-02-23T13:03:06.266 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_debug_verify_split": "false", 2026-02-23T13:03:06.266 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_dump_file": "", 2026-02-23T13:03:06.266 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2026-02-23T13:03:06.267 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_expected_throughput_ops": "200.000000", 2026-02-23T13:03:06.267 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_fadvise": "true", 2026-02-23T13:03:06.267 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_fail_eio": "true", 2026-02-23T13:03:06.267 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_fd_cache_shards": "16", 2026-02-23T13:03:06.267 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_fd_cache_size": "128", 2026-02-23T13:03:06.267 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_fiemap": "false", 2026-02-23T13:03:06.267 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_fiemap_threshold": "4096", 2026-02-23T13:03:06.267 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_fsync_flushes_journal_data": "false", 2026-02-23T13:03:06.267 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_index_retry_probability": "0.000000", 2026-02-23T13:03:06.267 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_inject_stall": "0", 2026-02-23T13:03:06.267 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_journal_parallel": "false", 2026-02-23T13:03:06.267 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_journal_trailing": "false", 2026-02-23T13:03:06.267 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_journal_writeahead": "false", 2026-02-23T13:03:06.267 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_kill_at": "0", 2026-02-23T13:03:06.268 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_max_alloc_hint_size": "1048576", 2026-02-23T13:03:06.268 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_max_inline_xattr_size": "0", 2026-02-23T13:03:06.268 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2026-02-23T13:03:06.268 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_max_inline_xattr_size_other": "512", 2026-02-23T13:03:06.268 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2026-02-23T13:03:06.268 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_max_inline_xattrs": "0", 2026-02-23T13:03:06.268 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2026-02-23T13:03:06.268 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_max_inline_xattrs_other": "2", 2026-02-23T13:03:06.268 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_max_inline_xattrs_xfs": "10", 2026-02-23T13:03:06.268 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_max_sync_interval": "5.000000", 2026-02-23T13:03:06.268 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_max_xattr_value_size": "0", 2026-02-23T13:03:06.268 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2026-02-23T13:03:06.268 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_max_xattr_value_size_other": "1024", 2026-02-23T13:03:06.268 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2026-02-23T13:03:06.269 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_merge_threshold": "-10", 2026-02-23T13:03:06.269 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_min_sync_interval": "0.010000", 2026-02-23T13:03:06.269 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_odsync_write": "false", 2026-02-23T13:03:06.269 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_omap_backend": "rocksdb", 2026-02-23T13:03:06.269 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_omap_backend_path": "", 2026-02-23T13:03:06.269 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_omap_header_cache_size": "1024", 2026-02-23T13:03:06.269 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_ondisk_finisher_threads": "1", 2026-02-23T13:03:06.269 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_op_thread_suicide_timeout": "180", 2026-02-23T13:03:06.269 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_op_thread_timeout": "60", 2026-02-23T13:03:06.269 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_op_threads": "2", 2026-02-23T13:03:06.269 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_punch_hole": "false", 2026-02-23T13:03:06.269 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2026-02-23T13:03:06.269 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2026-02-23T13:03:06.269 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2026-02-23T13:03:06.270 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_queue_high_threshhold": "0.900000", 2026-02-23T13:03:06.270 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_queue_low_threshhold": "0.300000", 2026-02-23T13:03:06.270 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_queue_max_bytes": "104857600", 2026-02-23T13:03:06.270 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2026-02-23T13:03:06.270 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2026-02-23T13:03:06.270 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2026-02-23T13:03:06.270 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_queue_max_ops": "50", 2026-02-23T13:03:06.270 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2026-02-23T13:03:06.270 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_seek_data_hole": "false", 2026-02-23T13:03:06.270 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_sloppy_crc": "false", 2026-02-23T13:03:06.270 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_sloppy_crc_block_size": "65536", 2026-02-23T13:03:06.270 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_splice": "false", 2026-02-23T13:03:06.270 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_split_multiple": "2", 2026-02-23T13:03:06.270 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_split_rand_factor": "20", 2026-02-23T13:03:06.270 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_update_to": "1000", 2026-02-23T13:03:06.271 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2026-02-23T13:03:06.271 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2026-02-23T13:03:06.271 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2026-02-23T13:03:06.271 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2026-02-23T13:03:06.271 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2026-02-23T13:03:06.271 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2026-02-23T13:03:06.271 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_wbthrottle_enable": "true", 2026-02-23T13:03:06.271 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2026-02-23T13:03:06.271 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2026-02-23T13:03:06.271 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2026-02-23T13:03:06.271 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2026-02-23T13:03:06.271 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2026-02-23T13:03:06.271 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2026-02-23T13:03:06.271 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_xfs_extsize": "false", 2026-02-23T13:03:06.271 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_zfs_snap": "false", 2026-02-23T13:03:06.271 INFO:teuthology.orchestra.run.trial046.stdout: "fio_dir": "/tmp/fio", 2026-02-23T13:03:06.271 INFO:teuthology.orchestra.run.trial046.stdout: "fsid": "c3b3ca7d-10b7-11f1-8efe-d404e6e7d460", 2026-02-23T13:03:06.272 INFO:teuthology.orchestra.run.trial046.stdout: "fuse_allow_other": "true", 2026-02-23T13:03:06.272 INFO:teuthology.orchestra.run.trial046.stdout: "fuse_atomic_o_trunc": "true", 2026-02-23T13:03:06.272 INFO:teuthology.orchestra.run.trial046.stdout: "fuse_big_writes": "true", 2026-02-23T13:03:06.272 INFO:teuthology.orchestra.run.trial046.stdout: "fuse_debug": "false", 2026-02-23T13:03:06.272 INFO:teuthology.orchestra.run.trial046.stdout: "fuse_default_permissions": "false", 2026-02-23T13:03:06.272 INFO:teuthology.orchestra.run.trial046.stdout: "fuse_disable_pagecache": "false", 2026-02-23T13:03:06.272 INFO:teuthology.orchestra.run.trial046.stdout: "fuse_max_write": "0", 2026-02-23T13:03:06.272 INFO:teuthology.orchestra.run.trial046.stdout: "fuse_multithreaded": "true", 2026-02-23T13:03:06.272 INFO:teuthology.orchestra.run.trial046.stdout: "fuse_require_active_mds": "true", 2026-02-23T13:03:06.272 INFO:teuthology.orchestra.run.trial046.stdout: "fuse_set_user_groups": "true", 2026-02-23T13:03:06.272 INFO:teuthology.orchestra.run.trial046.stdout: "fuse_splice_move": "true", 2026-02-23T13:03:06.272 INFO:teuthology.orchestra.run.trial046.stdout: "fuse_splice_read": "true", 2026-02-23T13:03:06.272 INFO:teuthology.orchestra.run.trial046.stdout: "fuse_splice_write": "true", 2026-02-23T13:03:06.272 INFO:teuthology.orchestra.run.trial046.stdout: "fuse_syncfs_on_mksnap": "true", 2026-02-23T13:03:06.272 INFO:teuthology.orchestra.run.trial046.stdout: "fuse_use_invalidate_cb": "true", 2026-02-23T13:03:06.272 INFO:teuthology.orchestra.run.trial046.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2026-02-23T13:03:06.272 INFO:teuthology.orchestra.run.trial046.stdout: "gss_target_name": "ceph", 2026-02-23T13:03:06.273 INFO:teuthology.orchestra.run.trial046.stdout: "heartbeat_file": "", 2026-02-23T13:03:06.273 INFO:teuthology.orchestra.run.trial046.stdout: "heartbeat_inject_failure": "0", 2026-02-23T13:03:06.273 INFO:teuthology.orchestra.run.trial046.stdout: "heartbeat_interval": "5", 2026-02-23T13:03:06.273 INFO:teuthology.orchestra.run.trial046.stdout: "host": "trial046", 2026-02-23T13:03:06.273 INFO:teuthology.orchestra.run.trial046.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2026-02-23T13:03:06.273 INFO:teuthology.orchestra.run.trial046.stdout: "immutable_object_cache_max_inflight_ops": "128", 2026-02-23T13:03:06.273 INFO:teuthology.orchestra.run.trial046.stdout: "immutable_object_cache_max_size": "1073741824", 2026-02-23T13:03:06.273 INFO:teuthology.orchestra.run.trial046.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2026-02-23T13:03:06.273 INFO:teuthology.orchestra.run.trial046.stdout: "immutable_object_cache_qos_bps_burst": "0", 2026-02-23T13:03:06.273 INFO:teuthology.orchestra.run.trial046.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2026-02-23T13:03:06.273 INFO:teuthology.orchestra.run.trial046.stdout: "immutable_object_cache_qos_bps_limit": "0", 2026-02-23T13:03:06.273 INFO:teuthology.orchestra.run.trial046.stdout: "immutable_object_cache_qos_iops_burst": "0", 2026-02-23T13:03:06.273 INFO:teuthology.orchestra.run.trial046.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2026-02-23T13:03:06.273 INFO:teuthology.orchestra.run.trial046.stdout: "immutable_object_cache_qos_iops_limit": "0", 2026-02-23T13:03:06.273 INFO:teuthology.orchestra.run.trial046.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2026-02-23T13:03:06.273 INFO:teuthology.orchestra.run.trial046.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2026-02-23T13:03:06.273 INFO:teuthology.orchestra.run.trial046.stdout: "immutable_object_cache_watermark": "0.900000", 2026-02-23T13:03:06.274 INFO:teuthology.orchestra.run.trial046.stdout: "inject_early_sigterm": "false", 2026-02-23T13:03:06.274 INFO:teuthology.orchestra.run.trial046.stdout: "jaeger_agent_port": "6799", 2026-02-23T13:03:06.274 INFO:teuthology.orchestra.run.trial046.stdout: "jaeger_tracing_enable": "false", 2026-02-23T13:03:06.274 INFO:teuthology.orchestra.run.trial046.stdout: "journal_aio": "true", 2026-02-23T13:03:06.274 INFO:teuthology.orchestra.run.trial046.stdout: "journal_align_min_size": "65536", 2026-02-23T13:03:06.274 INFO:teuthology.orchestra.run.trial046.stdout: "journal_block_align": "true", 2026-02-23T13:03:06.274 INFO:teuthology.orchestra.run.trial046.stdout: "journal_block_size": "4096", 2026-02-23T13:03:06.274 INFO:teuthology.orchestra.run.trial046.stdout: "journal_dio": "true", 2026-02-23T13:03:06.274 INFO:teuthology.orchestra.run.trial046.stdout: "journal_discard": "false", 2026-02-23T13:03:06.274 INFO:teuthology.orchestra.run.trial046.stdout: "journal_force_aio": "false", 2026-02-23T13:03:06.274 INFO:teuthology.orchestra.run.trial046.stdout: "journal_ignore_corruption": "false", 2026-02-23T13:03:06.274 INFO:teuthology.orchestra.run.trial046.stdout: "journal_max_write_bytes": "10485760", 2026-02-23T13:03:06.274 INFO:teuthology.orchestra.run.trial046.stdout: "journal_max_write_entries": "100", 2026-02-23T13:03:06.274 INFO:teuthology.orchestra.run.trial046.stdout: "journal_replay_from": "0", 2026-02-23T13:03:06.274 INFO:teuthology.orchestra.run.trial046.stdout: "journal_throttle_high_multiple": "0.000000", 2026-02-23T13:03:06.274 INFO:teuthology.orchestra.run.trial046.stdout: "journal_throttle_high_threshhold": "0.900000", 2026-02-23T13:03:06.274 INFO:teuthology.orchestra.run.trial046.stdout: "journal_throttle_low_threshhold": "0.600000", 2026-02-23T13:03:06.274 INFO:teuthology.orchestra.run.trial046.stdout: "journal_throttle_max_multiple": "0.000000", 2026-02-23T13:03:06.275 INFO:teuthology.orchestra.run.trial046.stdout: "journal_write_header_frequency": "0", 2026-02-23T13:03:06.275 INFO:teuthology.orchestra.run.trial046.stdout: "journal_zero_on_create": "false", 2026-02-23T13:03:06.275 INFO:teuthology.orchestra.run.trial046.stdout: "journaler_prefetch_periods": "10", 2026-02-23T13:03:06.275 INFO:teuthology.orchestra.run.trial046.stdout: "journaler_prezero_periods": "5", 2026-02-23T13:03:06.275 INFO:teuthology.orchestra.run.trial046.stdout: "journaler_write_head_interval": "15", 2026-02-23T13:03:06.275 INFO:teuthology.orchestra.run.trial046.stdout: "key": "", 2026-02-23T13:03:06.275 INFO:teuthology.orchestra.run.trial046.stdout: "keyfile": "", 2026-02-23T13:03:06.275 INFO:teuthology.orchestra.run.trial046.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2026-02-23T13:03:06.275 INFO:teuthology.orchestra.run.trial046.stdout: "librados_thread_count": "2", 2026-02-23T13:03:06.275 INFO:teuthology.orchestra.run.trial046.stdout: "lockdep": "false", 2026-02-23T13:03:06.275 INFO:teuthology.orchestra.run.trial046.stdout: "lockdep_force_backtrace": "false", 2026-02-23T13:03:06.275 INFO:teuthology.orchestra.run.trial046.stdout: "log_coarse_timestamps": "true", 2026-02-23T13:03:06.275 INFO:teuthology.orchestra.run.trial046.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2026-02-23T13:03:06.275 INFO:teuthology.orchestra.run.trial046.stdout: "log_flush_on_exit": "false", 2026-02-23T13:03:06.275 INFO:teuthology.orchestra.run.trial046.stdout: "log_graylog_host": "127.0.0.1", 2026-02-23T13:03:06.275 INFO:teuthology.orchestra.run.trial046.stdout: "log_graylog_port": "12201", 2026-02-23T13:03:06.276 INFO:teuthology.orchestra.run.trial046.stdout: "log_max_new": "1000", 2026-02-23T13:03:06.276 INFO:teuthology.orchestra.run.trial046.stdout: "log_max_recent": "10000", 2026-02-23T13:03:06.276 INFO:teuthology.orchestra.run.trial046.stdout: "log_stderr_prefix": "", 2026-02-23T13:03:06.276 INFO:teuthology.orchestra.run.trial046.stdout: "log_stop_at_utilization": "0.970000", 2026-02-23T13:03:06.276 INFO:teuthology.orchestra.run.trial046.stdout: "log_to_file": "true", 2026-02-23T13:03:06.276 INFO:teuthology.orchestra.run.trial046.stdout: "log_to_graylog": "false", 2026-02-23T13:03:06.276 INFO:teuthology.orchestra.run.trial046.stdout: "log_to_journald": "false", 2026-02-23T13:03:06.276 INFO:teuthology.orchestra.run.trial046.stdout: "log_to_stderr": "false", 2026-02-23T13:03:06.276 INFO:teuthology.orchestra.run.trial046.stdout: "log_to_syslog": "false", 2026-02-23T13:03:06.276 INFO:teuthology.orchestra.run.trial046.stdout: "max_rotating_auth_attempts": "10", 2026-02-23T13:03:06.276 INFO:teuthology.orchestra.run.trial046.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2026-02-23T13:03:06.276 INFO:teuthology.orchestra.run.trial046.stdout: "mds_action_on_write_error": "1", 2026-02-23T13:03:06.276 INFO:teuthology.orchestra.run.trial046.stdout: "mds_allow_async_dirops": "true", 2026-02-23T13:03:06.276 INFO:teuthology.orchestra.run.trial046.stdout: "mds_allow_batched_ops": "true", 2026-02-23T13:03:06.276 INFO:teuthology.orchestra.run.trial046.stdout: "mds_alternate_name_max": "8192", 2026-02-23T13:03:06.276 INFO:teuthology.orchestra.run.trial046.stdout: "mds_asio_thread_count": "2", 2026-02-23T13:03:06.276 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_export_pin": "true", 2026-02-23T13:03:06.276 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_fragment_dirs": "true", 2026-02-23T13:03:06.276 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2026-02-23T13:03:06.277 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_fragment_interval": "5", 2026-02-23T13:03:06.277 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_fragment_size_max": "100000", 2026-02-23T13:03:06.277 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_idle_threshold": "0.000000", 2026-02-23T13:03:06.277 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_interval": "10", 2026-02-23T13:03:06.277 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_max": "-1", 2026-02-23T13:03:06.277 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_max_until": "-1", 2026-02-23T13:03:06.277 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_merge_size": "50", 2026-02-23T13:03:06.277 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_midchunk": "0.300000", 2026-02-23T13:03:06.277 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_min_rebalance": "0.100000", 2026-02-23T13:03:06.277 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_min_start": "0.200000", 2026-02-23T13:03:06.277 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_minchunk": "0.001000", 2026-02-23T13:03:06.277 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_mode": "0", 2026-02-23T13:03:06.277 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_need_max": "1.200000", 2026-02-23T13:03:06.277 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_need_min": "0.800000", 2026-02-23T13:03:06.277 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_overload_epochs": "2", 2026-02-23T13:03:06.277 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_replicate_threshold": "8000.000000", 2026-02-23T13:03:06.277 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_sample_interval": "3.000000", 2026-02-23T13:03:06.277 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_split_bits": "3", 2026-02-23T13:03:06.277 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_split_rd": "25000.000000", 2026-02-23T13:03:06.277 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_split_size": "10000", 2026-02-23T13:03:06.278 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_split_wr": "10000.000000", 2026-02-23T13:03:06.278 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_target_decay": "10.000000", 2026-02-23T13:03:06.278 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2026-02-23T13:03:06.278 INFO:teuthology.orchestra.run.trial046.stdout: "mds_beacon_grace": "15.000000", 2026-02-23T13:03:06.278 INFO:teuthology.orchestra.run.trial046.stdout: "mds_beacon_interval": "4.000000", 2026-02-23T13:03:06.278 INFO:teuthology.orchestra.run.trial046.stdout: "mds_beacon_mon_down_grace": "60", 2026-02-23T13:03:06.278 INFO:teuthology.orchestra.run.trial046.stdout: "mds_cache_memory_limit": "4294967296", 2026-02-23T13:03:06.278 INFO:teuthology.orchestra.run.trial046.stdout: "mds_cache_mid": "0.700000", 2026-02-23T13:03:06.278 INFO:teuthology.orchestra.run.trial046.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2026-02-23T13:03:06.278 INFO:teuthology.orchestra.run.trial046.stdout: "mds_cache_quiesce_delay": "0", 2026-02-23T13:03:06.278 INFO:teuthology.orchestra.run.trial046.stdout: "mds_cache_quiesce_sleep": "200", 2026-02-23T13:03:06.278 INFO:teuthology.orchestra.run.trial046.stdout: "mds_cache_quiesce_splitauth": "true", 2026-02-23T13:03:06.278 INFO:teuthology.orchestra.run.trial046.stdout: "mds_cache_quiesce_threshold": "524288", 2026-02-23T13:03:06.278 INFO:teuthology.orchestra.run.trial046.stdout: "mds_cache_release_free_interval": "10", 2026-02-23T13:03:06.278 INFO:teuthology.orchestra.run.trial046.stdout: "mds_cache_reservation": "0.050000", 2026-02-23T13:03:06.278 INFO:teuthology.orchestra.run.trial046.stdout: "mds_cache_trim_decay_rate": "1.000000", 2026-02-23T13:03:06.278 INFO:teuthology.orchestra.run.trial046.stdout: "mds_cache_trim_interval": "1", 2026-02-23T13:03:06.278 INFO:teuthology.orchestra.run.trial046.stdout: "mds_cache_trim_threshold": "262144", 2026-02-23T13:03:06.278 INFO:teuthology.orchestra.run.trial046.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2026-02-23T13:03:06.278 INFO:teuthology.orchestra.run.trial046.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2026-02-23T13:03:06.278 INFO:teuthology.orchestra.run.trial046.stdout: "mds_client_delegate_inos_pct": "50", 2026-02-23T13:03:06.279 INFO:teuthology.orchestra.run.trial046.stdout: "mds_client_prealloc_inos": "1000", 2026-02-23T13:03:06.279 INFO:teuthology.orchestra.run.trial046.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2026-02-23T13:03:06.279 INFO:teuthology.orchestra.run.trial046.stdout: "mds_connect_bootstrapping": "false", 2026-02-23T13:03:06.279 INFO:teuthology.orchestra.run.trial046.stdout: "mds_damage_table_max_entries": "10000", 2026-02-23T13:03:06.279 INFO:teuthology.orchestra.run.trial046.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2026-02-23T13:03:06.279 INFO:teuthology.orchestra.run.trial046.stdout: "mds_debug_auth_pins": "false", 2026-02-23T13:03:06.279 INFO:teuthology.orchestra.run.trial046.stdout: "mds_debug_frag": "false", 2026-02-23T13:03:06.279 INFO:teuthology.orchestra.run.trial046.stdout: "mds_debug_scatterstat": "false", 2026-02-23T13:03:06.279 INFO:teuthology.orchestra.run.trial046.stdout: "mds_debug_subtrees": "false", 2026-02-23T13:03:06.279 INFO:teuthology.orchestra.run.trial046.stdout: "mds_decay_halflife": "5.000000", 2026-02-23T13:03:06.279 INFO:teuthology.orchestra.run.trial046.stdout: "mds_default_dir_hash": "2", 2026-02-23T13:03:06.279 INFO:teuthology.orchestra.run.trial046.stdout: "mds_defer_session_stale": "true", 2026-02-23T13:03:06.279 INFO:teuthology.orchestra.run.trial046.stdout: "mds_delay_journal_replay_for_testing": "0", 2026-02-23T13:03:06.279 INFO:teuthology.orchestra.run.trial046.stdout: "mds_deny_all_reconnect": "false", 2026-02-23T13:03:06.279 INFO:teuthology.orchestra.run.trial046.stdout: "mds_dir_keys_per_op": "16384", 2026-02-23T13:03:06.279 INFO:teuthology.orchestra.run.trial046.stdout: "mds_dir_max_commit_size": "10", 2026-02-23T13:03:06.279 INFO:teuthology.orchestra.run.trial046.stdout: "mds_dir_max_entries": "0", 2026-02-23T13:03:06.279 INFO:teuthology.orchestra.run.trial046.stdout: "mds_dir_prefetch": "true", 2026-02-23T13:03:06.279 INFO:teuthology.orchestra.run.trial046.stdout: "mds_dirstat_min_interval": "1.000000", 2026-02-23T13:03:06.279 INFO:teuthology.orchestra.run.trial046.stdout: "mds_dump_cache_after_rejoin": "false", 2026-02-23T13:03:06.279 INFO:teuthology.orchestra.run.trial046.stdout: "mds_dump_cache_on_map": "false", 2026-02-23T13:03:06.279 INFO:teuthology.orchestra.run.trial046.stdout: "mds_dump_cache_threshold_file": "0", 2026-02-23T13:03:06.280 INFO:teuthology.orchestra.run.trial046.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2026-02-23T13:03:06.280 INFO:teuthology.orchestra.run.trial046.stdout: "mds_early_reply": "true", 2026-02-23T13:03:06.280 INFO:teuthology.orchestra.run.trial046.stdout: "mds_enable_op_tracker": "true", 2026-02-23T13:03:06.280 INFO:teuthology.orchestra.run.trial046.stdout: "mds_enforce_unique_name": "true", 2026-02-23T13:03:06.280 INFO:teuthology.orchestra.run.trial046.stdout: "mds_export_ephemeral_distributed": "true", 2026-02-23T13:03:06.280 INFO:teuthology.orchestra.run.trial046.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2026-02-23T13:03:06.280 INFO:teuthology.orchestra.run.trial046.stdout: "mds_export_ephemeral_random": "true", 2026-02-23T13:03:06.280 INFO:teuthology.orchestra.run.trial046.stdout: "mds_export_ephemeral_random_max": "0.010000", 2026-02-23T13:03:06.280 INFO:teuthology.orchestra.run.trial046.stdout: "mds_extraordinary_events_dump_interval": "0", 2026-02-23T13:03:06.280 INFO:teuthology.orchestra.run.trial046.stdout: "mds_file_blockdiff_max_concurrent_object_scans": "16", 2026-02-23T13:03:06.280 INFO:teuthology.orchestra.run.trial046.stdout: "mds_forward_all_requests_to_auth": "false", 2026-02-23T13:03:06.280 INFO:teuthology.orchestra.run.trial046.stdout: "mds_freeze_tree_timeout": "30.000000", 2026-02-23T13:03:06.280 INFO:teuthology.orchestra.run.trial046.stdout: "mds_fscrypt_last_block_max_size": "4096", 2026-02-23T13:03:06.280 INFO:teuthology.orchestra.run.trial046.stdout: "mds_go_bad_corrupt_dentry": "true", 2026-02-23T13:03:06.280 INFO:teuthology.orchestra.run.trial046.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2026-02-23T13:03:06.280 INFO:teuthology.orchestra.run.trial046.stdout: "mds_health_cache_threshold": "1.500000", 2026-02-23T13:03:06.280 INFO:teuthology.orchestra.run.trial046.stdout: "mds_health_summarize_threshold": "10", 2026-02-23T13:03:06.280 INFO:teuthology.orchestra.run.trial046.stdout: "mds_heartbeat_grace": "15.000000", 2026-02-23T13:03:06.280 INFO:teuthology.orchestra.run.trial046.stdout: "mds_heartbeat_reset_grace": "1000", 2026-02-23T13:03:06.280 INFO:teuthology.orchestra.run.trial046.stdout: "mds_inject_health_dummy": "false", 2026-02-23T13:03:06.280 INFO:teuthology.orchestra.run.trial046.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2026-02-23T13:03:06.281 INFO:teuthology.orchestra.run.trial046.stdout: "mds_inject_migrator_session_race": "false", 2026-02-23T13:03:06.281 INFO:teuthology.orchestra.run.trial046.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2026-02-23T13:03:06.281 INFO:teuthology.orchestra.run.trial046.stdout: "mds_inject_skip_replaying_inotable": "false", 2026-02-23T13:03:06.281 INFO:teuthology.orchestra.run.trial046.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2026-02-23T13:03:06.281 INFO:teuthology.orchestra.run.trial046.stdout: "mds_join_fs": "", 2026-02-23T13:03:06.281 INFO:teuthology.orchestra.run.trial046.stdout: "mds_journal_format": "1", 2026-02-23T13:03:06.281 INFO:teuthology.orchestra.run.trial046.stdout: "mds_kill_after_journal_logs_flushed": "false", 2026-02-23T13:03:06.281 INFO:teuthology.orchestra.run.trial046.stdout: "mds_kill_create_at": "0", 2026-02-23T13:03:06.281 INFO:teuthology.orchestra.run.trial046.stdout: "mds_kill_dirfrag_at": "0", 2026-02-23T13:03:06.281 INFO:teuthology.orchestra.run.trial046.stdout: "mds_kill_export_at": "0", 2026-02-23T13:03:06.281 INFO:teuthology.orchestra.run.trial046.stdout: "mds_kill_import_at": "0", 2026-02-23T13:03:06.281 INFO:teuthology.orchestra.run.trial046.stdout: "mds_kill_journal_at": "0", 2026-02-23T13:03:06.281 INFO:teuthology.orchestra.run.trial046.stdout: "mds_kill_journal_expire_at": "0", 2026-02-23T13:03:06.281 INFO:teuthology.orchestra.run.trial046.stdout: "mds_kill_journal_replay_at": "0", 2026-02-23T13:03:06.281 INFO:teuthology.orchestra.run.trial046.stdout: "mds_kill_link_at": "0", 2026-02-23T13:03:06.281 INFO:teuthology.orchestra.run.trial046.stdout: "mds_kill_mdstable_at": "0", 2026-02-23T13:03:06.281 INFO:teuthology.orchestra.run.trial046.stdout: "mds_kill_openc_at": "0", 2026-02-23T13:03:06.281 INFO:teuthology.orchestra.run.trial046.stdout: "mds_kill_rename_at": "0", 2026-02-23T13:03:06.281 INFO:teuthology.orchestra.run.trial046.stdout: "mds_kill_shutdown_at": "0", 2026-02-23T13:03:06.281 INFO:teuthology.orchestra.run.trial046.stdout: "mds_log_event_large_threshold": "524288", 2026-02-23T13:03:06.281 INFO:teuthology.orchestra.run.trial046.stdout: "mds_log_events_per_segment": "1024", 2026-02-23T13:03:06.281 INFO:teuthology.orchestra.run.trial046.stdout: "mds_log_max_events": "-1", 2026-02-23T13:03:06.281 INFO:teuthology.orchestra.run.trial046.stdout: "mds_log_max_segments": "128", 2026-02-23T13:03:06.282 INFO:teuthology.orchestra.run.trial046.stdout: "mds_log_minor_segments_per_major_segment": "16", 2026-02-23T13:03:06.282 INFO:teuthology.orchestra.run.trial046.stdout: "mds_log_pause": "false", 2026-02-23T13:03:06.282 INFO:teuthology.orchestra.run.trial046.stdout: "mds_log_segment_size": "0", 2026-02-23T13:03:06.282 INFO:teuthology.orchestra.run.trial046.stdout: "mds_log_skip_corrupt_events": "false", 2026-02-23T13:03:06.282 INFO:teuthology.orchestra.run.trial046.stdout: "mds_log_skip_unbounded_events": "false", 2026-02-23T13:03:06.282 INFO:teuthology.orchestra.run.trial046.stdout: "mds_log_trim_decay_rate": "1.000000", 2026-02-23T13:03:06.282 INFO:teuthology.orchestra.run.trial046.stdout: "mds_log_trim_threshold": "128", 2026-02-23T13:03:06.282 INFO:teuthology.orchestra.run.trial046.stdout: "mds_log_trim_upkeep_interval": "1000", 2026-02-23T13:03:06.282 INFO:teuthology.orchestra.run.trial046.stdout: "mds_log_warn_factor": "2.000000", 2026-02-23T13:03:06.282 INFO:teuthology.orchestra.run.trial046.stdout: "mds_max_caps_per_client": "1048576", 2026-02-23T13:03:06.282 INFO:teuthology.orchestra.run.trial046.stdout: "mds_max_completed_flushes": "100000", 2026-02-23T13:03:06.282 INFO:teuthology.orchestra.run.trial046.stdout: "mds_max_completed_requests": "100000", 2026-02-23T13:03:06.282 INFO:teuthology.orchestra.run.trial046.stdout: "mds_max_export_size": "20971520", 2026-02-23T13:03:06.282 INFO:teuthology.orchestra.run.trial046.stdout: "mds_max_file_recover": "32", 2026-02-23T13:03:06.282 INFO:teuthology.orchestra.run.trial046.stdout: "mds_max_purge_files": "64", 2026-02-23T13:03:06.282 INFO:teuthology.orchestra.run.trial046.stdout: "mds_max_purge_ops": "8192", 2026-02-23T13:03:06.282 INFO:teuthology.orchestra.run.trial046.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2026-02-23T13:03:06.282 INFO:teuthology.orchestra.run.trial046.stdout: "mds_max_scrub_ops_in_progress": "5", 2026-02-23T13:03:06.282 INFO:teuthology.orchestra.run.trial046.stdout: "mds_max_snaps_per_dir": "100", 2026-02-23T13:03:06.282 INFO:teuthology.orchestra.run.trial046.stdout: "mds_metrics_update_interval": "2", 2026-02-23T13:03:06.282 INFO:teuthology.orchestra.run.trial046.stdout: "mds_min_caps_per_client": "100", 2026-02-23T13:03:06.282 INFO:teuthology.orchestra.run.trial046.stdout: "mds_min_caps_working_set": "10000", 2026-02-23T13:03:06.282 INFO:teuthology.orchestra.run.trial046.stdout: "mds_mon_shutdown_timeout": "5.000000", 2026-02-23T13:03:06.283 INFO:teuthology.orchestra.run.trial046.stdout: "mds_numa_node": "-1", 2026-02-23T13:03:06.283 INFO:teuthology.orchestra.run.trial046.stdout: "mds_oft_prefetch_dirfrags": "false", 2026-02-23T13:03:06.283 INFO:teuthology.orchestra.run.trial046.stdout: "mds_op_complaint_time": "30.000000", 2026-02-23T13:03:06.283 INFO:teuthology.orchestra.run.trial046.stdout: "mds_op_history_duration": "600", 2026-02-23T13:03:06.283 INFO:teuthology.orchestra.run.trial046.stdout: "mds_op_history_size": "20", 2026-02-23T13:03:06.283 INFO:teuthology.orchestra.run.trial046.stdout: "mds_op_history_slow_op_size": "20", 2026-02-23T13:03:06.283 INFO:teuthology.orchestra.run.trial046.stdout: "mds_op_history_slow_op_threshold": "10", 2026-02-23T13:03:06.283 INFO:teuthology.orchestra.run.trial046.stdout: "mds_op_log_threshold": "5", 2026-02-23T13:03:06.283 INFO:teuthology.orchestra.run.trial046.stdout: "mds_ping_grace": "15", 2026-02-23T13:03:06.283 INFO:teuthology.orchestra.run.trial046.stdout: "mds_ping_interval": "5", 2026-02-23T13:03:06.283 INFO:teuthology.orchestra.run.trial046.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2026-02-23T13:03:06.283 INFO:teuthology.orchestra.run.trial046.stdout: "mds_recall_global_max_decay_threshold": "131072", 2026-02-23T13:03:06.283 INFO:teuthology.orchestra.run.trial046.stdout: "mds_recall_max_caps": "30000", 2026-02-23T13:03:06.283 INFO:teuthology.orchestra.run.trial046.stdout: "mds_recall_max_decay_rate": "1.500000", 2026-02-23T13:03:06.283 INFO:teuthology.orchestra.run.trial046.stdout: "mds_recall_max_decay_threshold": "131072", 2026-02-23T13:03:06.283 INFO:teuthology.orchestra.run.trial046.stdout: "mds_recall_warning_decay_rate": "60.000000", 2026-02-23T13:03:06.283 INFO:teuthology.orchestra.run.trial046.stdout: "mds_recall_warning_threshold": "262144", 2026-02-23T13:03:06.283 INFO:teuthology.orchestra.run.trial046.stdout: "mds_reconnect_timeout": "45.000000", 2026-02-23T13:03:06.283 INFO:teuthology.orchestra.run.trial046.stdout: "mds_replay_interval": "1.000000", 2026-02-23T13:03:06.283 INFO:teuthology.orchestra.run.trial046.stdout: "mds_replay_unsafe_with_closed_session": "false", 2026-02-23T13:03:06.283 INFO:teuthology.orchestra.run.trial046.stdout: "mds_request_load_average_decay_rate": "60.000000", 2026-02-23T13:03:06.284 INFO:teuthology.orchestra.run.trial046.stdout: "mds_root_ino_gid": "0", 2026-02-23T13:03:06.284 INFO:teuthology.orchestra.run.trial046.stdout: "mds_root_ino_uid": "0", 2026-02-23T13:03:06.284 INFO:teuthology.orchestra.run.trial046.stdout: "mds_scatter_nudge_interval": "5.000000", 2026-02-23T13:03:06.284 INFO:teuthology.orchestra.run.trial046.stdout: "mds_scrub_stats_review_period": "1", 2026-02-23T13:03:06.284 INFO:teuthology.orchestra.run.trial046.stdout: "mds_server_dispatch_client_request_delay": "0", 2026-02-23T13:03:06.284 INFO:teuthology.orchestra.run.trial046.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2026-02-23T13:03:06.284 INFO:teuthology.orchestra.run.trial046.stdout: "mds_session_blocklist_on_evict": "true", 2026-02-23T13:03:06.284 INFO:teuthology.orchestra.run.trial046.stdout: "mds_session_blocklist_on_timeout": "true", 2026-02-23T13:03:06.284 INFO:teuthology.orchestra.run.trial046.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2026-02-23T13:03:06.284 INFO:teuthology.orchestra.run.trial046.stdout: "mds_session_cache_liveness_magnitude": "10", 2026-02-23T13:03:06.284 INFO:teuthology.orchestra.run.trial046.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2026-02-23T13:03:06.284 INFO:teuthology.orchestra.run.trial046.stdout: "mds_session_cap_acquisition_throttle": "100000", 2026-02-23T13:03:06.284 INFO:teuthology.orchestra.run.trial046.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2026-02-23T13:03:06.284 INFO:teuthology.orchestra.run.trial046.stdout: "mds_session_metadata_threshold": "16777216", 2026-02-23T13:03:06.284 INFO:teuthology.orchestra.run.trial046.stdout: "mds_sessionmap_keys_per_op": "1024", 2026-02-23T13:03:06.284 INFO:teuthology.orchestra.run.trial046.stdout: "mds_shutdown_check": "0", 2026-02-23T13:03:06.284 INFO:teuthology.orchestra.run.trial046.stdout: "mds_skip_ino": "0", 2026-02-23T13:03:06.284 INFO:teuthology.orchestra.run.trial046.stdout: "mds_sleep_rank_change": "0.000000", 2026-02-23T13:03:06.284 INFO:teuthology.orchestra.run.trial046.stdout: "mds_snap_max_uid": "4294967294", 2026-02-23T13:03:06.284 INFO:teuthology.orchestra.run.trial046.stdout: "mds_snap_min_uid": "0", 2026-02-23T13:03:06.284 INFO:teuthology.orchestra.run.trial046.stdout: "mds_snap_rstat": "false", 2026-02-23T13:03:06.285 INFO:teuthology.orchestra.run.trial046.stdout: "mds_standby_replay_damaged": "false", 2026-02-23T13:03:06.285 INFO:teuthology.orchestra.run.trial046.stdout: "mds_symlink_recovery": "true", 2026-02-23T13:03:06.285 INFO:teuthology.orchestra.run.trial046.stdout: "mds_task_status_update_interval": "2.000000", 2026-02-23T13:03:06.285 INFO:teuthology.orchestra.run.trial046.stdout: "mds_thrash_exports": "0", 2026-02-23T13:03:06.285 INFO:teuthology.orchestra.run.trial046.stdout: "mds_thrash_fragments": "0", 2026-02-23T13:03:06.285 INFO:teuthology.orchestra.run.trial046.stdout: "mds_tick_interval": "5.000000", 2026-02-23T13:03:06.285 INFO:teuthology.orchestra.run.trial046.stdout: "mds_use_global_snaprealm_seq_for_subvol": "true", 2026-02-23T13:03:06.285 INFO:teuthology.orchestra.run.trial046.stdout: "mds_valgrind_exit": "false", 2026-02-23T13:03:06.285 INFO:teuthology.orchestra.run.trial046.stdout: "mds_verify_backtrace": "1", 2026-02-23T13:03:06.285 INFO:teuthology.orchestra.run.trial046.stdout: "mds_verify_scatter": "false", 2026-02-23T13:03:06.285 INFO:teuthology.orchestra.run.trial046.stdout: "mds_wipe_ino_prealloc": "false", 2026-02-23T13:03:06.285 INFO:teuthology.orchestra.run.trial046.stdout: "mds_wipe_sessions": "false", 2026-02-23T13:03:06.285 INFO:teuthology.orchestra.run.trial046.stdout: "mempool_debug": "false", 2026-02-23T13:03:06.285 INFO:teuthology.orchestra.run.trial046.stdout: "memstore_debug_omit_block_device_write": "false", 2026-02-23T13:03:06.285 INFO:teuthology.orchestra.run.trial046.stdout: "memstore_device_bytes": "1073741824", 2026-02-23T13:03:06.285 INFO:teuthology.orchestra.run.trial046.stdout: "memstore_page_set": "false", 2026-02-23T13:03:06.285 INFO:teuthology.orchestra.run.trial046.stdout: "memstore_page_size": "65536", 2026-02-23T13:03:06.285 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_client_bytes": "134217728", 2026-02-23T13:03:06.285 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_client_messages": "512", 2026-02-23T13:03:06.285 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2026-02-23T13:03:06.285 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_connect_retry_interval": "1.000000", 2026-02-23T13:03:06.285 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2026-02-23T13:03:06.285 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2026-02-23T13:03:06.286 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_disabled_modules": "", 2026-02-23T13:03:06.286 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_enable_op_tracker": "true", 2026-02-23T13:03:06.286 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_initial_modules": "iostat nfs", 2026-02-23T13:03:06.286 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_max_pg_creating": "1024", 2026-02-23T13:03:06.286 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_max_pg_num_change": "128", 2026-02-23T13:03:06.286 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_mds_bytes": "134217728", 2026-02-23T13:03:06.286 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_mds_messages": "128", 2026-02-23T13:03:06.286 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2026-02-23T13:03:06.286 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_mon_bytes": "134217728", 2026-02-23T13:03:06.286 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_mon_messages": "128", 2026-02-23T13:03:06.286 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_num_op_tracker_shard": "32", 2026-02-23T13:03:06.286 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_op_complaint_time": "30.000000", 2026-02-23T13:03:06.286 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_op_history_duration": "600", 2026-02-23T13:03:06.286 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_op_history_size": "20", 2026-02-23T13:03:06.286 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_op_history_slow_op_size": "20", 2026-02-23T13:03:06.286 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2026-02-23T13:03:06.286 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_op_log_threshold": "5", 2026-02-23T13:03:06.286 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_osd_bytes": "536870912", 2026-02-23T13:03:06.286 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_osd_messages": "8192", 2026-02-23T13:03:06.286 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_pool": "true", 2026-02-23T13:03:06.286 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_service_beacon_grace": "60.000000", 2026-02-23T13:03:06.286 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_standby_modules": "true", 2026-02-23T13:03:06.286 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_stats_period": "5", 2026-02-23T13:03:06.286 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_stats_threshold": "5", 2026-02-23T13:03:06.286 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_tick_period": "2", 2026-02-23T13:03:06.286 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_ttl_cache_expire_seconds": "0", 2026-02-23T13:03:06.287 INFO:teuthology.orchestra.run.trial046.stdout: "mon_accept_timeout_factor": "2.000000", 2026-02-23T13:03:06.287 INFO:teuthology.orchestra.run.trial046.stdout: "mon_allow_pool_delete": "true", 2026-02-23T13:03:06.287 INFO:teuthology.orchestra.run.trial046.stdout: "mon_allow_pool_size_one": "false", 2026-02-23T13:03:06.287 INFO:teuthology.orchestra.run.trial046.stdout: "mon_auth_validate_all_caps": "true", 2026-02-23T13:03:06.287 INFO:teuthology.orchestra.run.trial046.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2026-02-23T13:03:06.287 INFO:teuthology.orchestra.run.trial046.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2026-02-23T13:03:06.287 INFO:teuthology.orchestra.run.trial046.stdout: "mon_client_bytes": "104857600", 2026-02-23T13:03:06.287 INFO:teuthology.orchestra.run.trial046.stdout: "mon_client_directed_command_retry": "2", 2026-02-23T13:03:06.287 INFO:teuthology.orchestra.run.trial046.stdout: "mon_client_hunt_interval": "3.000000", 2026-02-23T13:03:06.287 INFO:teuthology.orchestra.run.trial046.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2026-02-23T13:03:06.287 INFO:teuthology.orchestra.run.trial046.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2026-02-23T13:03:06.287 INFO:teuthology.orchestra.run.trial046.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2026-02-23T13:03:06.287 INFO:teuthology.orchestra.run.trial046.stdout: "mon_client_hunt_on_resend": "true", 2026-02-23T13:03:06.287 INFO:teuthology.orchestra.run.trial046.stdout: "mon_client_hunt_parallel": "3", 2026-02-23T13:03:06.287 INFO:teuthology.orchestra.run.trial046.stdout: "mon_client_log_interval": "1.000000", 2026-02-23T13:03:06.287 INFO:teuthology.orchestra.run.trial046.stdout: "mon_client_max_log_entries_per_message": "1000", 2026-02-23T13:03:06.287 INFO:teuthology.orchestra.run.trial046.stdout: "mon_client_ping_interval": "10.000000", 2026-02-23T13:03:06.287 INFO:teuthology.orchestra.run.trial046.stdout: "mon_client_ping_timeout": "30.000000", 2026-02-23T13:03:06.287 INFO:teuthology.orchestra.run.trial046.stdout: "mon_client_target_rank": "-1", 2026-02-23T13:03:06.287 INFO:teuthology.orchestra.run.trial046.stdout: "mon_clock_drift_allowed": "1.000000", 2026-02-23T13:03:06.287 INFO:teuthology.orchestra.run.trial046.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2026-02-23T13:03:06.287 INFO:teuthology.orchestra.run.trial046.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2026-02-23T13:03:06.287 INFO:teuthology.orchestra.run.trial046.stdout: "mon_cluster_log_level": "debug", 2026-02-23T13:03:06.287 INFO:teuthology.orchestra.run.trial046.stdout: "mon_cluster_log_to_file": "true", 2026-02-23T13:03:06.287 INFO:teuthology.orchestra.run.trial046.stdout: "mon_cluster_log_to_graylog": "false", 2026-02-23T13:03:06.287 INFO:teuthology.orchestra.run.trial046.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2026-02-23T13:03:06.288 INFO:teuthology.orchestra.run.trial046.stdout: "mon_cluster_log_to_graylog_port": "12201", 2026-02-23T13:03:06.288 INFO:teuthology.orchestra.run.trial046.stdout: "mon_cluster_log_to_journald": "true", 2026-02-23T13:03:06.288 INFO:teuthology.orchestra.run.trial046.stdout: "mon_cluster_log_to_stderr": "false", 2026-02-23T13:03:06.288 INFO:teuthology.orchestra.run.trial046.stdout: "mon_cluster_log_to_syslog": "default=false", 2026-02-23T13:03:06.288 INFO:teuthology.orchestra.run.trial046.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2026-02-23T13:03:06.288 INFO:teuthology.orchestra.run.trial046.stdout: "mon_compact_on_bootstrap": "false", 2026-02-23T13:03:06.288 INFO:teuthology.orchestra.run.trial046.stdout: "mon_compact_on_start": "false", 2026-02-23T13:03:06.288 INFO:teuthology.orchestra.run.trial046.stdout: "mon_compact_on_trim": "true", 2026-02-23T13:03:06.288 INFO:teuthology.orchestra.run.trial046.stdout: "mon_con_tracker_persist_interval": "10", 2026-02-23T13:03:06.288 INFO:teuthology.orchestra.run.trial046.stdout: "mon_con_tracker_score_halflife": "43200", 2026-02-23T13:03:06.288 INFO:teuthology.orchestra.run.trial046.stdout: "mon_config_key_max_entry_size": "65536", 2026-02-23T13:03:06.288 INFO:teuthology.orchestra.run.trial046.stdout: "mon_cpu_threads": "4", 2026-02-23T13:03:06.288 INFO:teuthology.orchestra.run.trial046.stdout: "mon_crush_min_required_version": "hammer", 2026-02-23T13:03:06.288 INFO:teuthology.orchestra.run.trial046.stdout: "mon_daemon_bytes": "419430400", 2026-02-23T13:03:06.288 INFO:teuthology.orchestra.run.trial046.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2026-02-23T13:03:06.288 INFO:teuthology.orchestra.run.trial046.stdout: "mon_data_avail_crit": "5", 2026-02-23T13:03:06.288 INFO:teuthology.orchestra.run.trial046.stdout: "mon_data_avail_warn": "5", 2026-02-23T13:03:06.288 INFO:teuthology.orchestra.run.trial046.stdout: "mon_data_size_warn": "16106127360", 2026-02-23T13:03:06.288 INFO:teuthology.orchestra.run.trial046.stdout: "mon_debug_block_osdmap_trim": "false", 2026-02-23T13:03:06.288 INFO:teuthology.orchestra.run.trial046.stdout: "mon_debug_deprecated_as_obsolete": "false", 2026-02-23T13:03:06.288 INFO:teuthology.orchestra.run.trial046.stdout: "mon_debug_dump_json": "false", 2026-02-23T13:03:06.288 INFO:teuthology.orchestra.run.trial046.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2026-02-23T13:03:06.288 INFO:teuthology.orchestra.run.trial046.stdout: "mon_debug_dump_transactions": "false", 2026-02-23T13:03:06.288 INFO:teuthology.orchestra.run.trial046.stdout: "mon_debug_extra_checks": "false", 2026-02-23T13:03:06.288 INFO:teuthology.orchestra.run.trial046.stdout: "mon_debug_no_initial_persistent_features": "false", 2026-02-23T13:03:06.289 INFO:teuthology.orchestra.run.trial046.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2026-02-23T13:03:06.289 INFO:teuthology.orchestra.run.trial046.stdout: "mon_debug_no_require_squid": "false", 2026-02-23T13:03:06.289 INFO:teuthology.orchestra.run.trial046.stdout: "mon_debug_no_require_tentacle": "false", 2026-02-23T13:03:06.289 INFO:teuthology.orchestra.run.trial046.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2026-02-23T13:03:06.289 INFO:teuthology.orchestra.run.trial046.stdout: "mon_delta_reset_interval": "10.000000", 2026-02-23T13:03:06.289 INFO:teuthology.orchestra.run.trial046.stdout: "mon_dns_srv_name": "ceph-mon", 2026-02-23T13:03:06.289 INFO:teuthology.orchestra.run.trial046.stdout: "mon_down_added_grace": "180", 2026-02-23T13:03:06.289 INFO:teuthology.orchestra.run.trial046.stdout: "mon_down_mkfs_grace": "60", 2026-02-23T13:03:06.289 INFO:teuthology.orchestra.run.trial046.stdout: "mon_down_uptime_grace": "60", 2026-02-23T13:03:06.289 INFO:teuthology.orchestra.run.trial046.stdout: "mon_election_default_strategy": "1", 2026-02-23T13:03:06.289 INFO:teuthology.orchestra.run.trial046.stdout: "mon_election_timeout": "5.000000", 2026-02-23T13:03:06.289 INFO:teuthology.orchestra.run.trial046.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2026-02-23T13:03:06.289 INFO:teuthology.orchestra.run.trial046.stdout: "mon_elector_ping_divisor": "2", 2026-02-23T13:03:06.289 INFO:teuthology.orchestra.run.trial046.stdout: "mon_elector_ping_timeout": "2.000000", 2026-02-23T13:03:06.289 INFO:teuthology.orchestra.run.trial046.stdout: "mon_enable_op_tracker": "true", 2026-02-23T13:03:06.289 INFO:teuthology.orchestra.run.trial046.stdout: "mon_fake_pool_delete": "false", 2026-02-23T13:03:06.289 INFO:teuthology.orchestra.run.trial046.stdout: "mon_force_quorum_join": "false", 2026-02-23T13:03:06.289 INFO:teuthology.orchestra.run.trial046.stdout: "mon_fsmap_prune_threshold": "300", 2026-02-23T13:03:06.289 INFO:teuthology.orchestra.run.trial046.stdout: "mon_globalid_prealloc": "10000", 2026-02-23T13:03:06.289 INFO:teuthology.orchestra.run.trial046.stdout: "mon_health_detail_to_clog": "true", 2026-02-23T13:03:06.289 INFO:teuthology.orchestra.run.trial046.stdout: "mon_health_log_update_period": "5", 2026-02-23T13:03:06.289 INFO:teuthology.orchestra.run.trial046.stdout: "mon_health_max_detail": "50", 2026-02-23T13:03:06.289 INFO:teuthology.orchestra.run.trial046.stdout: "mon_health_to_clog": "true", 2026-02-23T13:03:06.289 INFO:teuthology.orchestra.run.trial046.stdout: "mon_health_to_clog_interval": "600", 2026-02-23T13:03:06.290 INFO:teuthology.orchestra.run.trial046.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2026-02-23T13:03:06.290 INFO:teuthology.orchestra.run.trial046.stdout: "mon_host": "[v2:10.20.193.46:3300/0,v1:10.20.193.46:6789/0]", 2026-02-23T13:03:06.290 INFO:teuthology.orchestra.run.trial046.stdout: "mon_host_override": "", 2026-02-23T13:03:06.290 INFO:teuthology.orchestra.run.trial046.stdout: "mon_initial_members": "", 2026-02-23T13:03:06.290 INFO:teuthology.orchestra.run.trial046.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2026-02-23T13:03:06.290 INFO:teuthology.orchestra.run.trial046.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2026-02-23T13:03:06.290 INFO:teuthology.orchestra.run.trial046.stdout: "mon_inject_transaction_delay_max": "10.000000", 2026-02-23T13:03:06.290 INFO:teuthology.orchestra.run.trial046.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2026-02-23T13:03:06.290 INFO:teuthology.orchestra.run.trial046.stdout: "mon_keyvaluedb": "rocksdb", 2026-02-23T13:03:06.290 INFO:teuthology.orchestra.run.trial046.stdout: "mon_lease": "5.000000", 2026-02-23T13:03:06.290 INFO:teuthology.orchestra.run.trial046.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2026-02-23T13:03:06.290 INFO:teuthology.orchestra.run.trial046.stdout: "mon_lease_renew_interval_factor": "0.600000", 2026-02-23T13:03:06.290 INFO:teuthology.orchestra.run.trial046.stdout: "mon_log_full_interval": "50", 2026-02-23T13:03:06.290 INFO:teuthology.orchestra.run.trial046.stdout: "mon_log_max": "10000", 2026-02-23T13:03:06.290 INFO:teuthology.orchestra.run.trial046.stdout: "mon_log_max_summary": "50", 2026-02-23T13:03:06.290 INFO:teuthology.orchestra.run.trial046.stdout: "mon_max_log_entries_per_event": "4096", 2026-02-23T13:03:06.290 INFO:teuthology.orchestra.run.trial046.stdout: "mon_max_log_epochs": "500", 2026-02-23T13:03:06.290 INFO:teuthology.orchestra.run.trial046.stdout: "mon_max_mdsmap_epochs": "500", 2026-02-23T13:03:06.290 INFO:teuthology.orchestra.run.trial046.stdout: "mon_max_mgrmap_epochs": "500", 2026-02-23T13:03:06.290 INFO:teuthology.orchestra.run.trial046.stdout: "mon_max_nvmeof_epochs": "500", 2026-02-23T13:03:06.290 INFO:teuthology.orchestra.run.trial046.stdout: "mon_max_osd": "10000", 2026-02-23T13:03:06.290 INFO:teuthology.orchestra.run.trial046.stdout: "mon_max_pg_per_osd": "10000", 2026-02-23T13:03:06.290 INFO:teuthology.orchestra.run.trial046.stdout: "mon_max_pool_pg_num": "65536", 2026-02-23T13:03:06.290 INFO:teuthology.orchestra.run.trial046.stdout: "mon_max_snap_prune_per_epoch": "100", 2026-02-23T13:03:06.290 INFO:teuthology.orchestra.run.trial046.stdout: "mon_mds_blocklist_interval": "86400.000000", 2026-02-23T13:03:06.290 INFO:teuthology.orchestra.run.trial046.stdout: "mon_mds_force_trim_to": "0", 2026-02-23T13:03:06.291 INFO:teuthology.orchestra.run.trial046.stdout: "mon_mds_skip_sanity": "false", 2026-02-23T13:03:06.291 INFO:teuthology.orchestra.run.trial046.stdout: "mon_memory_autotune": "true", 2026-02-23T13:03:06.291 INFO:teuthology.orchestra.run.trial046.stdout: "mon_memory_target": "2147483648", 2026-02-23T13:03:06.291 INFO:teuthology.orchestra.run.trial046.stdout: "mon_mgr_beacon_grace": "30", 2026-02-23T13:03:06.291 INFO:teuthology.orchestra.run.trial046.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2026-02-23T13:03:06.291 INFO:teuthology.orchestra.run.trial046.stdout: "mon_mgr_digest_period": "5", 2026-02-23T13:03:06.291 INFO:teuthology.orchestra.run.trial046.stdout: "mon_mgr_inactive_grace": "60", 2026-02-23T13:03:06.291 INFO:teuthology.orchestra.run.trial046.stdout: "mon_mgr_mkfs_grace": "240", 2026-02-23T13:03:06.291 INFO:teuthology.orchestra.run.trial046.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2026-02-23T13:03:06.291 INFO:teuthology.orchestra.run.trial046.stdout: "mon_min_osdmap_epochs": "50", 2026-02-23T13:03:06.291 INFO:teuthology.orchestra.run.trial046.stdout: "mon_netsplit_grace_period": "9", 2026-02-23T13:03:06.291 INFO:teuthology.orchestra.run.trial046.stdout: "mon_nvmeofgw_beacon_grace": "7", 2026-02-23T13:03:06.291 INFO:teuthology.orchestra.run.trial046.stdout: "mon_nvmeofgw_beacons_till_ack": "15", 2026-02-23T13:03:06.291 INFO:teuthology.orchestra.run.trial046.stdout: "mon_nvmeofgw_delete_grace": "900", 2026-02-23T13:03:06.291 INFO:teuthology.orchestra.run.trial046.stdout: "mon_nvmeofgw_set_group_id_retry": "1000", 2026-02-23T13:03:06.291 INFO:teuthology.orchestra.run.trial046.stdout: "mon_nvmeofgw_skip_failovers_interval": "16", 2026-02-23T13:03:06.291 INFO:teuthology.orchestra.run.trial046.stdout: "mon_nvmeofgw_wrong_map_ignore_sec": "15", 2026-02-23T13:03:06.291 INFO:teuthology.orchestra.run.trial046.stdout: "mon_op_complaint_time": "30", 2026-02-23T13:03:06.291 INFO:teuthology.orchestra.run.trial046.stdout: "mon_op_history_duration": "600", 2026-02-23T13:03:06.291 INFO:teuthology.orchestra.run.trial046.stdout: "mon_op_history_size": "20", 2026-02-23T13:03:06.291 INFO:teuthology.orchestra.run.trial046.stdout: "mon_op_history_slow_op_size": "20", 2026-02-23T13:03:06.291 INFO:teuthology.orchestra.run.trial046.stdout: "mon_op_history_slow_op_threshold": "10", 2026-02-23T13:03:06.291 INFO:teuthology.orchestra.run.trial046.stdout: "mon_op_log_threshold": "5", 2026-02-23T13:03:06.291 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_adjust_down_out_interval": "true", 2026-02-23T13:03:06.291 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2026-02-23T13:03:06.291 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2026-02-23T13:03:06.291 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_auto_mark_in": "false", 2026-02-23T13:03:06.292 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_auto_mark_new_in": "true", 2026-02-23T13:03:06.292 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2026-02-23T13:03:06.292 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2026-02-23T13:03:06.292 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_cache_size": "500", 2026-02-23T13:03:06.292 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_cache_size_min": "134217728", 2026-02-23T13:03:06.292 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_crush_smoke_test": "true", 2026-02-23T13:03:06.292 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_destroyed_out_interval": "600", 2026-02-23T13:03:06.292 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_down_out_interval": "600", 2026-02-23T13:03:06.292 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_down_out_subtree_limit": "rack", 2026-02-23T13:03:06.292 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2026-02-23T13:03:06.292 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_force_trim_to": "0", 2026-02-23T13:03:06.292 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_full_ratio": "0.950000", 2026-02-23T13:03:06.292 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2026-02-23T13:03:06.292 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_laggy_halflife": "3600", 2026-02-23T13:03:06.292 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_laggy_max_interval": "300", 2026-02-23T13:03:06.292 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_laggy_weight": "0.300000", 2026-02-23T13:03:06.292 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2026-02-23T13:03:06.292 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_max_initial_pgs": "1024", 2026-02-23T13:03:06.292 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_min_down_reporters": "2", 2026-02-23T13:03:06.292 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_min_in_ratio": "0.750000", 2026-02-23T13:03:06.292 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_min_up_ratio": "0.300000", 2026-02-23T13:03:06.292 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_nearfull_ratio": "0.850000", 2026-02-23T13:03:06.292 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_prime_pg_temp": "true", 2026-02-23T13:03:06.292 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2026-02-23T13:03:06.292 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2026-02-23T13:03:06.292 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_report_timeout": "900", 2026-02-23T13:03:06.292 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_reporter_subtree_level": "osd", 2026-02-23T13:03:06.292 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2026-02-23T13:03:06.293 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_warn_num_repaired": "10", 2026-02-23T13:03:06.293 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_warn_op_age": "32.000000", 2026-02-23T13:03:06.293 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osdmap_full_prune_enabled": "true", 2026-02-23T13:03:06.293 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osdmap_full_prune_interval": "2", 2026-02-23T13:03:06.293 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osdmap_full_prune_min": "15", 2026-02-23T13:03:06.293 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osdmap_full_prune_txsize": "2", 2026-02-23T13:03:06.293 INFO:teuthology.orchestra.run.trial046.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2026-02-23T13:03:06.293 INFO:teuthology.orchestra.run.trial046.stdout: "mon_pg_stuck_threshold": "60", 2026-02-23T13:03:06.293 INFO:teuthology.orchestra.run.trial046.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2026-02-23T13:03:06.293 INFO:teuthology.orchestra.run.trial046.stdout: "mon_pg_warn_min_objects": "10000", 2026-02-23T13:03:06.293 INFO:teuthology.orchestra.run.trial046.stdout: "mon_pg_warn_min_per_osd": "0", 2026-02-23T13:03:06.293 INFO:teuthology.orchestra.run.trial046.stdout: "mon_pg_warn_min_pool_objects": "1000", 2026-02-23T13:03:06.293 INFO:teuthology.orchestra.run.trial046.stdout: "mon_pool_quota_crit_threshold": "0", 2026-02-23T13:03:06.293 INFO:teuthology.orchestra.run.trial046.stdout: "mon_pool_quota_warn_threshold": "0", 2026-02-23T13:03:06.293 INFO:teuthology.orchestra.run.trial046.stdout: "mon_probe_timeout": "2.000000", 2026-02-23T13:03:06.293 INFO:teuthology.orchestra.run.trial046.stdout: "mon_reweight_max_change": "0.050000", 2026-02-23T13:03:06.293 INFO:teuthology.orchestra.run.trial046.stdout: "mon_reweight_max_osds": "4", 2026-02-23T13:03:06.293 INFO:teuthology.orchestra.run.trial046.stdout: "mon_reweight_min_bytes_per_osd": "10", 2026-02-23T13:03:06.293 INFO:teuthology.orchestra.run.trial046.stdout: "mon_reweight_min_pgs_per_osd": "4", 2026-02-23T13:03:06.293 INFO:teuthology.orchestra.run.trial046.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2026-02-23T13:03:06.293 INFO:teuthology.orchestra.run.trial046.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2026-02-23T13:03:06.293 INFO:teuthology.orchestra.run.trial046.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2026-02-23T13:03:06.293 INFO:teuthology.orchestra.run.trial046.stdout: "mon_scrub_interval": "86400", 2026-02-23T13:03:06.293 INFO:teuthology.orchestra.run.trial046.stdout: "mon_scrub_max_keys": "100", 2026-02-23T13:03:06.293 INFO:teuthology.orchestra.run.trial046.stdout: "mon_scrub_timeout": "300", 2026-02-23T13:03:06.293 INFO:teuthology.orchestra.run.trial046.stdout: "mon_session_timeout": "300", 2026-02-23T13:03:06.293 INFO:teuthology.orchestra.run.trial046.stdout: "mon_smart_report_timeout": "5", 2026-02-23T13:03:06.293 INFO:teuthology.orchestra.run.trial046.stdout: "mon_stat_smooth_intervals": "6", 2026-02-23T13:03:06.293 INFO:teuthology.orchestra.run.trial046.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2026-02-23T13:03:06.294 INFO:teuthology.orchestra.run.trial046.stdout: "mon_stretch_pool_min_size": "2", 2026-02-23T13:03:06.294 INFO:teuthology.orchestra.run.trial046.stdout: "mon_stretch_pool_size": "4", 2026-02-23T13:03:06.294 INFO:teuthology.orchestra.run.trial046.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2026-02-23T13:03:06.294 INFO:teuthology.orchestra.run.trial046.stdout: "mon_subscribe_interval": "86400.000000", 2026-02-23T13:03:06.294 INFO:teuthology.orchestra.run.trial046.stdout: "mon_sync_debug": "false", 2026-02-23T13:03:06.294 INFO:teuthology.orchestra.run.trial046.stdout: "mon_sync_max_payload_keys": "2000", 2026-02-23T13:03:06.294 INFO:teuthology.orchestra.run.trial046.stdout: "mon_sync_max_payload_size": "1048576", 2026-02-23T13:03:06.294 INFO:teuthology.orchestra.run.trial046.stdout: "mon_sync_provider_kill_at": "0", 2026-02-23T13:03:06.294 INFO:teuthology.orchestra.run.trial046.stdout: "mon_sync_requester_kill_at": "0", 2026-02-23T13:03:06.294 INFO:teuthology.orchestra.run.trial046.stdout: "mon_sync_timeout": "60.000000", 2026-02-23T13:03:06.294 INFO:teuthology.orchestra.run.trial046.stdout: "mon_target_pg_per_osd": "100", 2026-02-23T13:03:06.294 INFO:teuthology.orchestra.run.trial046.stdout: "mon_tick_interval": "5", 2026-02-23T13:03:06.294 INFO:teuthology.orchestra.run.trial046.stdout: "mon_timecheck_interval": "300.000000", 2026-02-23T13:03:06.294 INFO:teuthology.orchestra.run.trial046.stdout: "mon_timecheck_skew_interval": "30.000000", 2026-02-23T13:03:06.294 INFO:teuthology.orchestra.run.trial046.stdout: "mon_use_min_delay_socket": "false", 2026-02-23T13:03:06.294 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_older_version_delay": "604800", 2026-02-23T13:03:06.294 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2026-02-23T13:03:06.294 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2026-02-23T13:03:06.294 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2026-02-23T13:03:06.294 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_on_filestore_osds": "true", 2026-02-23T13:03:06.294 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2026-02-23T13:03:06.294 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2026-02-23T13:03:06.294 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2026-02-23T13:03:06.294 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_on_misplaced": "false", 2026-02-23T13:03:06.294 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2026-02-23T13:03:06.294 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_on_older_version": "true", 2026-02-23T13:03:06.294 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2026-02-23T13:03:06.294 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_on_pool_no_app": "true", 2026-02-23T13:03:06.294 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_on_pool_no_app_grace": "300", 2026-02-23T13:03:06.294 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_on_pool_no_redundancy": "true", 2026-02-23T13:03:06.295 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2026-02-23T13:03:06.295 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2026-02-23T13:03:06.295 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2026-02-23T13:03:06.295 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_on_too_few_osds": "false", 2026-02-23T13:03:06.295 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2026-02-23T13:03:06.295 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2026-02-23T13:03:06.295 INFO:teuthology.orchestra.run.trial046.stdout: "monmap": "", 2026-02-23T13:03:06.295 INFO:teuthology.orchestra.run.trial046.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2026-02-23T13:03:06.295 INFO:teuthology.orchestra.run.trial046.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2026-02-23T13:03:06.295 INFO:teuthology.orchestra.run.trial046.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2026-02-23T13:03:06.295 INFO:teuthology.orchestra.run.trial046.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2026-02-23T13:03:06.295 INFO:teuthology.orchestra.run.trial046.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2026-02-23T13:03:06.295 INFO:teuthology.orchestra.run.trial046.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2026-02-23T13:03:06.295 INFO:teuthology.orchestra.run.trial046.stdout: "motr_tracing_enabled": "false", 2026-02-23T13:03:06.295 INFO:teuthology.orchestra.run.trial046.stdout: "ms_async_op_threads": "3", 2026-02-23T13:03:06.295 INFO:teuthology.orchestra.run.trial046.stdout: "ms_async_rdma_buffer_size": "131072", 2026-02-23T13:03:06.295 INFO:teuthology.orchestra.run.trial046.stdout: "ms_async_rdma_cm": "false", 2026-02-23T13:03:06.295 INFO:teuthology.orchestra.run.trial046.stdout: "ms_async_rdma_device_name": "", 2026-02-23T13:03:06.295 INFO:teuthology.orchestra.run.trial046.stdout: "ms_async_rdma_dscp": "96", 2026-02-23T13:03:06.295 INFO:teuthology.orchestra.run.trial046.stdout: "ms_async_rdma_enable_hugepage": "false", 2026-02-23T13:03:06.295 INFO:teuthology.orchestra.run.trial046.stdout: "ms_async_rdma_gid_idx": "0", 2026-02-23T13:03:06.295 INFO:teuthology.orchestra.run.trial046.stdout: "ms_async_rdma_local_gid": "", 2026-02-23T13:03:06.295 INFO:teuthology.orchestra.run.trial046.stdout: "ms_async_rdma_polling_us": "1000", 2026-02-23T13:03:06.295 INFO:teuthology.orchestra.run.trial046.stdout: "ms_async_rdma_port_num": "1", 2026-02-23T13:03:06.295 INFO:teuthology.orchestra.run.trial046.stdout: "ms_async_rdma_receive_buffers": "32768", 2026-02-23T13:03:06.295 INFO:teuthology.orchestra.run.trial046.stdout: "ms_async_rdma_receive_queue_len": "4096", 2026-02-23T13:03:06.295 INFO:teuthology.orchestra.run.trial046.stdout: "ms_async_rdma_roce_ver": "1", 2026-02-23T13:03:06.295 INFO:teuthology.orchestra.run.trial046.stdout: "ms_async_rdma_send_buffers": "1024", 2026-02-23T13:03:06.296 INFO:teuthology.orchestra.run.trial046.stdout: "ms_async_rdma_sl": "3", 2026-02-23T13:03:06.296 INFO:teuthology.orchestra.run.trial046.stdout: "ms_async_rdma_support_srq": "true", 2026-02-23T13:03:06.296 INFO:teuthology.orchestra.run.trial046.stdout: "ms_async_rdma_type": "ib", 2026-02-23T13:03:06.296 INFO:teuthology.orchestra.run.trial046.stdout: "ms_async_reap_threshold": "5", 2026-02-23T13:03:06.296 INFO:teuthology.orchestra.run.trial046.stdout: "ms_bind_before_connect": "false", 2026-02-23T13:03:06.296 INFO:teuthology.orchestra.run.trial046.stdout: "ms_bind_ipv4": "true", 2026-02-23T13:03:06.296 INFO:teuthology.orchestra.run.trial046.stdout: "ms_bind_ipv6": "false", 2026-02-23T13:03:06.296 INFO:teuthology.orchestra.run.trial046.stdout: "ms_bind_msgr1": "true", 2026-02-23T13:03:06.296 INFO:teuthology.orchestra.run.trial046.stdout: "ms_bind_msgr2": "true", 2026-02-23T13:03:06.296 INFO:teuthology.orchestra.run.trial046.stdout: "ms_bind_port_max": "7568", 2026-02-23T13:03:06.296 INFO:teuthology.orchestra.run.trial046.stdout: "ms_bind_port_min": "6800", 2026-02-23T13:03:06.296 INFO:teuthology.orchestra.run.trial046.stdout: "ms_bind_prefer_ipv4": "false", 2026-02-23T13:03:06.296 INFO:teuthology.orchestra.run.trial046.stdout: "ms_bind_retry_count": "3", 2026-02-23T13:03:06.296 INFO:teuthology.orchestra.run.trial046.stdout: "ms_bind_retry_delay": "5", 2026-02-23T13:03:06.296 INFO:teuthology.orchestra.run.trial046.stdout: "ms_blackhole_client": "false", 2026-02-23T13:03:06.296 INFO:teuthology.orchestra.run.trial046.stdout: "ms_blackhole_mds": "false", 2026-02-23T13:03:06.296 INFO:teuthology.orchestra.run.trial046.stdout: "ms_blackhole_mgr": "false", 2026-02-23T13:03:06.296 INFO:teuthology.orchestra.run.trial046.stdout: "ms_blackhole_mon": "false", 2026-02-23T13:03:06.296 INFO:teuthology.orchestra.run.trial046.stdout: "ms_blackhole_osd": "false", 2026-02-23T13:03:06.296 INFO:teuthology.orchestra.run.trial046.stdout: "ms_client_mode": "crc", 2026-02-23T13:03:06.296 INFO:teuthology.orchestra.run.trial046.stdout: "ms_client_throttle_retry_time_interval": "5000", 2026-02-23T13:03:06.296 INFO:teuthology.orchestra.run.trial046.stdout: "ms_cluster_mode": "crc", 2026-02-23T13:03:06.296 INFO:teuthology.orchestra.run.trial046.stdout: "ms_cluster_type": "", 2026-02-23T13:03:06.296 INFO:teuthology.orchestra.run.trial046.stdout: "ms_compress_secure": "false", 2026-02-23T13:03:06.296 INFO:teuthology.orchestra.run.trial046.stdout: "ms_connection_idle_timeout": "900", 2026-02-23T13:03:06.296 INFO:teuthology.orchestra.run.trial046.stdout: "ms_connection_ready_timeout": "10", 2026-02-23T13:03:06.296 INFO:teuthology.orchestra.run.trial046.stdout: "ms_crc_data": "true", 2026-02-23T13:03:06.296 INFO:teuthology.orchestra.run.trial046.stdout: "ms_crc_header": "true", 2026-02-23T13:03:06.296 INFO:teuthology.orchestra.run.trial046.stdout: "ms_die_on_bad_msg": "false", 2026-02-23T13:03:06.296 INFO:teuthology.orchestra.run.trial046.stdout: "ms_die_on_bug": "true", 2026-02-23T13:03:06.297 INFO:teuthology.orchestra.run.trial046.stdout: "ms_die_on_old_message": "true", 2026-02-23T13:03:06.297 INFO:teuthology.orchestra.run.trial046.stdout: "ms_die_on_skipped_message": "false", 2026-02-23T13:03:06.297 INFO:teuthology.orchestra.run.trial046.stdout: "ms_die_on_unhandled_msg": "false", 2026-02-23T13:03:06.297 INFO:teuthology.orchestra.run.trial046.stdout: "ms_dispatch_throttle_bytes": "104857600", 2026-02-23T13:03:06.297 INFO:teuthology.orchestra.run.trial046.stdout: "ms_dpdk_coremask": "0xF", 2026-02-23T13:03:06.297 INFO:teuthology.orchestra.run.trial046.stdout: "ms_dpdk_debug_allow_loopback": "false", 2026-02-23T13:03:06.297 INFO:teuthology.orchestra.run.trial046.stdout: "ms_dpdk_devs_allowlist": "", 2026-02-23T13:03:06.297 INFO:teuthology.orchestra.run.trial046.stdout: "ms_dpdk_enable_tso": "true", 2026-02-23T13:03:06.297 INFO:teuthology.orchestra.run.trial046.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2026-02-23T13:03:06.297 INFO:teuthology.orchestra.run.trial046.stdout: "ms_dpdk_host_ipv4_addr": "", 2026-02-23T13:03:06.297 INFO:teuthology.orchestra.run.trial046.stdout: "ms_dpdk_hugepages": "", 2026-02-23T13:03:06.297 INFO:teuthology.orchestra.run.trial046.stdout: "ms_dpdk_hw_flow_control": "true", 2026-02-23T13:03:06.297 INFO:teuthology.orchestra.run.trial046.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2026-02-23T13:03:06.297 INFO:teuthology.orchestra.run.trial046.stdout: "ms_dpdk_lro": "true", 2026-02-23T13:03:06.297 INFO:teuthology.orchestra.run.trial046.stdout: "ms_dpdk_memory_channel": "4", 2026-02-23T13:03:06.297 INFO:teuthology.orchestra.run.trial046.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2026-02-23T13:03:06.297 INFO:teuthology.orchestra.run.trial046.stdout: "ms_dpdk_pmd": "", 2026-02-23T13:03:06.297 INFO:teuthology.orchestra.run.trial046.stdout: "ms_dpdk_port_id": "0", 2026-02-23T13:03:06.297 INFO:teuthology.orchestra.run.trial046.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2026-02-23T13:03:06.297 INFO:teuthology.orchestra.run.trial046.stdout: "ms_dump_corrupt_message_level": "1", 2026-02-23T13:03:06.297 INFO:teuthology.orchestra.run.trial046.stdout: "ms_dump_on_send": "false", 2026-02-23T13:03:06.297 INFO:teuthology.orchestra.run.trial046.stdout: "ms_initial_backoff": "0.200000", 2026-02-23T13:03:06.297 INFO:teuthology.orchestra.run.trial046.stdout: "ms_inject_delay_max": "1.000000", 2026-02-23T13:03:06.297 INFO:teuthology.orchestra.run.trial046.stdout: "ms_inject_delay_probability": "0.000000", 2026-02-23T13:03:06.297 INFO:teuthology.orchestra.run.trial046.stdout: "ms_inject_delay_type": "", 2026-02-23T13:03:06.297 INFO:teuthology.orchestra.run.trial046.stdout: "ms_inject_internal_delays": "0.000000", 2026-02-23T13:03:06.297 INFO:teuthology.orchestra.run.trial046.stdout: "ms_inject_network_congestion": "0", 2026-02-23T13:03:06.297 INFO:teuthology.orchestra.run.trial046.stdout: "ms_inject_socket_failures": "0", 2026-02-23T13:03:06.297 INFO:teuthology.orchestra.run.trial046.stdout: "ms_learn_addr_from_peer": "true", 2026-02-23T13:03:06.297 INFO:teuthology.orchestra.run.trial046.stdout: "ms_max_accept_failures": "4", 2026-02-23T13:03:06.297 INFO:teuthology.orchestra.run.trial046.stdout: "ms_max_backoff": "15.000000", 2026-02-23T13:03:06.297 INFO:teuthology.orchestra.run.trial046.stdout: "ms_mon_client_mode": "crc", 2026-02-23T13:03:06.298 INFO:teuthology.orchestra.run.trial046.stdout: "ms_mon_cluster_mode": "crc", 2026-02-23T13:03:06.298 INFO:teuthology.orchestra.run.trial046.stdout: "ms_mon_service_mode": "crc", 2026-02-23T13:03:06.298 INFO:teuthology.orchestra.run.trial046.stdout: "ms_osd_compress_min_size": "1024", 2026-02-23T13:03:06.298 INFO:teuthology.orchestra.run.trial046.stdout: "ms_osd_compress_mode": "none", 2026-02-23T13:03:06.298 INFO:teuthology.orchestra.run.trial046.stdout: "ms_osd_compression_algorithm": "snappy", 2026-02-23T13:03:06.298 INFO:teuthology.orchestra.run.trial046.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2026-02-23T13:03:06.298 INFO:teuthology.orchestra.run.trial046.stdout: "ms_pq_min_cost": "65536", 2026-02-23T13:03:06.298 INFO:teuthology.orchestra.run.trial046.stdout: "ms_public_type": "", 2026-02-23T13:03:06.298 INFO:teuthology.orchestra.run.trial046.stdout: "ms_service_mode": "crc", 2026-02-23T13:03:06.298 INFO:teuthology.orchestra.run.trial046.stdout: "ms_tcp_listen_backlog": "512", 2026-02-23T13:03:06.298 INFO:teuthology.orchestra.run.trial046.stdout: "ms_tcp_nodelay": "true", 2026-02-23T13:03:06.298 INFO:teuthology.orchestra.run.trial046.stdout: "ms_tcp_prefetch_max_size": "65536", 2026-02-23T13:03:06.298 INFO:teuthology.orchestra.run.trial046.stdout: "ms_tcp_rcvbuf": "0", 2026-02-23T13:03:06.298 INFO:teuthology.orchestra.run.trial046.stdout: "ms_time_events_min_wait_interval": "1000", 2026-02-23T13:03:06.298 INFO:teuthology.orchestra.run.trial046.stdout: "ms_type": "async+posix", 2026-02-23T13:03:06.298 INFO:teuthology.orchestra.run.trial046.stdout: "no_config_file": "false", 2026-02-23T13:03:06.298 INFO:teuthology.orchestra.run.trial046.stdout: "nvmeof_mon_client_connect_panic": "30", 2026-02-23T13:03:06.298 INFO:teuthology.orchestra.run.trial046.stdout: "nvmeof_mon_client_disconnect_panic": "100", 2026-02-23T13:03:06.298 INFO:teuthology.orchestra.run.trial046.stdout: "nvmeof_mon_client_tick_period": "1", 2026-02-23T13:03:06.298 INFO:teuthology.orchestra.run.trial046.stdout: "objecter_completion_locks_per_session": "32", 2026-02-23T13:03:06.298 INFO:teuthology.orchestra.run.trial046.stdout: "objecter_debug_inject_relock_delay": "false", 2026-02-23T13:03:06.298 INFO:teuthology.orchestra.run.trial046.stdout: "objecter_inflight_op_bytes": "104857600", 2026-02-23T13:03:06.298 INFO:teuthology.orchestra.run.trial046.stdout: "objecter_inflight_ops": "1024", 2026-02-23T13:03:06.298 INFO:teuthology.orchestra.run.trial046.stdout: "objecter_inject_no_watch_ping": "false", 2026-02-23T13:03:06.298 INFO:teuthology.orchestra.run.trial046.stdout: "objecter_retry_writes_after_first_reply": "false", 2026-02-23T13:03:06.298 INFO:teuthology.orchestra.run.trial046.stdout: "objecter_tick_interval": "5.000000", 2026-02-23T13:03:06.298 INFO:teuthology.orchestra.run.trial046.stdout: "objecter_timeout": "10.000000", 2026-02-23T13:03:06.298 INFO:teuthology.orchestra.run.trial046.stdout: "objectstore_blackhole": "false", 2026-02-23T13:03:06.298 INFO:teuthology.orchestra.run.trial046.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2026-02-23T13:03:06.298 INFO:teuthology.orchestra.run.trial046.stdout: "openssl_conf": "", 2026-02-23T13:03:06.299 INFO:teuthology.orchestra.run.trial046.stdout: "osd_agent_delay_time": "5.000000", 2026-02-23T13:03:06.299 INFO:teuthology.orchestra.run.trial046.stdout: "osd_agent_hist_halflife": "1000", 2026-02-23T13:03:06.299 INFO:teuthology.orchestra.run.trial046.stdout: "osd_agent_max_low_ops": "2", 2026-02-23T13:03:06.299 INFO:teuthology.orchestra.run.trial046.stdout: "osd_agent_max_ops": "4", 2026-02-23T13:03:06.299 INFO:teuthology.orchestra.run.trial046.stdout: "osd_agent_min_evict_effort": "0.100000", 2026-02-23T13:03:06.299 INFO:teuthology.orchestra.run.trial046.stdout: "osd_agent_quantize_effort": "0.100000", 2026-02-23T13:03:06.299 INFO:teuthology.orchestra.run.trial046.stdout: "osd_agent_slop": "0.020000", 2026-02-23T13:03:06.299 INFO:teuthology.orchestra.run.trial046.stdout: "osd_aggregated_slow_ops_logging": "true", 2026-02-23T13:03:06.299 INFO:teuthology.orchestra.run.trial046.stdout: "osd_allow_recovery_below_min_size": "true", 2026-02-23T13:03:06.299 INFO:teuthology.orchestra.run.trial046.stdout: "osd_asio_thread_count": "2", 2026-02-23T13:03:06.299 INFO:teuthology.orchestra.run.trial046.stdout: "osd_async_recovery_min_cost": "100", 2026-02-23T13:03:06.299 INFO:teuthology.orchestra.run.trial046.stdout: "osd_auto_mark_unfound_lost": "false", 2026-02-23T13:03:06.299 INFO:teuthology.orchestra.run.trial046.stdout: "osd_backfill_retry_interval": "30.000000", 2026-02-23T13:03:06.299 INFO:teuthology.orchestra.run.trial046.stdout: "osd_backfill_scan_max": "512", 2026-02-23T13:03:06.299 INFO:teuthology.orchestra.run.trial046.stdout: "osd_backfill_scan_min": "64", 2026-02-23T13:03:06.299 INFO:teuthology.orchestra.run.trial046.stdout: "osd_backoff_on_degraded": "false", 2026-02-23T13:03:06.299 INFO:teuthology.orchestra.run.trial046.stdout: "osd_backoff_on_peering": "false", 2026-02-23T13:03:06.299 INFO:teuthology.orchestra.run.trial046.stdout: "osd_backoff_on_unfound": "true", 2026-02-23T13:03:06.299 INFO:teuthology.orchestra.run.trial046.stdout: "osd_beacon_report_interval": "300", 2026-02-23T13:03:06.299 INFO:teuthology.orchestra.run.trial046.stdout: "osd_bench_duration": "30", 2026-02-23T13:03:06.299 INFO:teuthology.orchestra.run.trial046.stdout: "osd_bench_large_size_max_throughput": "104857600", 2026-02-23T13:03:06.299 INFO:teuthology.orchestra.run.trial046.stdout: "osd_bench_max_block_size": "67108864", 2026-02-23T13:03:06.299 INFO:teuthology.orchestra.run.trial046.stdout: "osd_bench_small_size_max_iops": "100", 2026-02-23T13:03:06.299 INFO:teuthology.orchestra.run.trial046.stdout: "osd_blkin_trace_all": "false", 2026-02-23T13:03:06.299 INFO:teuthology.orchestra.run.trial046.stdout: "osd_blocked_scrub_grace_period": "120", 2026-02-23T13:03:06.299 INFO:teuthology.orchestra.run.trial046.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2026-02-23T13:03:06.299 INFO:teuthology.orchestra.run.trial046.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2026-02-23T13:03:06.299 INFO:teuthology.orchestra.run.trial046.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2026-02-23T13:03:06.299 INFO:teuthology.orchestra.run.trial046.stdout: "osd_check_for_log_corruption": "false", 2026-02-23T13:03:06.299 INFO:teuthology.orchestra.run.trial046.stdout: "osd_check_max_object_name_len_on_startup": "true", 2026-02-23T13:03:06.299 INFO:teuthology.orchestra.run.trial046.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo sem_set", 2026-02-23T13:03:06.299 INFO:teuthology.orchestra.run.trial046.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2026-02-23T13:03:06.300 INFO:teuthology.orchestra.run.trial046.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo sem_set", 2026-02-23T13:03:06.300 INFO:teuthology.orchestra.run.trial046.stdout: "osd_class_update_on_start": "true", 2026-02-23T13:03:06.300 INFO:teuthology.orchestra.run.trial046.stdout: "osd_client_message_cap": "256", 2026-02-23T13:03:06.300 INFO:teuthology.orchestra.run.trial046.stdout: "osd_client_message_size_cap": "524288000", 2026-02-23T13:03:06.300 INFO:teuthology.orchestra.run.trial046.stdout: "osd_client_op_priority": "63", 2026-02-23T13:03:06.300 INFO:teuthology.orchestra.run.trial046.stdout: "osd_client_watch_timeout": "30", 2026-02-23T13:03:06.300 INFO:teuthology.orchestra.run.trial046.stdout: "osd_command_max_records": "256", 2026-02-23T13:03:06.300 INFO:teuthology.orchestra.run.trial046.stdout: "osd_compact_on_start": "false", 2026-02-23T13:03:06.300 INFO:teuthology.orchestra.run.trial046.stdout: "osd_copyfrom_max_chunk": "8388608", 2026-02-23T13:03:06.300 INFO:teuthology.orchestra.run.trial046.stdout: "osd_crush_chooseleaf_type": "1", 2026-02-23T13:03:06.300 INFO:teuthology.orchestra.run.trial046.stdout: "osd_crush_initial_weight": "-1.000000", 2026-02-23T13:03:06.300 INFO:teuthology.orchestra.run.trial046.stdout: "osd_crush_update_on_start": "true", 2026-02-23T13:03:06.300 INFO:teuthology.orchestra.run.trial046.stdout: "osd_crush_update_weight_set": "true", 2026-02-23T13:03:06.300 INFO:teuthology.orchestra.run.trial046.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2026-02-23T13:03:06.300 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2026-02-23T13:03:06.300 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2026-02-23T13:03:06.300 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_drop_ping_duration": "0", 2026-02-23T13:03:06.300 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_drop_ping_probability": "0.000000", 2026-02-23T13:03:06.300 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_feed_pullee": "-1", 2026-02-23T13:03:06.300 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_inject_copyfrom_error": "false", 2026-02-23T13:03:06.300 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2026-02-23T13:03:06.300 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2026-02-23T13:03:06.300 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_misdirected_ops": "false", 2026-02-23T13:03:06.300 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_no_acting_change": "false", 2026-02-23T13:03:06.300 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_no_purge_strays": "false", 2026-02-23T13:03:06.300 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_op_order": "false", 2026-02-23T13:03:06.300 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_pg_log_writeout": "false", 2026-02-23T13:03:06.300 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_pretend_recovery_active": "false", 2026-02-23T13:03:06.300 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_random_push_read_error": "0.000000", 2026-02-23T13:03:06.300 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2026-02-23T13:03:06.300 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_shutdown": "false", 2026-02-23T13:03:06.301 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2026-02-23T13:03:06.301 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2026-02-23T13:03:06.301 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_trim_objects": "false", 2026-02-23T13:03:06.301 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_verify_cached_snaps": "false", 2026-02-23T13:03:06.301 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_verify_missing_on_start": "false", 2026-02-23T13:03:06.301 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_verify_snaps": "false", 2026-02-23T13:03:06.301 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_verify_stray_on_activate": "false", 2026-02-23T13:03:06.301 INFO:teuthology.orchestra.run.trial046.stdout: "osd_deep_scrub_interval": "604800.000000", 2026-02-23T13:03:06.301 INFO:teuthology.orchestra.run.trial046.stdout: "osd_deep_scrub_interval_cv": "0.200000", 2026-02-23T13:03:06.301 INFO:teuthology.orchestra.run.trial046.stdout: "osd_deep_scrub_keys": "1024", 2026-02-23T13:03:06.301 INFO:teuthology.orchestra.run.trial046.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2026-02-23T13:03:06.301 INFO:teuthology.orchestra.run.trial046.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2026-02-23T13:03:06.301 INFO:teuthology.orchestra.run.trial046.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2026-02-23T13:03:06.301 INFO:teuthology.orchestra.run.trial046.stdout: "osd_deep_scrub_stride": "4194304", 2026-02-23T13:03:06.301 INFO:teuthology.orchestra.run.trial046.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2026-02-23T13:03:06.301 INFO:teuthology.orchestra.run.trial046.stdout: "osd_default_data_pool_replay_window": "45", 2026-02-23T13:03:06.301 INFO:teuthology.orchestra.run.trial046.stdout: "osd_default_notify_timeout": "30", 2026-02-23T13:03:06.301 INFO:teuthology.orchestra.run.trial046.stdout: "osd_delete_sleep": "0.000000", 2026-02-23T13:03:06.301 INFO:teuthology.orchestra.run.trial046.stdout: "osd_delete_sleep_hdd": "5.000000", 2026-02-23T13:03:06.301 INFO:teuthology.orchestra.run.trial046.stdout: "osd_delete_sleep_hybrid": "1.000000", 2026-02-23T13:03:06.301 INFO:teuthology.orchestra.run.trial046.stdout: "osd_delete_sleep_ssd": "1.000000", 2026-02-23T13:03:06.301 INFO:teuthology.orchestra.run.trial046.stdout: "osd_discard_disconnected_ops": "true", 2026-02-23T13:03:06.301 INFO:teuthology.orchestra.run.trial046.stdout: "osd_ec_partial_reads": "true", 2026-02-23T13:03:06.301 INFO:teuthology.orchestra.run.trial046.stdout: "osd_enable_op_tracker": "true", 2026-02-23T13:03:06.301 INFO:teuthology.orchestra.run.trial046.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2026-02-23T13:03:06.301 INFO:teuthology.orchestra.run.trial046.stdout: "osd_extblkdev_plugins": "vdo", 2026-02-23T13:03:06.301 INFO:teuthology.orchestra.run.trial046.stdout: "osd_failsafe_full_ratio": "0.970000", 2026-02-23T13:03:06.301 INFO:teuthology.orchestra.run.trial046.stdout: "osd_fast_fail_on_connection_refused": "true", 2026-02-23T13:03:06.301 INFO:teuthology.orchestra.run.trial046.stdout: "osd_fast_info": "true", 2026-02-23T13:03:06.301 INFO:teuthology.orchestra.run.trial046.stdout: "osd_fast_shutdown": "true", 2026-02-23T13:03:06.301 INFO:teuthology.orchestra.run.trial046.stdout: "osd_fast_shutdown_notify_mon": "true", 2026-02-23T13:03:06.301 INFO:teuthology.orchestra.run.trial046.stdout: "osd_fast_shutdown_timeout": "15", 2026-02-23T13:03:06.301 INFO:teuthology.orchestra.run.trial046.stdout: "osd_find_best_info_ignore_history_les": "false", 2026-02-23T13:03:06.302 INFO:teuthology.orchestra.run.trial046.stdout: "osd_force_auth_primary_missing_objects": "100", 2026-02-23T13:03:06.302 INFO:teuthology.orchestra.run.trial046.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2026-02-23T13:03:06.302 INFO:teuthology.orchestra.run.trial046.stdout: "osd_function_tracing": "false", 2026-02-23T13:03:06.302 INFO:teuthology.orchestra.run.trial046.stdout: "osd_heartbeat_grace": "20", 2026-02-23T13:03:06.302 INFO:teuthology.orchestra.run.trial046.stdout: "osd_heartbeat_interval": "6", 2026-02-23T13:03:06.302 INFO:teuthology.orchestra.run.trial046.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2026-02-23T13:03:06.302 INFO:teuthology.orchestra.run.trial046.stdout: "osd_heartbeat_min_peers": "10", 2026-02-23T13:03:06.302 INFO:teuthology.orchestra.run.trial046.stdout: "osd_heartbeat_min_size": "2000", 2026-02-23T13:03:06.302 INFO:teuthology.orchestra.run.trial046.stdout: "osd_heartbeat_stale": "600", 2026-02-23T13:03:06.302 INFO:teuthology.orchestra.run.trial046.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2026-02-23T13:03:06.302 INFO:teuthology.orchestra.run.trial046.stdout: "osd_hit_set_max_size": "100000", 2026-02-23T13:03:06.302 INFO:teuthology.orchestra.run.trial046.stdout: "osd_hit_set_min_size": "1000", 2026-02-23T13:03:06.302 INFO:teuthology.orchestra.run.trial046.stdout: "osd_hit_set_namespace": ".ceph-internal", 2026-02-23T13:03:06.302 INFO:teuthology.orchestra.run.trial046.stdout: "osd_ignore_stale_divergent_priors": "false", 2026-02-23T13:03:06.302 INFO:teuthology.orchestra.run.trial046.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2026-02-23T13:03:06.302 INFO:teuthology.orchestra.run.trial046.stdout: "osd_inject_failure_on_pg_removal": "false", 2026-02-23T13:03:06.302 INFO:teuthology.orchestra.run.trial046.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2026-02-23T13:03:06.302 INFO:teuthology.orchestra.run.trial046.stdout: "osd_journal_flush_on_shutdown": "true", 2026-02-23T13:03:06.302 INFO:teuthology.orchestra.run.trial046.stdout: "osd_journal_size": "5120", 2026-02-23T13:03:06.302 INFO:teuthology.orchestra.run.trial046.stdout: "osd_kill_backfill_at": "0", 2026-02-23T13:03:06.302 INFO:teuthology.orchestra.run.trial046.stdout: "osd_loop_before_reset_tphandle": "64", 2026-02-23T13:03:06.302 INFO:teuthology.orchestra.run.trial046.stdout: "osd_map_cache_size": "50", 2026-02-23T13:03:06.302 INFO:teuthology.orchestra.run.trial046.stdout: "osd_map_dedup": "true", 2026-02-23T13:03:06.302 INFO:teuthology.orchestra.run.trial046.stdout: "osd_map_message_max": "40", 2026-02-23T13:03:06.302 INFO:teuthology.orchestra.run.trial046.stdout: "osd_map_message_max_bytes": "10485760", 2026-02-23T13:03:06.302 INFO:teuthology.orchestra.run.trial046.stdout: "osd_map_share_max_epochs": "40", 2026-02-23T13:03:06.302 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_attr_name_len": "100", 2026-02-23T13:03:06.302 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_attr_size": "0", 2026-02-23T13:03:06.302 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_backfills": "1", 2026-02-23T13:03:06.302 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_markdown_count": "5", 2026-02-23T13:03:06.302 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_markdown_period": "600", 2026-02-23T13:03:06.302 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_object_name_len": "2048", 2026-02-23T13:03:06.302 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_object_namespace_len": "256", 2026-02-23T13:03:06.302 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_object_size": "134217728", 2026-02-23T13:03:06.303 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2026-02-23T13:03:06.303 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_omap_entries_per_request": "1024", 2026-02-23T13:03:06.303 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_pg_blocked_by": "16", 2026-02-23T13:03:06.303 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_pg_log_entries": "2", 2026-02-23T13:03:06.303 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2026-02-23T13:03:06.303 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_pgls": "1024", 2026-02-23T13:03:06.303 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_push_cost": "8388608", 2026-02-23T13:03:06.303 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_push_objects": "10", 2026-02-23T13:03:06.303 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_scrubs": "3", 2026-02-23T13:03:06.303 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2026-02-23T13:03:06.303 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_trimming_pgs": "2", 2026-02-23T13:03:06.303 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_write_op_reply_len": "64", 2026-02-23T13:03:06.303 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_write_size": "90", 2026-02-23T13:03:06.303 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2026-02-23T13:03:06.303 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_iops_capacity_low_threshold_hdd": "50.000000", 2026-02-23T13:03:06.303 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_iops_capacity_low_threshold_ssd": "1000.000000", 2026-02-23T13:03:06.303 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2026-02-23T13:03:06.303 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2026-02-23T13:03:06.303 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2026-02-23T13:03:06.303 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2026-02-23T13:03:06.303 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2026-02-23T13:03:06.303 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2026-02-23T13:03:06.303 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_override_recovery_settings": "false", 2026-02-23T13:03:06.303 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_profile": "balanced", 2026-02-23T13:03:06.303 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2026-02-23T13:03:06.303 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2026-02-23T13:03:06.303 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2026-02-23T13:03:06.303 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2026-02-23T13:03:06.303 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2026-02-23T13:03:06.303 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2026-02-23T13:03:06.303 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2026-02-23T13:03:06.303 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2026-02-23T13:03:06.303 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2026-02-23T13:03:06.304 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_scheduler_client_wgt": "1", 2026-02-23T13:03:06.304 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_skip_benchmark": "false", 2026-02-23T13:03:06.304 INFO:teuthology.orchestra.run.trial046.stdout: "osd_memory_base": "805306368", 2026-02-23T13:03:06.304 INFO:teuthology.orchestra.run.trial046.stdout: "osd_memory_cache_min": "134217728", 2026-02-23T13:03:06.304 INFO:teuthology.orchestra.run.trial046.stdout: "osd_memory_cache_resize_interval": "1.000000", 2026-02-23T13:03:06.304 INFO:teuthology.orchestra.run.trial046.stdout: "osd_memory_expected_fragmentation": "0.150000", 2026-02-23T13:03:06.304 INFO:teuthology.orchestra.run.trial046.stdout: "osd_memory_target": "4294967296", 2026-02-23T13:03:06.304 INFO:teuthology.orchestra.run.trial046.stdout: "osd_memory_target_autotune": "false", 2026-02-23T13:03:06.304 INFO:teuthology.orchestra.run.trial046.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2026-02-23T13:03:06.304 INFO:teuthology.orchestra.run.trial046.stdout: "osd_min_pg_log_entries": "1", 2026-02-23T13:03:06.304 INFO:teuthology.orchestra.run.trial046.stdout: "osd_min_recovery_priority": "0", 2026-02-23T13:03:06.304 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mon_heartbeat_interval": "30", 2026-02-23T13:03:06.304 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2026-02-23T13:03:06.304 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mon_report_interval": "5", 2026-02-23T13:03:06.304 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mon_report_max_in_flight": "2", 2026-02-23T13:03:06.304 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mon_shutdown_timeout": "5.000000", 2026-02-23T13:03:06.304 INFO:teuthology.orchestra.run.trial046.stdout: "osd_num_cache_shards": "32", 2026-02-23T13:03:06.304 INFO:teuthology.orchestra.run.trial046.stdout: "osd_num_op_tracker_shard": "32", 2026-02-23T13:03:06.304 INFO:teuthology.orchestra.run.trial046.stdout: "osd_numa_auto_affinity": "true", 2026-02-23T13:03:06.304 INFO:teuthology.orchestra.run.trial046.stdout: "osd_numa_node": "-1", 2026-02-23T13:03:06.304 INFO:teuthology.orchestra.run.trial046.stdout: "osd_numa_prefer_iface": "true", 2026-02-23T13:03:06.304 INFO:teuthology.orchestra.run.trial046.stdout: "osd_object_clean_region_max_num_intervals": "10", 2026-02-23T13:03:06.304 INFO:teuthology.orchestra.run.trial046.stdout: "osd_objecter_finishers": "1", 2026-02-23T13:03:06.304 INFO:teuthology.orchestra.run.trial046.stdout: "osd_objectstore": "bluestore", 2026-02-23T13:03:06.304 INFO:teuthology.orchestra.run.trial046.stdout: "osd_objectstore_fuse": "false", 2026-02-23T13:03:06.304 INFO:teuthology.orchestra.run.trial046.stdout: "osd_objectstore_ideal_list_max": "64", 2026-02-23T13:03:06.304 INFO:teuthology.orchestra.run.trial046.stdout: "osd_objectstore_tracing": "false", 2026-02-23T13:03:06.304 INFO:teuthology.orchestra.run.trial046.stdout: "osd_op_complaint_time": "30.000000", 2026-02-23T13:03:06.304 INFO:teuthology.orchestra.run.trial046.stdout: "osd_op_history_duration": "600", 2026-02-23T13:03:06.304 INFO:teuthology.orchestra.run.trial046.stdout: "osd_op_history_size": "20", 2026-02-23T13:03:06.304 INFO:teuthology.orchestra.run.trial046.stdout: "osd_op_history_slow_op_size": "20", 2026-02-23T13:03:06.304 INFO:teuthology.orchestra.run.trial046.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2026-02-23T13:03:06.304 INFO:teuthology.orchestra.run.trial046.stdout: "osd_op_log_threshold": "5", 2026-02-23T13:03:06.305 INFO:teuthology.orchestra.run.trial046.stdout: "osd_op_num_shards": "0", 2026-02-23T13:03:06.305 INFO:teuthology.orchestra.run.trial046.stdout: "osd_op_num_shards_hdd": "1", 2026-02-23T13:03:06.305 INFO:teuthology.orchestra.run.trial046.stdout: "osd_op_num_shards_ssd": "8", 2026-02-23T13:03:06.305 INFO:teuthology.orchestra.run.trial046.stdout: "osd_op_num_threads_per_shard": "0", 2026-02-23T13:03:06.305 INFO:teuthology.orchestra.run.trial046.stdout: "osd_op_num_threads_per_shard_hdd": "5", 2026-02-23T13:03:06.305 INFO:teuthology.orchestra.run.trial046.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2026-02-23T13:03:06.305 INFO:teuthology.orchestra.run.trial046.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2026-02-23T13:03:06.305 INFO:teuthology.orchestra.run.trial046.stdout: "osd_op_pq_min_cost": "65536", 2026-02-23T13:03:06.305 INFO:teuthology.orchestra.run.trial046.stdout: "osd_op_queue": "mclock_scheduler", 2026-02-23T13:03:06.305 INFO:teuthology.orchestra.run.trial046.stdout: "osd_op_queue_cut_off": "high", 2026-02-23T13:03:06.305 INFO:teuthology.orchestra.run.trial046.stdout: "osd_op_thread_suicide_timeout": "150", 2026-02-23T13:03:06.305 INFO:teuthology.orchestra.run.trial046.stdout: "osd_op_thread_timeout": "15", 2026-02-23T13:03:06.305 INFO:teuthology.orchestra.run.trial046.stdout: "osd_open_classes_on_start": "true", 2026-02-23T13:03:06.305 INFO:teuthology.orchestra.run.trial046.stdout: "osd_os_flags": "0", 2026-02-23T13:03:06.305 INFO:teuthology.orchestra.run.trial046.stdout: "osd_peering_op_priority": "255", 2026-02-23T13:03:06.305 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pg_delete_cost": "1048576", 2026-02-23T13:03:06.305 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pg_delete_priority": "5", 2026-02-23T13:03:06.305 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2026-02-23T13:03:06.305 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2026-02-23T13:03:06.305 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pg_log_dups_tracked": "3000", 2026-02-23T13:03:06.305 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pg_log_trim_max": "10000", 2026-02-23T13:03:06.305 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pg_log_trim_min": "0", 2026-02-23T13:03:06.305 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2026-02-23T13:03:06.305 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pg_object_context_cache_count": "64", 2026-02-23T13:03:06.305 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2026-02-23T13:03:06.305 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2026-02-23T13:03:06.305 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2026-02-23T13:03:06.305 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_cache_min_evict_age": "0", 2026-02-23T13:03:06.305 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_cache_min_flush_age": "0", 2026-02-23T13:03:06.305 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2026-02-23T13:03:06.305 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2026-02-23T13:03:06.305 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2026-02-23T13:03:06.305 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_crimson": "true", 2026-02-23T13:03:06.305 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_crush_rule": "-1", 2026-02-23T13:03:06.305 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_ec_fast_read": "false", 2026-02-23T13:03:06.305 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_erasure_code_profile": "plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_flag_bulk": "false", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_flag_ec_optimizations": "false", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_flag_hashpspool": "true", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_flag_nodelete": "false", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_flag_nopgchange": "false", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_flag_nosizechange": "false", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_flags": "0", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_min_size": "2", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_pg_num": "32", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_pgp_num": "0", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_read_ratio": "70", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_size": "3", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_type": "replicated", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_erasure_code_stripe_unit": "0", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_use_gmt_hitset": "true", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_push_per_object_cost": "1000", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_read_ec_check_for_errors": "false", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recover_clone_overlap": "true", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recover_clone_overlap_limit": "10", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_cost": "20971520", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_delay_start": "0.000000", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_max_active": "0", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_max_active_hdd": "3", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_max_active_ssd": "10", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_max_chunk": "8388608", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_max_single_start": "1", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_op_priority": "3", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_op_warn_multiple": "16", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_priority": "5", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_retry_interval": "30.000000", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_sleep": "0.000000", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_sleep_degraded": "0.000000", 2026-02-23T13:03:06.306 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_sleep_degraded_hdd": "0.100000", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_sleep_degraded_hybrid": "0.025000", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_sleep_degraded_ssd": "0.000000", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_sleep_hdd": "0.100000", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_sleep_ssd": "0.000000", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_requested_scrub_priority": "5", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_rollback_to_cluster_snap": "", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_auto_repair": "false", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_auto_repair_num_errors": "5", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_backoff_ratio": "0.660000", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_begin_hour": "0", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_begin_week_day": "0", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_chunk_max": "15", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_chunk_min": "5", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_cost": "52428800", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_disable_reservation_queuing": "false", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_during_recovery": "false", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_end_hour": "0", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_end_week_day": "0", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_event_cost": "4096", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_extended_sleep": "0.000000", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_invalid_stats": "true", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_load_threshold": "10.000000", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_max_interval": "604800.000000", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_max_preemptions": "5", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_min_interval": "86400.000000", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_priority": "5", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_retry_after_noscrub": "60", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_retry_delay": "30", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_retry_new_interval": "10", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_retry_pg_state": "60", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_retry_trimming": "10", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_sleep": "0.000000", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_shallow_scrub_chunk_max": "100", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_shallow_scrub_chunk_min": "50", 2026-02-23T13:03:06.307 INFO:teuthology.orchestra.run.trial046.stdout: "osd_shutdown_pgref_assert": "false", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "osd_skip_check_past_interval_bounds": "false", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "osd_skip_data_digest": "false", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "osd_smart_report_timeout": "5", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "osd_snap_trim_cost": "1048576", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "osd_snap_trim_priority": "5", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "osd_snap_trim_sleep": "0.000000", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "osd_stats_update_period_not_scrubbing": "120", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "osd_stats_update_period_scrubbing": "15", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "osd_target_transaction_size": "30", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "osd_tier_default_cache_hit_set_count": "4", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "osd_tier_default_cache_mode": "writeback", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "osd_tier_promote_max_objects_sec": "25", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "osd_tracing": "false", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "osd_use_stale_snap": "false", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "osdc_blkin_trace_all": "false", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "paxos_kill_at": "0", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "paxos_max_join_drift": "10", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "paxos_min": "500", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "paxos_min_wait": "0.050000", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "paxos_propose_interval": "1.000000", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "paxos_service_trim_max": "500", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "paxos_service_trim_max_multiplier": "20", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "paxos_service_trim_min": "10", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "paxos_stash_full_interval": "25", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "paxos_trim_max": "500", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "paxos_trim_min": "250", 2026-02-23T13:03:06.308 INFO:teuthology.orchestra.run.trial046.stdout: "perf": "true", 2026-02-23T13:03:06.309 INFO:teuthology.orchestra.run.trial046.stdout: "pid_file": "", 2026-02-23T13:03:06.309 INFO:teuthology.orchestra.run.trial046.stdout: "plugin_crypto_accelerator": "crypto_isal", 2026-02-23T13:03:06.309 INFO:teuthology.orchestra.run.trial046.stdout: "plugin_dir": "/usr/lib64/ceph", 2026-02-23T13:03:06.309 INFO:teuthology.orchestra.run.trial046.stdout: "pool_availability_update_interval": "1.000000", 2026-02-23T13:03:06.309 INFO:teuthology.orchestra.run.trial046.stdout: "public_addr": "-", 2026-02-23T13:03:06.309 INFO:teuthology.orchestra.run.trial046.stdout: "public_addrv": "", 2026-02-23T13:03:06.309 INFO:teuthology.orchestra.run.trial046.stdout: "public_bind_addr": "-", 2026-02-23T13:03:06.309 INFO:teuthology.orchestra.run.trial046.stdout: "public_network": "", 2026-02-23T13:03:06.309 INFO:teuthology.orchestra.run.trial046.stdout: "public_network_interface": "", 2026-02-23T13:03:06.309 INFO:teuthology.orchestra.run.trial046.stdout: "qat_compressor_busy_polling": "false", 2026-02-23T13:03:06.309 INFO:teuthology.orchestra.run.trial046.stdout: "qat_compressor_enabled": "false", 2026-02-23T13:03:06.309 INFO:teuthology.orchestra.run.trial046.stdout: "qat_compressor_session_max_number": "256", 2026-02-23T13:03:06.309 INFO:teuthology.orchestra.run.trial046.stdout: "rados_mon_op_timeout": "0", 2026-02-23T13:03:06.310 INFO:teuthology.orchestra.run.trial046.stdout: "rados_osd_op_timeout": "0", 2026-02-23T13:03:06.310 INFO:teuthology.orchestra.run.trial046.stdout: "rados_replica_read_policy": "default", 2026-02-23T13:03:06.310 INFO:teuthology.orchestra.run.trial046.stdout: "rados_replica_read_policy_on_objclass": "false", 2026-02-23T13:03:06.310 INFO:teuthology.orchestra.run.trial046.stdout: "rados_tracing": "false", 2026-02-23T13:03:06.310 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_atime_update_interval": "60", 2026-02-23T13:03:06.310 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2026-02-23T13:03:06.310 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_balance_parent_reads": "false", 2026-02-23T13:03:06.310 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_balance_snap_reads": "false", 2026-02-23T13:03:06.310 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_blkin_trace_all": "false", 2026-02-23T13:03:06.310 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_blocklist_expire_seconds": "0", 2026-02-23T13:03:06.310 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_blocklist_on_break_lock": "true", 2026-02-23T13:03:06.310 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_cache": "true", 2026-02-23T13:03:06.310 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_cache_block_writes_upfront": "false", 2026-02-23T13:03:06.310 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_cache_max_dirty": "25165824", 2026-02-23T13:03:06.310 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_cache_max_dirty_age": "1.000000", 2026-02-23T13:03:06.310 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_cache_max_dirty_object": "0", 2026-02-23T13:03:06.310 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_cache_policy": "writearound", 2026-02-23T13:03:06.310 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_cache_size": "33554432", 2026-02-23T13:03:06.310 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_cache_target_dirty": "16777216", 2026-02-23T13:03:06.310 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_cache_writethrough_until_flush": "true", 2026-02-23T13:03:06.310 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_clone_copy_on_read": "false", 2026-02-23T13:03:06.310 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_compression_hint": "none", 2026-02-23T13:03:06.310 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_concurrent_management_ops": "10", 2026-02-23T13:03:06.310 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_config_pool_override_update_timestamp": "0", 2026-02-23T13:03:06.310 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_default_clone_format": "auto", 2026-02-23T13:03:06.310 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_default_data_pool": "", 2026-02-23T13:03:06.310 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_default_features": "61", 2026-02-23T13:03:06.310 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_default_format": "2", 2026-02-23T13:03:06.310 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_default_map_options": "", 2026-02-23T13:03:06.310 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_default_order": "22", 2026-02-23T13:03:06.310 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_default_pool": "rbd", 2026-02-23T13:03:06.310 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2026-02-23T13:03:06.310 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_default_stripe_count": "0", 2026-02-23T13:03:06.311 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_default_stripe_unit": "0", 2026-02-23T13:03:06.311 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_disable_zero_copy_writes": "true", 2026-02-23T13:03:06.311 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_discard_granularity_bytes": "65536", 2026-02-23T13:03:06.311 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_discard_on_zeroed_write_same": "true", 2026-02-23T13:03:06.311 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_enable_alloc_hint": "true", 2026-02-23T13:03:06.311 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2026-02-23T13:03:06.311 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_io_scheduler": "simple", 2026-02-23T13:03:06.311 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2026-02-23T13:03:06.311 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_journal_commit_age": "5.000000", 2026-02-23T13:03:06.311 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2026-02-23T13:03:06.311 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_journal_max_payload_bytes": "16384", 2026-02-23T13:03:06.311 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_journal_object_flush_age": "0.000000", 2026-02-23T13:03:06.311 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_journal_object_flush_bytes": "1048576", 2026-02-23T13:03:06.311 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_journal_object_flush_interval": "0", 2026-02-23T13:03:06.311 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2026-02-23T13:03:06.311 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2026-02-23T13:03:06.311 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_journal_order": "24", 2026-02-23T13:03:06.311 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_journal_pool": "", 2026-02-23T13:03:06.311 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_journal_splay_width": "4", 2026-02-23T13:03:06.311 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_localize_parent_reads": "false", 2026-02-23T13:03:06.311 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_localize_snap_reads": "false", 2026-02-23T13:03:06.311 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2026-02-23T13:03:06.311 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2026-02-23T13:03:06.311 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2026-02-23T13:03:06.311 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2026-02-23T13:03:06.311 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2026-02-23T13:03:06.311 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2026-02-23T13:03:06.311 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_image_policy_type": "simple", 2026-02-23T13:03:06.311 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2026-02-23T13:03:06.311 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_image_state_check_interval": "30", 2026-02-23T13:03:06.311 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2026-02-23T13:03:06.311 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2026-02-23T13:03:06.311 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2026-02-23T13:03:06.311 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2026-02-23T13:03:06.311 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2026-02-23T13:03:06.311 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_memory_autotune": "true", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_memory_base": "805306368", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_memory_cache_min": "134217728", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_memory_target": "4294967296", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_perf_stats_prio": "5", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirroring_delete_delay": "0", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirroring_replay_delay": "0", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_move_to_trash_on_remove": "false", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mtime_update_interval": "60", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_non_blocking_aio": "true", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_op_thread_timeout": "60", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_op_threads": "1", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_parent_cache_enabled": "false", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_persistent_cache_mode": "disabled", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_persistent_cache_path": "/tmp", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_persistent_cache_size": "1073741824", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_plugins": "", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_bps_burst": "0", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_bps_burst_seconds": "1", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_bps_limit": "0", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_exclude_ops": "0", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_iops_burst": "0", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_iops_burst_seconds": "1", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_iops_limit": "0", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_read_bps_burst": "0", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_read_bps_limit": "0", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_read_iops_burst": "0", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_read_iops_limit": "0", 2026-02-23T13:03:06.312 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_schedule_tick_min": "50", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_write_bps_burst": "0", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_write_bps_limit": "0", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_write_iops_burst": "0", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_write_iops_limit": "0", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_quiesce_notification_attempts": "10", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_read_from_replica_policy": "default", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_readahead_max_bytes": "524288", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_readahead_trigger_requests": "10", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_request_timed_out_seconds": "30", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_skip_partial_discard": "true", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_tracing": "false", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_validate_names": "true", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_validate_pool": "true", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "restapi_base_url": "", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "restapi_log_level": "", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_account_default_quota_max_objects": "-1", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_account_default_quota_max_size": "-1", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_acl_grants_max_num": "100", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_admin_entry": "admin", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_asio_assert_yielding": "false", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_backend_store": "rados", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_barbican_url": "", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_beast_enable_async": "true", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_bucket_counters_cache": "false", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_bucket_counters_cache_size": "10000", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_bucket_default_quota_max_size": "-1", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_bucket_eexist_override": "false", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_bucket_index_max_aio": "128", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_bucket_logging_obj_roll_time": "300", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_bucket_persistent_notif_num_shards": "11", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_bucket_quota_cache_size": "10000", 2026-02-23T13:03:06.313 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_bucket_quota_ttl": "600", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_bucket_sync_spawn_window": "20", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_cache_enabled": "true", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_cache_expiry_interval": "900", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_cache_lru_size": "25000", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_config_store": "rados", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_content_length_compat": "false", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_copy_obj_progress": "true", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_cors_rules_max_num": "100", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_cross_domain_policy": "", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_default_encryption_key": "", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_kmip_addr": "", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_kmip_ca_path": "", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_kmip_client_cert": "", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_kmip_client_key": "", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_kmip_kms_key_template": "", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_kmip_password": "", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_kmip_username": "", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_require_ssl": "true", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_sse_s3_backend": "vault", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_suppress_logs": "true", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_vault_addr": "", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_vault_auth": "token", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_vault_namespace": "", 2026-02-23T13:03:06.314 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_vault_prefix": "", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_vault_secret_engine": "transit", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_vault_ssl_cacert": "", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_vault_token_file": "", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_vault_verify_ssl": "true", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_curl_buffersize": "524288", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_curl_low_speed_limit": "1024", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_curl_low_speed_time": "300", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_curl_tcp_keepalive": "0", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_curl_wait_timeout_ms": "1000", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d3n_l1_fadvise": "4", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d3n_libaio_aio_num": "64", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d3n_libaio_aio_threads": "20", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d4n_address": "127.0.0.1:6379", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d4n_backend_address": "127.0.0.1:6379", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d4n_cache_cleaning_interval": "1000", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d4n_l1_datacache_address": "127.0.0.1:6379", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d4n_l1_datacache_disk_reserve": "1073741824", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d4n_l1_fadvise": "4", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d4n_l1_write_open_flags": "4096", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d4n_libaio_aio_num": "64", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d4n_libaio_aio_threads": "20", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d4n_local_rgw_address": "127.0.0.1:8000", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_data_log_changes_size": "1000", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_data_log_num_shards": "128", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_data_log_window": "30", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_data_notify_interval_msec": "0", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_data_sync_poll_interval": "20", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_data_sync_spawn_window": "20", 2026-02-23T13:03:06.315 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_debug_inject_set_olh_err": "0", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_default_data_log_backing": "fifo", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_default_realm_info_oid": "default.realm", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_default_region_info_oid": "default.region", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_default_zone_info_oid": "default.zone", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_defer_to_bucket_acls": "", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_delete_multi_obj_max_num": "1000", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_disable_s3select": "false", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_dmclock_admin_lim": "0.000000", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_dmclock_admin_res": "100.000000", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_dmclock_auth_lim": "0.000000", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_dmclock_auth_res": "200.000000", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_dmclock_data_lim": "0.000000", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_dmclock_data_res": "500.000000", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_dmclock_data_wgt": "500.000000", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_dmclock_metadata_res": "500.000000", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_dns_name": "", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_dns_s3website_name": "", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_dynamic_resharding": "true", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_dynamic_resharding_may_reduce": "true", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_dynamic_resharding_reduction_wait": "120", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_enable_gc_threads": "true", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_enable_jwks_url_verification": "false", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_enable_lc_threads": "true", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_enable_mdsearch": "true", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_enable_ops_log": "false", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_enable_quota_threads": "true", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_enable_restore_threads": "true", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_enable_static_website": "false", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_enable_usage_log": "false", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_enforce_swift_acls": "true", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_exit_timeout_secs": "120", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_expose_bucket": "false", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_extended_http_attrs": "", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_filter": "none", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2026-02-23T13:03:06.316 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_frontends": "beast port=7480", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_gc_max_concurrent_io": "10", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_gc_max_deferred": "50", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_gc_max_objs": "32", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_gc_max_queue_size": "134213632", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_gc_max_trim_chunk": "16", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_gc_obj_min_wait": "7200", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_gc_processor_max_time": "3600", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_gc_processor_period": "3600", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_get_obj_max_req_size": "4194304", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_get_obj_window_size": "16777216", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_graceful_stop": "false", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_healthcheck_disabling_path": "", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_http_notif_connection_timeout": "5", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_http_notif_max_inflight": "8192", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_http_notif_message_timeout": "10", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_ignore_get_invalid_range": "false", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_init_timeout": "300", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_kafka_connection_idle": "300", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_kafka_message_timeout": "5000", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_kafka_sleep_timeout": "10", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_accepted_admin_roles": "", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_accepted_reader_roles": "", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_admin_domain": "", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_admin_password": "", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_admin_password_path": "", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_admin_project": "", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_admin_tenant": "", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_admin_user": "", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_barbican_domain": "", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_barbican_password": "", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_barbican_project": "", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_barbican_tenant": "", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_barbican_user": "", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_implicit_tenants": "false", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_service_token_enabled": "false", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_token_cache_size": "10000", 2026-02-23T13:03:06.317 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_token_cache_ttl": "300", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_url": "", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_verify_ssl": "true", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_lc_debug_interval": "-1", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_lc_list_cnt": "1000", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_lc_lock_max_time": "90", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_lc_max_objs": "32", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_lc_max_rules": "1000", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_lc_max_worker": "3", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_lc_max_wp_worker": "128", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_lc_ordered_list_threshold": "500", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_lc_thread_delay": "0", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_ldap_dnattr": "uid", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_ldap_searchfilter": "", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_ldap_uri": "", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_lfuda_sync_frequency": "60", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_list_bucket_min_readahead": "1000", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_list_buckets_max_chunk": "1000", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_log_http_headers": "", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_log_nonexistent_bucket": "false", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_log_object_name_utc": "false", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_lua_enable": "true", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_lua_max_memory_per_state": "128000", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_lua_max_runtime_per_state": "1000", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_max_attr_name_len": "0", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_max_attr_size": "0", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_max_attrs_num_in_req": "0", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_max_chunk_size": "4194304", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_max_concurrent_requests": "1024", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_max_control_aio": "8", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_max_dynamic_shards": "1999", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_max_listing_results": "5000", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_max_notify_retries": "10", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_max_objs_per_shard": "100000", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_max_put_param_size": "1048576", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_max_put_size": "5368709120", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_max_slo_entries": "1000", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_md_log_max_shards": "64", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_md_notify_interval_msec": "200", 2026-02-23T13:03:06.318 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_meta_sync_poll_interval": "20", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_meta_sync_spawn_window": "20", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_mime_types_file": "/etc/mime.types", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_mp_lock_max_time": "600", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_multi_obj_del_max_aio": "16", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_multipart_min_part_size": "5242880", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_multipart_part_upload_limit": "10000", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_nfs_fhcache_partitions": "3", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_nfs_fhcache_size": "2017", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_nfs_frontends": "rgw-nfs", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_nfs_lru_lanes": "5", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_nfs_max_gc": "300", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_nfs_namespace_expire_secs": "300", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_nfs_run_gc_threads": "false", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_nfs_run_lc_threads": "false", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_nfs_run_quota_threads": "false", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_nfs_run_restore_threads": "false", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_nfs_run_sync_thread": "false", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_nfs_s3_fast_attrs": "false", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_nfs_write_completion_interval_s": "10", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_num_async_rados_threads": "32", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_num_control_oids": "8", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_numa_node": "-1", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_obj_stripe_size": "4194304", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_obj_tombstone_cache_size": "1000", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_objexp_chunk_size": "100", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_objexp_gc_interval": "600", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_objexp_hints_num_shards": "127", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_olh_pending_timeout_sec": "3600", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_op_thread_suicide_timeout": "0", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_op_thread_timeout": "600", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_op_tracing": "false", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_opa_token": "", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_opa_url": "", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_opa_verify_ssl": "true", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_ops_log_data_backlog": "5242880", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_ops_log_rados": "false", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_ops_log_socket_path": "", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_override_bucket_index_max_shards": "0", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_parquet_buffer_size": "16777216", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2026-02-23T13:03:06.319 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_period_push_interval": "2.000000", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_period_push_interval_max": "30.000000", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_period_root_pool": ".rgw.root", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_policy_reject_invalid_principals": "true", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_posix_cache_lanes": "3", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_posix_cache_lmdb_count": "3", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_posix_cache_max_buckets": "100", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_posix_cache_partitions": "3", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_posix_userdb_dir": "/var/lib/ceph/radosgw", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_print_continue": "true", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_print_prohibited_content_length": "false", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_put_obj_max_window_size": "67108864", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_put_obj_min_window_size": "16777216", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_rados_pool_recovery_priority": "5", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_rados_tracing": "false", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_ratelimit_interval": "60", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_realm": "", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_realm_id": "", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_realm_root_pool": ".rgw.root", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_redis_connection_pool_size": "512", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_region": "", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_region_root_pool": ".rgw.root", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_relaxed_region_enforcement": "false", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_relaxed_s3_bucket_names": "false", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_request_uri": "", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_reshard_batch_size": "64", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_reshard_bucket_lock_duration": "360", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_reshard_debug_interval": "-1", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_reshard_max_aio": "128", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_reshard_num_logs": "16", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_reshard_progress_judge_interval": "120", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_reshard_progress_judge_ratio": "0.500000", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_reshard_thread_interval": "600", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_reshardlog_threshold": "30000", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_resolve_cname": "false", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_rest_getusage_op_compat": "false", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_restore_debug_interval": "-1", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_restore_lock_max_time": "90", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_restore_max_objs": "32", 2026-02-23T13:03:06.320 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_restore_processor_period": "900", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_run_sync_thread": "true", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_s3_auth_disable_signature_url": "false", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_s3_auth_order": "sts, external, local", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_s3_auth_use_keystone": "false", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_s3_auth_use_ldap": "false", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_s3_auth_use_rados": "true", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_s3_auth_use_sts": "false", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_s3_client_max_sig_ver": "-1", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_s3_success_create_obj_status": "0", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_safe_max_objects_per_shard": "102400", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_scheduler_type": "throttler", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_script_uri": "", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_service_provider_name": "", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_shard_warning_threshold": "90.000000", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sts_client_id": "", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sts_client_secret": "", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sts_entry": "sts", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sts_key": "", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sts_max_session_duration": "43200", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sts_min_session_duration": "900", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sts_token_introspection_url": "", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_swift_account_in_url": "false", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_swift_auth_entry": "auth", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_swift_auth_url": "", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_swift_custom_header": "", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_swift_enforce_content_length": "false", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_swift_need_stats": "true", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_swift_tenant_name": "", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_swift_token_expiration": "86400", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_swift_url": "", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_swift_url_prefix": "swift", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_swift_versioning_enabled": "false", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sync_lease_period": "120", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sync_log_trim_interval": "1200", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sync_log_trim_max_buckets": "16", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sync_obj_etag_verify": "false", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sync_trace_history_size": "4096", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sync_trace_per_node_log_size": "32", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_thread_pool_size": "512", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_topic_persistency_max_retries": "0", 2026-02-23T13:03:06.321 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_topic_persistency_sleep_duration": "0", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_topic_persistency_time_to_live": "0", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_topic_require_publish_policy": "false", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_torrent_comment": "", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_torrent_createby": "", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_torrent_encoding": "", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_torrent_flag": "false", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_torrent_max_size": "5368709120", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_torrent_origin": "", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_torrent_sha_unit": "524288", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_torrent_tracker": "", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_trust_forwarded_https": "false", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_usage_log_flush_threshold": "1024", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_usage_log_key_transition": "true", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_usage_log_tick_interval": "30", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_usage_max_shards": "32", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_usage_max_user_shards": "1", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_use_opa_authz": "false", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_user_counters_cache": "false", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_user_counters_cache_size": "10000", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_user_default_quota_max_objects": "-1", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_user_default_quota_max_size": "-1", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_user_max_buckets": "1000", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_user_policies_max_num": "100", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_user_quota_sync_idle_users": "false", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_user_quota_sync_interval": "86400", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_user_quota_sync_wait_time": "86400", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_user_unique_email": "true", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_verify_ssl": "true", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_website_routing_rules_max_num": "50", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_zone": "", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_zone_id": "", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_zone_root_pool": ".rgw.root", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_zonegroup": "", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_zonegroup_id": "", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgwlc_auto_session_clear": "true", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rgwlc_skip_bucket_step": "false", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_block_size": "4096", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_bloom_bits_per_key": "20", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_cache_row_ratio": "0.000000", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_cache_shard_bits": "4", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_cache_size": "536870912", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_cache_type": "binned_lru", 2026-02-23T13:03:06.322 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_cf_compact_on_deletion": "true", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_collect_compaction_stats": "false", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_collect_extended_stats": "false", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_collect_memory_stats": "false", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_delete_range_threshold": "1048576", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_index_type": "binary_search", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_log_to_ceph_log": "true", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_metadata_block_size": "4096", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_partition_filters": "false", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_perf": "false", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "rotating_keys_bootstrap_timeout": "30", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "rotating_keys_renewal_timeout": "10", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "run_dir": "/var/run/ceph", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_block_create": "true", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_cachepin_2q_in_ratio": "0.500000", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_cachepin_2q_out_ratio": "0.500000", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_cachepin_size_pershard": "2147483648", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_cachepin_type": "LRU", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_cbjournal_size": "5368709120", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_cold_tier_generations": "3", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_data_delta_based_overwrite": "0", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_default_max_object_size": "16777216", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_default_object_metadata_reservation": "16777216", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_device_size": "53687091200", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_disable_end_to_end_data_protection": "true", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_full_integrity_check": "false", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_hot_tier_generations": "5", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_journal_batch_capacity": "16", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_journal_batch_flush_size": "16777216", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_journal_iodepth_limit": "5", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_main_device_type": "SSD", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_max_concurrent_transactions": "128", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_max_data_allocation_size": "0", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_segment_cleaner_gc_formula": "cost_benefit", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_segment_size": "67108864", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "service_unique_id": "", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "set_keepcaps": "false", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "setgroup": "ceph", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "setuser": "ceph", 2026-02-23T13:03:06.323 INFO:teuthology.orchestra.run.trial046.stdout: "setuser_match_path": "", 2026-02-23T13:03:06.324 INFO:teuthology.orchestra.run.trial046.stdout: "subv_metrics_window_interval": "30", 2026-02-23T13:03:06.324 INFO:teuthology.orchestra.run.trial046.stdout: "target_max_misplaced_ratio": "0.050000", 2026-02-23T13:03:06.324 INFO:teuthology.orchestra.run.trial046.stdout: "thp": "false", 2026-02-23T13:03:06.324 INFO:teuthology.orchestra.run.trial046.stdout: "threadpool_default_timeout": "60", 2026-02-23T13:03:06.324 INFO:teuthology.orchestra.run.trial046.stdout: "threadpool_empty_queue_max_wait": "2", 2026-02-23T13:03:06.324 INFO:teuthology.orchestra.run.trial046.stdout: "throttler_perf_counter": "true", 2026-02-23T13:03:06.324 INFO:teuthology.orchestra.run.trial046.stdout: "tmp_dir": "/tmp", 2026-02-23T13:03:06.324 INFO:teuthology.orchestra.run.trial046.stdout: "tmp_file_template": "/tmp/ceph-mon.a.XXXXXX", 2026-02-23T13:03:06.324 INFO:teuthology.orchestra.run.trial046.stdout: "uadk_compressor_enabled": "false", 2026-02-23T13:03:06.324 INFO:teuthology.orchestra.run.trial046.stdout: "uadk_wd_sync_ctx_num": "2" 2026-02-23T13:03:06.324 INFO:teuthology.orchestra.run.trial046.stdout:} 2026-02-23T13:03:06.324 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2026-02-23T13:03:06.417 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:03:06 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: [23/Feb/2026:13:03:06] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2026-02-23T13:03:06.417 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:03:06 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: [23/Feb/2026:13:03:06] ENGINE Bus STOPPED 2026-02-23T13:03:06.417 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:03:06 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: [23/Feb/2026:13:03:06] ENGINE Bus STARTING 2026-02-23T13:03:06.417 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:03:06 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: [23/Feb/2026:13:03:06] ENGINE Serving on http://:::9283 2026-02-23T13:03:06.417 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:03:06 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: [23/Feb/2026:13:03:06] ENGINE Bus STARTED 2026-02-23T13:03:06.441 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:06.540 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:06.538+0000 7f8623754640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:06.540 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:06.539+0000 7f8623754640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:06.547 INFO:teuthology.orchestra.run.trial046.stdout:{} 2026-02-23T13:03:06.547 INFO:teuthology.orchestra.run.trial046.stderr:mon_osd_down_out_interval = '' (not observed, change may require restart) 2026-02-23T13:03:06.580 INFO:teuthology.run_tasks:Running task full_sequential... 2026-02-23T13:03:06.593 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2026-02-23T13:03:06.595 INFO:tasks.radosbench:Beginning radosbench... 2026-02-23T13:03:06.595 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_0 2026-02-23T13:03:06.596 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool create unique_pool_0 16 2026-02-23T13:03:06.596 INFO:tasks.thrashosds.thrasher:starting do_thrash 2026-02-23T13:03:06.596 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:03:06.596 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:03:06.596 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2026-02-23T13:03:06.597 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph tell osd.0 'trim stale osdmaps' 2026-02-23T13:03:06.597 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2026-02-23T13:03:06.597 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:03:06.714 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:06.715 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:06.716 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:06.813 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:06.810+0000 7f2884baf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:06.813 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:06.811+0000 7f2884baf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:06.814 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:06.810+0000 7f622ca02640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:06.814 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:06.811+0000 7f622ca02640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:06.814 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:06.811+0000 7ff9c10d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:06.814 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:06.811+0000 7ff9c10d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:06.827 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:03:06.827 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:03:06.830 INFO:teuthology.orchestra.run.trial046.stderr:no valid command found; 10 closest matches: 2026-02-23T13:03:06.830 INFO:teuthology.orchestra.run.trial046.stderr:0 2026-02-23T13:03:06.830 INFO:teuthology.orchestra.run.trial046.stderr:1 2026-02-23T13:03:06.830 INFO:teuthology.orchestra.run.trial046.stderr:2 2026-02-23T13:03:06.830 INFO:teuthology.orchestra.run.trial046.stderr:abort 2026-02-23T13:03:06.830 INFO:teuthology.orchestra.run.trial046.stderr:assert 2026-02-23T13:03:06.830 INFO:teuthology.orchestra.run.trial046.stderr:bench [] [] [] [] 2026-02-23T13:03:06.831 INFO:teuthology.orchestra.run.trial046.stderr:bluefs debug_inject_read_zeros 2026-02-23T13:03:06.831 INFO:teuthology.orchestra.run.trial046.stderr:bluefs files list 2026-02-23T13:03:06.831 INFO:teuthology.orchestra.run.trial046.stderr:bluefs stats 2026-02-23T13:03:06.831 INFO:teuthology.orchestra.run.trial046.stderr:bluestore allocator dump block 2026-02-23T13:03:06.831 INFO:teuthology.orchestra.run.trial046.stderr:Error EINVAL: invalid command 2026-02-23T13:03:06.838 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:03:06.839 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:03:06.853 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:03:06.853 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:03:06.865 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:03:06.866 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:03:06.880 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-23T13:03:06.881 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-23T13:03:06.881 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph tell osd.1 'trim stale osdmaps' 2026-02-23T13:03:06.998 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:07.022 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:06 trial046 ceph-mon[38575]: Reconfiguring prometheus.a deps ['8765', 'alertmanager_configured:False', 'ceph-exporter_configured:False', 'ingress_configured:False', 'mgmt-gateway_configured:False', 'mgr.x', 'nfs_configured:False', 'node-exporter_configured:False', 'nvmeof_configured:False', 'oauth2-proxy_configured:False', 'secure_monitoring_stack:False', 'smb_configured:False'] -> ['8765', 'alertmanager_configured:False', 'ceph-exporter_configured:False', 'ingress_configured:False', 'mgmt-gateway_configured:False', 'mgr.x', 'nfs_configured:False', 'node-exporter_configured:True', 'nvmeof_configured:False', 'oauth2-proxy_configured:False', 'secure_monitoring_stack:False', 'smb_configured:False'] (diff {'node-exporter_configured:False', 'node-exporter_configured:True'}) 2026-02-23T13:03:07.022 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:06 trial046 ceph-mon[38575]: Reconfiguring daemon prometheus.a on trial131 2026-02-23T13:03:07.022 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:06 trial046 ceph-mon[38575]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch get-security-config"}]: dispatch 2026-02-23T13:03:07.022 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:06 trial046 ceph-mon[38575]: from='client.14319 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:03:07.022 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:06 trial046 ceph-mon[38575]: from='client.14321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:03:07.022 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:06 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:07.022 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:06 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:07.023 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:06 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:07.023 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:06 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:07.023 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:06 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "dashboard get-prometheus-api-host"} : dispatch 2026-02-23T13:03:07.023 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:06 trial046 ceph-mon[38575]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2026-02-23T13:03:07.023 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:06 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "dashboard set-prometheus-api-host", "value": "http://trial131:9095"} : dispatch 2026-02-23T13:03:07.023 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:06 trial046 ceph-mon[38575]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://trial131:9095"}]: dispatch 2026-02-23T13:03:07.023 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:06 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:07.023 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:06 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:07.023 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:06 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-23T13:03:07.023 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:06 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/470518420' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2026-02-23T13:03:07.023 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:06 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "orch get-security-config"} : dispatch 2026-02-23T13:03:07.024 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:06 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:07.024 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:06 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:07.024 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:06 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:03:07.024 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:06 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-23T13:03:07.024 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:06 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:03:07.024 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:06 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-23T13:03:07.024 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:06 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4161421888' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-23T13:03:07.097 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:07.095+0000 7f73989a6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:07.097 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:07.095+0000 7f73989a6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:07.114 INFO:teuthology.orchestra.run.trial046.stderr:no valid command found; 10 closest matches: 2026-02-23T13:03:07.114 INFO:teuthology.orchestra.run.trial046.stderr:0 2026-02-23T13:03:07.114 INFO:teuthology.orchestra.run.trial046.stderr:1 2026-02-23T13:03:07.114 INFO:teuthology.orchestra.run.trial046.stderr:2 2026-02-23T13:03:07.114 INFO:teuthology.orchestra.run.trial046.stderr:abort 2026-02-23T13:03:07.114 INFO:teuthology.orchestra.run.trial046.stderr:assert 2026-02-23T13:03:07.114 INFO:teuthology.orchestra.run.trial046.stderr:bench [] [] [] [] 2026-02-23T13:03:07.115 INFO:teuthology.orchestra.run.trial046.stderr:bluefs debug_inject_read_zeros 2026-02-23T13:03:07.115 INFO:teuthology.orchestra.run.trial046.stderr:bluefs files list 2026-02-23T13:03:07.115 INFO:teuthology.orchestra.run.trial046.stderr:bluefs stats 2026-02-23T13:03:07.115 INFO:teuthology.orchestra.run.trial046.stderr:bluestore allocator dump block 2026-02-23T13:03:07.115 INFO:teuthology.orchestra.run.trial046.stderr:Error EINVAL: invalid command 2026-02-23T13:03:07.142 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-23T13:03:07.142 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-23T13:03:07.142 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph tell osd.2 'trim stale osdmaps' 2026-02-23T13:03:07.256 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:07.354 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:07.352+0000 7fee7e964640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:07.354 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:07.352+0000 7fee7e964640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:07.371 INFO:teuthology.orchestra.run.trial046.stderr:no valid command found; 10 closest matches: 2026-02-23T13:03:07.372 INFO:teuthology.orchestra.run.trial046.stderr:0 2026-02-23T13:03:07.372 INFO:teuthology.orchestra.run.trial046.stderr:1 2026-02-23T13:03:07.372 INFO:teuthology.orchestra.run.trial046.stderr:2 2026-02-23T13:03:07.372 INFO:teuthology.orchestra.run.trial046.stderr:abort 2026-02-23T13:03:07.372 INFO:teuthology.orchestra.run.trial046.stderr:assert 2026-02-23T13:03:07.372 INFO:teuthology.orchestra.run.trial046.stderr:bench [] [] [] [] 2026-02-23T13:03:07.372 INFO:teuthology.orchestra.run.trial046.stderr:bluefs debug_inject_read_zeros 2026-02-23T13:03:07.372 INFO:teuthology.orchestra.run.trial046.stderr:bluefs files list 2026-02-23T13:03:07.372 INFO:teuthology.orchestra.run.trial046.stderr:bluefs stats 2026-02-23T13:03:07.372 INFO:teuthology.orchestra.run.trial046.stderr:bluestore allocator dump block 2026-02-23T13:03:07.372 INFO:teuthology.orchestra.run.trial046.stderr:Error EINVAL: invalid command 2026-02-23T13:03:07.400 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-23T13:03:07.400 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-23T13:03:07.401 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph tell osd.3 'trim stale osdmaps' 2026-02-23T13:03:07.514 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:07.615 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:07.613+0000 7f6d1f258640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:07.615 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:07.613+0000 7f6d1f258640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:07.633 INFO:teuthology.orchestra.run.trial046.stderr:no valid command found; 10 closest matches: 2026-02-23T13:03:07.633 INFO:teuthology.orchestra.run.trial046.stderr:0 2026-02-23T13:03:07.633 INFO:teuthology.orchestra.run.trial046.stderr:1 2026-02-23T13:03:07.633 INFO:teuthology.orchestra.run.trial046.stderr:2 2026-02-23T13:03:07.633 INFO:teuthology.orchestra.run.trial046.stderr:abort 2026-02-23T13:03:07.633 INFO:teuthology.orchestra.run.trial046.stderr:assert 2026-02-23T13:03:07.633 INFO:teuthology.orchestra.run.trial046.stderr:bench [] [] [] [] 2026-02-23T13:03:07.633 INFO:teuthology.orchestra.run.trial046.stderr:bluefs debug_inject_read_zeros 2026-02-23T13:03:07.633 INFO:teuthology.orchestra.run.trial046.stderr:bluefs files list 2026-02-23T13:03:07.633 INFO:teuthology.orchestra.run.trial046.stderr:bluefs stats 2026-02-23T13:03:07.633 INFO:teuthology.orchestra.run.trial046.stderr:bluestore allocator dump block 2026-02-23T13:03:07.633 INFO:teuthology.orchestra.run.trial046.stderr:Error EINVAL: invalid command 2026-02-23T13:03:07.663 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-23T13:03:07.663 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-23T13:03:07.697 INFO:teuthology.orchestra.run.trial046.stderr:pool 'unique_pool_0' created 2026-02-23T13:03:07.736 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2026-02-23T13:03:07.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:07 trial046 ceph-mon[38575]: Certificate for "cephadm-signed_agent_cert (trial046)" is still valid for 1824 days. 2026-02-23T13:03:07.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:07 trial046 ceph-mon[38575]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch get-security-config"}]: dispatch 2026-02-23T13:03:07.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:07 trial046 ceph-mon[38575]: pgmap v6: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-23T13:03:07.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:07 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3338972617' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:03:07.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:07 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4111117141' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16} : dispatch 2026-02-23T13:03:07.892 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:07.990 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:07.988+0000 7fd7bfa3d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:07.990 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:07.988+0000 7fd7bfa3d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:08.703 INFO:teuthology.orchestra.run.trial046.stderr:enabled application 'rados' on pool 'unique_pool_0' 2026-02-23T13:03:08.902 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:03:09.018 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:09.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:08 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4111117141' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]': finished 2026-02-23T13:03:09.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:08 trial046 ceph-mon[38575]: osdmap e28: 4 total, 4 up, 4 in 2026-02-23T13:03:09.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:08 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3981028383' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true} : dispatch 2026-02-23T13:03:09.120 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:09.118+0000 7f2c482e3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:09.120 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:09.119+0000 7f2c482e3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:09.132 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:03:09.132 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:03:09.142 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:03:09.143 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:03:09.153 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:03:09.153 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:03:09.163 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:03:09.163 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:03:09.746 DEBUG:teuthology.orchestra.run.trial046:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -t 16 -b 65536 --object-size 65536 -p unique_pool_0 bench 90 write' 2026-02-23T13:03:09.749 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2026-02-23T13:03:09.749 INFO:teuthology.orchestra.run:waiting for 3000 2026-02-23T13:03:09.796 INFO:tasks.radosbench.radosbench.0.trial046.stdout:hints = 1 2026-02-23T13:03:09.797 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2026-02-23T13:03:09.797 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Object prefix: benchmark_data_trial046_81118 2026-02-23T13:03:09.797 INFO:tasks.radosbench.radosbench.0.trial046.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-23T13:03:09.797 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 0 0 0 0 0 0 - 0 2026-02-23T13:03:10.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:09 trial046 ceph-mon[38575]: pgmap v8: 17 pgs: 16 unknown, 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 25 KiB/s rd, 0 B/s wr, 10 op/s 2026-02-23T13:03:10.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:09 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3981028383' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]': finished 2026-02-23T13:03:10.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:09 trial046 ceph-mon[38575]: osdmap e29: 4 total, 4 up, 4 in 2026-02-23T13:03:10.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:09 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3822117590' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:03:10.797 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 1 16 7181 7165 447.776 447.812 0.00217038 0.00222896 2026-02-23T13:03:11.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:10 trial046 ceph-mon[38575]: osdmap e30: 4 total, 4 up, 4 in 2026-02-23T13:03:11.200 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:03:11.339 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:11.449 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:11.447+0000 7f134b1b5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:11.450 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:11.448+0000 7f134b1b5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:11.463 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:03:11.464 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:03:11.477 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:03:11.477 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:03:11.489 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:03:11.489 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:03:11.501 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:03:11.501 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:03:11.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:11 trial046 ceph-mon[38575]: pgmap v11: 17 pgs: 16 unknown, 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 29 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-23T13:03:11.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:11 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1089419113' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:03:11.797 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 2 16 14225 14209 443.996 440.25 0.00147358 0.00224938 2026-02-23T13:03:12.664 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:03:12.664 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:03:12.664 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:03:12.664 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:03:12.797 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 3 16 21651 21635 450.694 464.125 0.0021291 0.00221684 2026-02-23T13:03:12.804 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:12.937 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:12.934+0000 7f430f1ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:12.938 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:12.935+0000 7f430f1ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:13.087 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:03:13.088 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:03:13.133 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2026-02-23T13:03:12.591979+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":842465824,"num_objects":12848,"num_object_clones":0,"num_object_copies":38544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12848,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":12981,"num_write_kb":824294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":2015532,"kb_used_data":1871580,"kb_used_omap":52,"kb_used_meta":143819,"kb_avail":2933997268,"statfs":{"total":3006477107200,"available":3004413202432,"internally_reserved":0,"allocated":1916497920,"data_stored":1915799452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":54009,"internal_metadata":147270919},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":841875456,"num_objects":12846,"num_object_clones":0,"num_object_copies":38538,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12846,"num_whiteouts":0,"num_read":60,"num_read_kb":176,"num_write":12858,"num_write_kb":822144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000782"},"pg_stats":[{"pgid":"2.f","version":"30'837","reported_seq":850,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:11.591790+0000","last_change":"2026-02-23T13:03:08.711612+0000","last_active":"2026-02-23T13:03:11.591790+0000","last_peered":"2026-02-23T13:03:11.591790+0000","last_clean":"2026-02-23T13:03:11.591790+0000","last_became_active":"2026-02-23T13:03:08.711408+0000","last_became_peered":"2026-02-23T13:03:08.711408+0000","last_unstale":"2026-02-23T13:03:11.591790+0000","last_undegraded":"2026-02-23T13:03:11.591790+0000","last_fullsized":"2026-02-23T13:03:11.591790+0000","mapping_epoch":28,"log_start":"30'834","ondisk_log_start":"30'834","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":834,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:21.274136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54853632,"num_objects":837,"num_object_clones":0,"num_object_copies":2511,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":837,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":837,"num_write_kb":53568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"30'830","reported_seq":843,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:11.590648+0000","last_change":"2026-02-23T13:03:08.711629+0000","last_active":"2026-02-23T13:03:11.590648+0000","last_peered":"2026-02-23T13:03:11.590648+0000","last_clean":"2026-02-23T13:03:11.590648+0000","last_became_active":"2026-02-23T13:03:08.711462+0000","last_became_peered":"2026-02-23T13:03:08.711462+0000","last_unstale":"2026-02-23T13:03:11.590648+0000","last_undegraded":"2026-02-23T13:03:11.590648+0000","last_fullsized":"2026-02-23T13:03:11.590648+0000","mapping_epoch":28,"log_start":"30'827","ondisk_log_start":"30'827","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":827,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:35.369081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54394880,"num_objects":830,"num_object_clones":0,"num_object_copies":2490,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":830,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":830,"num_write_kb":53120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"30'827","reported_seq":841,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:11.591020+0000","last_change":"2026-02-23T13:03:08.712615+0000","last_active":"2026-02-23T13:03:11.591020+0000","last_peered":"2026-02-23T13:03:11.591020+0000","last_clean":"2026-02-23T13:03:11.591020+0000","last_became_active":"2026-02-23T13:03:08.712246+0000","last_became_peered":"2026-02-23T13:03:08.712246+0000","last_unstale":"2026-02-23T13:03:11.591020+0000","last_undegraded":"2026-02-23T13:03:11.591020+0000","last_fullsized":"2026-02-23T13:03:11.591020+0000","mapping_epoch":28,"log_start":"30'824","ondisk_log_start":"30'824","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":824,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:26.869038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54198272,"num_objects":827,"num_object_clones":0,"num_object_copies":2481,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":827,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":827,"num_write_kb":52928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"30'822","reported_seq":835,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:11.591444+0000","last_change":"2026-02-23T13:03:08.712832+0000","last_active":"2026-02-23T13:03:11.591444+0000","last_peered":"2026-02-23T13:03:11.591444+0000","last_clean":"2026-02-23T13:03:11.591444+0000","last_became_active":"2026-02-23T13:03:08.712348+0000","last_became_peered":"2026-02-23T13:03:08.712348+0000","last_unstale":"2026-02-23T13:03:11.591444+0000","last_undegraded":"2026-02-23T13:03:11.591444+0000","last_fullsized":"2026-02-23T13:03:11.591444+0000","mapping_epoch":28,"log_start":"30'819","ondisk_log_start":"30'819","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":819,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:23.478567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53870592,"num_objects":822,"num_object_clones":0,"num_object_copies":2466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":822,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":52608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:09.799124+0000","last_change":"2026-02-23T13:02:55.158696+0000","last_active":"2026-02-23T13:03:09.799124+0000","last_peered":"2026-02-23T13:03:09.799124+0000","last_clean":"2026-02-23T13:03:09.799124+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:03:09.799124+0000","last_undegraded":"2026-02-23T13:03:09.799124+0000","last_fullsized":"2026-02-23T13:03:09.799124+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:02:44.100679+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:07.625581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"30'776","reported_seq":789,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:11.590071+0000","last_change":"2026-02-23T13:03:08.709049+0000","last_active":"2026-02-23T13:03:11.590071+0000","last_peered":"2026-02-23T13:03:11.590071+0000","last_clean":"2026-02-23T13:03:11.590071+0000","last_became_active":"2026-02-23T13:03:08.708695+0000","last_became_peered":"2026-02-23T13:03:08.708695+0000","last_unstale":"2026-02-23T13:03:11.590071+0000","last_undegraded":"2026-02-23T13:03:11.590071+0000","last_fullsized":"2026-02-23T13:03:11.590071+0000","mapping_epoch":28,"log_start":"30'773","ondisk_log_start":"30'773","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":773,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:11.438878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50855936,"num_objects":776,"num_object_clones":0,"num_object_copies":2328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":776,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":776,"num_write_kb":49664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"30'778","reported_seq":792,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:11.588640+0000","last_change":"2026-02-23T13:03:08.712038+0000","last_active":"2026-02-23T13:03:11.588640+0000","last_peered":"2026-02-23T13:03:11.588640+0000","last_clean":"2026-02-23T13:03:11.588640+0000","last_became_active":"2026-02-23T13:03:08.711847+0000","last_became_peered":"2026-02-23T13:03:08.711847+0000","last_unstale":"2026-02-23T13:03:11.588640+0000","last_undegraded":"2026-02-23T13:03:11.588640+0000","last_fullsized":"2026-02-23T13:03:11.588640+0000","mapping_epoch":28,"log_start":"30'775","ondisk_log_start":"30'775","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":775,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:25.087301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50987008,"num_objects":778,"num_object_clones":0,"num_object_copies":2334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":778,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":778,"num_write_kb":49792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"30'770","reported_seq":783,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:11.587713+0000","last_change":"2026-02-23T13:03:08.713062+0000","last_active":"2026-02-23T13:03:11.587713+0000","last_peered":"2026-02-23T13:03:11.587713+0000","last_clean":"2026-02-23T13:03:11.587713+0000","last_became_active":"2026-02-23T13:03:08.712783+0000","last_became_peered":"2026-02-23T13:03:08.712783+0000","last_unstale":"2026-02-23T13:03:11.587713+0000","last_undegraded":"2026-02-23T13:03:11.587713+0000","last_fullsized":"2026-02-23T13:03:11.587713+0000","mapping_epoch":28,"log_start":"30'767","ondisk_log_start":"30'767","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":767,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:07.712555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50462720,"num_objects":770,"num_object_clones":0,"num_object_copies":2310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":770,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":770,"num_write_kb":49280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"30'805","reported_seq":816,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:11.590152+0000","last_change":"2026-02-23T13:03:08.709181+0000","last_active":"2026-02-23T13:03:11.590152+0000","last_peered":"2026-02-23T13:03:11.590152+0000","last_clean":"2026-02-23T13:03:11.590152+0000","last_became_active":"2026-02-23T13:03:08.708821+0000","last_became_peered":"2026-02-23T13:03:08.708821+0000","last_unstale":"2026-02-23T13:03:11.590152+0000","last_undegraded":"2026-02-23T13:03:11.590152+0000","last_fullsized":"2026-02-23T13:03:11.590152+0000","mapping_epoch":28,"log_start":"30'802","ondisk_log_start":"30'802","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":802,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:22.653808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52756480,"num_objects":805,"num_object_clones":0,"num_object_copies":2415,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":805,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":805,"num_write_kb":51520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"30'815","reported_seq":827,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:11.590443+0000","last_change":"2026-02-23T13:03:08.712493+0000","last_active":"2026-02-23T13:03:11.590443+0000","last_peered":"2026-02-23T13:03:11.590443+0000","last_clean":"2026-02-23T13:03:11.590443+0000","last_became_active":"2026-02-23T13:03:08.712152+0000","last_became_peered":"2026-02-23T13:03:08.712152+0000","last_unstale":"2026-02-23T13:03:11.590443+0000","last_undegraded":"2026-02-23T13:03:11.590443+0000","last_fullsized":"2026-02-23T13:03:11.590443+0000","mapping_epoch":28,"log_start":"30'812","ondisk_log_start":"30'812","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":812,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:33.900038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53411840,"num_objects":815,"num_object_clones":0,"num_object_copies":2445,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":815,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":815,"num_write_kb":52160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"30'792","reported_seq":806,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:11.585293+0000","last_change":"2026-02-23T13:03:08.712205+0000","last_active":"2026-02-23T13:03:11.585293+0000","last_peered":"2026-02-23T13:03:11.585293+0000","last_clean":"2026-02-23T13:03:11.585293+0000","last_became_active":"2026-02-23T13:03:08.712055+0000","last_became_peered":"2026-02-23T13:03:08.712055+0000","last_unstale":"2026-02-23T13:03:11.585293+0000","last_undegraded":"2026-02-23T13:03:11.585293+0000","last_fullsized":"2026-02-23T13:03:11.585293+0000","mapping_epoch":28,"log_start":"30'789","ondisk_log_start":"30'789","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":789,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:37.263900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51904512,"num_objects":792,"num_object_clones":0,"num_object_copies":2376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":792,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":792,"num_write_kb":50688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"30'763","reported_seq":776,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:11.591274+0000","last_change":"2026-02-23T13:03:08.709028+0000","last_active":"2026-02-23T13:03:11.591274+0000","last_peered":"2026-02-23T13:03:11.591274+0000","last_clean":"2026-02-23T13:03:11.591274+0000","last_became_active":"2026-02-23T13:03:08.708852+0000","last_became_peered":"2026-02-23T13:03:08.708852+0000","last_unstale":"2026-02-23T13:03:11.591274+0000","last_undegraded":"2026-02-23T13:03:11.591274+0000","last_fullsized":"2026-02-23T13:03:11.591274+0000","mapping_epoch":28,"log_start":"30'760","ondisk_log_start":"30'760","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":760,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:19.208546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50003968,"num_objects":763,"num_object_clones":0,"num_object_copies":2289,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":763,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":763,"num_write_kb":48832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"30'854","reported_seq":867,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:11.588445+0000","last_change":"2026-02-23T13:03:08.708883+0000","last_active":"2026-02-23T13:03:11.588445+0000","last_peered":"2026-02-23T13:03:11.588445+0000","last_clean":"2026-02-23T13:03:11.588445+0000","last_became_active":"2026-02-23T13:03:08.708457+0000","last_became_peered":"2026-02-23T13:03:08.708457+0000","last_unstale":"2026-02-23T13:03:11.588445+0000","last_undegraded":"2026-02-23T13:03:11.588445+0000","last_fullsized":"2026-02-23T13:03:11.588445+0000","mapping_epoch":28,"log_start":"30'851","ondisk_log_start":"30'851","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":851,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:32.806938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55967744,"num_objects":854,"num_object_clones":0,"num_object_copies":2562,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":854,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":854,"num_write_kb":54656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"30'792","reported_seq":806,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:11.588887+0000","last_change":"2026-02-23T13:03:08.712176+0000","last_active":"2026-02-23T13:03:11.588887+0000","last_peered":"2026-02-23T13:03:11.588887+0000","last_clean":"2026-02-23T13:03:11.588887+0000","last_became_active":"2026-02-23T13:03:08.712010+0000","last_became_peered":"2026-02-23T13:03:08.712010+0000","last_unstale":"2026-02-23T13:03:11.588887+0000","last_undegraded":"2026-02-23T13:03:11.588887+0000","last_fullsized":"2026-02-23T13:03:11.588887+0000","mapping_epoch":28,"log_start":"30'789","ondisk_log_start":"30'789","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":789,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:29.753408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51904512,"num_objects":792,"num_object_clones":0,"num_object_copies":2376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":792,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":792,"num_write_kb":50688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"30'814","reported_seq":828,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:11.589109+0000","last_change":"2026-02-23T13:03:08.713049+0000","last_active":"2026-02-23T13:03:11.589109+0000","last_peered":"2026-02-23T13:03:11.589109+0000","last_clean":"2026-02-23T13:03:11.589109+0000","last_became_active":"2026-02-23T13:03:08.712763+0000","last_became_peered":"2026-02-23T13:03:08.712763+0000","last_unstale":"2026-02-23T13:03:11.589109+0000","last_undegraded":"2026-02-23T13:03:11.589109+0000","last_fullsized":"2026-02-23T13:03:11.589109+0000","mapping_epoch":28,"log_start":"30'811","ondisk_log_start":"30'811","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":811,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:18.501703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53346304,"num_objects":814,"num_object_clones":0,"num_object_copies":2442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":814,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":814,"num_write_kb":52096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"30'820","reported_seq":834,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:11.591400+0000","last_change":"2026-02-23T13:03:08.709558+0000","last_active":"2026-02-23T13:03:11.591400+0000","last_peered":"2026-02-23T13:03:11.591400+0000","last_clean":"2026-02-23T13:03:11.591400+0000","last_became_active":"2026-02-23T13:03:08.709391+0000","last_became_peered":"2026-02-23T13:03:08.709391+0000","last_unstale":"2026-02-23T13:03:11.591400+0000","last_undegraded":"2026-02-23T13:03:11.591400+0000","last_fullsized":"2026-02-23T13:03:11.591400+0000","mapping_epoch":28,"log_start":"30'817","ondisk_log_start":"30'817","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":817,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:34.787615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53739520,"num_objects":820,"num_object_clones":0,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":820,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":820,"num_write_kb":52480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"30'751","reported_seq":765,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:11.588237+0000","last_change":"2026-02-23T13:03:08.711473+0000","last_active":"2026-02-23T13:03:11.588237+0000","last_peered":"2026-02-23T13:03:11.588237+0000","last_clean":"2026-02-23T13:03:11.588237+0000","last_became_active":"2026-02-23T13:03:08.711303+0000","last_became_peered":"2026-02-23T13:03:08.711303+0000","last_unstale":"2026-02-23T13:03:11.588237+0000","last_undegraded":"2026-02-23T13:03:11.588237+0000","last_fullsized":"2026-02-23T13:03:11.588237+0000","mapping_epoch":28,"log_start":"30'748","ondisk_log_start":"30'748","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":748,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:35.916414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49217536,"num_objects":751,"num_object_clones":0,"num_object_copies":2253,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":751,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":751,"num_write_kb":48064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":841875456,"num_objects":12846,"num_object_clones":0,"num_object_copies":38538,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12846,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12846,"num_write_kb":822144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2524643328,"data_stored":2524643328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247813,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":660188,"kb_used_data":615176,"kb_used_omap":8,"kb_used_meta":44983,"kb_avail":733343012,"statfs":{"total":751619276800,"available":750943244288,"internally_reserved":0,"allocated":629940224,"data_stored":629764719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8772,"internal_metadata":46063036},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444040,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":341660,"kb_used_data":314696,"kb_used_omap":12,"kb_used_meta":26931,"kb_avail":733661540,"statfs":{"total":751619276800,"available":751269416960,"internally_reserved":0,"allocated":322248704,"data_stored":322073199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12692,"internal_metadata":27577964},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":654616,"kb_used_data":609604,"kb_used_omap":14,"kb_used_meta":44977,"kb_avail":733348584,"statfs":{"total":751619276800,"available":750948950016,"internally_reserved":0,"allocated":624234496,"data_stored":624062543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15296,"internal_metadata":46056512},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705675,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":359068,"kb_used_data":332104,"kb_used_omap":16,"kb_used_meta":26927,"kb_avail":733644132,"statfs":{"total":751619276800,"available":751251591168,"internally_reserved":0,"allocated":340074496,"data_stored":339898991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17249,"internal_metadata":27573407},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":578224128,"data_stored":578224128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":633929728,"data_stored":633929728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":578748416,"data_stored":578748416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":733741056,"data_stored":733741056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:03:13.135 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:03:13.135 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 11 2026-02-23T13:03:13.278 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:13.405 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:13.403+0000 7f84b2ef1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:13.406 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:13.404+0000 7f84b2ef1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:13.542 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:03:13.543 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:03:13.581 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:03:13.684 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:13.797 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 4 16 28702 28686 448.185 440.688 0.00209462 0.00222945 2026-02-23T13:03:13.810 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:13.808+0000 7fdb6f554640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:13.810 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:13.808+0000 7fdb6f554640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:13.823 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:03:13.824 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:03:13.836 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:03:13.836 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:03:13.848 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:03:13.849 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:03:13.860 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:03:13.860 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:03:14.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:13 trial046 ceph-mon[38575]: pgmap v12: 17 pgs: 17 active+clean; 803 MiB data, 1.9 GiB used, 2.7 TiB / 2.7 TiB avail; 29 KiB/s rd, 134 MiB/s wr, 2.15k op/s 2026-02-23T13:03:14.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:13 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/933313024' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "11"} : dispatch 2026-02-23T13:03:14.797 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 5 16 35746 35730 446.591 440.25 0.00210477 0.00223771 2026-02-23T13:03:15.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:14 trial046 ceph-mon[38575]: from='client.14350 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:03:15.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:14 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1267244556' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:03:15.798 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 6 16 42460 42444 442.091 419.625 0.00294568 0.00226049 2026-02-23T13:03:15.904 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:03:16.038 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:16.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:15 trial046 ceph-mon[38575]: pgmap v13: 17 pgs: 17 active+clean; 803 MiB data, 1.9 GiB used, 2.7 TiB / 2.7 TiB avail; 116 MiB/s wr, 1.86k op/s 2026-02-23T13:03:16.153 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:16.151+0000 7f3a17cc3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:16.153 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:16.151+0000 7f3a17cc3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:16.167 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:03:16.168 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:03:16.179 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:03:16.180 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:03:16.192 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:03:16.192 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:03:16.203 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:03:16.203 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:03:16.539 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:03:16 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:03:16] "GET /metrics HTTP/1.1" 200 4214 "" "Prometheus/3.6.0" 2026-02-23T13:03:16.561 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:16 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:03:16.087Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:03:16.797 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 7 16 49246 49230 439.52 424.125 0.00170134 0.00227368 2026-02-23T13:03:17.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:16 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:03:17.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:16 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1034578032' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:03:17.798 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 8 16 56538 56522 441.545 455.75 0.00185903 0.00226335 2026-02-23T13:03:18.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:17 trial046 ceph-mon[38575]: pgmap v14: 17 pgs: 17 active+clean; 1.7 GiB data, 5.4 GiB used, 2.7 TiB / 2.7 TiB avail; 220 MiB/s wr, 3.51k op/s 2026-02-23T13:03:18.246 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:03:18.386 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:18.513 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:18.510+0000 7fe37faeb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:18.513 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:18.510+0000 7fe37faeb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:18.529 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:03:18.529 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:03:18.542 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:03:18.543 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:03:18.556 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:03:18.556 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:03:18.569 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:03:18.569 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:03:18.582 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:03:18.582 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:03:18.582 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_0 2026-02-23T13:03:18.583 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:03:18.722 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:18.785 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:18 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3519660335' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:03:18.797 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 9 15 63871 63856 443.411 458.375 0.00148862 0.00225387 2026-02-23T13:03:18.849 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:18.847+0000 7f4420a14640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:18.849 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:18.847+0000 7f4420a14640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:18.984 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:03:18.985 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:03:19.032 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2026-02-23T13:03:18.592744+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3136225824,"num_objects":47848,"num_object_clones":0,"num_object_copies":143544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47848,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":47981,"num_write_kb":3064294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":9074540,"kb_used_data":8605660,"kb_used_omap":52,"kb_used_meta":468683,"kb_avail":2926938260,"statfs":{"total":3006477107200,"available":2997184778240,"internally_reserved":0,"allocated":8812195840,"data_stored":8811497372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":54009,"internal_metadata":479931655},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,4,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3135635456,"num_objects":47846,"num_object_clones":0,"num_object_copies":143538,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47846,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47846,"num_write_kb":3062144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.889356"},"pg_stats":[{"pgid":"2.f","version":"30'2954","reported_seq":2968,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:16.584882+0000","last_change":"2026-02-23T13:03:08.711612+0000","last_active":"2026-02-23T13:03:16.584882+0000","last_peered":"2026-02-23T13:03:16.584882+0000","last_clean":"2026-02-23T13:03:16.584882+0000","last_became_active":"2026-02-23T13:03:08.711408+0000","last_became_peered":"2026-02-23T13:03:08.711408+0000","last_unstale":"2026-02-23T13:03:16.584882+0000","last_undegraded":"2026-02-23T13:03:16.584882+0000","last_fullsized":"2026-02-23T13:03:16.584882+0000","mapping_epoch":28,"log_start":"30'2951","ondisk_log_start":"30'2951","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2951,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:21.274136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":193593344,"num_objects":2954,"num_object_clones":0,"num_object_copies":8862,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2954,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2954,"num_write_kb":189056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"30'3066","reported_seq":3080,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:16.582799+0000","last_change":"2026-02-23T13:03:08.711629+0000","last_active":"2026-02-23T13:03:16.582799+0000","last_peered":"2026-02-23T13:03:16.582799+0000","last_clean":"2026-02-23T13:03:16.582799+0000","last_became_active":"2026-02-23T13:03:08.711462+0000","last_became_peered":"2026-02-23T13:03:08.711462+0000","last_unstale":"2026-02-23T13:03:16.582799+0000","last_undegraded":"2026-02-23T13:03:16.582799+0000","last_fullsized":"2026-02-23T13:03:16.582799+0000","mapping_epoch":28,"log_start":"30'3063","ondisk_log_start":"30'3063","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:35.369081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200933376,"num_objects":3066,"num_object_clones":0,"num_object_copies":9198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3066,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3066,"num_write_kb":196224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"30'3041","reported_seq":3055,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:16.585819+0000","last_change":"2026-02-23T13:03:08.712615+0000","last_active":"2026-02-23T13:03:16.585819+0000","last_peered":"2026-02-23T13:03:16.585819+0000","last_clean":"2026-02-23T13:03:16.585819+0000","last_became_active":"2026-02-23T13:03:08.712246+0000","last_became_peered":"2026-02-23T13:03:08.712246+0000","last_unstale":"2026-02-23T13:03:16.585819+0000","last_undegraded":"2026-02-23T13:03:16.585819+0000","last_fullsized":"2026-02-23T13:03:16.585819+0000","mapping_epoch":28,"log_start":"30'3038","ondisk_log_start":"30'3038","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:26.869038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199294976,"num_objects":3041,"num_object_clones":0,"num_object_copies":9123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3041,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3041,"num_write_kb":194624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"30'3080","reported_seq":3094,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:16.592647+0000","last_change":"2026-02-23T13:03:08.712832+0000","last_active":"2026-02-23T13:03:16.592647+0000","last_peered":"2026-02-23T13:03:16.592647+0000","last_clean":"2026-02-23T13:03:16.592647+0000","last_became_active":"2026-02-23T13:03:08.712348+0000","last_became_peered":"2026-02-23T13:03:08.712348+0000","last_unstale":"2026-02-23T13:03:16.592647+0000","last_undegraded":"2026-02-23T13:03:16.592647+0000","last_fullsized":"2026-02-23T13:03:16.592647+0000","mapping_epoch":28,"log_start":"30'3077","ondisk_log_start":"30'3077","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:23.478567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201850880,"num_objects":3080,"num_object_clones":0,"num_object_copies":9240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3080,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3080,"num_write_kb":197120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:09.799124+0000","last_change":"2026-02-23T13:02:55.158696+0000","last_active":"2026-02-23T13:03:09.799124+0000","last_peered":"2026-02-23T13:03:09.799124+0000","last_clean":"2026-02-23T13:03:09.799124+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:03:09.799124+0000","last_undegraded":"2026-02-23T13:03:09.799124+0000","last_fullsized":"2026-02-23T13:03:09.799124+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:02:44.100679+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:07.625581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"30'2953","reported_seq":2967,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:16.589774+0000","last_change":"2026-02-23T13:03:08.709049+0000","last_active":"2026-02-23T13:03:16.589774+0000","last_peered":"2026-02-23T13:03:16.589774+0000","last_clean":"2026-02-23T13:03:16.589774+0000","last_became_active":"2026-02-23T13:03:08.708695+0000","last_became_peered":"2026-02-23T13:03:08.708695+0000","last_unstale":"2026-02-23T13:03:16.589774+0000","last_undegraded":"2026-02-23T13:03:16.589774+0000","last_fullsized":"2026-02-23T13:03:16.589774+0000","mapping_epoch":28,"log_start":"30'2950","ondisk_log_start":"30'2950","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2950,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:11.438878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":193527808,"num_objects":2953,"num_object_clones":0,"num_object_copies":8859,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2953,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2953,"num_write_kb":188992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"30'2885","reported_seq":2899,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:16.585697+0000","last_change":"2026-02-23T13:03:08.712038+0000","last_active":"2026-02-23T13:03:16.585697+0000","last_peered":"2026-02-23T13:03:16.585697+0000","last_clean":"2026-02-23T13:03:16.585697+0000","last_became_active":"2026-02-23T13:03:08.711847+0000","last_became_peered":"2026-02-23T13:03:08.711847+0000","last_unstale":"2026-02-23T13:03:16.585697+0000","last_undegraded":"2026-02-23T13:03:16.585697+0000","last_fullsized":"2026-02-23T13:03:16.585697+0000","mapping_epoch":28,"log_start":"30'2882","ondisk_log_start":"30'2882","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2882,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:25.087301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":189071360,"num_objects":2885,"num_object_clones":0,"num_object_copies":8655,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2885,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2885,"num_write_kb":184640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"30'2994","reported_seq":3008,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:16.590438+0000","last_change":"2026-02-23T13:03:08.713062+0000","last_active":"2026-02-23T13:03:16.590438+0000","last_peered":"2026-02-23T13:03:16.590438+0000","last_clean":"2026-02-23T13:03:16.590438+0000","last_became_active":"2026-02-23T13:03:08.712783+0000","last_became_peered":"2026-02-23T13:03:08.712783+0000","last_unstale":"2026-02-23T13:03:16.590438+0000","last_undegraded":"2026-02-23T13:03:16.590438+0000","last_fullsized":"2026-02-23T13:03:16.590438+0000","mapping_epoch":28,"log_start":"30'2991","ondisk_log_start":"30'2991","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2991,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:07.712555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196214784,"num_objects":2994,"num_object_clones":0,"num_object_copies":8982,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2994,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2994,"num_write_kb":191616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"30'2960","reported_seq":2974,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:16.589182+0000","last_change":"2026-02-23T13:03:08.709181+0000","last_active":"2026-02-23T13:03:16.589182+0000","last_peered":"2026-02-23T13:03:16.589182+0000","last_clean":"2026-02-23T13:03:16.589182+0000","last_became_active":"2026-02-23T13:03:08.708821+0000","last_became_peered":"2026-02-23T13:03:08.708821+0000","last_unstale":"2026-02-23T13:03:16.589182+0000","last_undegraded":"2026-02-23T13:03:16.589182+0000","last_fullsized":"2026-02-23T13:03:16.589182+0000","mapping_epoch":28,"log_start":"30'2957","ondisk_log_start":"30'2957","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2957,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:22.653808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":193986560,"num_objects":2960,"num_object_clones":0,"num_object_copies":8880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2960,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2960,"num_write_kb":189440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"30'2949","reported_seq":2963,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:16.591826+0000","last_change":"2026-02-23T13:03:08.712493+0000","last_active":"2026-02-23T13:03:16.591826+0000","last_peered":"2026-02-23T13:03:16.591826+0000","last_clean":"2026-02-23T13:03:16.591826+0000","last_became_active":"2026-02-23T13:03:08.712152+0000","last_became_peered":"2026-02-23T13:03:08.712152+0000","last_unstale":"2026-02-23T13:03:16.591826+0000","last_undegraded":"2026-02-23T13:03:16.591826+0000","last_fullsized":"2026-02-23T13:03:16.591826+0000","mapping_epoch":28,"log_start":"30'2946","ondisk_log_start":"30'2946","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2946,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:33.900038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":193265664,"num_objects":2949,"num_object_clones":0,"num_object_copies":8847,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2949,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2949,"num_write_kb":188736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"30'2922","reported_seq":2936,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:16.588624+0000","last_change":"2026-02-23T13:03:08.712205+0000","last_active":"2026-02-23T13:03:16.588624+0000","last_peered":"2026-02-23T13:03:16.588624+0000","last_clean":"2026-02-23T13:03:16.588624+0000","last_became_active":"2026-02-23T13:03:08.712055+0000","last_became_peered":"2026-02-23T13:03:08.712055+0000","last_unstale":"2026-02-23T13:03:16.588624+0000","last_undegraded":"2026-02-23T13:03:16.588624+0000","last_fullsized":"2026-02-23T13:03:16.588624+0000","mapping_epoch":28,"log_start":"30'2919","ondisk_log_start":"30'2919","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2919,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:37.263900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191496192,"num_objects":2922,"num_object_clones":0,"num_object_copies":8766,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2922,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2922,"num_write_kb":187008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"30'2933","reported_seq":2947,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:16.585708+0000","last_change":"2026-02-23T13:03:08.709028+0000","last_active":"2026-02-23T13:03:16.585708+0000","last_peered":"2026-02-23T13:03:16.585708+0000","last_clean":"2026-02-23T13:03:16.585708+0000","last_became_active":"2026-02-23T13:03:08.708852+0000","last_became_peered":"2026-02-23T13:03:08.708852+0000","last_unstale":"2026-02-23T13:03:16.585708+0000","last_undegraded":"2026-02-23T13:03:16.585708+0000","last_fullsized":"2026-02-23T13:03:16.585708+0000","mapping_epoch":28,"log_start":"30'2930","ondisk_log_start":"30'2930","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2930,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:19.208546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192217088,"num_objects":2933,"num_object_clones":0,"num_object_copies":8799,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2933,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2933,"num_write_kb":187712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"30'3128","reported_seq":3142,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:16.589368+0000","last_change":"2026-02-23T13:03:08.708883+0000","last_active":"2026-02-23T13:03:16.589368+0000","last_peered":"2026-02-23T13:03:16.589368+0000","last_clean":"2026-02-23T13:03:16.589368+0000","last_became_active":"2026-02-23T13:03:08.708457+0000","last_became_peered":"2026-02-23T13:03:08.708457+0000","last_unstale":"2026-02-23T13:03:16.589368+0000","last_undegraded":"2026-02-23T13:03:16.589368+0000","last_fullsized":"2026-02-23T13:03:16.589368+0000","mapping_epoch":28,"log_start":"30'3125","ondisk_log_start":"30'3125","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:32.806938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204996608,"num_objects":3128,"num_object_clones":0,"num_object_copies":9384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3128,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3128,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"30'2984","reported_seq":2998,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:16.581670+0000","last_change":"2026-02-23T13:03:08.712176+0000","last_active":"2026-02-23T13:03:16.581670+0000","last_peered":"2026-02-23T13:03:16.581670+0000","last_clean":"2026-02-23T13:03:16.581670+0000","last_became_active":"2026-02-23T13:03:08.712010+0000","last_became_peered":"2026-02-23T13:03:08.712010+0000","last_unstale":"2026-02-23T13:03:16.581670+0000","last_undegraded":"2026-02-23T13:03:16.581670+0000","last_fullsized":"2026-02-23T13:03:16.581670+0000","mapping_epoch":28,"log_start":"30'2981","ondisk_log_start":"30'2981","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2981,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:29.753408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195559424,"num_objects":2984,"num_object_clones":0,"num_object_copies":8952,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2984,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2984,"num_write_kb":190976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"30'2978","reported_seq":2992,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:16.588048+0000","last_change":"2026-02-23T13:03:08.713049+0000","last_active":"2026-02-23T13:03:16.588048+0000","last_peered":"2026-02-23T13:03:16.588048+0000","last_clean":"2026-02-23T13:03:16.588048+0000","last_became_active":"2026-02-23T13:03:08.712763+0000","last_became_peered":"2026-02-23T13:03:08.712763+0000","last_unstale":"2026-02-23T13:03:16.588048+0000","last_undegraded":"2026-02-23T13:03:16.588048+0000","last_fullsized":"2026-02-23T13:03:16.588048+0000","mapping_epoch":28,"log_start":"30'2975","ondisk_log_start":"30'2975","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2975,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:18.501703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195166208,"num_objects":2978,"num_object_clones":0,"num_object_copies":8934,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2978,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2978,"num_write_kb":190592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"30'3039","reported_seq":3053,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:16.590268+0000","last_change":"2026-02-23T13:03:08.709558+0000","last_active":"2026-02-23T13:03:16.590268+0000","last_peered":"2026-02-23T13:03:16.590268+0000","last_clean":"2026-02-23T13:03:16.590268+0000","last_became_active":"2026-02-23T13:03:08.709391+0000","last_became_peered":"2026-02-23T13:03:08.709391+0000","last_unstale":"2026-02-23T13:03:16.590268+0000","last_undegraded":"2026-02-23T13:03:16.590268+0000","last_fullsized":"2026-02-23T13:03:16.590268+0000","mapping_epoch":28,"log_start":"30'3036","ondisk_log_start":"30'3036","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:34.787615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199163904,"num_objects":3039,"num_object_clones":0,"num_object_copies":9117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3039,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3039,"num_write_kb":194496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"30'2980","reported_seq":2994,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:16.589082+0000","last_change":"2026-02-23T13:03:08.711473+0000","last_active":"2026-02-23T13:03:16.589082+0000","last_peered":"2026-02-23T13:03:16.589082+0000","last_clean":"2026-02-23T13:03:16.589082+0000","last_became_active":"2026-02-23T13:03:08.711303+0000","last_became_peered":"2026-02-23T13:03:08.711303+0000","last_unstale":"2026-02-23T13:03:16.589082+0000","last_undegraded":"2026-02-23T13:03:16.589082+0000","last_fullsized":"2026-02-23T13:03:16.589082+0000","mapping_epoch":28,"log_start":"30'2977","ondisk_log_start":"30'2977","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2977,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:35.916414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195297280,"num_objects":2980,"num_object_clones":0,"num_object_copies":8940,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2980,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2980,"num_write_kb":190720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":3135635456,"num_objects":47846,"num_object_clones":0,"num_object_copies":143538,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47846,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47846,"num_write_kb":3062144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9408348160,"data_stored":9408348160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247814,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2713948,"kb_used_data":2578632,"kb_used_omap":8,"kb_used_meta":135223,"kb_avail":731289252,"statfs":{"total":751619276800,"available":748840194048,"internally_reserved":0,"allocated":2640519168,"data_stored":2640343663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8772,"internal_metadata":138468796},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,3],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444041,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1961052,"kb_used_data":1861896,"kb_used_omap":12,"kb_used_meta":99123,"kb_avail":732042148,"statfs":{"total":751619276800,"available":749611159552,"internally_reserved":0,"allocated":1906581504,"data_stored":1906405999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12692,"internal_metadata":101502572},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2438104,"kb_used_data":2302852,"kb_used_omap":14,"kb_used_meta":135217,"kb_avail":731565096,"statfs":{"total":751619276800,"available":749122658304,"internally_reserved":0,"allocated":2358120448,"data_stored":2357948495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15296,"internal_metadata":138462272},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705676,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1961436,"kb_used_data":1862280,"kb_used_omap":16,"kb_used_meta":99119,"kb_avail":732041764,"statfs":{"total":751619276800,"available":749610766336,"internally_reserved":0,"allocated":1906974720,"data_stored":1906799215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17249,"internal_metadata":101498015},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2151874560,"data_stored":2151874560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2360082432,"data_stored":2360082432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2154496000,"data_stored":2154496000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2741895168,"data_stored":2741895168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:03:19.034 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:03:19.035 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_0 pg_num 26 2026-02-23T13:03:19.184 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:19.309 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:19.307+0000 7fb688d64640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:19.309 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:19.307+0000 7fb688d64640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:19.460 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:03:19.497 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:03:19.798 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 10 15 71175 71160 444.716 456.5 0.00258812 0.00224722 2026-02-23T13:03:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:19 trial046 ceph-mon[38575]: pgmap v15: 17 pgs: 17 active+clean; 2.9 GiB data, 8.7 GiB used, 2.7 TiB / 2.7 TiB avail; 302 MiB/s wr, 4.84k op/s 2026-02-23T13:03:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:19 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3457256034' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_0", "var": "pg_num", "val": "26"} : dispatch 2026-02-23T13:03:20.615 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:03:20.755 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:20.798 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 11 16 78024 78008 443.194 428 0.00133623 0.00225499 2026-02-23T13:03:20.882 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:20.880+0000 7fe21504d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:20.882 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:20.880+0000 7fe21504d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:20.896 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:03:20.897 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:03:20.897 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:20 trial046 ceph-mon[38575]: from='client.14360 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:03:20.909 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:03:20.909 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:03:20.921 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:03:20.921 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:03:20.933 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:03:20.933 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:03:21.798 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 12 16 84903 84887 442.086 429.938 0.0013139 0.00226063 2026-02-23T13:03:22.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:21 trial046 ceph-mon[38575]: pgmap v16: 17 pgs: 17 active+clean; 2.9 GiB data, 8.7 GiB used, 2.7 TiB / 2.7 TiB avail; 275 MiB/s wr, 4.39k op/s 2026-02-23T13:03:22.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:21 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3906885251' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:03:22.798 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 13 16 91763 91747 441.058 428.75 0.00158451 0.00226598 2026-02-23T13:03:22.976 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:03:23.121 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:23.507 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:23.463+0000 7f1dbef47640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:23.507 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:23.464+0000 7f1dbef47640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:23.507 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:03:23.507 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:03:23.508 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:03:23.508 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:03:23.508 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:03:23.508 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:03:23.519 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:03:23.519 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:03:23.798 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 14 16 97714 97698 436.119 371.938 0.000882404 0.00229142 2026-02-23T13:03:24.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:23 trial046 ceph-mon[38575]: pgmap v17: 17 pgs: 17 active+clean; 5.1 GiB data, 15 GiB used, 2.7 TiB / 2.7 TiB avail; 435 MiB/s wr, 6.95k op/s 2026-02-23T13:03:24.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:23 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1824503337' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:03:24.498 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:03:24.499 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:03:24.499 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:03:24.499 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:03:24.643 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:24.798 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 15 16 103560 103544 431.401 365.375 0.00257926 0.00231672 2026-02-23T13:03:25.143 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:25.071+0000 7f7f597da640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:25.144 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:25.072+0000 7f7f597da640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:25.207 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:03:25.208 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:03:25.677 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2026-02-23T13:03:24.593549+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5469241888,"num_objects":83447,"num_object_clones":0,"num_object_copies":250341,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83447,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":83580,"num_write_kb":5342630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":15902764,"kb_used_data":15036892,"kb_used_omap":52,"kb_used_meta":865739,"kb_avail":2920110036,"statfs":{"total":3006477107200,"available":2990192676864,"internally_reserved":0,"allocated":15397777408,"data_stored":15397078940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":54009,"internal_metadata":886516999},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,4,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4626776064,"num_objects":70599,"num_object_clones":0,"num_object_copies":211797,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70599,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70599,"num_write_kb":4518336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001570"},"pg_stats":[{"pgid":"2.f","version":"30'5220","reported_seq":5234,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:21.590286+0000","last_change":"2026-02-23T13:03:08.711612+0000","last_active":"2026-02-23T13:03:21.590286+0000","last_peered":"2026-02-23T13:03:21.590286+0000","last_clean":"2026-02-23T13:03:21.590286+0000","last_became_active":"2026-02-23T13:03:08.711408+0000","last_became_peered":"2026-02-23T13:03:08.711408+0000","last_unstale":"2026-02-23T13:03:21.590286+0000","last_undegraded":"2026-02-23T13:03:21.590286+0000","last_fullsized":"2026-02-23T13:03:21.590286+0000","mapping_epoch":28,"log_start":"30'5217","ondisk_log_start":"30'5217","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:21.274136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":342097920,"num_objects":5220,"num_object_clones":0,"num_object_copies":15660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5220,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5220,"num_write_kb":334080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"30'5283","reported_seq":5297,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:21.590630+0000","last_change":"2026-02-23T13:03:08.711629+0000","last_active":"2026-02-23T13:03:21.590630+0000","last_peered":"2026-02-23T13:03:21.590630+0000","last_clean":"2026-02-23T13:03:21.590630+0000","last_became_active":"2026-02-23T13:03:08.711462+0000","last_became_peered":"2026-02-23T13:03:08.711462+0000","last_unstale":"2026-02-23T13:03:21.590630+0000","last_undegraded":"2026-02-23T13:03:21.590630+0000","last_fullsized":"2026-02-23T13:03:21.590630+0000","mapping_epoch":28,"log_start":"30'5280","ondisk_log_start":"30'5280","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:35.369081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":346226688,"num_objects":5283,"num_object_clones":0,"num_object_copies":15849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5283,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5283,"num_write_kb":338112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"30'5213","reported_seq":5227,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:21.587245+0000","last_change":"2026-02-23T13:03:08.712615+0000","last_active":"2026-02-23T13:03:21.587245+0000","last_peered":"2026-02-23T13:03:21.587245+0000","last_clean":"2026-02-23T13:03:21.587245+0000","last_became_active":"2026-02-23T13:03:08.712246+0000","last_became_peered":"2026-02-23T13:03:08.712246+0000","last_unstale":"2026-02-23T13:03:21.587245+0000","last_undegraded":"2026-02-23T13:03:21.587245+0000","last_fullsized":"2026-02-23T13:03:21.587245+0000","mapping_epoch":28,"log_start":"30'5210","ondisk_log_start":"30'5210","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:26.869038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":341639168,"num_objects":5213,"num_object_clones":0,"num_object_copies":15639,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5213,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5213,"num_write_kb":333632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"30'5288","reported_seq":5302,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:21.589074+0000","last_change":"2026-02-23T13:03:08.712832+0000","last_active":"2026-02-23T13:03:21.589074+0000","last_peered":"2026-02-23T13:03:21.589074+0000","last_clean":"2026-02-23T13:03:21.589074+0000","last_became_active":"2026-02-23T13:03:08.712348+0000","last_became_peered":"2026-02-23T13:03:08.712348+0000","last_unstale":"2026-02-23T13:03:21.589074+0000","last_undegraded":"2026-02-23T13:03:21.589074+0000","last_fullsized":"2026-02-23T13:03:21.589074+0000","mapping_epoch":28,"log_start":"30'5285","ondisk_log_start":"30'5285","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:23.478567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":346554368,"num_objects":5288,"num_object_clones":0,"num_object_copies":15864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5288,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5288,"num_write_kb":338432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:09.799124+0000","last_change":"2026-02-23T13:02:55.158696+0000","last_active":"2026-02-23T13:03:09.799124+0000","last_peered":"2026-02-23T13:03:09.799124+0000","last_clean":"2026-02-23T13:03:09.799124+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:03:09.799124+0000","last_undegraded":"2026-02-23T13:03:09.799124+0000","last_fullsized":"2026-02-23T13:03:09.799124+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:02:44.100679+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:07.625581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"30'5145","reported_seq":5159,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:21.589970+0000","last_change":"2026-02-23T13:03:08.709049+0000","last_active":"2026-02-23T13:03:21.589970+0000","last_peered":"2026-02-23T13:03:21.589970+0000","last_clean":"2026-02-23T13:03:21.589970+0000","last_became_active":"2026-02-23T13:03:08.708695+0000","last_became_peered":"2026-02-23T13:03:08.708695+0000","last_unstale":"2026-02-23T13:03:21.589970+0000","last_undegraded":"2026-02-23T13:03:21.589970+0000","last_fullsized":"2026-02-23T13:03:21.589970+0000","mapping_epoch":28,"log_start":"30'5142","ondisk_log_start":"30'5142","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:11.438878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":337182720,"num_objects":5145,"num_object_clones":0,"num_object_copies":15435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5145,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5145,"num_write_kb":329280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"30'5196","reported_seq":5210,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:21.584755+0000","last_change":"2026-02-23T13:03:08.712038+0000","last_active":"2026-02-23T13:03:21.584755+0000","last_peered":"2026-02-23T13:03:21.584755+0000","last_clean":"2026-02-23T13:03:21.584755+0000","last_became_active":"2026-02-23T13:03:08.711847+0000","last_became_peered":"2026-02-23T13:03:08.711847+0000","last_unstale":"2026-02-23T13:03:21.584755+0000","last_undegraded":"2026-02-23T13:03:21.584755+0000","last_fullsized":"2026-02-23T13:03:21.584755+0000","mapping_epoch":28,"log_start":"30'5193","ondisk_log_start":"30'5193","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:25.087301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340525056,"num_objects":5196,"num_object_clones":0,"num_object_copies":15588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5196,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5196,"num_write_kb":332544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"30'5183","reported_seq":5197,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:21.591297+0000","last_change":"2026-02-23T13:03:08.713062+0000","last_active":"2026-02-23T13:03:21.591297+0000","last_peered":"2026-02-23T13:03:21.591297+0000","last_clean":"2026-02-23T13:03:21.591297+0000","last_became_active":"2026-02-23T13:03:08.712783+0000","last_became_peered":"2026-02-23T13:03:08.712783+0000","last_unstale":"2026-02-23T13:03:21.591297+0000","last_undegraded":"2026-02-23T13:03:21.591297+0000","last_fullsized":"2026-02-23T13:03:21.591297+0000","mapping_epoch":28,"log_start":"30'5180","ondisk_log_start":"30'5180","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:07.712555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":339673088,"num_objects":5183,"num_object_clones":0,"num_object_copies":15549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5183,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5183,"num_write_kb":331712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"30'5201","reported_seq":5215,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:21.590045+0000","last_change":"2026-02-23T13:03:08.709181+0000","last_active":"2026-02-23T13:03:21.590045+0000","last_peered":"2026-02-23T13:03:21.590045+0000","last_clean":"2026-02-23T13:03:21.590045+0000","last_became_active":"2026-02-23T13:03:08.708821+0000","last_became_peered":"2026-02-23T13:03:08.708821+0000","last_unstale":"2026-02-23T13:03:21.590045+0000","last_undegraded":"2026-02-23T13:03:21.590045+0000","last_fullsized":"2026-02-23T13:03:21.590045+0000","mapping_epoch":28,"log_start":"30'5198","ondisk_log_start":"30'5198","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:22.653808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340852736,"num_objects":5201,"num_object_clones":0,"num_object_copies":15603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5201,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5201,"num_write_kb":332864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"30'5140","reported_seq":5154,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:21.588008+0000","last_change":"2026-02-23T13:03:08.712493+0000","last_active":"2026-02-23T13:03:21.588008+0000","last_peered":"2026-02-23T13:03:21.588008+0000","last_clean":"2026-02-23T13:03:21.588008+0000","last_became_active":"2026-02-23T13:03:08.712152+0000","last_became_peered":"2026-02-23T13:03:08.712152+0000","last_unstale":"2026-02-23T13:03:21.588008+0000","last_undegraded":"2026-02-23T13:03:21.588008+0000","last_fullsized":"2026-02-23T13:03:21.588008+0000","mapping_epoch":28,"log_start":"30'5137","ondisk_log_start":"30'5137","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:33.900038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":336855040,"num_objects":5140,"num_object_clones":0,"num_object_copies":15420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5140,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5140,"num_write_kb":328960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"30'5147","reported_seq":5161,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:21.589898+0000","last_change":"2026-02-23T13:03:08.712205+0000","last_active":"2026-02-23T13:03:21.589898+0000","last_peered":"2026-02-23T13:03:21.589898+0000","last_clean":"2026-02-23T13:03:21.589898+0000","last_became_active":"2026-02-23T13:03:08.712055+0000","last_became_peered":"2026-02-23T13:03:08.712055+0000","last_unstale":"2026-02-23T13:03:21.589898+0000","last_undegraded":"2026-02-23T13:03:21.589898+0000","last_fullsized":"2026-02-23T13:03:21.589898+0000","mapping_epoch":28,"log_start":"30'5144","ondisk_log_start":"30'5144","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:37.263900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":337313792,"num_objects":5147,"num_object_clones":0,"num_object_copies":15441,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5147,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5147,"num_write_kb":329408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"30'5189","reported_seq":5203,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:21.584753+0000","last_change":"2026-02-23T13:03:08.709028+0000","last_active":"2026-02-23T13:03:21.584753+0000","last_peered":"2026-02-23T13:03:21.584753+0000","last_clean":"2026-02-23T13:03:21.584753+0000","last_became_active":"2026-02-23T13:03:08.708852+0000","last_became_peered":"2026-02-23T13:03:08.708852+0000","last_unstale":"2026-02-23T13:03:21.584753+0000","last_undegraded":"2026-02-23T13:03:21.584753+0000","last_fullsized":"2026-02-23T13:03:21.584753+0000","mapping_epoch":28,"log_start":"30'5186","ondisk_log_start":"30'5186","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:19.208546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340066304,"num_objects":5189,"num_object_clones":0,"num_object_copies":15567,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5189,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5189,"num_write_kb":332096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"30'5396","reported_seq":5410,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:21.590126+0000","last_change":"2026-02-23T13:03:08.708883+0000","last_active":"2026-02-23T13:03:21.590126+0000","last_peered":"2026-02-23T13:03:21.590126+0000","last_clean":"2026-02-23T13:03:21.590126+0000","last_became_active":"2026-02-23T13:03:08.708457+0000","last_became_peered":"2026-02-23T13:03:08.708457+0000","last_unstale":"2026-02-23T13:03:21.590126+0000","last_undegraded":"2026-02-23T13:03:21.590126+0000","last_fullsized":"2026-02-23T13:03:21.590126+0000","mapping_epoch":28,"log_start":"30'5393","ondisk_log_start":"30'5393","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:32.806938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353632256,"num_objects":5396,"num_object_clones":0,"num_object_copies":16188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5396,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5396,"num_write_kb":345344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"30'5177","reported_seq":5191,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:21.584846+0000","last_change":"2026-02-23T13:03:08.712176+0000","last_active":"2026-02-23T13:03:21.584846+0000","last_peered":"2026-02-23T13:03:21.584846+0000","last_clean":"2026-02-23T13:03:21.584846+0000","last_became_active":"2026-02-23T13:03:08.712010+0000","last_became_peered":"2026-02-23T13:03:08.712010+0000","last_unstale":"2026-02-23T13:03:21.584846+0000","last_undegraded":"2026-02-23T13:03:21.584846+0000","last_fullsized":"2026-02-23T13:03:21.584846+0000","mapping_epoch":28,"log_start":"30'5174","ondisk_log_start":"30'5174","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:29.753408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":339279872,"num_objects":5177,"num_object_clones":0,"num_object_copies":15531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5177,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5177,"num_write_kb":331328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"30'5214","reported_seq":5228,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:21.588805+0000","last_change":"2026-02-23T13:03:08.713049+0000","last_active":"2026-02-23T13:03:21.588805+0000","last_peered":"2026-02-23T13:03:21.588805+0000","last_clean":"2026-02-23T13:03:21.588805+0000","last_became_active":"2026-02-23T13:03:08.712763+0000","last_became_peered":"2026-02-23T13:03:08.712763+0000","last_unstale":"2026-02-23T13:03:21.588805+0000","last_undegraded":"2026-02-23T13:03:21.588805+0000","last_fullsized":"2026-02-23T13:03:21.588805+0000","mapping_epoch":28,"log_start":"30'5211","ondisk_log_start":"30'5211","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:18.501703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":341704704,"num_objects":5214,"num_object_clones":0,"num_object_copies":15642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5214,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5214,"num_write_kb":333696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"30'5257","reported_seq":5271,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:21.587060+0000","last_change":"2026-02-23T13:03:08.709558+0000","last_active":"2026-02-23T13:03:21.587060+0000","last_peered":"2026-02-23T13:03:21.587060+0000","last_clean":"2026-02-23T13:03:21.587060+0000","last_became_active":"2026-02-23T13:03:08.709391+0000","last_became_peered":"2026-02-23T13:03:08.709391+0000","last_unstale":"2026-02-23T13:03:21.587060+0000","last_undegraded":"2026-02-23T13:03:21.587060+0000","last_fullsized":"2026-02-23T13:03:21.587060+0000","mapping_epoch":28,"log_start":"30'5254","ondisk_log_start":"30'5254","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:34.787615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":344522752,"num_objects":5257,"num_object_clones":0,"num_object_copies":15771,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5257,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5257,"num_write_kb":336448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"30'5196","reported_seq":5210,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:21.586708+0000","last_change":"2026-02-23T13:03:08.711473+0000","last_active":"2026-02-23T13:03:21.586708+0000","last_peered":"2026-02-23T13:03:21.586708+0000","last_clean":"2026-02-23T13:03:21.586708+0000","last_became_active":"2026-02-23T13:03:08.711303+0000","last_became_peered":"2026-02-23T13:03:08.711303+0000","last_unstale":"2026-02-23T13:03:21.586708+0000","last_undegraded":"2026-02-23T13:03:21.586708+0000","last_fullsized":"2026-02-23T13:03:21.586708+0000","mapping_epoch":28,"log_start":"30'5193","ondisk_log_start":"30'5193","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:35.916414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340525056,"num_objects":5196,"num_object_clones":0,"num_object_copies":15588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5196,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5196,"num_write_kb":332544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":5468651520,"num_objects":83445,"num_object_clones":0,"num_object_copies":250335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83445,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83445,"num_write_kb":5340480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16407724032,"data_stored":16407724032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247815,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4786524,"kb_used_data":4542984,"kb_used_omap":8,"kb_used_meta":243511,"kb_avail":729216676,"statfs":{"total":751619276800,"available":746717876224,"internally_reserved":0,"allocated":4652015616,"data_stored":4651840111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8772,"internal_metadata":249355708},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,4,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444042,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3617052,"kb_used_data":3409608,"kb_used_omap":12,"kb_used_meta":207411,"kb_avail":730386148,"statfs":{"total":751619276800,"available":747915415552,"internally_reserved":0,"allocated":3491438592,"data_stored":3491263087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12692,"internal_metadata":212389484},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3879640,"kb_used_data":3672196,"kb_used_omap":14,"kb_used_meta":207409,"kb_avail":730123560,"statfs":{"total":751619276800,"available":747646525440,"internally_reserved":0,"allocated":3760328704,"data_stored":3760156751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15296,"internal_metadata":212386880},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705677,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3619548,"kb_used_data":3412104,"kb_used_omap":16,"kb_used_meta":207407,"kb_avail":730383652,"statfs":{"total":751619276800,"available":747912859648,"internally_reserved":0,"allocated":3493994496,"data_stored":3493818991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17249,"internal_metadata":212384927},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3752656896,"data_stored":3752656896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4110024704,"data_stored":4110024704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3759013888,"data_stored":3759013888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4786028544,"data_stored":4786028544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:03:25.679 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:03:25.679 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 21 2026-02-23T13:03:25.798 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 16 16 108735 108719 424.652 323.438 0.00167593 0.00235361 2026-02-23T13:03:25.825 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:25.944 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:25 trial046 ceph-mon[38575]: pgmap v18: 17 pgs: 17 active+clean; 5.1 GiB data, 15 GiB used, 2.7 TiB / 2.7 TiB avail; 368 MiB/s wr, 5.88k op/s 2026-02-23T13:03:26.194 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:03:26 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:03:26] "GET /metrics HTTP/1.1" 200 4214 "" "Prometheus/3.6.0" 2026-02-23T13:03:26.204 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:03:26.259 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:26.246+0000 7f9717e77640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:26.259 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:26.246+0000 7f9717e77640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:26.353 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:26.386 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:03:26.560 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:26 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:03:26.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:03:26.798 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 17 16 113984 113968 418.969 328.062 0.00116727 0.00238443 2026-02-23T13:03:26.971 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:03:27.038 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:26 trial046 ceph-mon[38575]: from='client.14368 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:03:27.038 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:26 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3371931018' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "21"} : dispatch 2026-02-23T13:03:27.376 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:27.373+0000 7efdc540a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:27.376 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:27.374+0000 7efdc540a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:27.390 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:03:27.390 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:03:27.403 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:03:27.403 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:03:27.417 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:03:27.418 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:03:27.431 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:03:27.432 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:03:27.798 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 18 16 120002 119986 416.587 376.125 0.00226719 0.00239916 2026-02-23T13:03:28.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:27 trial046 ceph-mon[38575]: pgmap v19: 17 pgs: 17 active+clean; 5.9 GiB data, 18 GiB used, 2.7 TiB / 2.7 TiB avail; 435 MiB/s wr, 6.96k op/s 2026-02-23T13:03:28.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:27 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1790182861' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:03:28.798 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 19 16 126707 126691 416.715 419.062 0.00273403 0.00239845 2026-02-23T13:03:29.475 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:03:29.619 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:29.740 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:29.738+0000 7fa229679640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:29.740 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:29.738+0000 7fa229679640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:29.754 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:03:29.755 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:03:29.755 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:29 trial046 ceph-mon[38575]: pgmap v20: 17 pgs: 17 active+clean; 6.9 GiB data, 21 GiB used, 2.7 TiB / 2.7 TiB avail; 442 MiB/s wr, 7.07k op/s 2026-02-23T13:03:29.769 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:03:29.769 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:03:29.782 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:03:29.782 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:03:29.794 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:03:29.795 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:03:29.798 INFO:tasks.radosbench.radosbench.0.trial046.stdout:2026-02-23T13:03:29.798440+0000 min lat: 0.000702009 max lat: 0.0388666 avg lat: 0.00239277 2026-02-23T13:03:29.799 INFO:tasks.radosbench.radosbench.0.trial046.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-23T13:03:29.799 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 20 16 133691 133675 417.703 436.5 0.00135454 0.00239277 2026-02-23T13:03:30.798 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 21 16 140864 140848 419.159 448.312 0.00235945 0.00238446 2026-02-23T13:03:31.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:30 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/89420081' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:03:31.798 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 22 16 147828 147812 419.889 435.25 0.00316938 0.00238031 2026-02-23T13:03:31.838 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:03:31.972 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:03:31.973 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-23T13:03:31.981 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:31.998 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:31 trial046 ceph-mon[38575]: pgmap v21: 17 pgs: 17 active+clean; 6.9 GiB data, 21 GiB used, 2.7 TiB / 2.7 TiB avail; 339 MiB/s wr, 5.42k op/s 2026-02-23T13:03:31.998 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:31 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:03:32.117 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:32.115+0000 7fb09b308640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:32.118 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:32.115+0000 7fb09b308640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:32.119 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:32.132 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:03:32.133 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:03:32.147 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:03:32.148 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:03:32.161 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:03:32.162 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:03:32.176 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:03:32.176 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:03:32.253 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:32.251+0000 7f403fab5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:32.253 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:32.251+0000 7f403fab5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:32.732 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.0 to 1 (10000) 2026-02-23T13:03:32.783 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-23T13:03:32.799 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 23 16 154936 154920 420.946 444.25 0.00243675 0.00237435 2026-02-23T13:03:32.939 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:32.991 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:32 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2543424353' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:03:32.991 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:32 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2162871664' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-23T13:03:33.058 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:33.056+0000 7f0b425e4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:33.058 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:33.056+0000 7f0b425e4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:33.732 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.1 to 1 (10000) 2026-02-23T13:03:33.781 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-23T13:03:33.799 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 24 16 161904 161888 421.551 435.5 0.00171896 0.00237095 2026-02-23T13:03:33.923 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:33.985 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:33 trial046 ceph-mon[38575]: pgmap v22: 17 pgs: 17 active+clean; 8.9 GiB data, 28 GiB used, 2.7 TiB / 2.7 TiB avail; 513 MiB/s wr, 8.21k op/s 2026-02-23T13:03:33.985 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:33 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2162871664' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-23T13:03:33.985 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:33 trial046 ceph-mon[38575]: osdmap e31: 4 total, 4 up, 4 in 2026-02-23T13:03:33.985 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:33 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2277424102' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-23T13:03:34.043 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:34.042+0000 7f619a4cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:34.043 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:34.043+0000 7f619a4cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:34.229 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:03:34.374 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:34.491 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:34.490+0000 7f9f8b878640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:34.491 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:34.491+0000 7f9f8b878640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:34.506 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:03:34.506 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:03:34.518 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:03:34.518 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:03:34.531 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:03:34.531 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:03:34.545 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:03:34.545 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:03:34.737 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.2 to 1 (10000) 2026-02-23T13:03:34.758 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:34 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2277424102' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-23T13:03:34.758 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:34 trial046 ceph-mon[38575]: osdmap e32: 4 total, 4 up, 4 in 2026-02-23T13:03:34.758 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:34 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3682651877' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-23T13:03:34.758 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:34 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1144639961' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:03:34.784 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-23T13:03:34.798 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 25 16 169388 169372 423.398 467.75 0.00216063 0.00236059 2026-02-23T13:03:34.920 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:35.308 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:35.247+0000 7f3b1a056640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:35.308 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:35.247+0000 7f3b1a056640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:35.738 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.3 to 1 (10000) 2026-02-23T13:03:35.784 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-23T13:03:35.784 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:03:35.799 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 26 15 175479 175464 421.757 380.75 0.00249175 0.00236981 2026-02-23T13:03:35.943 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:36.008 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:35 trial046 ceph-mon[38575]: pgmap v25: 17 pgs: 17 active+clean; 8.9 GiB data, 28 GiB used, 2.7 TiB / 2.7 TiB avail; 391 MiB/s wr, 6.25k op/s 2026-02-23T13:03:36.008 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:35 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3682651877' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-23T13:03:36.008 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:35 trial046 ceph-mon[38575]: osdmap e33: 4 total, 4 up, 4 in 2026-02-23T13:03:36.008 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:35 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4150262581' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-23T13:03:36.077 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:36.076+0000 7f0772df2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:36.077 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:36.076+0000 7f0772df2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:36.217 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:03:36.218 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:03:36.260 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:03:36 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:03:36] "GET /metrics HTTP/1.1" 200 4207 "" "Prometheus/3.6.0" 2026-02-23T13:03:36.261 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2026-02-23T13:03:35.737813+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":9596043808,"num_objects":146417,"num_object_clones":0,"num_object_copies":439251,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":146417,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":146550,"num_write_kb":9372710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":29083244,"kb_used_data":27369116,"kb_used_omap":52,"kb_used_meta":1713995,"kb_avail":2906929556,"statfs":{"total":3006477107200,"available":2976695865344,"internally_reserved":0,"allocated":28025974784,"data_stored":28025276316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":54009,"internal_metadata":1755131143},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2195193856,"num_objects":33496,"num_object_clones":0,"num_object_copies":100488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33496,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33496,"num_write_kb":2143744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.143432"},"pg_stats":[{"pgid":"2.f","version":"30'9111","reported_seq":9125,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.586011+0000","last_change":"2026-02-23T13:03:08.711612+0000","last_active":"2026-02-23T13:03:31.586011+0000","last_peered":"2026-02-23T13:03:31.586011+0000","last_clean":"2026-02-23T13:03:31.586011+0000","last_became_active":"2026-02-23T13:03:08.711408+0000","last_became_peered":"2026-02-23T13:03:08.711408+0000","last_unstale":"2026-02-23T13:03:31.586011+0000","last_undegraded":"2026-02-23T13:03:31.586011+0000","last_fullsized":"2026-02-23T13:03:31.586011+0000","mapping_epoch":28,"log_start":"30'9108","ondisk_log_start":"30'9108","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:21.274136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":597098496,"num_objects":9111,"num_object_clones":0,"num_object_copies":27333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9111,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9111,"num_write_kb":583104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"30'9320","reported_seq":9334,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.589196+0000","last_change":"2026-02-23T13:03:08.711629+0000","last_active":"2026-02-23T13:03:31.589196+0000","last_peered":"2026-02-23T13:03:31.589196+0000","last_clean":"2026-02-23T13:03:31.589196+0000","last_became_active":"2026-02-23T13:03:08.711462+0000","last_became_peered":"2026-02-23T13:03:08.711462+0000","last_unstale":"2026-02-23T13:03:31.589196+0000","last_undegraded":"2026-02-23T13:03:31.589196+0000","last_fullsized":"2026-02-23T13:03:31.589196+0000","mapping_epoch":28,"log_start":"30'9317","ondisk_log_start":"30'9317","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:35.369081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610795520,"num_objects":9320,"num_object_clones":0,"num_object_copies":27960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9320,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9320,"num_write_kb":596480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"30'9020","reported_seq":9034,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.592861+0000","last_change":"2026-02-23T13:03:08.712615+0000","last_active":"2026-02-23T13:03:31.592861+0000","last_peered":"2026-02-23T13:03:31.592861+0000","last_clean":"2026-02-23T13:03:31.592861+0000","last_became_active":"2026-02-23T13:03:08.712246+0000","last_became_peered":"2026-02-23T13:03:08.712246+0000","last_unstale":"2026-02-23T13:03:31.592861+0000","last_undegraded":"2026-02-23T13:03:31.592861+0000","last_fullsized":"2026-02-23T13:03:31.592861+0000","mapping_epoch":28,"log_start":"30'9017","ondisk_log_start":"30'9017","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:26.869038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":591134720,"num_objects":9020,"num_object_clones":0,"num_object_copies":27060,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9020,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9020,"num_write_kb":577280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"30'9154","reported_seq":9168,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.592027+0000","last_change":"2026-02-23T13:03:08.712832+0000","last_active":"2026-02-23T13:03:31.592027+0000","last_peered":"2026-02-23T13:03:31.592027+0000","last_clean":"2026-02-23T13:03:31.592027+0000","last_became_active":"2026-02-23T13:03:08.712348+0000","last_became_peered":"2026-02-23T13:03:08.712348+0000","last_unstale":"2026-02-23T13:03:31.592027+0000","last_undegraded":"2026-02-23T13:03:31.592027+0000","last_fullsized":"2026-02-23T13:03:31.592027+0000","mapping_epoch":28,"log_start":"30'9151","ondisk_log_start":"30'9151","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:23.478567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":599916544,"num_objects":9154,"num_object_clones":0,"num_object_copies":27462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9154,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9154,"num_write_kb":585856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:09.799124+0000","last_change":"2026-02-23T13:02:55.158696+0000","last_active":"2026-02-23T13:03:09.799124+0000","last_peered":"2026-02-23T13:03:09.799124+0000","last_clean":"2026-02-23T13:03:09.799124+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:03:09.799124+0000","last_undegraded":"2026-02-23T13:03:09.799124+0000","last_fullsized":"2026-02-23T13:03:09.799124+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:02:44.100679+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:07.625581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"30'9073","reported_seq":9087,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.585315+0000","last_change":"2026-02-23T13:03:08.709049+0000","last_active":"2026-02-23T13:03:31.585315+0000","last_peered":"2026-02-23T13:03:31.585315+0000","last_clean":"2026-02-23T13:03:31.585315+0000","last_became_active":"2026-02-23T13:03:08.708695+0000","last_became_peered":"2026-02-23T13:03:08.708695+0000","last_unstale":"2026-02-23T13:03:31.585315+0000","last_undegraded":"2026-02-23T13:03:31.585315+0000","last_fullsized":"2026-02-23T13:03:31.585315+0000","mapping_epoch":28,"log_start":"30'9070","ondisk_log_start":"30'9070","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:11.438878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":594608128,"num_objects":9073,"num_object_clones":0,"num_object_copies":27219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9073,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9073,"num_write_kb":580672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"30'9073","reported_seq":9087,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.582394+0000","last_change":"2026-02-23T13:03:08.712038+0000","last_active":"2026-02-23T13:03:31.582394+0000","last_peered":"2026-02-23T13:03:31.582394+0000","last_clean":"2026-02-23T13:03:31.582394+0000","last_became_active":"2026-02-23T13:03:08.711847+0000","last_became_peered":"2026-02-23T13:03:08.711847+0000","last_unstale":"2026-02-23T13:03:31.582394+0000","last_undegraded":"2026-02-23T13:03:31.582394+0000","last_fullsized":"2026-02-23T13:03:31.582394+0000","mapping_epoch":28,"log_start":"30'9070","ondisk_log_start":"30'9070","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:25.087301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":594608128,"num_objects":9073,"num_object_clones":0,"num_object_copies":27219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9073,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9073,"num_write_kb":580672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"30'9180","reported_seq":9194,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.584928+0000","last_change":"2026-02-23T13:03:08.713062+0000","last_active":"2026-02-23T13:03:31.584928+0000","last_peered":"2026-02-23T13:03:31.584928+0000","last_clean":"2026-02-23T13:03:31.584928+0000","last_became_active":"2026-02-23T13:03:08.712783+0000","last_became_peered":"2026-02-23T13:03:08.712783+0000","last_unstale":"2026-02-23T13:03:31.584928+0000","last_undegraded":"2026-02-23T13:03:31.584928+0000","last_fullsized":"2026-02-23T13:03:31.584928+0000","mapping_epoch":28,"log_start":"30'9177","ondisk_log_start":"30'9177","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:07.712555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":601620480,"num_objects":9180,"num_object_clones":0,"num_object_copies":27540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9180,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9180,"num_write_kb":587520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"30'9347","reported_seq":9361,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.591744+0000","last_change":"2026-02-23T13:03:08.709181+0000","last_active":"2026-02-23T13:03:31.591744+0000","last_peered":"2026-02-23T13:03:31.591744+0000","last_clean":"2026-02-23T13:03:31.591744+0000","last_became_active":"2026-02-23T13:03:08.708821+0000","last_became_peered":"2026-02-23T13:03:08.708821+0000","last_unstale":"2026-02-23T13:03:31.591744+0000","last_undegraded":"2026-02-23T13:03:31.591744+0000","last_fullsized":"2026-02-23T13:03:31.591744+0000","mapping_epoch":28,"log_start":"30'9344","ondisk_log_start":"30'9344","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:22.653808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":612564992,"num_objects":9347,"num_object_clones":0,"num_object_copies":28041,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9347,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9347,"num_write_kb":598208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"30'9162","reported_seq":9176,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.591790+0000","last_change":"2026-02-23T13:03:08.712493+0000","last_active":"2026-02-23T13:03:31.591790+0000","last_peered":"2026-02-23T13:03:31.591790+0000","last_clean":"2026-02-23T13:03:31.591790+0000","last_became_active":"2026-02-23T13:03:08.712152+0000","last_became_peered":"2026-02-23T13:03:08.712152+0000","last_unstale":"2026-02-23T13:03:31.591790+0000","last_undegraded":"2026-02-23T13:03:31.591790+0000","last_fullsized":"2026-02-23T13:03:31.591790+0000","mapping_epoch":28,"log_start":"30'9159","ondisk_log_start":"30'9159","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:33.900038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":600440832,"num_objects":9162,"num_object_clones":0,"num_object_copies":27486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9162,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9162,"num_write_kb":586368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"30'9108","reported_seq":9122,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.590141+0000","last_change":"2026-02-23T13:03:08.712205+0000","last_active":"2026-02-23T13:03:31.590141+0000","last_peered":"2026-02-23T13:03:31.590141+0000","last_clean":"2026-02-23T13:03:31.590141+0000","last_became_active":"2026-02-23T13:03:08.712055+0000","last_became_peered":"2026-02-23T13:03:08.712055+0000","last_unstale":"2026-02-23T13:03:31.590141+0000","last_undegraded":"2026-02-23T13:03:31.590141+0000","last_fullsized":"2026-02-23T13:03:31.590141+0000","mapping_epoch":28,"log_start":"30'9105","ondisk_log_start":"30'9105","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:37.263900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":596901888,"num_objects":9108,"num_object_clones":0,"num_object_copies":27324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9108,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9108,"num_write_kb":582912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"30'9083","reported_seq":9096,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.590177+0000","last_change":"2026-02-23T13:03:08.709028+0000","last_active":"2026-02-23T13:03:31.590177+0000","last_peered":"2026-02-23T13:03:31.590177+0000","last_clean":"2026-02-23T13:03:31.590177+0000","last_became_active":"2026-02-23T13:03:08.708852+0000","last_became_peered":"2026-02-23T13:03:08.708852+0000","last_unstale":"2026-02-23T13:03:31.590177+0000","last_undegraded":"2026-02-23T13:03:31.590177+0000","last_fullsized":"2026-02-23T13:03:31.590177+0000","mapping_epoch":28,"log_start":"30'9080","ondisk_log_start":"30'9080","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:19.208546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":595263488,"num_objects":9083,"num_object_clones":0,"num_object_copies":27249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9083,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9083,"num_write_kb":581312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"30'9296","reported_seq":9310,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.591585+0000","last_change":"2026-02-23T13:03:08.708883+0000","last_active":"2026-02-23T13:03:31.591585+0000","last_peered":"2026-02-23T13:03:31.591585+0000","last_clean":"2026-02-23T13:03:31.591585+0000","last_became_active":"2026-02-23T13:03:08.708457+0000","last_became_peered":"2026-02-23T13:03:08.708457+0000","last_unstale":"2026-02-23T13:03:31.591585+0000","last_undegraded":"2026-02-23T13:03:31.591585+0000","last_fullsized":"2026-02-23T13:03:31.591585+0000","mapping_epoch":28,"log_start":"30'9292","ondisk_log_start":"30'9292","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:32.806938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609222656,"num_objects":9296,"num_object_clones":0,"num_object_copies":27888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9296,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9296,"num_write_kb":594944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"30'9080","reported_seq":9094,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.592340+0000","last_change":"2026-02-23T13:03:08.712176+0000","last_active":"2026-02-23T13:03:31.592340+0000","last_peered":"2026-02-23T13:03:31.592340+0000","last_clean":"2026-02-23T13:03:31.592340+0000","last_became_active":"2026-02-23T13:03:08.712010+0000","last_became_peered":"2026-02-23T13:03:08.712010+0000","last_unstale":"2026-02-23T13:03:31.592340+0000","last_undegraded":"2026-02-23T13:03:31.592340+0000","last_fullsized":"2026-02-23T13:03:31.592340+0000","mapping_epoch":28,"log_start":"30'9077","ondisk_log_start":"30'9077","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:29.753408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":595066880,"num_objects":9080,"num_object_clones":0,"num_object_copies":27240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9080,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9080,"num_write_kb":581120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"30'9022","reported_seq":9035,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.590247+0000","last_change":"2026-02-23T13:03:08.713049+0000","last_active":"2026-02-23T13:03:31.590247+0000","last_peered":"2026-02-23T13:03:31.590247+0000","last_clean":"2026-02-23T13:03:31.590247+0000","last_became_active":"2026-02-23T13:03:08.712763+0000","last_became_peered":"2026-02-23T13:03:08.712763+0000","last_unstale":"2026-02-23T13:03:31.590247+0000","last_undegraded":"2026-02-23T13:03:31.590247+0000","last_fullsized":"2026-02-23T13:03:31.590247+0000","mapping_epoch":28,"log_start":"30'9019","ondisk_log_start":"30'9019","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:18.501703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":591265792,"num_objects":9022,"num_object_clones":0,"num_object_copies":27066,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9022,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9022,"num_write_kb":577408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"30'9228","reported_seq":9242,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.591235+0000","last_change":"2026-02-23T13:03:08.709558+0000","last_active":"2026-02-23T13:03:31.591235+0000","last_peered":"2026-02-23T13:03:31.591235+0000","last_clean":"2026-02-23T13:03:31.591235+0000","last_became_active":"2026-02-23T13:03:08.709391+0000","last_became_peered":"2026-02-23T13:03:08.709391+0000","last_unstale":"2026-02-23T13:03:31.591235+0000","last_undegraded":"2026-02-23T13:03:31.591235+0000","last_fullsized":"2026-02-23T13:03:31.591235+0000","mapping_epoch":28,"log_start":"30'9225","ondisk_log_start":"30'9225","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:34.787615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604766208,"num_objects":9228,"num_object_clones":0,"num_object_copies":27684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9228,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9228,"num_write_kb":590592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"30'9158","reported_seq":9172,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.587893+0000","last_change":"2026-02-23T13:03:08.711473+0000","last_active":"2026-02-23T13:03:31.587893+0000","last_peered":"2026-02-23T13:03:31.587893+0000","last_clean":"2026-02-23T13:03:31.587893+0000","last_became_active":"2026-02-23T13:03:08.711303+0000","last_became_peered":"2026-02-23T13:03:08.711303+0000","last_unstale":"2026-02-23T13:03:31.587893+0000","last_undegraded":"2026-02-23T13:03:31.587893+0000","last_fullsized":"2026-02-23T13:03:31.587893+0000","mapping_epoch":28,"log_start":"30'9155","ondisk_log_start":"30'9155","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:35.916414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":600178688,"num_objects":9158,"num_object_clones":0,"num_object_copies":27474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9158,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9158,"num_write_kb":586112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":9595453440,"num_objects":146415,"num_object_clones":0,"num_object_copies":439245,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":146415,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146415,"num_write_kb":9370560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28787212288,"data_stored":28787212288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247817,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":8519580,"kb_used_data":8023368,"kb_used_omap":8,"kb_used_meta":496183,"kb_avail":725483620,"statfs":{"total":751619276800,"available":742895226880,"internally_reserved":0,"allocated":8215928832,"data_stored":8215753327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8772,"internal_metadata":508091836},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444044,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6583260,"kb_used_data":6177288,"kb_used_omap":12,"kb_used_meta":405939,"kb_avail":727419940,"statfs":{"total":751619276800,"available":744878018560,"internally_reserved":0,"allocated":6325542912,"data_stored":6325367407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12692,"internal_metadata":415682156},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":7451800,"kb_used_data":7027780,"kb_used_omap":14,"kb_used_meta":423985,"kb_avail":726551400,"statfs":{"total":751619276800,"available":743988633600,"internally_reserved":0,"allocated":7196446720,"data_stored":7196274767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15296,"internal_metadata":434160704},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705679,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6528604,"kb_used_data":6140680,"kb_used_omap":16,"kb_used_meta":387887,"kb_avail":727474596,"statfs":{"total":751619276800,"available":744933986304,"internally_reserved":0,"allocated":6288056320,"data_stored":6287880815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17249,"internal_metadata":397196447},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6578962432,"data_stored":6578962432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7206600704,"data_stored":7206600704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6617104384,"data_stored":6617104384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8384544768,"data_stored":8384544768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:03:36.262 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:03:36.400 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:36.519 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:36.518+0000 7f5d047d9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:36.520 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:36.519+0000 7f5d047d9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:36.560 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:36 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:03:36.087Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:03:36.586 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:03:36.659 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:03:36.659 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:03:36.705 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2026-02-23T13:03:36.595178+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":9731899936,"num_objects":148490,"num_object_clones":0,"num_object_copies":445470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":148490,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":148623,"num_write_kb":9505382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":32585792,"kb_used_data":30709232,"kb_used_omap":57,"kb_used_meta":1876422,"kb_avail":2903427008,"statfs":{"total":3006477107200,"available":2973109256192,"internally_reserved":0,"allocated":31446253568,"data_stored":31445499947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58566,"internal_metadata":1921456954},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":135856128,"num_objects":2073,"num_object_clones":0,"num_object_copies":6219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2073,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2073,"num_write_kb":132672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000537"},"pg_stats":[{"pgid":"2.f","version":"34'11184","reported_seq":11206,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:36.592692+0000","last_change":"2026-02-23T13:03:08.711612+0000","last_active":"2026-02-23T13:03:36.592692+0000","last_peered":"2026-02-23T13:03:36.592692+0000","last_clean":"2026-02-23T13:03:36.592692+0000","last_became_active":"2026-02-23T13:03:08.711408+0000","last_became_peered":"2026-02-23T13:03:08.711408+0000","last_unstale":"2026-02-23T13:03:36.592692+0000","last_undegraded":"2026-02-23T13:03:36.592692+0000","last_fullsized":"2026-02-23T13:03:36.592692+0000","mapping_epoch":28,"log_start":"34'11181","ondisk_log_start":"34'11181","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:21.274136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":732954624,"num_objects":11184,"num_object_clones":0,"num_object_copies":33552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11184,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11184,"num_write_kb":715776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"30'9320","reported_seq":9334,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.589196+0000","last_change":"2026-02-23T13:03:08.711629+0000","last_active":"2026-02-23T13:03:31.589196+0000","last_peered":"2026-02-23T13:03:31.589196+0000","last_clean":"2026-02-23T13:03:31.589196+0000","last_became_active":"2026-02-23T13:03:08.711462+0000","last_became_peered":"2026-02-23T13:03:08.711462+0000","last_unstale":"2026-02-23T13:03:31.589196+0000","last_undegraded":"2026-02-23T13:03:31.589196+0000","last_fullsized":"2026-02-23T13:03:31.589196+0000","mapping_epoch":28,"log_start":"30'9317","ondisk_log_start":"30'9317","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:35.369081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610795520,"num_objects":9320,"num_object_clones":0,"num_object_copies":27960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9320,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9320,"num_write_kb":596480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"30'9020","reported_seq":9034,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.592861+0000","last_change":"2026-02-23T13:03:08.712615+0000","last_active":"2026-02-23T13:03:31.592861+0000","last_peered":"2026-02-23T13:03:31.592861+0000","last_clean":"2026-02-23T13:03:31.592861+0000","last_became_active":"2026-02-23T13:03:08.712246+0000","last_became_peered":"2026-02-23T13:03:08.712246+0000","last_unstale":"2026-02-23T13:03:31.592861+0000","last_undegraded":"2026-02-23T13:03:31.592861+0000","last_fullsized":"2026-02-23T13:03:31.592861+0000","mapping_epoch":28,"log_start":"30'9017","ondisk_log_start":"30'9017","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:26.869038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":591134720,"num_objects":9020,"num_object_clones":0,"num_object_copies":27060,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9020,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9020,"num_write_kb":577280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"30'9154","reported_seq":9168,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.592027+0000","last_change":"2026-02-23T13:03:08.712832+0000","last_active":"2026-02-23T13:03:31.592027+0000","last_peered":"2026-02-23T13:03:31.592027+0000","last_clean":"2026-02-23T13:03:31.592027+0000","last_became_active":"2026-02-23T13:03:08.712348+0000","last_became_peered":"2026-02-23T13:03:08.712348+0000","last_unstale":"2026-02-23T13:03:31.592027+0000","last_undegraded":"2026-02-23T13:03:31.592027+0000","last_fullsized":"2026-02-23T13:03:31.592027+0000","mapping_epoch":28,"log_start":"30'9151","ondisk_log_start":"30'9151","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:23.478567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":599916544,"num_objects":9154,"num_object_clones":0,"num_object_copies":27462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9154,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9154,"num_write_kb":585856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:09.799124+0000","last_change":"2026-02-23T13:02:55.158696+0000","last_active":"2026-02-23T13:03:09.799124+0000","last_peered":"2026-02-23T13:03:09.799124+0000","last_clean":"2026-02-23T13:03:09.799124+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:03:09.799124+0000","last_undegraded":"2026-02-23T13:03:09.799124+0000","last_fullsized":"2026-02-23T13:03:09.799124+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:02:44.100679+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:07.625581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"30'9073","reported_seq":9087,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.585315+0000","last_change":"2026-02-23T13:03:08.709049+0000","last_active":"2026-02-23T13:03:31.585315+0000","last_peered":"2026-02-23T13:03:31.585315+0000","last_clean":"2026-02-23T13:03:31.585315+0000","last_became_active":"2026-02-23T13:03:08.708695+0000","last_became_peered":"2026-02-23T13:03:08.708695+0000","last_unstale":"2026-02-23T13:03:31.585315+0000","last_undegraded":"2026-02-23T13:03:31.585315+0000","last_fullsized":"2026-02-23T13:03:31.585315+0000","mapping_epoch":28,"log_start":"30'9070","ondisk_log_start":"30'9070","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:11.438878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":594608128,"num_objects":9073,"num_object_clones":0,"num_object_copies":27219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9073,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9073,"num_write_kb":580672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"30'9073","reported_seq":9087,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.582394+0000","last_change":"2026-02-23T13:03:08.712038+0000","last_active":"2026-02-23T13:03:31.582394+0000","last_peered":"2026-02-23T13:03:31.582394+0000","last_clean":"2026-02-23T13:03:31.582394+0000","last_became_active":"2026-02-23T13:03:08.711847+0000","last_became_peered":"2026-02-23T13:03:08.711847+0000","last_unstale":"2026-02-23T13:03:31.582394+0000","last_undegraded":"2026-02-23T13:03:31.582394+0000","last_fullsized":"2026-02-23T13:03:31.582394+0000","mapping_epoch":28,"log_start":"30'9070","ondisk_log_start":"30'9070","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:25.087301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":594608128,"num_objects":9073,"num_object_clones":0,"num_object_copies":27219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9073,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9073,"num_write_kb":580672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"30'9180","reported_seq":9194,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.584928+0000","last_change":"2026-02-23T13:03:08.713062+0000","last_active":"2026-02-23T13:03:31.584928+0000","last_peered":"2026-02-23T13:03:31.584928+0000","last_clean":"2026-02-23T13:03:31.584928+0000","last_became_active":"2026-02-23T13:03:08.712783+0000","last_became_peered":"2026-02-23T13:03:08.712783+0000","last_unstale":"2026-02-23T13:03:31.584928+0000","last_undegraded":"2026-02-23T13:03:31.584928+0000","last_fullsized":"2026-02-23T13:03:31.584928+0000","mapping_epoch":28,"log_start":"30'9177","ondisk_log_start":"30'9177","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:07.712555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":601620480,"num_objects":9180,"num_object_clones":0,"num_object_copies":27540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9180,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9180,"num_write_kb":587520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"30'9347","reported_seq":9361,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.591744+0000","last_change":"2026-02-23T13:03:08.709181+0000","last_active":"2026-02-23T13:03:31.591744+0000","last_peered":"2026-02-23T13:03:31.591744+0000","last_clean":"2026-02-23T13:03:31.591744+0000","last_became_active":"2026-02-23T13:03:08.708821+0000","last_became_peered":"2026-02-23T13:03:08.708821+0000","last_unstale":"2026-02-23T13:03:31.591744+0000","last_undegraded":"2026-02-23T13:03:31.591744+0000","last_fullsized":"2026-02-23T13:03:31.591744+0000","mapping_epoch":28,"log_start":"30'9344","ondisk_log_start":"30'9344","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:22.653808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":612564992,"num_objects":9347,"num_object_clones":0,"num_object_copies":28041,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9347,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9347,"num_write_kb":598208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"30'9162","reported_seq":9176,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.591790+0000","last_change":"2026-02-23T13:03:08.712493+0000","last_active":"2026-02-23T13:03:31.591790+0000","last_peered":"2026-02-23T13:03:31.591790+0000","last_clean":"2026-02-23T13:03:31.591790+0000","last_became_active":"2026-02-23T13:03:08.712152+0000","last_became_peered":"2026-02-23T13:03:08.712152+0000","last_unstale":"2026-02-23T13:03:31.591790+0000","last_undegraded":"2026-02-23T13:03:31.591790+0000","last_fullsized":"2026-02-23T13:03:31.591790+0000","mapping_epoch":28,"log_start":"30'9159","ondisk_log_start":"30'9159","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:33.900038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":600440832,"num_objects":9162,"num_object_clones":0,"num_object_copies":27486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9162,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9162,"num_write_kb":586368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"30'9108","reported_seq":9122,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.590141+0000","last_change":"2026-02-23T13:03:08.712205+0000","last_active":"2026-02-23T13:03:31.590141+0000","last_peered":"2026-02-23T13:03:31.590141+0000","last_clean":"2026-02-23T13:03:31.590141+0000","last_became_active":"2026-02-23T13:03:08.712055+0000","last_became_peered":"2026-02-23T13:03:08.712055+0000","last_unstale":"2026-02-23T13:03:31.590141+0000","last_undegraded":"2026-02-23T13:03:31.590141+0000","last_fullsized":"2026-02-23T13:03:31.590141+0000","mapping_epoch":28,"log_start":"30'9105","ondisk_log_start":"30'9105","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:37.263900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":596901888,"num_objects":9108,"num_object_clones":0,"num_object_copies":27324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9108,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9108,"num_write_kb":582912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"30'9083","reported_seq":9096,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.590177+0000","last_change":"2026-02-23T13:03:08.709028+0000","last_active":"2026-02-23T13:03:31.590177+0000","last_peered":"2026-02-23T13:03:31.590177+0000","last_clean":"2026-02-23T13:03:31.590177+0000","last_became_active":"2026-02-23T13:03:08.708852+0000","last_became_peered":"2026-02-23T13:03:08.708852+0000","last_unstale":"2026-02-23T13:03:31.590177+0000","last_undegraded":"2026-02-23T13:03:31.590177+0000","last_fullsized":"2026-02-23T13:03:31.590177+0000","mapping_epoch":28,"log_start":"30'9080","ondisk_log_start":"30'9080","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:19.208546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":595263488,"num_objects":9083,"num_object_clones":0,"num_object_copies":27249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9083,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9083,"num_write_kb":581312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"30'9296","reported_seq":9310,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.591585+0000","last_change":"2026-02-23T13:03:08.708883+0000","last_active":"2026-02-23T13:03:31.591585+0000","last_peered":"2026-02-23T13:03:31.591585+0000","last_clean":"2026-02-23T13:03:31.591585+0000","last_became_active":"2026-02-23T13:03:08.708457+0000","last_became_peered":"2026-02-23T13:03:08.708457+0000","last_unstale":"2026-02-23T13:03:31.591585+0000","last_undegraded":"2026-02-23T13:03:31.591585+0000","last_fullsized":"2026-02-23T13:03:31.591585+0000","mapping_epoch":28,"log_start":"30'9292","ondisk_log_start":"30'9292","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:32.806938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609222656,"num_objects":9296,"num_object_clones":0,"num_object_copies":27888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9296,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9296,"num_write_kb":594944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"30'9080","reported_seq":9094,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.592340+0000","last_change":"2026-02-23T13:03:08.712176+0000","last_active":"2026-02-23T13:03:31.592340+0000","last_peered":"2026-02-23T13:03:31.592340+0000","last_clean":"2026-02-23T13:03:31.592340+0000","last_became_active":"2026-02-23T13:03:08.712010+0000","last_became_peered":"2026-02-23T13:03:08.712010+0000","last_unstale":"2026-02-23T13:03:31.592340+0000","last_undegraded":"2026-02-23T13:03:31.592340+0000","last_fullsized":"2026-02-23T13:03:31.592340+0000","mapping_epoch":28,"log_start":"30'9077","ondisk_log_start":"30'9077","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:29.753408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":595066880,"num_objects":9080,"num_object_clones":0,"num_object_copies":27240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9080,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9080,"num_write_kb":581120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"30'9022","reported_seq":9035,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.590247+0000","last_change":"2026-02-23T13:03:08.713049+0000","last_active":"2026-02-23T13:03:31.590247+0000","last_peered":"2026-02-23T13:03:31.590247+0000","last_clean":"2026-02-23T13:03:31.590247+0000","last_became_active":"2026-02-23T13:03:08.712763+0000","last_became_peered":"2026-02-23T13:03:08.712763+0000","last_unstale":"2026-02-23T13:03:31.590247+0000","last_undegraded":"2026-02-23T13:03:31.590247+0000","last_fullsized":"2026-02-23T13:03:31.590247+0000","mapping_epoch":28,"log_start":"30'9019","ondisk_log_start":"30'9019","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:18.501703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":591265792,"num_objects":9022,"num_object_clones":0,"num_object_copies":27066,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9022,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9022,"num_write_kb":577408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"30'9228","reported_seq":9242,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.591235+0000","last_change":"2026-02-23T13:03:08.709558+0000","last_active":"2026-02-23T13:03:31.591235+0000","last_peered":"2026-02-23T13:03:31.591235+0000","last_clean":"2026-02-23T13:03:31.591235+0000","last_became_active":"2026-02-23T13:03:08.709391+0000","last_became_peered":"2026-02-23T13:03:08.709391+0000","last_unstale":"2026-02-23T13:03:31.591235+0000","last_undegraded":"2026-02-23T13:03:31.591235+0000","last_fullsized":"2026-02-23T13:03:31.591235+0000","mapping_epoch":28,"log_start":"30'9225","ondisk_log_start":"30'9225","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:34.787615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604766208,"num_objects":9228,"num_object_clones":0,"num_object_copies":27684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9228,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9228,"num_write_kb":590592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"30'9158","reported_seq":9172,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.587893+0000","last_change":"2026-02-23T13:03:08.711473+0000","last_active":"2026-02-23T13:03:31.587893+0000","last_peered":"2026-02-23T13:03:31.587893+0000","last_clean":"2026-02-23T13:03:31.587893+0000","last_became_active":"2026-02-23T13:03:08.711303+0000","last_became_peered":"2026-02-23T13:03:08.711303+0000","last_unstale":"2026-02-23T13:03:31.587893+0000","last_undegraded":"2026-02-23T13:03:31.587893+0000","last_fullsized":"2026-02-23T13:03:31.587893+0000","mapping_epoch":28,"log_start":"30'9155","ondisk_log_start":"30'9155","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:35.916414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":600178688,"num_objects":9158,"num_object_clones":0,"num_object_copies":27474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9158,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9158,"num_write_kb":586112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":9731309568,"num_objects":148488,"num_object_clones":0,"num_object_copies":445464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":148488,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148488,"num_write_kb":9503232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":31902793728,"data_stored":31902793728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247817,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":8519580,"kb_used_data":8023368,"kb_used_omap":8,"kb_used_meta":496183,"kb_avail":725483620,"statfs":{"total":751619276800,"available":742895226880,"internally_reserved":0,"allocated":8215928832,"data_stored":8215753327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8772,"internal_metadata":508091836},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444045,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":8177408,"kb_used_data":7717292,"kb_used_omap":14,"kb_used_meta":460081,"kb_avail":725825792,"statfs":{"total":751619276800,"available":743245611008,"internally_reserved":0,"allocated":7902507008,"data_stored":7902307866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14645,"internal_metadata":471123659},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":7451800,"kb_used_data":7027780,"kb_used_omap":14,"kb_used_meta":423985,"kb_avail":726551400,"statfs":{"total":751619276800,"available":743988633600,"internally_reserved":0,"allocated":7196446720,"data_stored":7196274767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15296,"internal_metadata":434160704},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705680,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":8437004,"kb_used_data":7940792,"kb_used_omap":19,"kb_used_meta":496172,"kb_avail":725566196,"statfs":{"total":751619276800,"available":742979784704,"internally_reserved":0,"allocated":8131371008,"data_stored":8131163987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19853,"internal_metadata":508080755},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8135704576,"data_stored":8135704576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7206600704,"data_stored":7206600704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8175943680,"data_stored":8175943680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8384544768,"data_stored":8384544768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:03:36.707 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-23T13:03:36.707 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:03:36.707 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:03:36.725 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:36.778 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:36 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4150262581' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-23T13:03:36.779 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:36 trial046 ceph-mon[38575]: osdmap e34: 4 total, 4 up, 4 in 2026-02-23T13:03:36.799 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 27 16 182349 182333 422.035 429.312 0.00143218 0.00236818 2026-02-23T13:03:36.847 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:36.846+0000 7f37033ea640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:36.848 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:36.846+0000 7f37033ea640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:36.855 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:36.863 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:03:36.864 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:03:36.876 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:03:36.877 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:03:36.889 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:03:36.890 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:03:36.902 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:03:36.902 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:03:36.976 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:36.975+0000 7fab5a105640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:36.976 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:36.975+0000 7fab5a105640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:37.112 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:03:37.112 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:03:37.157 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2026-02-23T13:03:36.595178+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":9731899936,"num_objects":148490,"num_object_clones":0,"num_object_copies":445470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":148490,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":148623,"num_write_kb":9505382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":32585792,"kb_used_data":30709232,"kb_used_omap":57,"kb_used_meta":1876422,"kb_avail":2903427008,"statfs":{"total":3006477107200,"available":2973109256192,"internally_reserved":0,"allocated":31446253568,"data_stored":31445499947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58566,"internal_metadata":1921456954},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":135856128,"num_objects":2073,"num_object_clones":0,"num_object_copies":6219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2073,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2073,"num_write_kb":132672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000537"},"pg_stats":[{"pgid":"2.f","version":"34'11184","reported_seq":11206,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:36.592692+0000","last_change":"2026-02-23T13:03:08.711612+0000","last_active":"2026-02-23T13:03:36.592692+0000","last_peered":"2026-02-23T13:03:36.592692+0000","last_clean":"2026-02-23T13:03:36.592692+0000","last_became_active":"2026-02-23T13:03:08.711408+0000","last_became_peered":"2026-02-23T13:03:08.711408+0000","last_unstale":"2026-02-23T13:03:36.592692+0000","last_undegraded":"2026-02-23T13:03:36.592692+0000","last_fullsized":"2026-02-23T13:03:36.592692+0000","mapping_epoch":28,"log_start":"34'11181","ondisk_log_start":"34'11181","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:21.274136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":732954624,"num_objects":11184,"num_object_clones":0,"num_object_copies":33552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11184,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11184,"num_write_kb":715776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"30'9320","reported_seq":9334,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.589196+0000","last_change":"2026-02-23T13:03:08.711629+0000","last_active":"2026-02-23T13:03:31.589196+0000","last_peered":"2026-02-23T13:03:31.589196+0000","last_clean":"2026-02-23T13:03:31.589196+0000","last_became_active":"2026-02-23T13:03:08.711462+0000","last_became_peered":"2026-02-23T13:03:08.711462+0000","last_unstale":"2026-02-23T13:03:31.589196+0000","last_undegraded":"2026-02-23T13:03:31.589196+0000","last_fullsized":"2026-02-23T13:03:31.589196+0000","mapping_epoch":28,"log_start":"30'9317","ondisk_log_start":"30'9317","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:35.369081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610795520,"num_objects":9320,"num_object_clones":0,"num_object_copies":27960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9320,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9320,"num_write_kb":596480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"30'9020","reported_seq":9034,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.592861+0000","last_change":"2026-02-23T13:03:08.712615+0000","last_active":"2026-02-23T13:03:31.592861+0000","last_peered":"2026-02-23T13:03:31.592861+0000","last_clean":"2026-02-23T13:03:31.592861+0000","last_became_active":"2026-02-23T13:03:08.712246+0000","last_became_peered":"2026-02-23T13:03:08.712246+0000","last_unstale":"2026-02-23T13:03:31.592861+0000","last_undegraded":"2026-02-23T13:03:31.592861+0000","last_fullsized":"2026-02-23T13:03:31.592861+0000","mapping_epoch":28,"log_start":"30'9017","ondisk_log_start":"30'9017","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:26.869038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":591134720,"num_objects":9020,"num_object_clones":0,"num_object_copies":27060,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9020,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9020,"num_write_kb":577280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"30'9154","reported_seq":9168,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.592027+0000","last_change":"2026-02-23T13:03:08.712832+0000","last_active":"2026-02-23T13:03:31.592027+0000","last_peered":"2026-02-23T13:03:31.592027+0000","last_clean":"2026-02-23T13:03:31.592027+0000","last_became_active":"2026-02-23T13:03:08.712348+0000","last_became_peered":"2026-02-23T13:03:08.712348+0000","last_unstale":"2026-02-23T13:03:31.592027+0000","last_undegraded":"2026-02-23T13:03:31.592027+0000","last_fullsized":"2026-02-23T13:03:31.592027+0000","mapping_epoch":28,"log_start":"30'9151","ondisk_log_start":"30'9151","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:23.478567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":599916544,"num_objects":9154,"num_object_clones":0,"num_object_copies":27462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9154,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9154,"num_write_kb":585856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:09.799124+0000","last_change":"2026-02-23T13:02:55.158696+0000","last_active":"2026-02-23T13:03:09.799124+0000","last_peered":"2026-02-23T13:03:09.799124+0000","last_clean":"2026-02-23T13:03:09.799124+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:03:09.799124+0000","last_undegraded":"2026-02-23T13:03:09.799124+0000","last_fullsized":"2026-02-23T13:03:09.799124+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:02:44.100679+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:07.625581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"30'9073","reported_seq":9087,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.585315+0000","last_change":"2026-02-23T13:03:08.709049+0000","last_active":"2026-02-23T13:03:31.585315+0000","last_peered":"2026-02-23T13:03:31.585315+0000","last_clean":"2026-02-23T13:03:31.585315+0000","last_became_active":"2026-02-23T13:03:08.708695+0000","last_became_peered":"2026-02-23T13:03:08.708695+0000","last_unstale":"2026-02-23T13:03:31.585315+0000","last_undegraded":"2026-02-23T13:03:31.585315+0000","last_fullsized":"2026-02-23T13:03:31.585315+0000","mapping_epoch":28,"log_start":"30'9070","ondisk_log_start":"30'9070","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:11.438878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":594608128,"num_objects":9073,"num_object_clones":0,"num_object_copies":27219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9073,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9073,"num_write_kb":580672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"30'9073","reported_seq":9087,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.582394+0000","last_change":"2026-02-23T13:03:08.712038+0000","last_active":"2026-02-23T13:03:31.582394+0000","last_peered":"2026-02-23T13:03:31.582394+0000","last_clean":"2026-02-23T13:03:31.582394+0000","last_became_active":"2026-02-23T13:03:08.711847+0000","last_became_peered":"2026-02-23T13:03:08.711847+0000","last_unstale":"2026-02-23T13:03:31.582394+0000","last_undegraded":"2026-02-23T13:03:31.582394+0000","last_fullsized":"2026-02-23T13:03:31.582394+0000","mapping_epoch":28,"log_start":"30'9070","ondisk_log_start":"30'9070","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:25.087301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":594608128,"num_objects":9073,"num_object_clones":0,"num_object_copies":27219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9073,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9073,"num_write_kb":580672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"30'9180","reported_seq":9194,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.584928+0000","last_change":"2026-02-23T13:03:08.713062+0000","last_active":"2026-02-23T13:03:31.584928+0000","last_peered":"2026-02-23T13:03:31.584928+0000","last_clean":"2026-02-23T13:03:31.584928+0000","last_became_active":"2026-02-23T13:03:08.712783+0000","last_became_peered":"2026-02-23T13:03:08.712783+0000","last_unstale":"2026-02-23T13:03:31.584928+0000","last_undegraded":"2026-02-23T13:03:31.584928+0000","last_fullsized":"2026-02-23T13:03:31.584928+0000","mapping_epoch":28,"log_start":"30'9177","ondisk_log_start":"30'9177","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:07.712555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":601620480,"num_objects":9180,"num_object_clones":0,"num_object_copies":27540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9180,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9180,"num_write_kb":587520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"30'9347","reported_seq":9361,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.591744+0000","last_change":"2026-02-23T13:03:08.709181+0000","last_active":"2026-02-23T13:03:31.591744+0000","last_peered":"2026-02-23T13:03:31.591744+0000","last_clean":"2026-02-23T13:03:31.591744+0000","last_became_active":"2026-02-23T13:03:08.708821+0000","last_became_peered":"2026-02-23T13:03:08.708821+0000","last_unstale":"2026-02-23T13:03:31.591744+0000","last_undegraded":"2026-02-23T13:03:31.591744+0000","last_fullsized":"2026-02-23T13:03:31.591744+0000","mapping_epoch":28,"log_start":"30'9344","ondisk_log_start":"30'9344","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:22.653808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":612564992,"num_objects":9347,"num_object_clones":0,"num_object_copies":28041,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9347,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9347,"num_write_kb":598208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"30'9162","reported_seq":9176,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.591790+0000","last_change":"2026-02-23T13:03:08.712493+0000","last_active":"2026-02-23T13:03:31.591790+0000","last_peered":"2026-02-23T13:03:31.591790+0000","last_clean":"2026-02-23T13:03:31.591790+0000","last_became_active":"2026-02-23T13:03:08.712152+0000","last_became_peered":"2026-02-23T13:03:08.712152+0000","last_unstale":"2026-02-23T13:03:31.591790+0000","last_undegraded":"2026-02-23T13:03:31.591790+0000","last_fullsized":"2026-02-23T13:03:31.591790+0000","mapping_epoch":28,"log_start":"30'9159","ondisk_log_start":"30'9159","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:33.900038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":600440832,"num_objects":9162,"num_object_clones":0,"num_object_copies":27486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9162,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9162,"num_write_kb":586368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"30'9108","reported_seq":9122,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.590141+0000","last_change":"2026-02-23T13:03:08.712205+0000","last_active":"2026-02-23T13:03:31.590141+0000","last_peered":"2026-02-23T13:03:31.590141+0000","last_clean":"2026-02-23T13:03:31.590141+0000","last_became_active":"2026-02-23T13:03:08.712055+0000","last_became_peered":"2026-02-23T13:03:08.712055+0000","last_unstale":"2026-02-23T13:03:31.590141+0000","last_undegraded":"2026-02-23T13:03:31.590141+0000","last_fullsized":"2026-02-23T13:03:31.590141+0000","mapping_epoch":28,"log_start":"30'9105","ondisk_log_start":"30'9105","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:37.263900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":596901888,"num_objects":9108,"num_object_clones":0,"num_object_copies":27324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9108,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9108,"num_write_kb":582912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"30'9083","reported_seq":9096,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.590177+0000","last_change":"2026-02-23T13:03:08.709028+0000","last_active":"2026-02-23T13:03:31.590177+0000","last_peered":"2026-02-23T13:03:31.590177+0000","last_clean":"2026-02-23T13:03:31.590177+0000","last_became_active":"2026-02-23T13:03:08.708852+0000","last_became_peered":"2026-02-23T13:03:08.708852+0000","last_unstale":"2026-02-23T13:03:31.590177+0000","last_undegraded":"2026-02-23T13:03:31.590177+0000","last_fullsized":"2026-02-23T13:03:31.590177+0000","mapping_epoch":28,"log_start":"30'9080","ondisk_log_start":"30'9080","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:19.208546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":595263488,"num_objects":9083,"num_object_clones":0,"num_object_copies":27249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9083,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9083,"num_write_kb":581312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"30'9296","reported_seq":9310,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.591585+0000","last_change":"2026-02-23T13:03:08.708883+0000","last_active":"2026-02-23T13:03:31.591585+0000","last_peered":"2026-02-23T13:03:31.591585+0000","last_clean":"2026-02-23T13:03:31.591585+0000","last_became_active":"2026-02-23T13:03:08.708457+0000","last_became_peered":"2026-02-23T13:03:08.708457+0000","last_unstale":"2026-02-23T13:03:31.591585+0000","last_undegraded":"2026-02-23T13:03:31.591585+0000","last_fullsized":"2026-02-23T13:03:31.591585+0000","mapping_epoch":28,"log_start":"30'9292","ondisk_log_start":"30'9292","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:32.806938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609222656,"num_objects":9296,"num_object_clones":0,"num_object_copies":27888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9296,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9296,"num_write_kb":594944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"30'9080","reported_seq":9094,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.592340+0000","last_change":"2026-02-23T13:03:08.712176+0000","last_active":"2026-02-23T13:03:31.592340+0000","last_peered":"2026-02-23T13:03:31.592340+0000","last_clean":"2026-02-23T13:03:31.592340+0000","last_became_active":"2026-02-23T13:03:08.712010+0000","last_became_peered":"2026-02-23T13:03:08.712010+0000","last_unstale":"2026-02-23T13:03:31.592340+0000","last_undegraded":"2026-02-23T13:03:31.592340+0000","last_fullsized":"2026-02-23T13:03:31.592340+0000","mapping_epoch":28,"log_start":"30'9077","ondisk_log_start":"30'9077","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:29.753408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":595066880,"num_objects":9080,"num_object_clones":0,"num_object_copies":27240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9080,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9080,"num_write_kb":581120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"30'9022","reported_seq":9035,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.590247+0000","last_change":"2026-02-23T13:03:08.713049+0000","last_active":"2026-02-23T13:03:31.590247+0000","last_peered":"2026-02-23T13:03:31.590247+0000","last_clean":"2026-02-23T13:03:31.590247+0000","last_became_active":"2026-02-23T13:03:08.712763+0000","last_became_peered":"2026-02-23T13:03:08.712763+0000","last_unstale":"2026-02-23T13:03:31.590247+0000","last_undegraded":"2026-02-23T13:03:31.590247+0000","last_fullsized":"2026-02-23T13:03:31.590247+0000","mapping_epoch":28,"log_start":"30'9019","ondisk_log_start":"30'9019","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:18.501703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":591265792,"num_objects":9022,"num_object_clones":0,"num_object_copies":27066,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9022,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9022,"num_write_kb":577408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"30'9228","reported_seq":9242,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.591235+0000","last_change":"2026-02-23T13:03:08.709558+0000","last_active":"2026-02-23T13:03:31.591235+0000","last_peered":"2026-02-23T13:03:31.591235+0000","last_clean":"2026-02-23T13:03:31.591235+0000","last_became_active":"2026-02-23T13:03:08.709391+0000","last_became_peered":"2026-02-23T13:03:08.709391+0000","last_unstale":"2026-02-23T13:03:31.591235+0000","last_undegraded":"2026-02-23T13:03:31.591235+0000","last_fullsized":"2026-02-23T13:03:31.591235+0000","mapping_epoch":28,"log_start":"30'9225","ondisk_log_start":"30'9225","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:34.787615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604766208,"num_objects":9228,"num_object_clones":0,"num_object_copies":27684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9228,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9228,"num_write_kb":590592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"30'9158","reported_seq":9172,"reported_epoch":30,"state":"active+clean","last_fresh":"2026-02-23T13:03:31.587893+0000","last_change":"2026-02-23T13:03:08.711473+0000","last_active":"2026-02-23T13:03:31.587893+0000","last_peered":"2026-02-23T13:03:31.587893+0000","last_clean":"2026-02-23T13:03:31.587893+0000","last_became_active":"2026-02-23T13:03:08.711303+0000","last_became_peered":"2026-02-23T13:03:08.711303+0000","last_unstale":"2026-02-23T13:03:31.587893+0000","last_undegraded":"2026-02-23T13:03:31.587893+0000","last_fullsized":"2026-02-23T13:03:31.587893+0000","mapping_epoch":28,"log_start":"30'9155","ondisk_log_start":"30'9155","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:35.916414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":600178688,"num_objects":9158,"num_object_clones":0,"num_object_copies":27474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9158,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9158,"num_write_kb":586112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":9731309568,"num_objects":148488,"num_object_clones":0,"num_object_copies":445464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":148488,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148488,"num_write_kb":9503232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":31902793728,"data_stored":31902793728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247817,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":8519580,"kb_used_data":8023368,"kb_used_omap":8,"kb_used_meta":496183,"kb_avail":725483620,"statfs":{"total":751619276800,"available":742895226880,"internally_reserved":0,"allocated":8215928832,"data_stored":8215753327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8772,"internal_metadata":508091836},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444045,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":8177408,"kb_used_data":7717292,"kb_used_omap":14,"kb_used_meta":460081,"kb_avail":725825792,"statfs":{"total":751619276800,"available":743245611008,"internally_reserved":0,"allocated":7902507008,"data_stored":7902307866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14645,"internal_metadata":471123659},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":7451800,"kb_used_data":7027780,"kb_used_omap":14,"kb_used_meta":423985,"kb_avail":726551400,"statfs":{"total":751619276800,"available":743988633600,"internally_reserved":0,"allocated":7196446720,"data_stored":7196274767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15296,"internal_metadata":434160704},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705680,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":8437004,"kb_used_data":7940792,"kb_used_omap":19,"kb_used_meta":496172,"kb_avail":725566196,"statfs":{"total":751619276800,"available":742979784704,"internally_reserved":0,"allocated":8131371008,"data_stored":8131163987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19853,"internal_metadata":508080755},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8135704576,"data_stored":8135704576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7206600704,"data_stored":7206600704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8175943680,"data_stored":8175943680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8384544768,"data_stored":8384544768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:03:37.799 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 28 16 189101 189085 422.033 422 0.00249848 0.00236821 2026-02-23T13:03:38.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:37 trial046 ceph-mon[38575]: from='client.14388 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:03:38.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:37 trial046 ceph-mon[38575]: pgmap v28: 17 pgs: 17 active+clean; 9.1 GiB data, 31 GiB used, 2.7 TiB / 2.7 TiB avail; 32 MiB/s wr, 518 op/s 2026-02-23T13:03:38.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:37 trial046 ceph-mon[38575]: from='client.14390 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:03:38.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:37 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4272778090' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:03:38.799 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 29 15 195620 195605 421.531 407.5 0.00445491 0.00237112 2026-02-23T13:03:38.948 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:03:39.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:38 trial046 ceph-mon[38575]: from='client.14394 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:03:39.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:38 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:03:39.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:38 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:03:39.086 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:39.205 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:39.204+0000 7f1ff126a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:39.205 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:39.204+0000 7f1ff126a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:39.219 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:03:39.219 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:03:39.231 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:03:39.231 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:03:39.242 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:03:39.243 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:03:39.254 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:03:39.255 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:03:39.800 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 30 16 202182 202166 421.147 410.062 0.00221805 0.00237321 2026-02-23T13:03:40.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:39 trial046 ceph-mon[38575]: pgmap v29: 17 pgs: 17 active+clean; 11 GiB data, 35 GiB used, 2.7 TiB / 2.7 TiB avail; 369 MiB/s wr, 5.90k op/s 2026-02-23T13:03:40.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:39 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1605250801' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:03:40.800 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 31 16 208906 208890 421.111 420.25 0.00117439 0.00237346 2026-02-23T13:03:41.300 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:03:41.438 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:41.561 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:41.560+0000 7fc6d5497640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:41.561 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:41.561+0000 7fc6d5497640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:41.577 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:03:41.577 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:03:41.592 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:03:41.592 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:03:41.604 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:03:41.604 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:03:41.616 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:03:41.617 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:03:41.800 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 32 16 215456 215440 420.744 409.375 0.00189441 0.00237553 2026-02-23T13:03:42.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:41 trial046 ceph-mon[38575]: pgmap v30: 17 pgs: 17 active+clean; 11 GiB data, 35 GiB used, 2.7 TiB / 2.7 TiB avail; 315 MiB/s wr, 5.04k op/s 2026-02-23T13:03:42.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:41 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3062619329' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:03:42.159 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:03:42.160 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:03:42.160 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_0 2026-02-23T13:03:42.160 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:03:42.297 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:42.418 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:42.417+0000 7f17463b1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:42.418 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:42.417+0000 7f17463b1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:42.549 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:03:42.549 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:03:42.592 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2026-02-23T13:03:40.595732+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":11864834592,"num_objects":181036,"num_object_clones":0,"num_object_copies":543108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181036,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":181169,"num_write_kb":11588326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":36401312,"kb_used_data":34308176,"kb_used_omap":62,"kb_used_meta":2092993,"kb_avail":2899611488,"statfs":{"total":3006477107200,"available":2969202163712,"internally_reserved":0,"allocated":35131572224,"data_stored":35130755571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63770,"internal_metadata":2143225574},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2268790784,"num_objects":34619,"num_object_clones":0,"num_object_copies":103857,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34619,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34619,"num_write_kb":2215616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.863321"},"pg_stats":[{"pgid":"2.f","version":"34'11184","reported_seq":11206,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:36.592692+0000","last_change":"2026-02-23T13:03:08.711612+0000","last_active":"2026-02-23T13:03:36.592692+0000","last_peered":"2026-02-23T13:03:36.592692+0000","last_clean":"2026-02-23T13:03:36.592692+0000","last_became_active":"2026-02-23T13:03:08.711408+0000","last_became_peered":"2026-02-23T13:03:08.711408+0000","last_unstale":"2026-02-23T13:03:36.592692+0000","last_undegraded":"2026-02-23T13:03:36.592692+0000","last_fullsized":"2026-02-23T13:03:36.592692+0000","mapping_epoch":28,"log_start":"34'11181","ondisk_log_start":"34'11181","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:21.274136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":732954624,"num_objects":11184,"num_object_clones":0,"num_object_copies":33552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11184,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11184,"num_write_kb":715776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"34'11494","reported_seq":11516,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:36.593157+0000","last_change":"2026-02-23T13:03:08.711629+0000","last_active":"2026-02-23T13:03:36.593157+0000","last_peered":"2026-02-23T13:03:36.593157+0000","last_clean":"2026-02-23T13:03:36.593157+0000","last_became_active":"2026-02-23T13:03:08.711462+0000","last_became_peered":"2026-02-23T13:03:08.711462+0000","last_unstale":"2026-02-23T13:03:36.593157+0000","last_undegraded":"2026-02-23T13:03:36.593157+0000","last_fullsized":"2026-02-23T13:03:36.593157+0000","mapping_epoch":28,"log_start":"34'11491","ondisk_log_start":"34'11491","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:35.369081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":753270784,"num_objects":11494,"num_object_clones":0,"num_object_copies":34482,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11494,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11494,"num_write_kb":735616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"34'11188","reported_seq":11209,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:36.591236+0000","last_change":"2026-02-23T13:03:08.712615+0000","last_active":"2026-02-23T13:03:36.591236+0000","last_peered":"2026-02-23T13:03:36.591236+0000","last_clean":"2026-02-23T13:03:36.591236+0000","last_became_active":"2026-02-23T13:03:08.712246+0000","last_became_peered":"2026-02-23T13:03:08.712246+0000","last_unstale":"2026-02-23T13:03:36.591236+0000","last_undegraded":"2026-02-23T13:03:36.591236+0000","last_fullsized":"2026-02-23T13:03:36.591236+0000","mapping_epoch":28,"log_start":"34'11185","ondisk_log_start":"34'11185","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:26.869038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":733216768,"num_objects":11188,"num_object_clones":0,"num_object_copies":33564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11188,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11188,"num_write_kb":716032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"34'11349","reported_seq":11370,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:36.593671+0000","last_change":"2026-02-23T13:03:08.712832+0000","last_active":"2026-02-23T13:03:36.593671+0000","last_peered":"2026-02-23T13:03:36.593671+0000","last_clean":"2026-02-23T13:03:36.593671+0000","last_became_active":"2026-02-23T13:03:08.712348+0000","last_became_peered":"2026-02-23T13:03:08.712348+0000","last_unstale":"2026-02-23T13:03:36.593671+0000","last_undegraded":"2026-02-23T13:03:36.593671+0000","last_fullsized":"2026-02-23T13:03:36.593671+0000","mapping_epoch":28,"log_start":"34'11346","ondisk_log_start":"34'11346","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:23.478567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":743768064,"num_objects":11349,"num_object_clones":0,"num_object_copies":34047,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11349,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11349,"num_write_kb":726336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":196,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:35.739133+0000","last_change":"2026-02-23T13:02:55.158696+0000","last_active":"2026-02-23T13:03:35.739133+0000","last_peered":"2026-02-23T13:03:35.739133+0000","last_clean":"2026-02-23T13:03:35.739133+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:03:35.739133+0000","last_undegraded":"2026-02-23T13:03:35.739133+0000","last_fullsized":"2026-02-23T13:03:35.739133+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:02:44.100679+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:07.625581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"34'11208","reported_seq":11230,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:36.585805+0000","last_change":"2026-02-23T13:03:08.709049+0000","last_active":"2026-02-23T13:03:36.585805+0000","last_peered":"2026-02-23T13:03:36.585805+0000","last_clean":"2026-02-23T13:03:36.585805+0000","last_became_active":"2026-02-23T13:03:08.708695+0000","last_became_peered":"2026-02-23T13:03:08.708695+0000","last_unstale":"2026-02-23T13:03:36.585805+0000","last_undegraded":"2026-02-23T13:03:36.585805+0000","last_fullsized":"2026-02-23T13:03:36.585805+0000","mapping_epoch":28,"log_start":"34'11205","ondisk_log_start":"34'11205","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:11.438878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":734527488,"num_objects":11208,"num_object_clones":0,"num_object_copies":33624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11208,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11208,"num_write_kb":717312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"34'11192","reported_seq":11213,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:36.586708+0000","last_change":"2026-02-23T13:03:08.712038+0000","last_active":"2026-02-23T13:03:36.586708+0000","last_peered":"2026-02-23T13:03:36.586708+0000","last_clean":"2026-02-23T13:03:36.586708+0000","last_became_active":"2026-02-23T13:03:08.711847+0000","last_became_peered":"2026-02-23T13:03:08.711847+0000","last_unstale":"2026-02-23T13:03:36.586708+0000","last_undegraded":"2026-02-23T13:03:36.586708+0000","last_fullsized":"2026-02-23T13:03:36.586708+0000","mapping_epoch":28,"log_start":"34'11189","ondisk_log_start":"34'11189","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:25.087301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":733478912,"num_objects":11192,"num_object_clones":0,"num_object_copies":33576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11192,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11192,"num_write_kb":716288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"34'11299","reported_seq":11321,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:36.590973+0000","last_change":"2026-02-23T13:03:08.713062+0000","last_active":"2026-02-23T13:03:36.590973+0000","last_peered":"2026-02-23T13:03:36.590973+0000","last_clean":"2026-02-23T13:03:36.590973+0000","last_became_active":"2026-02-23T13:03:08.712783+0000","last_became_peered":"2026-02-23T13:03:08.712783+0000","last_unstale":"2026-02-23T13:03:36.590973+0000","last_undegraded":"2026-02-23T13:03:36.590973+0000","last_fullsized":"2026-02-23T13:03:36.590973+0000","mapping_epoch":28,"log_start":"34'11296","ondisk_log_start":"34'11296","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:07.712555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":740491264,"num_objects":11299,"num_object_clones":0,"num_object_copies":33897,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11299,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11299,"num_write_kb":723136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"34'11550","reported_seq":11572,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:36.592097+0000","last_change":"2026-02-23T13:03:08.709181+0000","last_active":"2026-02-23T13:03:36.592097+0000","last_peered":"2026-02-23T13:03:36.592097+0000","last_clean":"2026-02-23T13:03:36.592097+0000","last_became_active":"2026-02-23T13:03:08.708821+0000","last_became_peered":"2026-02-23T13:03:08.708821+0000","last_unstale":"2026-02-23T13:03:36.592097+0000","last_undegraded":"2026-02-23T13:03:36.592097+0000","last_fullsized":"2026-02-23T13:03:36.592097+0000","mapping_epoch":28,"log_start":"34'11547","ondisk_log_start":"34'11547","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:22.653808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":756940800,"num_objects":11550,"num_object_clones":0,"num_object_copies":34650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11550,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11550,"num_write_kb":739200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"34'11349","reported_seq":11371,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:36.589821+0000","last_change":"2026-02-23T13:03:08.712493+0000","last_active":"2026-02-23T13:03:36.589821+0000","last_peered":"2026-02-23T13:03:36.589821+0000","last_clean":"2026-02-23T13:03:36.589821+0000","last_became_active":"2026-02-23T13:03:08.712152+0000","last_became_peered":"2026-02-23T13:03:08.712152+0000","last_unstale":"2026-02-23T13:03:36.589821+0000","last_undegraded":"2026-02-23T13:03:36.589821+0000","last_fullsized":"2026-02-23T13:03:36.589821+0000","mapping_epoch":28,"log_start":"34'11346","ondisk_log_start":"34'11346","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:33.900038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":743768064,"num_objects":11349,"num_object_clones":0,"num_object_copies":34047,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11349,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11349,"num_write_kb":726336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"34'11231","reported_seq":11253,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:36.590372+0000","last_change":"2026-02-23T13:03:08.712205+0000","last_active":"2026-02-23T13:03:36.590372+0000","last_peered":"2026-02-23T13:03:36.590372+0000","last_clean":"2026-02-23T13:03:36.590372+0000","last_became_active":"2026-02-23T13:03:08.712055+0000","last_became_peered":"2026-02-23T13:03:08.712055+0000","last_unstale":"2026-02-23T13:03:36.590372+0000","last_undegraded":"2026-02-23T13:03:36.590372+0000","last_fullsized":"2026-02-23T13:03:36.590372+0000","mapping_epoch":28,"log_start":"34'11228","ondisk_log_start":"34'11228","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:37.263900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":736034816,"num_objects":11231,"num_object_clones":0,"num_object_copies":33693,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11231,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11231,"num_write_kb":718784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"34'11325","reported_seq":11347,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:36.593553+0000","last_change":"2026-02-23T13:03:08.709028+0000","last_active":"2026-02-23T13:03:36.593553+0000","last_peered":"2026-02-23T13:03:36.593553+0000","last_clean":"2026-02-23T13:03:36.593553+0000","last_became_active":"2026-02-23T13:03:08.708852+0000","last_became_peered":"2026-02-23T13:03:08.708852+0000","last_unstale":"2026-02-23T13:03:36.593553+0000","last_undegraded":"2026-02-23T13:03:36.593553+0000","last_fullsized":"2026-02-23T13:03:36.593553+0000","mapping_epoch":28,"log_start":"34'11322","ondisk_log_start":"34'11322","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:19.208546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":742195200,"num_objects":11325,"num_object_clones":0,"num_object_copies":33975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11325,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11325,"num_write_kb":724800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"34'11435","reported_seq":11457,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:36.589600+0000","last_change":"2026-02-23T13:03:08.708883+0000","last_active":"2026-02-23T13:03:36.589600+0000","last_peered":"2026-02-23T13:03:36.589600+0000","last_clean":"2026-02-23T13:03:36.589600+0000","last_became_active":"2026-02-23T13:03:08.708457+0000","last_became_peered":"2026-02-23T13:03:08.708457+0000","last_unstale":"2026-02-23T13:03:36.589600+0000","last_undegraded":"2026-02-23T13:03:36.589600+0000","last_fullsized":"2026-02-23T13:03:36.589600+0000","mapping_epoch":28,"log_start":"34'11432","ondisk_log_start":"34'11432","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:32.806938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":749404160,"num_objects":11435,"num_object_clones":0,"num_object_copies":34305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11435,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11435,"num_write_kb":731840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"34'11266","reported_seq":11287,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:36.590300+0000","last_change":"2026-02-23T13:03:08.712176+0000","last_active":"2026-02-23T13:03:36.590300+0000","last_peered":"2026-02-23T13:03:36.590300+0000","last_clean":"2026-02-23T13:03:36.590300+0000","last_became_active":"2026-02-23T13:03:08.712010+0000","last_became_peered":"2026-02-23T13:03:08.712010+0000","last_unstale":"2026-02-23T13:03:36.590300+0000","last_undegraded":"2026-02-23T13:03:36.590300+0000","last_fullsized":"2026-02-23T13:03:36.590300+0000","mapping_epoch":28,"log_start":"34'11263","ondisk_log_start":"34'11263","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:29.753408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":738328576,"num_objects":11266,"num_object_clones":0,"num_object_copies":33798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11266,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11266,"num_write_kb":721024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"34'11254","reported_seq":11276,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:36.591333+0000","last_change":"2026-02-23T13:03:08.713049+0000","last_active":"2026-02-23T13:03:36.591333+0000","last_peered":"2026-02-23T13:03:36.591333+0000","last_clean":"2026-02-23T13:03:36.591333+0000","last_became_active":"2026-02-23T13:03:08.712763+0000","last_became_peered":"2026-02-23T13:03:08.712763+0000","last_unstale":"2026-02-23T13:03:36.591333+0000","last_undegraded":"2026-02-23T13:03:36.591333+0000","last_fullsized":"2026-02-23T13:03:36.591333+0000","mapping_epoch":28,"log_start":"34'11251","ondisk_log_start":"34'11251","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:18.501703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":737542144,"num_objects":11254,"num_object_clones":0,"num_object_copies":33762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11254,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11254,"num_write_kb":720256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"34'11367","reported_seq":11389,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:36.592249+0000","last_change":"2026-02-23T13:03:08.709558+0000","last_active":"2026-02-23T13:03:36.592249+0000","last_peered":"2026-02-23T13:03:36.592249+0000","last_clean":"2026-02-23T13:03:36.592249+0000","last_became_active":"2026-02-23T13:03:08.709391+0000","last_became_peered":"2026-02-23T13:03:08.709391+0000","last_unstale":"2026-02-23T13:03:36.592249+0000","last_undegraded":"2026-02-23T13:03:36.592249+0000","last_fullsized":"2026-02-23T13:03:36.592249+0000","mapping_epoch":28,"log_start":"34'11364","ondisk_log_start":"34'11364","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:34.787615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":744947712,"num_objects":11367,"num_object_clones":0,"num_object_copies":34101,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11367,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11367,"num_write_kb":727488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"34'11343","reported_seq":11365,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:36.588452+0000","last_change":"2026-02-23T13:03:08.711473+0000","last_active":"2026-02-23T13:03:36.588452+0000","last_peered":"2026-02-23T13:03:36.588452+0000","last_clean":"2026-02-23T13:03:36.588452+0000","last_became_active":"2026-02-23T13:03:08.711303+0000","last_became_peered":"2026-02-23T13:03:08.711303+0000","last_unstale":"2026-02-23T13:03:36.588452+0000","last_undegraded":"2026-02-23T13:03:36.588452+0000","last_fullsized":"2026-02-23T13:03:36.588452+0000","mapping_epoch":28,"log_start":"34'11340","ondisk_log_start":"34'11340","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:35.916414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":743374848,"num_objects":11343,"num_object_clones":0,"num_object_copies":34029,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11343,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11343,"num_write_kb":725952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":11864244224,"num_objects":181034,"num_object_clones":0,"num_object_copies":543102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181034,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181034,"num_write_kb":11586176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":35592863744,"data_stored":35592863744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247818,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":10573196,"kb_used_data":9968696,"kb_used_omap":11,"kb_used_meta":604468,"kb_avail":723430004,"statfs":{"total":751619276800,"available":740792324096,"internally_reserved":0,"allocated":10207944704,"data_stored":10207737683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11372,"internal_metadata":618976148},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444045,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":8177408,"kb_used_data":7717292,"kb_used_omap":14,"kb_used_meta":460081,"kb_avail":725825792,"statfs":{"total":751619276800,"available":743245611008,"internally_reserved":0,"allocated":7902507008,"data_stored":7902307866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14645,"internal_metadata":471123659},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":9213704,"kb_used_data":8681396,"kb_used_omap":17,"kb_used_meta":532270,"kb_avail":724789496,"statfs":{"total":751619276800,"available":742184443904,"internally_reserved":0,"allocated":8889749504,"data_stored":8889546035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17900,"internal_metadata":545045012},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705680,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":8437004,"kb_used_data":7940792,"kb_used_omap":19,"kb_used_meta":496172,"kb_avail":725566196,"statfs":{"total":751619276800,"available":742979784704,"internally_reserved":0,"allocated":8131371008,"data_stored":8131163987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19853,"internal_metadata":508080755},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8135704576,"data_stored":8135704576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8913616896,"data_stored":8913616896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8175943680,"data_stored":8175943680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10367598592,"data_stored":10367598592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:03:42.594 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:03:42.594 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_0 pg_num 36 2026-02-23T13:03:42.730 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:42.800 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 33 16 222187 222171 420.741 420.688 0.00223752 0.00237552 2026-02-23T13:03:42.842 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:42.841+0000 7f65892c9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:42.843 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:42.841+0000 7f65892c9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:42.980 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:03:43.659 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:03:43.705 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:03:43.800 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 34 16 227776 227760 418.639 349.312 0.0019799 0.00238751 2026-02-23T13:03:43.803 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:43.966 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:43 trial046 ceph-mon[38575]: from='client.14400 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:03:43.966 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:43 trial046 ceph-mon[38575]: pgmap v31: 17 pgs: 17 active+clean; 13 GiB data, 41 GiB used, 2.7 TiB / 2.7 TiB avail; 529 MiB/s wr, 8.46k op/s 2026-02-23T13:03:43.966 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:43 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3494041625' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_0", "var": "pg_num", "val": "36"} : dispatch 2026-02-23T13:03:44.227 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:03:44.227 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:03:44.227 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:03:44.227 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:44.183+0000 7f979d067640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:44.227 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:44.184+0000 7f979d067640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:44.227 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:03:44.227 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:03:44.228 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:03:44.237 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:03:44.237 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:03:44.800 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 35 16 232623 232607 415.333 302.938 0.00114919 0.00240653 2026-02-23T13:03:44.910 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:44 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2945886148' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:03:45.800 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 36 16 239093 239077 415.028 404.375 0.00256833 0.00240827 2026-02-23T13:03:46.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:45 trial046 ceph-mon[38575]: pgmap v32: 17 pgs: 17 active+clean; 13 GiB data, 41 GiB used, 2.7 TiB / 2.7 TiB avail; 429 MiB/s wr, 6.87k op/s 2026-02-23T13:03:46.469 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:46 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:03:46.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:03:46.539 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:03:46 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:03:46] "GET /metrics HTTP/1.1" 200 4210 "" "Prometheus/3.6.0" 2026-02-23T13:03:46.800 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 37 16 245634 245618 414.859 408.812 0.00367936 0.00240924 2026-02-23T13:03:46.933 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:03:47.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:46 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:03:47.075 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:47.202 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:47.200+0000 7f4f1973f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:47.202 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:47.200+0000 7f4f1973f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:47.216 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:03:47.216 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:03:47.230 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:03:47.230 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:03:47.241 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:03:47.241 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:03:47.256 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:03:47.256 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:03:47.800 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 38 16 252314 252298 414.928 417.5 0.00106153 0.0024088 2026-02-23T13:03:48.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:47 trial046 ceph-mon[38575]: pgmap v33: 17 pgs: 17 active+clean; 15 GiB data, 47 GiB used, 2.7 TiB / 2.7 TiB avail; 563 MiB/s wr, 9.01k op/s 2026-02-23T13:03:48.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:47 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/784876681' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:03:48.706 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:03:48.706 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:03:48.707 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-23T13:03:48.707 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:03:48.800 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 39 16 258991 258975 414.988 417.312 0.00264037 0.00240852 2026-02-23T13:03:48.846 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:48.967 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:48.964+0000 7fb4ab2aa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:48.967 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:48.965+0000 7fb4ab2aa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:49.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:48 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:03:49.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:48 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:03:49.107 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:03:49.108 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:03:49.154 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2026-02-23T13:03:48.596741+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16006185504,"num_objects":244228,"num_object_clones":0,"num_object_copies":732684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":244228,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":244361,"num_write_kb":15632614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":48965292,"kb_used_data":46240476,"kb_used_omap":63,"kb_used_meta":2724672,"kb_avail":2887047508,"statfs":{"total":3006477107200,"available":2956336648192,"internally_reserved":0,"allocated":47350247424,"data_stored":47349422892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":65072,"internal_metadata":2790064592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[17,4,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6274285568,"num_objects":95738,"num_object_clones":0,"num_object_copies":287214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95738,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95738,"num_write_kb":6127232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001563"},"pg_stats":[{"pgid":"2.f","version":"34'15183","reported_seq":15205,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:46.589576+0000","last_change":"2026-02-23T13:03:08.711612+0000","last_active":"2026-02-23T13:03:46.589576+0000","last_peered":"2026-02-23T13:03:46.589576+0000","last_clean":"2026-02-23T13:03:46.589576+0000","last_became_active":"2026-02-23T13:03:08.711408+0000","last_became_peered":"2026-02-23T13:03:08.711408+0000","last_unstale":"2026-02-23T13:03:46.589576+0000","last_undegraded":"2026-02-23T13:03:46.589576+0000","last_fullsized":"2026-02-23T13:03:46.589576+0000","mapping_epoch":28,"log_start":"34'15180","ondisk_log_start":"34'15180","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:21.274136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":995033088,"num_objects":15183,"num_object_clones":0,"num_object_copies":45549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15183,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15183,"num_write_kb":971712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"34'15461","reported_seq":15483,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:46.593651+0000","last_change":"2026-02-23T13:03:08.711629+0000","last_active":"2026-02-23T13:03:46.593651+0000","last_peered":"2026-02-23T13:03:46.593651+0000","last_clean":"2026-02-23T13:03:46.593651+0000","last_became_active":"2026-02-23T13:03:08.711462+0000","last_became_peered":"2026-02-23T13:03:08.711462+0000","last_unstale":"2026-02-23T13:03:46.593651+0000","last_undegraded":"2026-02-23T13:03:46.593651+0000","last_fullsized":"2026-02-23T13:03:46.593651+0000","mapping_epoch":28,"log_start":"34'15458","ondisk_log_start":"34'15458","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:35.369081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013252096,"num_objects":15461,"num_object_clones":0,"num_object_copies":46383,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15461,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15461,"num_write_kb":989504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"34'15061","reported_seq":15083,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:46.594177+0000","last_change":"2026-02-23T13:03:08.712615+0000","last_active":"2026-02-23T13:03:46.594177+0000","last_peered":"2026-02-23T13:03:46.594177+0000","last_clean":"2026-02-23T13:03:46.594177+0000","last_became_active":"2026-02-23T13:03:08.712246+0000","last_became_peered":"2026-02-23T13:03:08.712246+0000","last_unstale":"2026-02-23T13:03:46.594177+0000","last_undegraded":"2026-02-23T13:03:46.594177+0000","last_fullsized":"2026-02-23T13:03:46.594177+0000","mapping_epoch":28,"log_start":"34'15058","ondisk_log_start":"34'15058","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:26.869038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":987037696,"num_objects":15061,"num_object_clones":0,"num_object_copies":45183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15061,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15061,"num_write_kb":963904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"34'15249","reported_seq":15270,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:46.594012+0000","last_change":"2026-02-23T13:03:08.712832+0000","last_active":"2026-02-23T13:03:46.594012+0000","last_peered":"2026-02-23T13:03:46.594012+0000","last_clean":"2026-02-23T13:03:46.594012+0000","last_became_active":"2026-02-23T13:03:08.712348+0000","last_became_peered":"2026-02-23T13:03:08.712348+0000","last_unstale":"2026-02-23T13:03:46.594012+0000","last_undegraded":"2026-02-23T13:03:46.594012+0000","last_fullsized":"2026-02-23T13:03:46.594012+0000","mapping_epoch":28,"log_start":"34'15246","ondisk_log_start":"34'15246","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:23.478567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":999358464,"num_objects":15249,"num_object_clones":0,"num_object_copies":45747,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15249,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15249,"num_write_kb":975936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":196,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:35.739133+0000","last_change":"2026-02-23T13:02:55.158696+0000","last_active":"2026-02-23T13:03:35.739133+0000","last_peered":"2026-02-23T13:03:35.739133+0000","last_clean":"2026-02-23T13:03:35.739133+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:03:35.739133+0000","last_undegraded":"2026-02-23T13:03:35.739133+0000","last_fullsized":"2026-02-23T13:03:35.739133+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:02:44.100679+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:07.625581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"34'15183","reported_seq":15204,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:46.593127+0000","last_change":"2026-02-23T13:03:08.709049+0000","last_active":"2026-02-23T13:03:46.593127+0000","last_peered":"2026-02-23T13:03:46.593127+0000","last_clean":"2026-02-23T13:03:46.593127+0000","last_became_active":"2026-02-23T13:03:08.708695+0000","last_became_peered":"2026-02-23T13:03:08.708695+0000","last_unstale":"2026-02-23T13:03:46.593127+0000","last_undegraded":"2026-02-23T13:03:46.593127+0000","last_fullsized":"2026-02-23T13:03:46.593127+0000","mapping_epoch":28,"log_start":"34'15180","ondisk_log_start":"34'15180","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:11.438878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":995033088,"num_objects":15183,"num_object_clones":0,"num_object_copies":45549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15183,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15183,"num_write_kb":971712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"34'15270","reported_seq":15292,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:46.590528+0000","last_change":"2026-02-23T13:03:08.712038+0000","last_active":"2026-02-23T13:03:46.590528+0000","last_peered":"2026-02-23T13:03:46.590528+0000","last_clean":"2026-02-23T13:03:46.590528+0000","last_became_active":"2026-02-23T13:03:08.711847+0000","last_became_peered":"2026-02-23T13:03:08.711847+0000","last_unstale":"2026-02-23T13:03:46.590528+0000","last_undegraded":"2026-02-23T13:03:46.590528+0000","last_fullsized":"2026-02-23T13:03:46.590528+0000","mapping_epoch":28,"log_start":"34'15267","ondisk_log_start":"34'15267","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:25.087301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1000734720,"num_objects":15270,"num_object_clones":0,"num_object_copies":45810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15270,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15270,"num_write_kb":977280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"34'15222","reported_seq":15244,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:46.591541+0000","last_change":"2026-02-23T13:03:08.713062+0000","last_active":"2026-02-23T13:03:46.591541+0000","last_peered":"2026-02-23T13:03:46.591541+0000","last_clean":"2026-02-23T13:03:46.591541+0000","last_became_active":"2026-02-23T13:03:08.712783+0000","last_became_peered":"2026-02-23T13:03:08.712783+0000","last_unstale":"2026-02-23T13:03:46.591541+0000","last_undegraded":"2026-02-23T13:03:46.591541+0000","last_fullsized":"2026-02-23T13:03:46.591541+0000","mapping_epoch":28,"log_start":"34'15219","ondisk_log_start":"34'15219","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:07.712555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":997588992,"num_objects":15222,"num_object_clones":0,"num_object_copies":45666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15222,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15222,"num_write_kb":974208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"34'15548","reported_seq":15570,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:46.595324+0000","last_change":"2026-02-23T13:03:08.709181+0000","last_active":"2026-02-23T13:03:46.595324+0000","last_peered":"2026-02-23T13:03:46.595324+0000","last_clean":"2026-02-23T13:03:46.595324+0000","last_became_active":"2026-02-23T13:03:08.708821+0000","last_became_peered":"2026-02-23T13:03:08.708821+0000","last_unstale":"2026-02-23T13:03:46.595324+0000","last_undegraded":"2026-02-23T13:03:46.595324+0000","last_fullsized":"2026-02-23T13:03:46.595324+0000","mapping_epoch":28,"log_start":"34'15545","ondisk_log_start":"34'15545","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:22.653808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1018953728,"num_objects":15548,"num_object_clones":0,"num_object_copies":46644,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15548,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15548,"num_write_kb":995072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"34'15208","reported_seq":15230,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:46.586359+0000","last_change":"2026-02-23T13:03:08.712493+0000","last_active":"2026-02-23T13:03:46.586359+0000","last_peered":"2026-02-23T13:03:46.586359+0000","last_clean":"2026-02-23T13:03:46.586359+0000","last_became_active":"2026-02-23T13:03:08.712152+0000","last_became_peered":"2026-02-23T13:03:08.712152+0000","last_unstale":"2026-02-23T13:03:46.586359+0000","last_undegraded":"2026-02-23T13:03:46.586359+0000","last_fullsized":"2026-02-23T13:03:46.586359+0000","mapping_epoch":28,"log_start":"34'15205","ondisk_log_start":"34'15205","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:33.900038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":996671488,"num_objects":15208,"num_object_clones":0,"num_object_copies":45624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15208,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15208,"num_write_kb":973312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"34'15219","reported_seq":15241,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:46.584643+0000","last_change":"2026-02-23T13:03:08.712205+0000","last_active":"2026-02-23T13:03:46.584643+0000","last_peered":"2026-02-23T13:03:46.584643+0000","last_clean":"2026-02-23T13:03:46.584643+0000","last_became_active":"2026-02-23T13:03:08.712055+0000","last_became_peered":"2026-02-23T13:03:08.712055+0000","last_unstale":"2026-02-23T13:03:46.584643+0000","last_undegraded":"2026-02-23T13:03:46.584643+0000","last_fullsized":"2026-02-23T13:03:46.584643+0000","mapping_epoch":28,"log_start":"34'15216","ondisk_log_start":"34'15216","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:37.263900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":997392384,"num_objects":15219,"num_object_clones":0,"num_object_copies":45657,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15219,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15219,"num_write_kb":974016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"34'15300","reported_seq":15322,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:46.583980+0000","last_change":"2026-02-23T13:03:08.709028+0000","last_active":"2026-02-23T13:03:46.583980+0000","last_peered":"2026-02-23T13:03:46.583980+0000","last_clean":"2026-02-23T13:03:46.583980+0000","last_became_active":"2026-02-23T13:03:08.708852+0000","last_became_peered":"2026-02-23T13:03:08.708852+0000","last_unstale":"2026-02-23T13:03:46.583980+0000","last_undegraded":"2026-02-23T13:03:46.583980+0000","last_fullsized":"2026-02-23T13:03:46.583980+0000","mapping_epoch":28,"log_start":"34'15297","ondisk_log_start":"34'15297","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:19.208546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1002700800,"num_objects":15300,"num_object_clones":0,"num_object_copies":45900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15300,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15300,"num_write_kb":979200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"34'15339","reported_seq":15361,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:46.593949+0000","last_change":"2026-02-23T13:03:08.708883+0000","last_active":"2026-02-23T13:03:46.593949+0000","last_peered":"2026-02-23T13:03:46.593949+0000","last_clean":"2026-02-23T13:03:46.593949+0000","last_became_active":"2026-02-23T13:03:08.708457+0000","last_became_peered":"2026-02-23T13:03:08.708457+0000","last_unstale":"2026-02-23T13:03:46.593949+0000","last_undegraded":"2026-02-23T13:03:46.593949+0000","last_fullsized":"2026-02-23T13:03:46.593949+0000","mapping_epoch":28,"log_start":"34'15336","ondisk_log_start":"34'15336","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:32.806938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1005256704,"num_objects":15339,"num_object_clones":0,"num_object_copies":46017,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15339,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15339,"num_write_kb":981696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"34'15212","reported_seq":15234,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:46.595172+0000","last_change":"2026-02-23T13:03:08.712176+0000","last_active":"2026-02-23T13:03:46.595172+0000","last_peered":"2026-02-23T13:03:46.595172+0000","last_clean":"2026-02-23T13:03:46.595172+0000","last_became_active":"2026-02-23T13:03:08.712010+0000","last_became_peered":"2026-02-23T13:03:08.712010+0000","last_unstale":"2026-02-23T13:03:46.595172+0000","last_undegraded":"2026-02-23T13:03:46.595172+0000","last_fullsized":"2026-02-23T13:03:46.595172+0000","mapping_epoch":28,"log_start":"34'15209","ondisk_log_start":"34'15209","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:29.753408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":996933632,"num_objects":15212,"num_object_clones":0,"num_object_copies":45636,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15212,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15212,"num_write_kb":973568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"34'15278","reported_seq":15299,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:46.594241+0000","last_change":"2026-02-23T13:03:08.713049+0000","last_active":"2026-02-23T13:03:46.594241+0000","last_peered":"2026-02-23T13:03:46.594241+0000","last_clean":"2026-02-23T13:03:46.594241+0000","last_became_active":"2026-02-23T13:03:08.712763+0000","last_became_peered":"2026-02-23T13:03:08.712763+0000","last_unstale":"2026-02-23T13:03:46.594241+0000","last_undegraded":"2026-02-23T13:03:46.594241+0000","last_fullsized":"2026-02-23T13:03:46.594241+0000","mapping_epoch":28,"log_start":"34'15275","ondisk_log_start":"34'15275","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:18.501703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1001259008,"num_objects":15278,"num_object_clones":0,"num_object_copies":45834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15278,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15278,"num_write_kb":977792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"34'15256","reported_seq":15278,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:46.591133+0000","last_change":"2026-02-23T13:03:08.709558+0000","last_active":"2026-02-23T13:03:46.591133+0000","last_peered":"2026-02-23T13:03:46.591133+0000","last_clean":"2026-02-23T13:03:46.591133+0000","last_became_active":"2026-02-23T13:03:08.709391+0000","last_became_peered":"2026-02-23T13:03:08.709391+0000","last_unstale":"2026-02-23T13:03:46.591133+0000","last_undegraded":"2026-02-23T13:03:46.591133+0000","last_fullsized":"2026-02-23T13:03:46.591133+0000","mapping_epoch":28,"log_start":"34'15253","ondisk_log_start":"34'15253","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:34.787615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":999817216,"num_objects":15256,"num_object_clones":0,"num_object_copies":45768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15256,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15256,"num_write_kb":976384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"34'15237","reported_seq":15259,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:46.591070+0000","last_change":"2026-02-23T13:03:08.711473+0000","last_active":"2026-02-23T13:03:46.591070+0000","last_peered":"2026-02-23T13:03:46.591070+0000","last_clean":"2026-02-23T13:03:46.591070+0000","last_became_active":"2026-02-23T13:03:08.711303+0000","last_became_peered":"2026-02-23T13:03:08.711303+0000","last_unstale":"2026-02-23T13:03:46.591070+0000","last_undegraded":"2026-02-23T13:03:46.591070+0000","last_fullsized":"2026-02-23T13:03:46.591070+0000","mapping_epoch":28,"log_start":"34'15234","ondisk_log_start":"34'15234","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:35.916414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":998572032,"num_objects":15237,"num_object_clones":0,"num_object_copies":45711,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15237,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15237,"num_write_kb":975168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":16005595136,"num_objects":244226,"num_object_clones":0,"num_object_copies":732678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":244226,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":244226,"num_write_kb":15630464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":48016850944,"data_stored":48016850944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247820,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":14351500,"kb_used_data":13530424,"kb_used_omap":11,"kb_used_meta":821044,"kb_avail":719651700,"statfs":{"total":751619276800,"available":736923340800,"internally_reserved":0,"allocated":13855154176,"data_stored":13854947155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11372,"internal_metadata":840749972},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444047,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":11168332,"kb_used_data":10545784,"kb_used_omap":14,"kb_used_meta":622513,"kb_avail":722834868,"statfs":{"total":751619276800,"available":740182904832,"internally_reserved":0,"allocated":10798882816,"data_stored":10798675795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15296,"internal_metadata":637453376},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":12383752,"kb_used_data":11707060,"kb_used_omap":18,"kb_used_meta":676653,"kb_avail":721619448,"statfs":{"total":751619276800,"available":738938314752,"internally_reserved":0,"allocated":11988029440,"data_stored":11987825971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18551,"internal_metadata":692893577},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,4,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705682,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":11061708,"kb_used_data":10457208,"kb_used_omap":19,"kb_used_meta":604460,"kb_avail":722941492,"statfs":{"total":751619276800,"available":740292087808,"internally_reserved":0,"allocated":10708180992,"data_stored":10707973971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19853,"internal_metadata":618967667},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10983505920,"data_stored":10983505920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12017926144,"data_stored":12017926144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11019616256,"data_stored":11019616256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13995802624,"data_stored":13995802624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:03:49.156 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 21 2026-02-23T13:03:49.299 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:03:49.304 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:49.433 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:49.431+0000 7f09d5baf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:49.433 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:49.431+0000 7f09d5baf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:49.440 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:49.566 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:49.564+0000 7f7bf0b8b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:49.566 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:49.564+0000 7f7bf0b8b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:49.571 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-23T13:03:49.581 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:03:49.581 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:03:49.595 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:03:49.595 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:03:49.609 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:03:49.609 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:03:49.615 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:03:49.622 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:03:49.622 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:03:49.800 INFO:tasks.radosbench.radosbench.0.trial046.stdout:2026-02-23T13:03:49.800384+0000 min lat: 0.000702009 max lat: 0.044898 avg lat: 0.00240565 2026-02-23T13:03:49.800 INFO:tasks.radosbench.radosbench.0.trial046.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-23T13:03:49.800 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 40 16 265942 265926 415.474 434.438 0.00108584 0.00240565 2026-02-23T13:03:49.875 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:49 trial046 ceph-mon[38575]: pgmap v34: 17 pgs: 17 active+clean; 15 GiB data, 47 GiB used, 2.7 TiB / 2.7 TiB avail; 499 MiB/s wr, 7.98k op/s 2026-02-23T13:03:49.875 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:49 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3775742047' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:03:49.875 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:49 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3142002394' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "21"} : dispatch 2026-02-23T13:03:50.800 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 41 16 272758 272742 415.729 426 0.00154353 0.00240418 2026-02-23T13:03:51.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:50 trial046 ceph-mon[38575]: from='client.14408 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:03:51.666 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:03:51.800 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 42 16 279604 279588 416.018 427.875 0.00211432 0.00240254 2026-02-23T13:03:51.802 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:51.923 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:51.921+0000 7f05c4e45640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:51.923 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:51.921+0000 7f05c4e45640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:51.937 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:03:51.938 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:03:51.951 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:03:51.952 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:03:51.952 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:51 trial046 ceph-mon[38575]: pgmap v35: 17 pgs: 17 active+clean; 15 GiB data, 47 GiB used, 2.7 TiB / 2.7 TiB avail; 329 MiB/s wr, 5.26k op/s 2026-02-23T13:03:51.963 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:03:51.964 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:03:51.976 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:03:51.977 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:03:52.801 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 43 16 286854 286838 416.88 453.125 0.00104828 0.00239759 2026-02-23T13:03:53.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:52 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1354099513' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:03:53.801 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 44 15 294024 294009 417.591 448.188 0.00225054 0.00239353 2026-02-23T13:03:54.017 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:03:54.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:53 trial046 ceph-mon[38575]: pgmap v36: 17 pgs: 17 active+clean; 17 GiB data, 53 GiB used, 2.7 TiB / 2.7 TiB avail; 505 MiB/s wr, 8.08k op/s 2026-02-23T13:03:54.154 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:54.488 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:54.486+0000 7f2c12bb6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:54.488 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:54.487+0000 7f2c12bb6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:54.504 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:03:54.504 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:03:54.516 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:03:54.516 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:03:54.528 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:03:54.528 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:03:54.542 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:03:54.542 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:03:54.617 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:03:54.617 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:03:54.617 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2026-02-23T13:03:54.617 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph tell osd.0 'trim stale osdmaps' 2026-02-23T13:03:54.773 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:54.800 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 45 16 300307 300291 417.035 392.625 0.00242078 0.00239673 2026-02-23T13:03:54.896 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:54.894+0000 7f418e277640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:54.897 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:54.895+0000 7f418e277640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:54.916 INFO:teuthology.orchestra.run.trial046.stderr:no valid command found; 10 closest matches: 2026-02-23T13:03:54.917 INFO:teuthology.orchestra.run.trial046.stderr:0 2026-02-23T13:03:54.917 INFO:teuthology.orchestra.run.trial046.stderr:1 2026-02-23T13:03:54.917 INFO:teuthology.orchestra.run.trial046.stderr:2 2026-02-23T13:03:54.917 INFO:teuthology.orchestra.run.trial046.stderr:abort 2026-02-23T13:03:54.917 INFO:teuthology.orchestra.run.trial046.stderr:assert 2026-02-23T13:03:54.917 INFO:teuthology.orchestra.run.trial046.stderr:bench [] [] [] [] 2026-02-23T13:03:54.917 INFO:teuthology.orchestra.run.trial046.stderr:bluefs debug_inject_read_zeros 2026-02-23T13:03:54.917 INFO:teuthology.orchestra.run.trial046.stderr:bluefs files list 2026-02-23T13:03:54.917 INFO:teuthology.orchestra.run.trial046.stderr:bluefs stats 2026-02-23T13:03:54.918 INFO:teuthology.orchestra.run.trial046.stderr:bluestore allocator dump block 2026-02-23T13:03:54.918 INFO:teuthology.orchestra.run.trial046.stderr:Error EINVAL: invalid command 2026-02-23T13:03:54.918 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:54 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/304043005' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:03:54.952 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-23T13:03:54.953 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-23T13:03:54.953 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph tell osd.1 'trim stale osdmaps' 2026-02-23T13:03:55.099 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:55.219 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:55.217+0000 7f709e3a1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:55.220 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:55.217+0000 7f709e3a1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:55.241 INFO:teuthology.orchestra.run.trial046.stderr:no valid command found; 10 closest matches: 2026-02-23T13:03:55.241 INFO:teuthology.orchestra.run.trial046.stderr:0 2026-02-23T13:03:55.241 INFO:teuthology.orchestra.run.trial046.stderr:1 2026-02-23T13:03:55.241 INFO:teuthology.orchestra.run.trial046.stderr:2 2026-02-23T13:03:55.241 INFO:teuthology.orchestra.run.trial046.stderr:abort 2026-02-23T13:03:55.241 INFO:teuthology.orchestra.run.trial046.stderr:assert 2026-02-23T13:03:55.242 INFO:teuthology.orchestra.run.trial046.stderr:bench [] [] [] [] 2026-02-23T13:03:55.242 INFO:teuthology.orchestra.run.trial046.stderr:bluefs debug_inject_read_zeros 2026-02-23T13:03:55.242 INFO:teuthology.orchestra.run.trial046.stderr:bluefs files list 2026-02-23T13:03:55.242 INFO:teuthology.orchestra.run.trial046.stderr:bluefs stats 2026-02-23T13:03:55.242 INFO:teuthology.orchestra.run.trial046.stderr:bluestore allocator dump block 2026-02-23T13:03:55.242 INFO:teuthology.orchestra.run.trial046.stderr:Error EINVAL: invalid command 2026-02-23T13:03:55.295 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-23T13:03:55.295 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-23T13:03:55.296 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph tell osd.2 'trim stale osdmaps' 2026-02-23T13:03:55.432 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:55.561 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:55.558+0000 7f2cc6bc2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:55.561 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:55.559+0000 7f2cc6bc2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:55.581 INFO:teuthology.orchestra.run.trial046.stderr:no valid command found; 10 closest matches: 2026-02-23T13:03:55.581 INFO:teuthology.orchestra.run.trial046.stderr:0 2026-02-23T13:03:55.581 INFO:teuthology.orchestra.run.trial046.stderr:1 2026-02-23T13:03:55.581 INFO:teuthology.orchestra.run.trial046.stderr:2 2026-02-23T13:03:55.581 INFO:teuthology.orchestra.run.trial046.stderr:abort 2026-02-23T13:03:55.581 INFO:teuthology.orchestra.run.trial046.stderr:assert 2026-02-23T13:03:55.581 INFO:teuthology.orchestra.run.trial046.stderr:bench [] [] [] [] 2026-02-23T13:03:55.581 INFO:teuthology.orchestra.run.trial046.stderr:bluefs debug_inject_read_zeros 2026-02-23T13:03:55.582 INFO:teuthology.orchestra.run.trial046.stderr:bluefs files list 2026-02-23T13:03:55.582 INFO:teuthology.orchestra.run.trial046.stderr:bluefs stats 2026-02-23T13:03:55.582 INFO:teuthology.orchestra.run.trial046.stderr:bluestore allocator dump block 2026-02-23T13:03:55.582 INFO:teuthology.orchestra.run.trial046.stderr:Error EINVAL: invalid command 2026-02-23T13:03:55.614 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-23T13:03:55.614 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-23T13:03:55.615 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph tell osd.3 'trim stale osdmaps' 2026-02-23T13:03:55.758 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:55.800 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 46 16 307199 307183 417.333 430.75 0.00180946 0.00239499 2026-02-23T13:03:55.885 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:55.883+0000 7f9d5839d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:55.886 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:55.884+0000 7f9d5839d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:55.912 INFO:teuthology.orchestra.run.trial046.stderr:no valid command found; 10 closest matches: 2026-02-23T13:03:55.912 INFO:teuthology.orchestra.run.trial046.stderr:0 2026-02-23T13:03:55.912 INFO:teuthology.orchestra.run.trial046.stderr:1 2026-02-23T13:03:55.912 INFO:teuthology.orchestra.run.trial046.stderr:2 2026-02-23T13:03:55.913 INFO:teuthology.orchestra.run.trial046.stderr:abort 2026-02-23T13:03:55.913 INFO:teuthology.orchestra.run.trial046.stderr:assert 2026-02-23T13:03:55.913 INFO:teuthology.orchestra.run.trial046.stderr:bench [] [] [] [] 2026-02-23T13:03:55.913 INFO:teuthology.orchestra.run.trial046.stderr:bluefs debug_inject_read_zeros 2026-02-23T13:03:55.913 INFO:teuthology.orchestra.run.trial046.stderr:bluefs files list 2026-02-23T13:03:55.913 INFO:teuthology.orchestra.run.trial046.stderr:bluefs stats 2026-02-23T13:03:55.913 INFO:teuthology.orchestra.run.trial046.stderr:bluestore allocator dump block 2026-02-23T13:03:55.913 INFO:teuthology.orchestra.run.trial046.stderr:Error EINVAL: invalid command 2026-02-23T13:03:55.945 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-23T13:03:55.946 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-23T13:03:56.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:55 trial046 ceph-mon[38575]: pgmap v37: 17 pgs: 17 active+clean; 17 GiB data, 53 GiB used, 2.7 TiB / 2.7 TiB avail; 333 MiB/s wr, 5.33k op/s 2026-02-23T13:03:56.539 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:03:56 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:03:56] "GET /metrics HTTP/1.1" 200 4210 "" "Prometheus/3.6.0" 2026-02-23T13:03:56.560 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:03:56 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:03:56.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:03:56.588 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:03:56.726 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:56.801 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 47 16 313681 313665 417.072 405.125 0.00307505 0.00239648 2026-02-23T13:03:56.854 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:56.852+0000 7fdd26f17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:56.854 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:56.852+0000 7fdd26f17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:56.869 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:03:56.870 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:03:56.870 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:56 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:03:56.870 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:56 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:03:56.882 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:03:56.882 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:03:56.894 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:03:56.894 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:03:56.907 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:03:56.907 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:03:57.801 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 48 16 320313 320297 417.018 414.5 0.00199517 0.0023968 2026-02-23T13:03:58.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:57 trial046 ceph-mon[38575]: pgmap v38: 17 pgs: 17 active+clean; 17 GiB data, 56 GiB used, 2.7 TiB / 2.7 TiB avail; 344 MiB/s wr, 5.50k op/s 2026-02-23T13:03:58.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:57 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2357829501' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:03:58.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:57 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:03:58.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:57 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:03:58.801 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 49 15 327138 327123 417.213 426.625 0.00239812 0.00239569 2026-02-23T13:03:58.952 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:03:59.084 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:03:59.207 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:59.205+0000 7fa561f92640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:59.208 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:03:59.206+0000 7fa561f92640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:03:59.221 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:03:59.221 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:03:59.235 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:03:59.235 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:03:59.250 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:03:59.250 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:03:59.263 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:03:59.263 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:03:59.801 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 50 15 334003 333988 417.45 429.062 0.00289841 0.00239432 2026-02-23T13:04:00.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:59 trial046 ceph-mon[38575]: pgmap v39: 17 pgs: 17 active+clean; 19 GiB data, 60 GiB used, 2.7 TiB / 2.7 TiB avail; 355 MiB/s wr, 5.68k op/s 2026-02-23T13:04:00.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:03:59 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1226071526' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:04:00.801 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 51 16 340698 340682 417.467 418.375 0.00201802 0.00239424 2026-02-23T13:04:00.947 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:04:00.947 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:04:00.947 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:04:01.087 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:01.303 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:04:01.340 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:01.338+0000 7fac7ecee640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:01.340 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:01.338+0000 7fac7ecee640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:01.442 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:01.492 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:04:01.492 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:04:01.537 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2026-02-23T13:04:00.598321+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":20471087648,"num_objects":312357,"num_object_clones":0,"num_object_copies":937071,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":312357,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":312490,"num_write_kb":19992870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":62620972,"kb_used_data":59047900,"kb_used_omap":64,"kb_used_meta":3572927,"kb_avail":2873391828,"statfs":{"total":3006477107200,"available":2942353231872,"internally_reserved":0,"allocated":60465049600,"data_stored":60464225068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":66389,"internal_metadata":3658677419},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[19],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4464902144,"num_objects":68129,"num_object_clones":0,"num_object_copies":204387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68129,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68129,"num_write_kb":4360256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001579"},"pg_stats":[{"pgid":"2.f","version":"34'19447","reported_seq":19469,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:56.593938+0000","last_change":"2026-02-23T13:03:08.711612+0000","last_active":"2026-02-23T13:03:56.593938+0000","last_peered":"2026-02-23T13:03:56.593938+0000","last_clean":"2026-02-23T13:03:56.593938+0000","last_became_active":"2026-02-23T13:03:08.711408+0000","last_became_peered":"2026-02-23T13:03:08.711408+0000","last_unstale":"2026-02-23T13:03:56.593938+0000","last_undegraded":"2026-02-23T13:03:56.593938+0000","last_fullsized":"2026-02-23T13:03:56.593938+0000","mapping_epoch":28,"log_start":"34'19444","ondisk_log_start":"34'19444","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:21.274136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1274478592,"num_objects":19447,"num_object_clones":0,"num_object_copies":58341,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19447,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19447,"num_write_kb":1244608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"34'19767","reported_seq":19789,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:56.587525+0000","last_change":"2026-02-23T13:03:08.711629+0000","last_active":"2026-02-23T13:03:56.587525+0000","last_peered":"2026-02-23T13:03:56.587525+0000","last_clean":"2026-02-23T13:03:56.587525+0000","last_became_active":"2026-02-23T13:03:08.711462+0000","last_became_peered":"2026-02-23T13:03:08.711462+0000","last_unstale":"2026-02-23T13:03:56.587525+0000","last_undegraded":"2026-02-23T13:03:56.587525+0000","last_fullsized":"2026-02-23T13:03:56.587525+0000","mapping_epoch":28,"log_start":"34'19764","ondisk_log_start":"34'19764","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:35.369081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1295450112,"num_objects":19767,"num_object_clones":0,"num_object_copies":59301,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19767,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19767,"num_write_kb":1265088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"34'19325","reported_seq":19347,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:56.594400+0000","last_change":"2026-02-23T13:03:08.712615+0000","last_active":"2026-02-23T13:03:56.594400+0000","last_peered":"2026-02-23T13:03:56.594400+0000","last_clean":"2026-02-23T13:03:56.594400+0000","last_became_active":"2026-02-23T13:03:08.712246+0000","last_became_peered":"2026-02-23T13:03:08.712246+0000","last_unstale":"2026-02-23T13:03:56.594400+0000","last_undegraded":"2026-02-23T13:03:56.594400+0000","last_fullsized":"2026-02-23T13:03:56.594400+0000","mapping_epoch":28,"log_start":"34'19322","ondisk_log_start":"34'19322","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:26.869038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1266483200,"num_objects":19325,"num_object_clones":0,"num_object_copies":57975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19325,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19325,"num_write_kb":1236800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"34'19627","reported_seq":19649,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:56.590830+0000","last_change":"2026-02-23T13:03:08.712832+0000","last_active":"2026-02-23T13:03:56.590830+0000","last_peered":"2026-02-23T13:03:56.590830+0000","last_clean":"2026-02-23T13:03:56.590830+0000","last_became_active":"2026-02-23T13:03:08.712348+0000","last_became_peered":"2026-02-23T13:03:08.712348+0000","last_unstale":"2026-02-23T13:03:56.590830+0000","last_undegraded":"2026-02-23T13:03:56.590830+0000","last_fullsized":"2026-02-23T13:03:56.590830+0000","mapping_epoch":28,"log_start":"34'19624","ondisk_log_start":"34'19624","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:23.478567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1286275072,"num_objects":19627,"num_object_clones":0,"num_object_copies":58881,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19627,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19627,"num_write_kb":1256128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":196,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:35.739133+0000","last_change":"2026-02-23T13:02:55.158696+0000","last_active":"2026-02-23T13:03:35.739133+0000","last_peered":"2026-02-23T13:03:35.739133+0000","last_clean":"2026-02-23T13:03:35.739133+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:03:35.739133+0000","last_undegraded":"2026-02-23T13:03:35.739133+0000","last_fullsized":"2026-02-23T13:03:35.739133+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:02:44.100679+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:07.625581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"34'19406","reported_seq":19428,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:56.597386+0000","last_change":"2026-02-23T13:03:08.709049+0000","last_active":"2026-02-23T13:03:56.597386+0000","last_peered":"2026-02-23T13:03:56.597386+0000","last_clean":"2026-02-23T13:03:56.597386+0000","last_became_active":"2026-02-23T13:03:08.708695+0000","last_became_peered":"2026-02-23T13:03:08.708695+0000","last_unstale":"2026-02-23T13:03:56.597386+0000","last_undegraded":"2026-02-23T13:03:56.597386+0000","last_fullsized":"2026-02-23T13:03:56.597386+0000","mapping_epoch":28,"log_start":"34'19403","ondisk_log_start":"34'19403","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:11.438878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1271791616,"num_objects":19406,"num_object_clones":0,"num_object_copies":58218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19406,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19406,"num_write_kb":1241984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"34'19620","reported_seq":19642,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:56.593528+0000","last_change":"2026-02-23T13:03:08.712038+0000","last_active":"2026-02-23T13:03:56.593528+0000","last_peered":"2026-02-23T13:03:56.593528+0000","last_clean":"2026-02-23T13:03:56.593528+0000","last_became_active":"2026-02-23T13:03:08.711847+0000","last_became_peered":"2026-02-23T13:03:08.711847+0000","last_unstale":"2026-02-23T13:03:56.593528+0000","last_undegraded":"2026-02-23T13:03:56.593528+0000","last_fullsized":"2026-02-23T13:03:56.593528+0000","mapping_epoch":28,"log_start":"34'19617","ondisk_log_start":"34'19617","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:25.087301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1285816320,"num_objects":19620,"num_object_clones":0,"num_object_copies":58860,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19620,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19620,"num_write_kb":1255680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"34'19454","reported_seq":19476,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:56.596137+0000","last_change":"2026-02-23T13:03:08.713062+0000","last_active":"2026-02-23T13:03:56.596137+0000","last_peered":"2026-02-23T13:03:56.596137+0000","last_clean":"2026-02-23T13:03:56.596137+0000","last_became_active":"2026-02-23T13:03:08.712783+0000","last_became_peered":"2026-02-23T13:03:08.712783+0000","last_unstale":"2026-02-23T13:03:56.596137+0000","last_undegraded":"2026-02-23T13:03:56.596137+0000","last_fullsized":"2026-02-23T13:03:56.596137+0000","mapping_epoch":28,"log_start":"34'19451","ondisk_log_start":"34'19451","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:07.712555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1274937344,"num_objects":19454,"num_object_clones":0,"num_object_copies":58362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19454,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19454,"num_write_kb":1245056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"34'19670","reported_seq":19692,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:56.593222+0000","last_change":"2026-02-23T13:03:08.709181+0000","last_active":"2026-02-23T13:03:56.593222+0000","last_peered":"2026-02-23T13:03:56.593222+0000","last_clean":"2026-02-23T13:03:56.593222+0000","last_became_active":"2026-02-23T13:03:08.708821+0000","last_became_peered":"2026-02-23T13:03:08.708821+0000","last_unstale":"2026-02-23T13:03:56.593222+0000","last_undegraded":"2026-02-23T13:03:56.593222+0000","last_fullsized":"2026-02-23T13:03:56.593222+0000","mapping_epoch":28,"log_start":"34'19667","ondisk_log_start":"34'19667","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:22.653808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1289093120,"num_objects":19670,"num_object_clones":0,"num_object_copies":59010,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19670,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19670,"num_write_kb":1258880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"34'19378","reported_seq":19400,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:56.593101+0000","last_change":"2026-02-23T13:03:08.712493+0000","last_active":"2026-02-23T13:03:56.593101+0000","last_peered":"2026-02-23T13:03:56.593101+0000","last_clean":"2026-02-23T13:03:56.593101+0000","last_became_active":"2026-02-23T13:03:08.712152+0000","last_became_peered":"2026-02-23T13:03:08.712152+0000","last_unstale":"2026-02-23T13:03:56.593101+0000","last_undegraded":"2026-02-23T13:03:56.593101+0000","last_fullsized":"2026-02-23T13:03:56.593101+0000","mapping_epoch":28,"log_start":"34'19375","ondisk_log_start":"34'19375","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:33.900038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1269956608,"num_objects":19378,"num_object_clones":0,"num_object_copies":58134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19378,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19378,"num_write_kb":1240192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"34'19434","reported_seq":19456,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:56.591151+0000","last_change":"2026-02-23T13:03:08.712205+0000","last_active":"2026-02-23T13:03:56.591151+0000","last_peered":"2026-02-23T13:03:56.591151+0000","last_clean":"2026-02-23T13:03:56.591151+0000","last_became_active":"2026-02-23T13:03:08.712055+0000","last_became_peered":"2026-02-23T13:03:08.712055+0000","last_unstale":"2026-02-23T13:03:56.591151+0000","last_undegraded":"2026-02-23T13:03:56.591151+0000","last_fullsized":"2026-02-23T13:03:56.591151+0000","mapping_epoch":28,"log_start":"34'19431","ondisk_log_start":"34'19431","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:37.263900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1273626624,"num_objects":19434,"num_object_clones":0,"num_object_copies":58302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19434,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19434,"num_write_kb":1243776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"34'19593","reported_seq":19615,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:56.598089+0000","last_change":"2026-02-23T13:03:08.709028+0000","last_active":"2026-02-23T13:03:56.598089+0000","last_peered":"2026-02-23T13:03:56.598089+0000","last_clean":"2026-02-23T13:03:56.598089+0000","last_became_active":"2026-02-23T13:03:08.708852+0000","last_became_peered":"2026-02-23T13:03:08.708852+0000","last_unstale":"2026-02-23T13:03:56.598089+0000","last_undegraded":"2026-02-23T13:03:56.598089+0000","last_fullsized":"2026-02-23T13:03:56.598089+0000","mapping_epoch":28,"log_start":"34'19590","ondisk_log_start":"34'19590","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:19.208546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1284046848,"num_objects":19593,"num_object_clones":0,"num_object_copies":58779,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19593,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19593,"num_write_kb":1253952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"34'19646","reported_seq":19667,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:56.595413+0000","last_change":"2026-02-23T13:03:08.708883+0000","last_active":"2026-02-23T13:03:56.595413+0000","last_peered":"2026-02-23T13:03:56.595413+0000","last_clean":"2026-02-23T13:03:56.595413+0000","last_became_active":"2026-02-23T13:03:08.708457+0000","last_became_peered":"2026-02-23T13:03:08.708457+0000","last_unstale":"2026-02-23T13:03:56.595413+0000","last_undegraded":"2026-02-23T13:03:56.595413+0000","last_fullsized":"2026-02-23T13:03:56.595413+0000","mapping_epoch":28,"log_start":"34'19643","ondisk_log_start":"34'19643","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:32.806938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1287520256,"num_objects":19646,"num_object_clones":0,"num_object_copies":58938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19646,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19646,"num_write_kb":1257344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"34'19542","reported_seq":19562,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:56.592745+0000","last_change":"2026-02-23T13:03:08.712176+0000","last_active":"2026-02-23T13:03:56.592745+0000","last_peered":"2026-02-23T13:03:56.592745+0000","last_clean":"2026-02-23T13:03:56.592745+0000","last_became_active":"2026-02-23T13:03:08.712010+0000","last_became_peered":"2026-02-23T13:03:08.712010+0000","last_unstale":"2026-02-23T13:03:56.592745+0000","last_undegraded":"2026-02-23T13:03:56.592745+0000","last_fullsized":"2026-02-23T13:03:56.592745+0000","mapping_epoch":28,"log_start":"34'19539","ondisk_log_start":"34'19539","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:29.753408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1280704512,"num_objects":19542,"num_object_clones":0,"num_object_copies":58626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19542,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19542,"num_write_kb":1250688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"34'19490","reported_seq":19512,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:56.592157+0000","last_change":"2026-02-23T13:03:08.713049+0000","last_active":"2026-02-23T13:03:56.592157+0000","last_peered":"2026-02-23T13:03:56.592157+0000","last_clean":"2026-02-23T13:03:56.592157+0000","last_became_active":"2026-02-23T13:03:08.712763+0000","last_became_peered":"2026-02-23T13:03:08.712763+0000","last_unstale":"2026-02-23T13:03:56.592157+0000","last_undegraded":"2026-02-23T13:03:56.592157+0000","last_fullsized":"2026-02-23T13:03:56.592157+0000","mapping_epoch":28,"log_start":"34'19487","ondisk_log_start":"34'19487","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:18.501703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1277296640,"num_objects":19490,"num_object_clones":0,"num_object_copies":58470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19490,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19490,"num_write_kb":1247360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"34'19521","reported_seq":19543,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:56.594803+0000","last_change":"2026-02-23T13:03:08.709558+0000","last_active":"2026-02-23T13:03:56.594803+0000","last_peered":"2026-02-23T13:03:56.594803+0000","last_clean":"2026-02-23T13:03:56.594803+0000","last_became_active":"2026-02-23T13:03:08.709391+0000","last_became_peered":"2026-02-23T13:03:08.709391+0000","last_unstale":"2026-02-23T13:03:56.594803+0000","last_undegraded":"2026-02-23T13:03:56.594803+0000","last_fullsized":"2026-02-23T13:03:56.594803+0000","mapping_epoch":28,"log_start":"34'19518","ondisk_log_start":"34'19518","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:34.787615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1279328256,"num_objects":19521,"num_object_clones":0,"num_object_copies":58563,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19521,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19521,"num_write_kb":1249344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"34'19435","reported_seq":19457,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-23T13:03:56.596074+0000","last_change":"2026-02-23T13:03:08.711473+0000","last_active":"2026-02-23T13:03:56.596074+0000","last_peered":"2026-02-23T13:03:56.596074+0000","last_clean":"2026-02-23T13:03:56.596074+0000","last_became_active":"2026-02-23T13:03:08.711303+0000","last_became_peered":"2026-02-23T13:03:08.711303+0000","last_unstale":"2026-02-23T13:03:56.596074+0000","last_undegraded":"2026-02-23T13:03:56.596074+0000","last_fullsized":"2026-02-23T13:03:56.596074+0000","mapping_epoch":28,"log_start":"34'19432","ondisk_log_start":"34'19432","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:35.916414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1273692160,"num_objects":19435,"num_object_clones":0,"num_object_copies":58305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19435,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19435,"num_write_kb":1243840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":20470497280,"num_objects":312355,"num_object_clones":0,"num_object_copies":937065,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":312355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312355,"num_write_kb":19990720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61410902016,"data_stored":61410902016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247822,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":18384716,"kb_used_data":17347064,"kb_used_omap":11,"kb_used_meta":1037620,"kb_avail":715618484,"statfs":{"total":751619276800,"available":732793327616,"internally_reserved":0,"allocated":17763393536,"data_stored":17763186515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12038,"internal_metadata":1062523130},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444049,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":14354636,"kb_used_data":13533560,"kb_used_omap":14,"kb_used_meta":821041,"kb_avail":719648564,"statfs":{"total":751619276800,"available":736920129536,"internally_reserved":0,"allocated":13858365440,"data_stored":13858158419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15296,"internal_metadata":840746048},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":15588808,"kb_used_data":14695540,"kb_used_omap":18,"kb_used_meta":893229,"kb_avail":718414392,"statfs":{"total":751619276800,"available":735656337408,"internally_reserved":0,"allocated":15048232960,"data_stored":15048029491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18551,"internal_metadata":914667401},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705684,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":14292812,"kb_used_data":13471736,"kb_used_omap":20,"kb_used_meta":821035,"kb_avail":719710388,"statfs":{"total":751619276800,"available":736983437312,"internally_reserved":0,"allocated":13795057664,"data_stored":13794850643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20504,"internal_metadata":840740840},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14058061824,"data_stored":14058061824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15368192000,"data_stored":15368192000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14079229952,"data_stored":14079229952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17905418240,"data_stored":17905418240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:04:01.567 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:01.564+0000 7f3a62b10640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:01.567 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:01.565+0000 7f3a62b10640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:01.580 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:04:01.580 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:04:01.594 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:04:01.594 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:04:01.606 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:04:01.606 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:04:01.617 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:04:01.617 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:04:01.801 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 52 15 347434 347419 417.536 421.062 0.00250806 0.00239381 2026-02-23T13:04:02.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:01 trial046 ceph-mon[38575]: pgmap v40: 17 pgs: 17 active+clean; 19 GiB data, 60 GiB used, 2.7 TiB / 2.7 TiB avail; 355 MiB/s wr, 5.68k op/s 2026-02-23T13:04:02.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:01 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:04:02.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:01 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2481421464' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:04:02.801 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 53 16 354442 354426 417.92 437.938 0.00195156 0.00239165 2026-02-23T13:04:03.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:02 trial046 ceph-mon[38575]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:04:03.655 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:04:03.794 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:03.801 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 54 16 361252 361236 418.062 425.625 0.00211775 0.00239084 2026-02-23T13:04:03.911 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:03.910+0000 7f5df8d95640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:03.912 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:03.910+0000 7f5df8d95640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:03.926 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:04:03.926 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:04:03.939 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:04:03.939 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:04:03.939 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:03 trial046 ceph-mon[38575]: pgmap v41: 17 pgs: 17 active+clean; 21 GiB data, 66 GiB used, 2.7 TiB / 2.7 TiB avail; 530 MiB/s wr, 8.49k op/s 2026-02-23T13:04:03.953 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:04:03.953 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:04:03.969 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:04:03.969 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:04:04.802 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 55 16 367205 367189 417.225 372.062 0.00297511 0.00239563 2026-02-23T13:04:05.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:04 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1876154567' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:04:05.802 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 56 15 374351 374336 417.751 446.688 0.00160651 0.0023926 2026-02-23T13:04:06.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:05 trial046 ceph-mon[38575]: pgmap v42: 17 pgs: 17 active+clean; 21 GiB data, 66 GiB used, 2.7 TiB / 2.7 TiB avail; 354 MiB/s wr, 5.67k op/s 2026-02-23T13:04:06.431 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:04:06.456 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:04:06 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:04:06] "GET /metrics HTTP/1.1" 200 4210 "" "Prometheus/3.6.0" 2026-02-23T13:04:06.540 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:04:06.540 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-23T13:04:06.560 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:04:06 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:04:06.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:04:06.568 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:06.746 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:06.802 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 57 16 380731 380715 417.416 398.688 0.00291369 0.00239454 2026-02-23T13:04:06.955 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:06.903+0000 7f6bc1b48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:06.955 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:06.903+0000 7f6bc1b48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:06.955 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:04:06.955 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:04:06.956 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:04:06.956 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:04:06.957 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:04:06.958 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:04:06.970 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:04:06.970 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:04:07.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:06 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-23T13:04:07.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:06 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:04:07.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:06 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-23T13:04:07.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:06 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:04:07.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:06 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-23T13:04:07.802 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 58 15 385811 385796 415.692 317.562 0.00196701 0.00240446 2026-02-23T13:04:07.839 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:07.837+0000 7fe1cf8a8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:07.840 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:07.837+0000 7fe1cf8a8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:07.840 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:07 trial046 ceph-mon[38575]: pgmap v43: 17 pgs: 17 active+clean; 22 GiB data, 71 GiB used, 2.7 TiB / 2.7 TiB avail; 441 MiB/s wr, 7.06k op/s 2026-02-23T13:04:07.840 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:07 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1922889248' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:04:08.778 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.0 to 1 (10000) 2026-02-23T13:04:08.802 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 59 16 392342 392326 415.563 408.125 0.0012331 0.00240519 2026-02-23T13:04:08.823 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-23T13:04:08.968 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:09.033 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:08 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1217221795' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-23T13:04:09.033 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:08 trial046 ceph-mon[38575]: 1.0 scrub starts 2026-02-23T13:04:09.033 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:08 trial046 ceph-mon[38575]: 1.0 scrub ok 2026-02-23T13:04:09.103 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:09.100+0000 7f0985652640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:09.103 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:09.101+0000 7f0985652640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:09.586 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:04:09.726 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:09.780 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.1 to 1 (10000) 2026-02-23T13:04:09.802 INFO:tasks.radosbench.radosbench.0.trial046.stdout:2026-02-23T13:04:09.802184+0000 min lat: 0.000702009 max lat: 0.0475158 avg lat: 0.00240017 2026-02-23T13:04:09.802 INFO:tasks.radosbench.radosbench.0.trial046.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-23T13:04:09.802 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 60 16 399831 399815 416.438 468.062 0.00162069 0.00240017 2026-02-23T13:04:09.829 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-23T13:04:09.853 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:09.851+0000 7f900be0c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:09.853 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:09.851+0000 7f900be0c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:09.870 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:04:09.871 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:04:09.871 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:09 trial046 ceph-mon[38575]: pgmap v44: 17 pgs: 17 active+clean; 23 GiB data, 73 GiB used, 2.7 TiB / 2.7 TiB avail; 517 MiB/s wr, 8.28k op/s 2026-02-23T13:04:09.871 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:09 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1217221795' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-23T13:04:09.871 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:09 trial046 ceph-mon[38575]: osdmap e35: 4 total, 4 up, 4 in 2026-02-23T13:04:09.872 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:09 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/458180757' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-23T13:04:09.883 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:04:09.884 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:04:09.896 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:04:09.896 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:04:09.908 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:04:09.908 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:04:09.973 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:10.094 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:10.092+0000 7fdc9e725640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:10.094 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:10.092+0000 7fdc9e725640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:10.784 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.2 to 1 (10000) 2026-02-23T13:04:10.802 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 61 16 406961 406945 416.915 445.625 0.00236684 0.0023974 2026-02-23T13:04:10.833 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-23T13:04:11.016 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:11.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:10 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/458180757' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-23T13:04:11.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:10 trial046 ceph-mon[38575]: osdmap e36: 4 total, 4 up, 4 in 2026-02-23T13:04:11.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:10 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1235255513' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:04:11.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:10 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/776029637' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-23T13:04:11.140 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:11.137+0000 7f9e6e329640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:11.140 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:11.138+0000 7f9e6e329640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:11.785 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.3 to 1 (10000) 2026-02-23T13:04:11.802 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 62 16 414574 414558 417.865 475.812 0.00109423 0.00239196 2026-02-23T13:04:11.831 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-23T13:04:11.831 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:04:11.952 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:04:11.979 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:12.035 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:11 trial046 ceph-mon[38575]: pgmap v47: 17 pgs: 17 active+clean; 23 GiB data, 73 GiB used, 2.7 TiB / 2.7 TiB avail; 261 MiB/s wr, 4.18k op/s 2026-02-23T13:04:12.035 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:11 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/776029637' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-23T13:04:12.035 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:11 trial046 ceph-mon[38575]: osdmap e37: 4 total, 4 up, 4 in 2026-02-23T13:04:12.036 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:11 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/776896797' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-23T13:04:12.095 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:12.110 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:12.108+0000 7f06a5319640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:12.110 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:12.108+0000 7f06a5319640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:12.218 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:12.216+0000 7fda4d802640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:12.218 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:12.216+0000 7fda4d802640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:12.233 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:04:12.234 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:04:12.247 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:04:12.247 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:04:12.257 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:04:12.257 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:04:12.260 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:04:12.260 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:04:12.276 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:04:12.276 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:04:12.306 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2026-02-23T13:04:11.785046+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":27080458784,"num_objects":413208,"num_object_clones":0,"num_object_copies":1239624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":413208,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":413341,"num_write_kb":26447334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":82997988,"kb_used_data":78262612,"kb_used_omap":71,"kb_used_meta":4735224,"kb_avail":2853014812,"statfs":{"total":3006477107200,"available":2921487167488,"internally_reserved":0,"allocated":80140914688,"data_stored":80140011366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":73550,"internal_metadata":4848869554},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,4,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3301900288,"num_objects":50383,"num_object_clones":0,"num_object_copies":151149,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50383,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50383,"num_write_kb":3224512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.185921"},"pg_stats":[{"pgid":"2.f","version":"37'25775","reported_seq":25803,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.590731+0000","last_change":"2026-02-23T13:03:08.711612+0000","last_active":"2026-02-23T13:04:11.590731+0000","last_peered":"2026-02-23T13:04:11.590731+0000","last_clean":"2026-02-23T13:04:11.590731+0000","last_became_active":"2026-02-23T13:03:08.711408+0000","last_became_peered":"2026-02-23T13:03:08.711408+0000","last_unstale":"2026-02-23T13:04:11.590731+0000","last_undegraded":"2026-02-23T13:04:11.590731+0000","last_fullsized":"2026-02-23T13:04:11.590731+0000","mapping_epoch":28,"log_start":"37'25772","ondisk_log_start":"37'25772","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:21.274136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1689190400,"num_objects":25775,"num_object_clones":0,"num_object_copies":77325,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25775,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25775,"num_write_kb":1649600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"37'26180","reported_seq":26208,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.593612+0000","last_change":"2026-02-23T13:03:08.711629+0000","last_active":"2026-02-23T13:04:11.593612+0000","last_peered":"2026-02-23T13:04:11.593612+0000","last_clean":"2026-02-23T13:04:11.593612+0000","last_became_active":"2026-02-23T13:03:08.711462+0000","last_became_peered":"2026-02-23T13:03:08.711462+0000","last_unstale":"2026-02-23T13:04:11.593612+0000","last_undegraded":"2026-02-23T13:04:11.593612+0000","last_fullsized":"2026-02-23T13:04:11.593612+0000","mapping_epoch":28,"log_start":"37'26177","ondisk_log_start":"37'26177","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:35.369081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1715732480,"num_objects":26180,"num_object_clones":0,"num_object_copies":78540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26180,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26180,"num_write_kb":1675520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"37'25734","reported_seq":25762,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.595177+0000","last_change":"2026-02-23T13:03:08.712615+0000","last_active":"2026-02-23T13:04:11.595177+0000","last_peered":"2026-02-23T13:04:11.595177+0000","last_clean":"2026-02-23T13:04:11.595177+0000","last_became_active":"2026-02-23T13:03:08.712246+0000","last_became_peered":"2026-02-23T13:03:08.712246+0000","last_unstale":"2026-02-23T13:04:11.595177+0000","last_undegraded":"2026-02-23T13:04:11.595177+0000","last_fullsized":"2026-02-23T13:04:11.595177+0000","mapping_epoch":28,"log_start":"37'25731","ondisk_log_start":"37'25731","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:26.869038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1686503424,"num_objects":25734,"num_object_clones":0,"num_object_copies":77202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25734,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25734,"num_write_kb":1646976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"37'25904","reported_seq":25932,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.597518+0000","last_change":"2026-02-23T13:03:08.712832+0000","last_active":"2026-02-23T13:04:11.597518+0000","last_peered":"2026-02-23T13:04:11.597518+0000","last_clean":"2026-02-23T13:04:11.597518+0000","last_became_active":"2026-02-23T13:03:08.712348+0000","last_became_peered":"2026-02-23T13:03:08.712348+0000","last_unstale":"2026-02-23T13:04:11.597518+0000","last_undegraded":"2026-02-23T13:04:11.597518+0000","last_fullsized":"2026-02-23T13:04:11.597518+0000","mapping_epoch":28,"log_start":"37'25901","ondisk_log_start":"37'25901","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:23.478567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1697644544,"num_objects":25904,"num_object_clones":0,"num_object_copies":77712,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25904,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25904,"num_write_kb":1657856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":210,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:10.784962+0000","last_change":"2026-02-23T13:04:08.199097+0000","last_active":"2026-02-23T13:04:10.784962+0000","last_peered":"2026-02-23T13:04:10.784962+0000","last_clean":"2026-02-23T13:04:10.784962+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:04:10.784962+0000","last_undegraded":"2026-02-23T13:04:10.784962+0000","last_fullsized":"2026-02-23T13:04:10.784962+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:04:08.199036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:04:08.199036+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:23.231335+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"37'25833","reported_seq":25861,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.592687+0000","last_change":"2026-02-23T13:03:08.709049+0000","last_active":"2026-02-23T13:04:11.592687+0000","last_peered":"2026-02-23T13:04:11.592687+0000","last_clean":"2026-02-23T13:04:11.592687+0000","last_became_active":"2026-02-23T13:03:08.708695+0000","last_became_peered":"2026-02-23T13:03:08.708695+0000","last_unstale":"2026-02-23T13:04:11.592687+0000","last_undegraded":"2026-02-23T13:04:11.592687+0000","last_fullsized":"2026-02-23T13:04:11.592687+0000","mapping_epoch":28,"log_start":"37'25830","ondisk_log_start":"37'25830","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1692991488,"num_objects":25833,"num_object_clones":0,"num_object_copies":77499,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25833,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25833,"num_write_kb":1653312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"37'25897","reported_seq":25925,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.597111+0000","last_change":"2026-02-23T13:03:08.712038+0000","last_active":"2026-02-23T13:04:11.597111+0000","last_peered":"2026-02-23T13:04:11.597111+0000","last_clean":"2026-02-23T13:04:11.597111+0000","last_became_active":"2026-02-23T13:03:08.711847+0000","last_became_peered":"2026-02-23T13:03:08.711847+0000","last_unstale":"2026-02-23T13:04:11.597111+0000","last_undegraded":"2026-02-23T13:04:11.597111+0000","last_fullsized":"2026-02-23T13:04:11.597111+0000","mapping_epoch":28,"log_start":"37'25894","ondisk_log_start":"37'25894","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:25.087301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1697185792,"num_objects":25897,"num_object_clones":0,"num_object_copies":77691,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25897,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25897,"num_write_kb":1657408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"37'25702","reported_seq":25730,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.595150+0000","last_change":"2026-02-23T13:03:08.713062+0000","last_active":"2026-02-23T13:04:11.595150+0000","last_peered":"2026-02-23T13:04:11.595150+0000","last_clean":"2026-02-23T13:04:11.595150+0000","last_became_active":"2026-02-23T13:03:08.712783+0000","last_became_peered":"2026-02-23T13:03:08.712783+0000","last_unstale":"2026-02-23T13:04:11.595150+0000","last_undegraded":"2026-02-23T13:04:11.595150+0000","last_fullsized":"2026-02-23T13:04:11.595150+0000","mapping_epoch":28,"log_start":"37'25699","ondisk_log_start":"37'25699","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1684406272,"num_objects":25702,"num_object_clones":0,"num_object_copies":77106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25702,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25702,"num_write_kb":1644928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"37'25836","reported_seq":25864,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.590804+0000","last_change":"2026-02-23T13:03:08.709181+0000","last_active":"2026-02-23T13:04:11.590804+0000","last_peered":"2026-02-23T13:04:11.590804+0000","last_clean":"2026-02-23T13:04:11.590804+0000","last_became_active":"2026-02-23T13:03:08.708821+0000","last_became_peered":"2026-02-23T13:03:08.708821+0000","last_unstale":"2026-02-23T13:04:11.590804+0000","last_undegraded":"2026-02-23T13:04:11.590804+0000","last_fullsized":"2026-02-23T13:04:11.590804+0000","mapping_epoch":28,"log_start":"37'25833","ondisk_log_start":"37'25833","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:22.653808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1693188096,"num_objects":25836,"num_object_clones":0,"num_object_copies":77508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25836,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25836,"num_write_kb":1653504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"37'25655","reported_seq":25683,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.598376+0000","last_change":"2026-02-23T13:03:08.712493+0000","last_active":"2026-02-23T13:04:11.598376+0000","last_peered":"2026-02-23T13:04:11.598376+0000","last_clean":"2026-02-23T13:04:11.598376+0000","last_became_active":"2026-02-23T13:03:08.712152+0000","last_became_peered":"2026-02-23T13:03:08.712152+0000","last_unstale":"2026-02-23T13:04:11.598376+0000","last_undegraded":"2026-02-23T13:04:11.598376+0000","last_fullsized":"2026-02-23T13:04:11.598376+0000","mapping_epoch":28,"log_start":"37'25652","ondisk_log_start":"37'25652","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:33.900038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1681326080,"num_objects":25655,"num_object_clones":0,"num_object_copies":76965,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25655,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25655,"num_write_kb":1641920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"37'25698","reported_seq":25726,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.596256+0000","last_change":"2026-02-23T13:03:08.712205+0000","last_active":"2026-02-23T13:04:11.596256+0000","last_peered":"2026-02-23T13:04:11.596256+0000","last_clean":"2026-02-23T13:04:11.596256+0000","last_became_active":"2026-02-23T13:03:08.712055+0000","last_became_peered":"2026-02-23T13:03:08.712055+0000","last_unstale":"2026-02-23T13:04:11.596256+0000","last_undegraded":"2026-02-23T13:04:11.596256+0000","last_fullsized":"2026-02-23T13:04:11.596256+0000","mapping_epoch":28,"log_start":"37'25695","ondisk_log_start":"37'25695","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:37.263900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1684144128,"num_objects":25698,"num_object_clones":0,"num_object_copies":77094,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25698,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25698,"num_write_kb":1644672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"37'25914","reported_seq":25942,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.593917+0000","last_change":"2026-02-23T13:03:08.709028+0000","last_active":"2026-02-23T13:04:11.593917+0000","last_peered":"2026-02-23T13:04:11.593917+0000","last_clean":"2026-02-23T13:04:11.593917+0000","last_became_active":"2026-02-23T13:03:08.708852+0000","last_became_peered":"2026-02-23T13:03:08.708852+0000","last_unstale":"2026-02-23T13:04:11.593917+0000","last_undegraded":"2026-02-23T13:04:11.593917+0000","last_fullsized":"2026-02-23T13:04:11.593917+0000","mapping_epoch":28,"log_start":"37'25911","ondisk_log_start":"37'25911","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:19.208546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1698299904,"num_objects":25914,"num_object_clones":0,"num_object_copies":77742,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25914,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25914,"num_write_kb":1658496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"37'25996","reported_seq":26024,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.599012+0000","last_change":"2026-02-23T13:03:08.708883+0000","last_active":"2026-02-23T13:04:11.599012+0000","last_peered":"2026-02-23T13:04:11.599012+0000","last_clean":"2026-02-23T13:04:11.599012+0000","last_became_active":"2026-02-23T13:03:08.708457+0000","last_became_peered":"2026-02-23T13:03:08.708457+0000","last_unstale":"2026-02-23T13:04:11.599012+0000","last_undegraded":"2026-02-23T13:04:11.599012+0000","last_fullsized":"2026-02-23T13:04:11.599012+0000","mapping_epoch":28,"log_start":"37'25993","ondisk_log_start":"37'25993","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:32.806938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703673856,"num_objects":25996,"num_object_clones":0,"num_object_copies":77988,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25996,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25996,"num_write_kb":1663744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"37'25860","reported_seq":25888,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.596211+0000","last_change":"2026-02-23T13:03:08.712176+0000","last_active":"2026-02-23T13:04:11.596211+0000","last_peered":"2026-02-23T13:04:11.596211+0000","last_clean":"2026-02-23T13:04:11.596211+0000","last_became_active":"2026-02-23T13:03:08.712010+0000","last_became_peered":"2026-02-23T13:03:08.712010+0000","last_unstale":"2026-02-23T13:04:11.596211+0000","last_undegraded":"2026-02-23T13:04:11.596211+0000","last_fullsized":"2026-02-23T13:04:11.596211+0000","mapping_epoch":28,"log_start":"37'25857","ondisk_log_start":"37'25857","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:29.753408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1694760960,"num_objects":25860,"num_object_clones":0,"num_object_copies":77580,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25860,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25860,"num_write_kb":1655040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"37'25731","reported_seq":25759,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.598808+0000","last_change":"2026-02-23T13:03:08.713049+0000","last_active":"2026-02-23T13:04:11.598808+0000","last_peered":"2026-02-23T13:04:11.598808+0000","last_clean":"2026-02-23T13:04:11.598808+0000","last_became_active":"2026-02-23T13:03:08.712763+0000","last_became_peered":"2026-02-23T13:03:08.712763+0000","last_unstale":"2026-02-23T13:04:11.598808+0000","last_undegraded":"2026-02-23T13:04:11.598808+0000","last_fullsized":"2026-02-23T13:04:11.598808+0000","mapping_epoch":28,"log_start":"37'25728","ondisk_log_start":"37'25728","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:18.501703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1686306816,"num_objects":25731,"num_object_clones":0,"num_object_copies":77193,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25731,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25731,"num_write_kb":1646784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"37'25773","reported_seq":25801,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.598838+0000","last_change":"2026-02-23T13:03:08.709558+0000","last_active":"2026-02-23T13:04:11.598838+0000","last_peered":"2026-02-23T13:04:11.598838+0000","last_clean":"2026-02-23T13:04:11.598838+0000","last_became_active":"2026-02-23T13:03:08.709391+0000","last_became_peered":"2026-02-23T13:03:08.709391+0000","last_unstale":"2026-02-23T13:04:11.598838+0000","last_undegraded":"2026-02-23T13:04:11.598838+0000","last_fullsized":"2026-02-23T13:04:11.598838+0000","mapping_epoch":28,"log_start":"37'25770","ondisk_log_start":"37'25770","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:34.787615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1689059328,"num_objects":25773,"num_object_clones":0,"num_object_copies":77319,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25773,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25773,"num_write_kb":1649472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"37'25718","reported_seq":25746,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.597152+0000","last_change":"2026-02-23T13:03:08.711473+0000","last_active":"2026-02-23T13:04:11.597152+0000","last_peered":"2026-02-23T13:04:11.597152+0000","last_clean":"2026-02-23T13:04:11.597152+0000","last_became_active":"2026-02-23T13:03:08.711303+0000","last_became_peered":"2026-02-23T13:03:08.711303+0000","last_unstale":"2026-02-23T13:04:11.597152+0000","last_undegraded":"2026-02-23T13:04:11.597152+0000","last_fullsized":"2026-02-23T13:04:11.597152+0000","mapping_epoch":28,"log_start":"37'25715","ondisk_log_start":"37'25715","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:35.916414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1685454848,"num_objects":25718,"num_object_clones":0,"num_object_copies":77154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25718,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25718,"num_write_kb":1645952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":27079868416,"num_objects":413206,"num_object_clones":0,"num_object_copies":1239618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":413206,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":413206,"num_write_kb":26445184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":81239801856,"data_stored":81239801856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247825,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":24291440,"kb_used_data":22903644,"kb_used_omap":13,"kb_used_meta":1387762,"kb_avail":709711760,"statfs":{"total":751619276800,"available":726744842240,"internally_reserved":0,"allocated":23453331456,"data_stored":23453100798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13991,"internal_metadata":1421068633},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444052,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":18985380,"kb_used_data":17911632,"kb_used_omap":16,"kb_used_meta":1073711,"kb_avail":715017820,"statfs":{"total":751619276800,"available":732178247680,"internally_reserved":0,"allocated":18341511168,"data_stored":18341288389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17249,"internal_metadata":1099480223},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":20737440,"kb_used_data":19537356,"kb_used_omap":19,"kb_used_meta":1200044,"kb_avail":713265760,"statfs":{"total":751619276800,"available":730384138240,"internally_reserved":0,"allocated":20006252544,"data_stored":20006033317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19853,"internal_metadata":1228845683},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,4,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705687,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":18983728,"kb_used_data":17909980,"kb_used_omap":21,"kb_used_meta":1073706,"kb_avail":715019472,"statfs":{"total":751619276800,"available":732179939328,"internally_reserved":0,"allocated":18339819520,"data_stored":18339588862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22457,"internal_metadata":1099475015},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18601738240,"data_stored":18601738240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20327038976,"data_stored":20327038976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18627559424,"data_stored":18627559424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":23683465216,"data_stored":23683465216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:04:12.307 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:04:12.494 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:12.622 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:12.619+0000 7f24121b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:12.622 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:12.620+0000 7f24121b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:12.786 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:04:12.787 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:04:12.802 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 63 15 421106 421091 417.713 408.312 0.00269249 0.00239281 2026-02-23T13:04:12.807 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:12 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/776896797' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-23T13:04:12.808 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:12 trial046 ceph-mon[38575]: osdmap e38: 4 total, 4 up, 4 in 2026-02-23T13:04:12.808 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:12 trial046 ceph-mon[38575]: 2.1 scrub starts 2026-02-23T13:04:12.808 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:12 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/17234451' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:04:12.829 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2026-02-23T13:04:12.599830+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":27080458784,"num_objects":413208,"num_object_clones":0,"num_object_copies":1239624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":413208,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":413341,"num_write_kb":26447334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":82997988,"kb_used_data":78262612,"kb_used_omap":71,"kb_used_meta":4735224,"kb_avail":2853014812,"statfs":{"total":3006477107200,"available":2921487167488,"internally_reserved":0,"allocated":80140914688,"data_stored":80140011366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":73550,"internal_metadata":4848869554},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,4,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2205483008,"num_objects":33653,"num_object_clones":0,"num_object_copies":100959,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33653,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33653,"num_write_kb":2153792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000486"},"pg_stats":[{"pgid":"2.f","version":"37'25775","reported_seq":25803,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.590731+0000","last_change":"2026-02-23T13:03:08.711612+0000","last_active":"2026-02-23T13:04:11.590731+0000","last_peered":"2026-02-23T13:04:11.590731+0000","last_clean":"2026-02-23T13:04:11.590731+0000","last_became_active":"2026-02-23T13:03:08.711408+0000","last_became_peered":"2026-02-23T13:03:08.711408+0000","last_unstale":"2026-02-23T13:04:11.590731+0000","last_undegraded":"2026-02-23T13:04:11.590731+0000","last_fullsized":"2026-02-23T13:04:11.590731+0000","mapping_epoch":28,"log_start":"37'25772","ondisk_log_start":"37'25772","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:21.274136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1689190400,"num_objects":25775,"num_object_clones":0,"num_object_copies":77325,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25775,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25775,"num_write_kb":1649600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"37'26180","reported_seq":26208,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.593612+0000","last_change":"2026-02-23T13:03:08.711629+0000","last_active":"2026-02-23T13:04:11.593612+0000","last_peered":"2026-02-23T13:04:11.593612+0000","last_clean":"2026-02-23T13:04:11.593612+0000","last_became_active":"2026-02-23T13:03:08.711462+0000","last_became_peered":"2026-02-23T13:03:08.711462+0000","last_unstale":"2026-02-23T13:04:11.593612+0000","last_undegraded":"2026-02-23T13:04:11.593612+0000","last_fullsized":"2026-02-23T13:04:11.593612+0000","mapping_epoch":28,"log_start":"37'26177","ondisk_log_start":"37'26177","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:35.369081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1715732480,"num_objects":26180,"num_object_clones":0,"num_object_copies":78540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26180,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26180,"num_write_kb":1675520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"37'25734","reported_seq":25762,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.595177+0000","last_change":"2026-02-23T13:03:08.712615+0000","last_active":"2026-02-23T13:04:11.595177+0000","last_peered":"2026-02-23T13:04:11.595177+0000","last_clean":"2026-02-23T13:04:11.595177+0000","last_became_active":"2026-02-23T13:03:08.712246+0000","last_became_peered":"2026-02-23T13:03:08.712246+0000","last_unstale":"2026-02-23T13:04:11.595177+0000","last_undegraded":"2026-02-23T13:04:11.595177+0000","last_fullsized":"2026-02-23T13:04:11.595177+0000","mapping_epoch":28,"log_start":"37'25731","ondisk_log_start":"37'25731","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:26.869038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1686503424,"num_objects":25734,"num_object_clones":0,"num_object_copies":77202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25734,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25734,"num_write_kb":1646976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"37'25904","reported_seq":25932,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.597518+0000","last_change":"2026-02-23T13:03:08.712832+0000","last_active":"2026-02-23T13:04:11.597518+0000","last_peered":"2026-02-23T13:04:11.597518+0000","last_clean":"2026-02-23T13:04:11.597518+0000","last_became_active":"2026-02-23T13:03:08.712348+0000","last_became_peered":"2026-02-23T13:03:08.712348+0000","last_unstale":"2026-02-23T13:04:11.597518+0000","last_undegraded":"2026-02-23T13:04:11.597518+0000","last_fullsized":"2026-02-23T13:04:11.597518+0000","mapping_epoch":28,"log_start":"37'25901","ondisk_log_start":"37'25901","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:23.478567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1697644544,"num_objects":25904,"num_object_clones":0,"num_object_copies":77712,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25904,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25904,"num_write_kb":1657856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":210,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:10.784962+0000","last_change":"2026-02-23T13:04:08.199097+0000","last_active":"2026-02-23T13:04:10.784962+0000","last_peered":"2026-02-23T13:04:10.784962+0000","last_clean":"2026-02-23T13:04:10.784962+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:04:10.784962+0000","last_undegraded":"2026-02-23T13:04:10.784962+0000","last_fullsized":"2026-02-23T13:04:10.784962+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:04:08.199036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:04:08.199036+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:23.231335+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"37'25833","reported_seq":25861,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.592687+0000","last_change":"2026-02-23T13:03:08.709049+0000","last_active":"2026-02-23T13:04:11.592687+0000","last_peered":"2026-02-23T13:04:11.592687+0000","last_clean":"2026-02-23T13:04:11.592687+0000","last_became_active":"2026-02-23T13:03:08.708695+0000","last_became_peered":"2026-02-23T13:03:08.708695+0000","last_unstale":"2026-02-23T13:04:11.592687+0000","last_undegraded":"2026-02-23T13:04:11.592687+0000","last_fullsized":"2026-02-23T13:04:11.592687+0000","mapping_epoch":28,"log_start":"37'25830","ondisk_log_start":"37'25830","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1692991488,"num_objects":25833,"num_object_clones":0,"num_object_copies":77499,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25833,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25833,"num_write_kb":1653312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"37'25897","reported_seq":25925,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.597111+0000","last_change":"2026-02-23T13:03:08.712038+0000","last_active":"2026-02-23T13:04:11.597111+0000","last_peered":"2026-02-23T13:04:11.597111+0000","last_clean":"2026-02-23T13:04:11.597111+0000","last_became_active":"2026-02-23T13:03:08.711847+0000","last_became_peered":"2026-02-23T13:03:08.711847+0000","last_unstale":"2026-02-23T13:04:11.597111+0000","last_undegraded":"2026-02-23T13:04:11.597111+0000","last_fullsized":"2026-02-23T13:04:11.597111+0000","mapping_epoch":28,"log_start":"37'25894","ondisk_log_start":"37'25894","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:25.087301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1697185792,"num_objects":25897,"num_object_clones":0,"num_object_copies":77691,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25897,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25897,"num_write_kb":1657408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"37'25702","reported_seq":25730,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.595150+0000","last_change":"2026-02-23T13:03:08.713062+0000","last_active":"2026-02-23T13:04:11.595150+0000","last_peered":"2026-02-23T13:04:11.595150+0000","last_clean":"2026-02-23T13:04:11.595150+0000","last_became_active":"2026-02-23T13:03:08.712783+0000","last_became_peered":"2026-02-23T13:03:08.712783+0000","last_unstale":"2026-02-23T13:04:11.595150+0000","last_undegraded":"2026-02-23T13:04:11.595150+0000","last_fullsized":"2026-02-23T13:04:11.595150+0000","mapping_epoch":28,"log_start":"37'25699","ondisk_log_start":"37'25699","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1684406272,"num_objects":25702,"num_object_clones":0,"num_object_copies":77106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25702,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25702,"num_write_kb":1644928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"37'25836","reported_seq":25864,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.590804+0000","last_change":"2026-02-23T13:03:08.709181+0000","last_active":"2026-02-23T13:04:11.590804+0000","last_peered":"2026-02-23T13:04:11.590804+0000","last_clean":"2026-02-23T13:04:11.590804+0000","last_became_active":"2026-02-23T13:03:08.708821+0000","last_became_peered":"2026-02-23T13:03:08.708821+0000","last_unstale":"2026-02-23T13:04:11.590804+0000","last_undegraded":"2026-02-23T13:04:11.590804+0000","last_fullsized":"2026-02-23T13:04:11.590804+0000","mapping_epoch":28,"log_start":"37'25833","ondisk_log_start":"37'25833","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:22.653808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1693188096,"num_objects":25836,"num_object_clones":0,"num_object_copies":77508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25836,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25836,"num_write_kb":1653504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"37'25655","reported_seq":25683,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.598376+0000","last_change":"2026-02-23T13:03:08.712493+0000","last_active":"2026-02-23T13:04:11.598376+0000","last_peered":"2026-02-23T13:04:11.598376+0000","last_clean":"2026-02-23T13:04:11.598376+0000","last_became_active":"2026-02-23T13:03:08.712152+0000","last_became_peered":"2026-02-23T13:03:08.712152+0000","last_unstale":"2026-02-23T13:04:11.598376+0000","last_undegraded":"2026-02-23T13:04:11.598376+0000","last_fullsized":"2026-02-23T13:04:11.598376+0000","mapping_epoch":28,"log_start":"37'25652","ondisk_log_start":"37'25652","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:33.900038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1681326080,"num_objects":25655,"num_object_clones":0,"num_object_copies":76965,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25655,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25655,"num_write_kb":1641920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"37'25698","reported_seq":25726,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.596256+0000","last_change":"2026-02-23T13:03:08.712205+0000","last_active":"2026-02-23T13:04:11.596256+0000","last_peered":"2026-02-23T13:04:11.596256+0000","last_clean":"2026-02-23T13:04:11.596256+0000","last_became_active":"2026-02-23T13:03:08.712055+0000","last_became_peered":"2026-02-23T13:03:08.712055+0000","last_unstale":"2026-02-23T13:04:11.596256+0000","last_undegraded":"2026-02-23T13:04:11.596256+0000","last_fullsized":"2026-02-23T13:04:11.596256+0000","mapping_epoch":28,"log_start":"37'25695","ondisk_log_start":"37'25695","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:37.263900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1684144128,"num_objects":25698,"num_object_clones":0,"num_object_copies":77094,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25698,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25698,"num_write_kb":1644672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"37'25914","reported_seq":25942,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.593917+0000","last_change":"2026-02-23T13:03:08.709028+0000","last_active":"2026-02-23T13:04:11.593917+0000","last_peered":"2026-02-23T13:04:11.593917+0000","last_clean":"2026-02-23T13:04:11.593917+0000","last_became_active":"2026-02-23T13:03:08.708852+0000","last_became_peered":"2026-02-23T13:03:08.708852+0000","last_unstale":"2026-02-23T13:04:11.593917+0000","last_undegraded":"2026-02-23T13:04:11.593917+0000","last_fullsized":"2026-02-23T13:04:11.593917+0000","mapping_epoch":28,"log_start":"37'25911","ondisk_log_start":"37'25911","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:19.208546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1698299904,"num_objects":25914,"num_object_clones":0,"num_object_copies":77742,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25914,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25914,"num_write_kb":1658496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"37'25996","reported_seq":26024,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.599012+0000","last_change":"2026-02-23T13:03:08.708883+0000","last_active":"2026-02-23T13:04:11.599012+0000","last_peered":"2026-02-23T13:04:11.599012+0000","last_clean":"2026-02-23T13:04:11.599012+0000","last_became_active":"2026-02-23T13:03:08.708457+0000","last_became_peered":"2026-02-23T13:03:08.708457+0000","last_unstale":"2026-02-23T13:04:11.599012+0000","last_undegraded":"2026-02-23T13:04:11.599012+0000","last_fullsized":"2026-02-23T13:04:11.599012+0000","mapping_epoch":28,"log_start":"37'25993","ondisk_log_start":"37'25993","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:32.806938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703673856,"num_objects":25996,"num_object_clones":0,"num_object_copies":77988,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25996,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25996,"num_write_kb":1663744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"37'25860","reported_seq":25888,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.596211+0000","last_change":"2026-02-23T13:03:08.712176+0000","last_active":"2026-02-23T13:04:11.596211+0000","last_peered":"2026-02-23T13:04:11.596211+0000","last_clean":"2026-02-23T13:04:11.596211+0000","last_became_active":"2026-02-23T13:03:08.712010+0000","last_became_peered":"2026-02-23T13:03:08.712010+0000","last_unstale":"2026-02-23T13:04:11.596211+0000","last_undegraded":"2026-02-23T13:04:11.596211+0000","last_fullsized":"2026-02-23T13:04:11.596211+0000","mapping_epoch":28,"log_start":"37'25857","ondisk_log_start":"37'25857","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:29.753408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1694760960,"num_objects":25860,"num_object_clones":0,"num_object_copies":77580,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25860,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25860,"num_write_kb":1655040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"37'25731","reported_seq":25759,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.598808+0000","last_change":"2026-02-23T13:03:08.713049+0000","last_active":"2026-02-23T13:04:11.598808+0000","last_peered":"2026-02-23T13:04:11.598808+0000","last_clean":"2026-02-23T13:04:11.598808+0000","last_became_active":"2026-02-23T13:03:08.712763+0000","last_became_peered":"2026-02-23T13:03:08.712763+0000","last_unstale":"2026-02-23T13:04:11.598808+0000","last_undegraded":"2026-02-23T13:04:11.598808+0000","last_fullsized":"2026-02-23T13:04:11.598808+0000","mapping_epoch":28,"log_start":"37'25728","ondisk_log_start":"37'25728","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:18.501703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1686306816,"num_objects":25731,"num_object_clones":0,"num_object_copies":77193,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25731,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25731,"num_write_kb":1646784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"37'25773","reported_seq":25801,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.598838+0000","last_change":"2026-02-23T13:03:08.709558+0000","last_active":"2026-02-23T13:04:11.598838+0000","last_peered":"2026-02-23T13:04:11.598838+0000","last_clean":"2026-02-23T13:04:11.598838+0000","last_became_active":"2026-02-23T13:03:08.709391+0000","last_became_peered":"2026-02-23T13:03:08.709391+0000","last_unstale":"2026-02-23T13:04:11.598838+0000","last_undegraded":"2026-02-23T13:04:11.598838+0000","last_fullsized":"2026-02-23T13:04:11.598838+0000","mapping_epoch":28,"log_start":"37'25770","ondisk_log_start":"37'25770","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:34.787615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1689059328,"num_objects":25773,"num_object_clones":0,"num_object_copies":77319,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25773,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25773,"num_write_kb":1649472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"37'25718","reported_seq":25746,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.597152+0000","last_change":"2026-02-23T13:03:08.711473+0000","last_active":"2026-02-23T13:04:11.597152+0000","last_peered":"2026-02-23T13:04:11.597152+0000","last_clean":"2026-02-23T13:04:11.597152+0000","last_became_active":"2026-02-23T13:03:08.711303+0000","last_became_peered":"2026-02-23T13:03:08.711303+0000","last_unstale":"2026-02-23T13:04:11.597152+0000","last_undegraded":"2026-02-23T13:04:11.597152+0000","last_fullsized":"2026-02-23T13:04:11.597152+0000","mapping_epoch":28,"log_start":"37'25715","ondisk_log_start":"37'25715","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:35.916414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1685454848,"num_objects":25718,"num_object_clones":0,"num_object_copies":77154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25718,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25718,"num_write_kb":1645952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":27079868416,"num_objects":413206,"num_object_clones":0,"num_object_copies":1239618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":413206,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":413206,"num_write_kb":26445184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":81239801856,"data_stored":81239801856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247825,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":24291440,"kb_used_data":22903644,"kb_used_omap":13,"kb_used_meta":1387762,"kb_avail":709711760,"statfs":{"total":751619276800,"available":726744842240,"internally_reserved":0,"allocated":23453331456,"data_stored":23453100798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13991,"internal_metadata":1421068633},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444052,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":18985380,"kb_used_data":17911632,"kb_used_omap":16,"kb_used_meta":1073711,"kb_avail":715017820,"statfs":{"total":751619276800,"available":732178247680,"internally_reserved":0,"allocated":18341511168,"data_stored":18341288389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17249,"internal_metadata":1099480223},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":20737440,"kb_used_data":19537356,"kb_used_omap":19,"kb_used_meta":1200044,"kb_avail":713265760,"statfs":{"total":751619276800,"available":730384138240,"internally_reserved":0,"allocated":20006252544,"data_stored":20006033317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19853,"internal_metadata":1228845683},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,4,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705687,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":18983728,"kb_used_data":17909980,"kb_used_omap":21,"kb_used_meta":1073706,"kb_avail":715019472,"statfs":{"total":751619276800,"available":732179939328,"internally_reserved":0,"allocated":18339819520,"data_stored":18339588862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22457,"internal_metadata":1099475015},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18601738240,"data_stored":18601738240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20327038976,"data_stored":20327038976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18627559424,"data_stored":18627559424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":23683465216,"data_stored":23683465216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:04:12.831 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-23T13:04:12.832 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:04:12.832 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_0 2026-02-23T13:04:12.832 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:04:12.978 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:13.102 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:13.100+0000 7f19b873c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:13.102 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:13.100+0000 7f19b873c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:13.237 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:04:13.237 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:04:13.282 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2026-02-23T13:04:12.599830+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":27080458784,"num_objects":413208,"num_object_clones":0,"num_object_copies":1239624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":413208,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":413341,"num_write_kb":26447334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":82997988,"kb_used_data":78262612,"kb_used_omap":71,"kb_used_meta":4735224,"kb_avail":2853014812,"statfs":{"total":3006477107200,"available":2921487167488,"internally_reserved":0,"allocated":80140914688,"data_stored":80140011366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":73550,"internal_metadata":4848869554},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,4,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2205483008,"num_objects":33653,"num_object_clones":0,"num_object_copies":100959,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33653,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33653,"num_write_kb":2153792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000486"},"pg_stats":[{"pgid":"2.f","version":"37'25775","reported_seq":25803,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.590731+0000","last_change":"2026-02-23T13:03:08.711612+0000","last_active":"2026-02-23T13:04:11.590731+0000","last_peered":"2026-02-23T13:04:11.590731+0000","last_clean":"2026-02-23T13:04:11.590731+0000","last_became_active":"2026-02-23T13:03:08.711408+0000","last_became_peered":"2026-02-23T13:03:08.711408+0000","last_unstale":"2026-02-23T13:04:11.590731+0000","last_undegraded":"2026-02-23T13:04:11.590731+0000","last_fullsized":"2026-02-23T13:04:11.590731+0000","mapping_epoch":28,"log_start":"37'25772","ondisk_log_start":"37'25772","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:21.274136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1689190400,"num_objects":25775,"num_object_clones":0,"num_object_copies":77325,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25775,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25775,"num_write_kb":1649600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"37'26180","reported_seq":26208,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.593612+0000","last_change":"2026-02-23T13:03:08.711629+0000","last_active":"2026-02-23T13:04:11.593612+0000","last_peered":"2026-02-23T13:04:11.593612+0000","last_clean":"2026-02-23T13:04:11.593612+0000","last_became_active":"2026-02-23T13:03:08.711462+0000","last_became_peered":"2026-02-23T13:03:08.711462+0000","last_unstale":"2026-02-23T13:04:11.593612+0000","last_undegraded":"2026-02-23T13:04:11.593612+0000","last_fullsized":"2026-02-23T13:04:11.593612+0000","mapping_epoch":28,"log_start":"37'26177","ondisk_log_start":"37'26177","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:35.369081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1715732480,"num_objects":26180,"num_object_clones":0,"num_object_copies":78540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26180,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26180,"num_write_kb":1675520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"37'25734","reported_seq":25762,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.595177+0000","last_change":"2026-02-23T13:03:08.712615+0000","last_active":"2026-02-23T13:04:11.595177+0000","last_peered":"2026-02-23T13:04:11.595177+0000","last_clean":"2026-02-23T13:04:11.595177+0000","last_became_active":"2026-02-23T13:03:08.712246+0000","last_became_peered":"2026-02-23T13:03:08.712246+0000","last_unstale":"2026-02-23T13:04:11.595177+0000","last_undegraded":"2026-02-23T13:04:11.595177+0000","last_fullsized":"2026-02-23T13:04:11.595177+0000","mapping_epoch":28,"log_start":"37'25731","ondisk_log_start":"37'25731","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:26.869038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1686503424,"num_objects":25734,"num_object_clones":0,"num_object_copies":77202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25734,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25734,"num_write_kb":1646976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"37'25904","reported_seq":25932,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.597518+0000","last_change":"2026-02-23T13:03:08.712832+0000","last_active":"2026-02-23T13:04:11.597518+0000","last_peered":"2026-02-23T13:04:11.597518+0000","last_clean":"2026-02-23T13:04:11.597518+0000","last_became_active":"2026-02-23T13:03:08.712348+0000","last_became_peered":"2026-02-23T13:03:08.712348+0000","last_unstale":"2026-02-23T13:04:11.597518+0000","last_undegraded":"2026-02-23T13:04:11.597518+0000","last_fullsized":"2026-02-23T13:04:11.597518+0000","mapping_epoch":28,"log_start":"37'25901","ondisk_log_start":"37'25901","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:23.478567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1697644544,"num_objects":25904,"num_object_clones":0,"num_object_copies":77712,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25904,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25904,"num_write_kb":1657856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":210,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:10.784962+0000","last_change":"2026-02-23T13:04:08.199097+0000","last_active":"2026-02-23T13:04:10.784962+0000","last_peered":"2026-02-23T13:04:10.784962+0000","last_clean":"2026-02-23T13:04:10.784962+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:04:10.784962+0000","last_undegraded":"2026-02-23T13:04:10.784962+0000","last_fullsized":"2026-02-23T13:04:10.784962+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:04:08.199036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:04:08.199036+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:23.231335+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"37'25833","reported_seq":25861,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.592687+0000","last_change":"2026-02-23T13:03:08.709049+0000","last_active":"2026-02-23T13:04:11.592687+0000","last_peered":"2026-02-23T13:04:11.592687+0000","last_clean":"2026-02-23T13:04:11.592687+0000","last_became_active":"2026-02-23T13:03:08.708695+0000","last_became_peered":"2026-02-23T13:03:08.708695+0000","last_unstale":"2026-02-23T13:04:11.592687+0000","last_undegraded":"2026-02-23T13:04:11.592687+0000","last_fullsized":"2026-02-23T13:04:11.592687+0000","mapping_epoch":28,"log_start":"37'25830","ondisk_log_start":"37'25830","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1692991488,"num_objects":25833,"num_object_clones":0,"num_object_copies":77499,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25833,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25833,"num_write_kb":1653312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"37'25897","reported_seq":25925,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.597111+0000","last_change":"2026-02-23T13:03:08.712038+0000","last_active":"2026-02-23T13:04:11.597111+0000","last_peered":"2026-02-23T13:04:11.597111+0000","last_clean":"2026-02-23T13:04:11.597111+0000","last_became_active":"2026-02-23T13:03:08.711847+0000","last_became_peered":"2026-02-23T13:03:08.711847+0000","last_unstale":"2026-02-23T13:04:11.597111+0000","last_undegraded":"2026-02-23T13:04:11.597111+0000","last_fullsized":"2026-02-23T13:04:11.597111+0000","mapping_epoch":28,"log_start":"37'25894","ondisk_log_start":"37'25894","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:25.087301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1697185792,"num_objects":25897,"num_object_clones":0,"num_object_copies":77691,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25897,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25897,"num_write_kb":1657408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"37'25702","reported_seq":25730,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.595150+0000","last_change":"2026-02-23T13:03:08.713062+0000","last_active":"2026-02-23T13:04:11.595150+0000","last_peered":"2026-02-23T13:04:11.595150+0000","last_clean":"2026-02-23T13:04:11.595150+0000","last_became_active":"2026-02-23T13:03:08.712783+0000","last_became_peered":"2026-02-23T13:03:08.712783+0000","last_unstale":"2026-02-23T13:04:11.595150+0000","last_undegraded":"2026-02-23T13:04:11.595150+0000","last_fullsized":"2026-02-23T13:04:11.595150+0000","mapping_epoch":28,"log_start":"37'25699","ondisk_log_start":"37'25699","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1684406272,"num_objects":25702,"num_object_clones":0,"num_object_copies":77106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25702,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25702,"num_write_kb":1644928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"37'25836","reported_seq":25864,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.590804+0000","last_change":"2026-02-23T13:03:08.709181+0000","last_active":"2026-02-23T13:04:11.590804+0000","last_peered":"2026-02-23T13:04:11.590804+0000","last_clean":"2026-02-23T13:04:11.590804+0000","last_became_active":"2026-02-23T13:03:08.708821+0000","last_became_peered":"2026-02-23T13:03:08.708821+0000","last_unstale":"2026-02-23T13:04:11.590804+0000","last_undegraded":"2026-02-23T13:04:11.590804+0000","last_fullsized":"2026-02-23T13:04:11.590804+0000","mapping_epoch":28,"log_start":"37'25833","ondisk_log_start":"37'25833","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:22.653808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1693188096,"num_objects":25836,"num_object_clones":0,"num_object_copies":77508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25836,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25836,"num_write_kb":1653504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"37'25655","reported_seq":25683,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.598376+0000","last_change":"2026-02-23T13:03:08.712493+0000","last_active":"2026-02-23T13:04:11.598376+0000","last_peered":"2026-02-23T13:04:11.598376+0000","last_clean":"2026-02-23T13:04:11.598376+0000","last_became_active":"2026-02-23T13:03:08.712152+0000","last_became_peered":"2026-02-23T13:03:08.712152+0000","last_unstale":"2026-02-23T13:04:11.598376+0000","last_undegraded":"2026-02-23T13:04:11.598376+0000","last_fullsized":"2026-02-23T13:04:11.598376+0000","mapping_epoch":28,"log_start":"37'25652","ondisk_log_start":"37'25652","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:33.900038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1681326080,"num_objects":25655,"num_object_clones":0,"num_object_copies":76965,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25655,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25655,"num_write_kb":1641920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"37'25698","reported_seq":25726,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.596256+0000","last_change":"2026-02-23T13:03:08.712205+0000","last_active":"2026-02-23T13:04:11.596256+0000","last_peered":"2026-02-23T13:04:11.596256+0000","last_clean":"2026-02-23T13:04:11.596256+0000","last_became_active":"2026-02-23T13:03:08.712055+0000","last_became_peered":"2026-02-23T13:03:08.712055+0000","last_unstale":"2026-02-23T13:04:11.596256+0000","last_undegraded":"2026-02-23T13:04:11.596256+0000","last_fullsized":"2026-02-23T13:04:11.596256+0000","mapping_epoch":28,"log_start":"37'25695","ondisk_log_start":"37'25695","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:37.263900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1684144128,"num_objects":25698,"num_object_clones":0,"num_object_copies":77094,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25698,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25698,"num_write_kb":1644672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"37'25914","reported_seq":25942,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.593917+0000","last_change":"2026-02-23T13:03:08.709028+0000","last_active":"2026-02-23T13:04:11.593917+0000","last_peered":"2026-02-23T13:04:11.593917+0000","last_clean":"2026-02-23T13:04:11.593917+0000","last_became_active":"2026-02-23T13:03:08.708852+0000","last_became_peered":"2026-02-23T13:03:08.708852+0000","last_unstale":"2026-02-23T13:04:11.593917+0000","last_undegraded":"2026-02-23T13:04:11.593917+0000","last_fullsized":"2026-02-23T13:04:11.593917+0000","mapping_epoch":28,"log_start":"37'25911","ondisk_log_start":"37'25911","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:19.208546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1698299904,"num_objects":25914,"num_object_clones":0,"num_object_copies":77742,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25914,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25914,"num_write_kb":1658496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"37'25996","reported_seq":26024,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.599012+0000","last_change":"2026-02-23T13:03:08.708883+0000","last_active":"2026-02-23T13:04:11.599012+0000","last_peered":"2026-02-23T13:04:11.599012+0000","last_clean":"2026-02-23T13:04:11.599012+0000","last_became_active":"2026-02-23T13:03:08.708457+0000","last_became_peered":"2026-02-23T13:03:08.708457+0000","last_unstale":"2026-02-23T13:04:11.599012+0000","last_undegraded":"2026-02-23T13:04:11.599012+0000","last_fullsized":"2026-02-23T13:04:11.599012+0000","mapping_epoch":28,"log_start":"37'25993","ondisk_log_start":"37'25993","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:32.806938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703673856,"num_objects":25996,"num_object_clones":0,"num_object_copies":77988,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25996,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25996,"num_write_kb":1663744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"37'25860","reported_seq":25888,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.596211+0000","last_change":"2026-02-23T13:03:08.712176+0000","last_active":"2026-02-23T13:04:11.596211+0000","last_peered":"2026-02-23T13:04:11.596211+0000","last_clean":"2026-02-23T13:04:11.596211+0000","last_became_active":"2026-02-23T13:03:08.712010+0000","last_became_peered":"2026-02-23T13:03:08.712010+0000","last_unstale":"2026-02-23T13:04:11.596211+0000","last_undegraded":"2026-02-23T13:04:11.596211+0000","last_fullsized":"2026-02-23T13:04:11.596211+0000","mapping_epoch":28,"log_start":"37'25857","ondisk_log_start":"37'25857","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:29.753408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1694760960,"num_objects":25860,"num_object_clones":0,"num_object_copies":77580,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25860,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25860,"num_write_kb":1655040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"37'25731","reported_seq":25759,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.598808+0000","last_change":"2026-02-23T13:03:08.713049+0000","last_active":"2026-02-23T13:04:11.598808+0000","last_peered":"2026-02-23T13:04:11.598808+0000","last_clean":"2026-02-23T13:04:11.598808+0000","last_became_active":"2026-02-23T13:03:08.712763+0000","last_became_peered":"2026-02-23T13:03:08.712763+0000","last_unstale":"2026-02-23T13:04:11.598808+0000","last_undegraded":"2026-02-23T13:04:11.598808+0000","last_fullsized":"2026-02-23T13:04:11.598808+0000","mapping_epoch":28,"log_start":"37'25728","ondisk_log_start":"37'25728","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:18.501703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1686306816,"num_objects":25731,"num_object_clones":0,"num_object_copies":77193,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25731,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25731,"num_write_kb":1646784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"37'25773","reported_seq":25801,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.598838+0000","last_change":"2026-02-23T13:03:08.709558+0000","last_active":"2026-02-23T13:04:11.598838+0000","last_peered":"2026-02-23T13:04:11.598838+0000","last_clean":"2026-02-23T13:04:11.598838+0000","last_became_active":"2026-02-23T13:03:08.709391+0000","last_became_peered":"2026-02-23T13:03:08.709391+0000","last_unstale":"2026-02-23T13:04:11.598838+0000","last_undegraded":"2026-02-23T13:04:11.598838+0000","last_fullsized":"2026-02-23T13:04:11.598838+0000","mapping_epoch":28,"log_start":"37'25770","ondisk_log_start":"37'25770","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:34.787615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1689059328,"num_objects":25773,"num_object_clones":0,"num_object_copies":77319,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25773,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25773,"num_write_kb":1649472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"37'25718","reported_seq":25746,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-23T13:04:11.597152+0000","last_change":"2026-02-23T13:03:08.711473+0000","last_active":"2026-02-23T13:04:11.597152+0000","last_peered":"2026-02-23T13:04:11.597152+0000","last_clean":"2026-02-23T13:04:11.597152+0000","last_became_active":"2026-02-23T13:03:08.711303+0000","last_became_peered":"2026-02-23T13:03:08.711303+0000","last_unstale":"2026-02-23T13:04:11.597152+0000","last_undegraded":"2026-02-23T13:04:11.597152+0000","last_fullsized":"2026-02-23T13:04:11.597152+0000","mapping_epoch":28,"log_start":"37'25715","ondisk_log_start":"37'25715","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:35.916414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1685454848,"num_objects":25718,"num_object_clones":0,"num_object_copies":77154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25718,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25718,"num_write_kb":1645952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":27079868416,"num_objects":413206,"num_object_clones":0,"num_object_copies":1239618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":413206,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":413206,"num_write_kb":26445184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":81239801856,"data_stored":81239801856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247825,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":24291440,"kb_used_data":22903644,"kb_used_omap":13,"kb_used_meta":1387762,"kb_avail":709711760,"statfs":{"total":751619276800,"available":726744842240,"internally_reserved":0,"allocated":23453331456,"data_stored":23453100798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13991,"internal_metadata":1421068633},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444052,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":18985380,"kb_used_data":17911632,"kb_used_omap":16,"kb_used_meta":1073711,"kb_avail":715017820,"statfs":{"total":751619276800,"available":732178247680,"internally_reserved":0,"allocated":18341511168,"data_stored":18341288389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17249,"internal_metadata":1099480223},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":20737440,"kb_used_data":19537356,"kb_used_omap":19,"kb_used_meta":1200044,"kb_avail":713265760,"statfs":{"total":751619276800,"available":730384138240,"internally_reserved":0,"allocated":20006252544,"data_stored":20006033317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19853,"internal_metadata":1228845683},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,4,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705687,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":18983728,"kb_used_data":17909980,"kb_used_omap":21,"kb_used_meta":1073706,"kb_avail":715019472,"statfs":{"total":751619276800,"available":732179939328,"internally_reserved":0,"allocated":18339819520,"data_stored":18339588862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22457,"internal_metadata":1099475015},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18601738240,"data_stored":18601738240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20327038976,"data_stored":20327038976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18627559424,"data_stored":18627559424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":23683465216,"data_stored":23683465216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:04:13.285 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_0 pgp_num 36 2026-02-23T13:04:13.426 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:13.560 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:13.558+0000 7f282ed3e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:13.561 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:13.559+0000 7f282ed3e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:13.696 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-23T13:04:13.736 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:04:13.802 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 64 16 427096 427080 417.034 374.312 0.0012385 0.00239666 2026-02-23T13:04:14.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:13 trial046 ceph-mon[38575]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:04:14.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:13 trial046 ceph-mon[38575]: pgmap v50: 17 pgs: 17 active+clean; 25 GiB data, 79 GiB used, 2.7 TiB / 2.7 TiB avail; 526 MiB/s wr, 8.41k op/s 2026-02-23T13:04:14.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:13 trial046 ceph-mon[38575]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:04:14.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:13 trial046 ceph-mon[38575]: 2.3 scrub starts 2026-02-23T13:04:14.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:13 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/421947221' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_0", "var": "pgp_num", "val": "36"} : dispatch 2026-02-23T13:04:14.321 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:04:14.459 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:14.586 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:14.583+0000 7f49f1018640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:14.586 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:14.584+0000 7f49f1018640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:14.600 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:04:14.601 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:04:14.614 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:04:14.614 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:04:14.626 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:04:14.626 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:04:14.640 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:04:14.640 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:04:14.803 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 65 16 432895 432879 416.194 362.438 0.00193362 0.00240157 2026-02-23T13:04:15.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:14 trial046 ceph-mon[38575]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:04:15.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:14 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2248471385' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:04:15.803 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 66 15 439217 439202 415.875 395.188 0.00141788 0.0024034 2026-02-23T13:04:16.088 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:15 trial046 ceph-mon[38575]: pgmap v51: 17 pgs: 17 active+clean; 25 GiB data, 79 GiB used, 2.7 TiB / 2.7 TiB avail; 361 MiB/s wr, 5.78k op/s 2026-02-23T13:04:16.088 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:15 trial046 ceph-mon[38575]: 2.1 scrub ok 2026-02-23T13:04:16.468 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:04:16 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:04:16.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:04:16.539 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:04:16 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:04:16] "GET /metrics HTTP/1.1" 200 4204 "" "Prometheus/3.6.0" 2026-02-23T13:04:16.679 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:04:16.803 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 67 16 445627 445611 415.646 400.562 0.00119464 0.00240474 2026-02-23T13:04:16.818 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:16.944 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:16.942+0000 7f330542e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:16.944 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:16.943+0000 7f330542e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:16.959 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:04:16.959 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:04:16.959 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:16 trial046 ceph-mon[38575]: 2.3 scrub ok 2026-02-23T13:04:16.959 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:16 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:04:16.974 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:04:16.974 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:04:16.985 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:04:16.985 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:04:16.998 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:04:16.998 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:04:17.803 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 68 16 452285 452269 415.653 416.125 0.00260559 0.00240465 2026-02-23T13:04:18.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:17 trial046 ceph-mon[38575]: pgmap v52: 17 pgs: 17 active+clean; 26 GiB data, 84 GiB used, 2.7 TiB / 2.7 TiB avail; 450 MiB/s wr, 7.20k op/s 2026-02-23T13:04:18.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:17 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1587665607' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:04:18.737 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:04:18.738 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-23T13:04:18.803 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 69 16 458855 458839 415.579 410.625 0.00227635 0.00240509 2026-02-23T13:04:18.877 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:19.001 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:19.000+0000 7f50ea127640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:19.001 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:19.000+0000 7f50ea127640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:19.043 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:04:19.181 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:19.297 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:19.295+0000 7f509ac27640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:19.297 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:19.296+0000 7f509ac27640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:19.314 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:04:19.315 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:04:19.326 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:04:19.327 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:04:19.340 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:04:19.340 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:04:19.353 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:04:19.353 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:04:19.796 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.0 to 1 (10000) 2026-02-23T13:04:19.803 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 70 16 464970 464954 415.102 382.188 0.00153402 0.00240782 2026-02-23T13:04:19.861 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-23T13:04:20.002 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:20.058 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:19 trial046 ceph-mon[38575]: pgmap v53: 17 pgs: 17 active+clean; 27 GiB data, 86 GiB used, 2.7 TiB / 2.7 TiB avail; 507 MiB/s wr, 8.11k op/s 2026-02-23T13:04:20.058 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:19 trial046 ceph-mon[38575]: 2.9 scrub starts 2026-02-23T13:04:20.058 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:19 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3860696244' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-23T13:04:20.058 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:19 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/229240869' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:04:20.123 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:20.122+0000 7f4967fcc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:20.123 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:20.122+0000 7f4967fcc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:20.801 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.1 to 1 (10000) 2026-02-23T13:04:20.803 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 71 16 471013 470997 414.575 377.688 0.0018993 0.00241095 2026-02-23T13:04:20.846 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-23T13:04:20.991 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:21.055 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:20 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3860696244' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-23T13:04:21.055 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:20 trial046 ceph-mon[38575]: osdmap e39: 4 total, 4 up, 4 in 2026-02-23T13:04:21.055 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:20 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3218180716' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-23T13:04:21.117 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:21.116+0000 7f9fa3071640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:21.117 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:21.116+0000 7f9fa3071640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:21.398 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:04:21.542 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:21.656 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:21.655+0000 7f5710419640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:21.656 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:21.655+0000 7f5710419640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:21.670 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:04:21.671 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:04:21.684 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:04:21.684 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:04:21.697 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:04:21.697 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:04:21.709 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:04:21.710 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:04:21.802 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.2 to 1 (10000) 2026-02-23T13:04:21.803 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 72 15 477082 477067 414.085 379.375 0.00314061 0.00241379 2026-02-23T13:04:21.849 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-23T13:04:21.991 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:22.015 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:21 trial046 ceph-mon[38575]: pgmap v55: 17 pgs: 17 active+clean; 27 GiB data, 86 GiB used, 2.7 TiB / 2.7 TiB avail; 221 MiB/s wr, 3.54k op/s 2026-02-23T13:04:22.015 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:21 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3218180716' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-23T13:04:22.016 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:21 trial046 ceph-mon[38575]: osdmap e40: 4 total, 4 up, 4 in 2026-02-23T13:04:22.016 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:21 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1051890761' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-23T13:04:22.016 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:21 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3775777800' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:04:22.110 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:22.110+0000 7f488d823640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:22.110 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:22.110+0000 7f488d823640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:22.803 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 73 15 482993 482978 413.473 369.438 0.0039944 0.00241738 2026-02-23T13:04:22.805 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.3 to 1 (10000) 2026-02-23T13:04:22.850 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-23T13:04:22.850 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:04:22.987 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:23.057 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:22 trial046 ceph-mon[38575]: 2.6 scrub starts 2026-02-23T13:04:23.058 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:22 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1051890761' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-23T13:04:23.058 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:22 trial046 ceph-mon[38575]: osdmap e41: 4 total, 4 up, 4 in 2026-02-23T13:04:23.058 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:22 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4016212206' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-23T13:04:23.058 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:22 trial046 ceph-mon[38575]: 2.9 scrub ok 2026-02-23T13:04:23.106 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:23.105+0000 7fba363ab640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:23.106 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:23.106+0000 7fba363ab640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:23.260 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:04:23.260 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:04:23.306 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2026-02-23T13:04:22.804788+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":31189369376,"num_objects":475905,"num_object_clones":0,"num_object_copies":1427715,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":475905,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":476038,"num_write_kb":30459942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53,"ondisk_log_size":53,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":96113984,"kb_used_data":90541296,"kb_used_omap":78,"kb_used_meta":5572529,"kb_avail":2839898816,"statfs":{"total":3006477107200,"available":2908056387584,"internally_reserved":0,"allocated":92714287104,"data_stored":92713281355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":80711,"internal_metadata":5706269881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,6,4,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2063663104,"num_objects":31489,"num_object_clones":0,"num_object_copies":94467,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31489,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31489,"num_write_kb":2015296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.204208"},"pg_stats":[{"pgid":"2.f","version":"40'29763","reported_seq":29797,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.595832+0000","last_change":"2026-02-23T13:03:08.711612+0000","last_active":"2026-02-23T13:04:21.595832+0000","last_peered":"2026-02-23T13:04:21.595832+0000","last_clean":"2026-02-23T13:04:21.595832+0000","last_became_active":"2026-02-23T13:03:08.711408+0000","last_became_peered":"2026-02-23T13:03:08.711408+0000","last_unstale":"2026-02-23T13:04:21.595832+0000","last_undegraded":"2026-02-23T13:04:21.595832+0000","last_fullsized":"2026-02-23T13:04:21.595832+0000","mapping_epoch":28,"log_start":"40'29760","ondisk_log_start":"40'29760","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1950547968,"num_objects":29763,"num_object_clones":0,"num_object_copies":89289,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29763,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29763,"num_write_kb":1904832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"40'30027","reported_seq":30061,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.599230+0000","last_change":"2026-02-23T13:03:08.711629+0000","last_active":"2026-02-23T13:04:21.599230+0000","last_peered":"2026-02-23T13:04:21.599230+0000","last_clean":"2026-02-23T13:04:21.599230+0000","last_became_active":"2026-02-23T13:03:08.711462+0000","last_became_peered":"2026-02-23T13:03:08.711462+0000","last_unstale":"2026-02-23T13:04:21.599230+0000","last_undegraded":"2026-02-23T13:04:21.599230+0000","last_fullsized":"2026-02-23T13:04:21.599230+0000","mapping_epoch":28,"log_start":"40'30024","ondisk_log_start":"40'30024","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:35.369081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1967849472,"num_objects":30027,"num_object_clones":0,"num_object_copies":90081,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30027,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30027,"num_write_kb":1921728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"40'29689","reported_seq":29723,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.603330+0000","last_change":"2026-02-23T13:03:08.712615+0000","last_active":"2026-02-23T13:04:21.603330+0000","last_peered":"2026-02-23T13:04:21.603330+0000","last_clean":"2026-02-23T13:04:21.603330+0000","last_became_active":"2026-02-23T13:03:08.712246+0000","last_became_peered":"2026-02-23T13:03:08.712246+0000","last_unstale":"2026-02-23T13:04:21.603330+0000","last_undegraded":"2026-02-23T13:04:21.603330+0000","last_fullsized":"2026-02-23T13:04:21.603330+0000","mapping_epoch":28,"log_start":"40'29686","ondisk_log_start":"40'29686","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:26.869038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1945698304,"num_objects":29689,"num_object_clones":0,"num_object_copies":89067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29689,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29689,"num_write_kb":1900096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"40'29883","reported_seq":29917,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.607381+0000","last_change":"2026-02-23T13:03:08.712832+0000","last_active":"2026-02-23T13:04:21.607381+0000","last_peered":"2026-02-23T13:04:21.607381+0000","last_clean":"2026-02-23T13:04:21.607381+0000","last_became_active":"2026-02-23T13:03:08.712348+0000","last_became_peered":"2026-02-23T13:03:08.712348+0000","last_unstale":"2026-02-23T13:04:21.607381+0000","last_undegraded":"2026-02-23T13:04:21.607381+0000","last_fullsized":"2026-02-23T13:04:21.607381+0000","mapping_epoch":28,"log_start":"40'29880","ondisk_log_start":"40'29880","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:23.478567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1958412288,"num_objects":29883,"num_object_clones":0,"num_object_copies":89649,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29883,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29883,"num_write_kb":1912512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":216,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:20.802549+0000","last_change":"2026-02-23T13:04:08.199097+0000","last_active":"2026-02-23T13:04:20.802549+0000","last_peered":"2026-02-23T13:04:20.802549+0000","last_clean":"2026-02-23T13:04:20.802549+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:04:20.802549+0000","last_undegraded":"2026-02-23T13:04:20.802549+0000","last_fullsized":"2026-02-23T13:04:20.802549+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:04:08.199036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:04:08.199036+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:23.231335+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"40'29721","reported_seq":30032,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.595707+0000","last_change":"2026-02-23T13:04:15.649890+0000","last_active":"2026-02-23T13:04:21.595707+0000","last_peered":"2026-02-23T13:04:21.595707+0000","last_clean":"2026-02-23T13:04:21.595707+0000","last_became_active":"2026-02-23T13:03:08.708695+0000","last_became_peered":"2026-02-23T13:03:08.708695+0000","last_unstale":"2026-02-23T13:04:21.595707+0000","last_undegraded":"2026-02-23T13:04:21.595707+0000","last_fullsized":"2026-02-23T13:04:21.595707+0000","mapping_epoch":28,"log_start":"40'29718","ondisk_log_start":"40'29718","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'27365","last_scrub_stamp":"2026-02-23T13:04:15.649815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:15.649815+0000","objects_scrubbed":26902,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:16.658945+0000","scrub_duration":2575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1947795456,"num_objects":29721,"num_object_clones":0,"num_object_copies":89163,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29721,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29721,"num_write_kb":1902144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"40'29848","reported_seq":29881,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.598796+0000","last_change":"2026-02-23T13:03:08.712038+0000","last_active":"2026-02-23T13:04:21.598796+0000","last_peered":"2026-02-23T13:04:21.598796+0000","last_clean":"2026-02-23T13:04:21.598796+0000","last_became_active":"2026-02-23T13:03:08.711847+0000","last_became_peered":"2026-02-23T13:03:08.711847+0000","last_unstale":"2026-02-23T13:04:21.598796+0000","last_undegraded":"2026-02-23T13:04:21.598796+0000","last_fullsized":"2026-02-23T13:04:21.598796+0000","mapping_epoch":28,"log_start":"40'29845","ondisk_log_start":"40'29845","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:25.087301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1956118528,"num_objects":29848,"num_object_clones":0,"num_object_copies":89544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29848,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29848,"num_write_kb":1910272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"40'29745","reported_seq":30051,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.598207+0000","last_change":"2026-02-23T13:04:14.687654+0000","last_active":"2026-02-23T13:04:21.598207+0000","last_peered":"2026-02-23T13:04:21.598207+0000","last_clean":"2026-02-23T13:04:21.598207+0000","last_became_active":"2026-02-23T13:03:08.712783+0000","last_became_peered":"2026-02-23T13:03:08.712783+0000","last_unstale":"2026-02-23T13:04:21.598207+0000","last_undegraded":"2026-02-23T13:04:21.598207+0000","last_fullsized":"2026-02-23T13:04:21.598207+0000","mapping_epoch":28,"log_start":"40'29740","ondisk_log_start":"40'29740","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'26930","last_scrub_stamp":"2026-02-23T13:04:14.687533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:14.687533+0000","objects_scrubbed":26390,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:29.989051+0000","scrub_duration":2902,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1949368320,"num_objects":29745,"num_object_clones":0,"num_object_copies":89235,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29745,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29745,"num_write_kb":1903680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"40'29661","reported_seq":29695,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.598754+0000","last_change":"2026-02-23T13:03:08.709181+0000","last_active":"2026-02-23T13:04:21.598754+0000","last_peered":"2026-02-23T13:04:21.598754+0000","last_clean":"2026-02-23T13:04:21.598754+0000","last_became_active":"2026-02-23T13:03:08.708821+0000","last_became_peered":"2026-02-23T13:03:08.708821+0000","last_unstale":"2026-02-23T13:04:21.598754+0000","last_undegraded":"2026-02-23T13:04:21.598754+0000","last_fullsized":"2026-02-23T13:04:21.598754+0000","mapping_epoch":28,"log_start":"40'29658","ondisk_log_start":"40'29658","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:22.653808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1943863296,"num_objects":29661,"num_object_clones":0,"num_object_copies":88983,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29661,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29661,"num_write_kb":1898304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"40'29620","reported_seq":29654,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.605648+0000","last_change":"2026-02-23T13:03:08.712493+0000","last_active":"2026-02-23T13:04:21.605648+0000","last_peered":"2026-02-23T13:04:21.605648+0000","last_clean":"2026-02-23T13:04:21.605648+0000","last_became_active":"2026-02-23T13:03:08.712152+0000","last_became_peered":"2026-02-23T13:03:08.712152+0000","last_unstale":"2026-02-23T13:04:21.605648+0000","last_undegraded":"2026-02-23T13:04:21.605648+0000","last_fullsized":"2026-02-23T13:04:21.605648+0000","mapping_epoch":28,"log_start":"40'29617","ondisk_log_start":"40'29617","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:33.900038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1941176320,"num_objects":29620,"num_object_clones":0,"num_object_copies":88860,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29620,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29620,"num_write_kb":1895680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"40'29510","reported_seq":29544,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.595158+0000","last_change":"2026-02-23T13:03:08.712205+0000","last_active":"2026-02-23T13:04:21.595158+0000","last_peered":"2026-02-23T13:04:21.595158+0000","last_clean":"2026-02-23T13:04:21.595158+0000","last_became_active":"2026-02-23T13:03:08.712055+0000","last_became_peered":"2026-02-23T13:03:08.712055+0000","last_unstale":"2026-02-23T13:04:21.595158+0000","last_undegraded":"2026-02-23T13:04:21.595158+0000","last_fullsized":"2026-02-23T13:04:21.595158+0000","mapping_epoch":28,"log_start":"40'29507","ondisk_log_start":"40'29507","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:37.263900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1933967360,"num_objects":29510,"num_object_clones":0,"num_object_copies":88530,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29510,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29510,"num_write_kb":1888640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"40'29786","reported_seq":29820,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.604971+0000","last_change":"2026-02-23T13:03:08.709028+0000","last_active":"2026-02-23T13:04:21.604971+0000","last_peered":"2026-02-23T13:04:21.604971+0000","last_clean":"2026-02-23T13:04:21.604971+0000","last_became_active":"2026-02-23T13:03:08.708852+0000","last_became_peered":"2026-02-23T13:03:08.708852+0000","last_unstale":"2026-02-23T13:04:21.604971+0000","last_undegraded":"2026-02-23T13:04:21.604971+0000","last_fullsized":"2026-02-23T13:04:21.604971+0000","mapping_epoch":28,"log_start":"40'29783","ondisk_log_start":"40'29783","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1952055296,"num_objects":29786,"num_object_clones":0,"num_object_copies":89358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29786,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29786,"num_write_kb":1906304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"40'29934","reported_seq":29968,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.595770+0000","last_change":"2026-02-23T13:03:08.708883+0000","last_active":"2026-02-23T13:04:21.595770+0000","last_peered":"2026-02-23T13:04:21.595770+0000","last_clean":"2026-02-23T13:04:21.595770+0000","last_became_active":"2026-02-23T13:03:08.708457+0000","last_became_peered":"2026-02-23T13:03:08.708457+0000","last_unstale":"2026-02-23T13:04:21.595770+0000","last_undegraded":"2026-02-23T13:04:21.595770+0000","last_fullsized":"2026-02-23T13:04:21.595770+0000","mapping_epoch":28,"log_start":"40'29931","ondisk_log_start":"40'29931","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:32.806938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1961754624,"num_objects":29934,"num_object_clones":0,"num_object_copies":89802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29934,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29934,"num_write_kb":1915776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"40'29781","reported_seq":29815,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.599543+0000","last_change":"2026-02-23T13:03:08.712176+0000","last_active":"2026-02-23T13:04:21.599543+0000","last_peered":"2026-02-23T13:04:21.599543+0000","last_clean":"2026-02-23T13:04:21.599543+0000","last_became_active":"2026-02-23T13:03:08.712010+0000","last_became_peered":"2026-02-23T13:03:08.712010+0000","last_unstale":"2026-02-23T13:04:21.599543+0000","last_undegraded":"2026-02-23T13:04:21.599543+0000","last_fullsized":"2026-02-23T13:04:21.599543+0000","mapping_epoch":28,"log_start":"40'29778","ondisk_log_start":"40'29778","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:29.753408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1951727616,"num_objects":29781,"num_object_clones":0,"num_object_copies":89343,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29781,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29781,"num_write_kb":1905984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"40'29559","reported_seq":29824,"reported_epoch":40,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:04:21.601400+0000","last_change":"2026-02-23T13:04:18.855737+0000","last_active":"2026-02-23T13:04:21.601400+0000","last_peered":"2026-02-23T13:04:21.601400+0000","last_clean":"2026-02-23T13:04:21.601400+0000","last_became_active":"2026-02-23T13:03:08.712763+0000","last_became_peered":"2026-02-23T13:03:08.712763+0000","last_unstale":"2026-02-23T13:04:21.601400+0000","last_undegraded":"2026-02-23T13:04:21.601400+0000","last_fullsized":"2026-02-23T13:04:21.601400+0000","mapping_epoch":28,"log_start":"40'29556","ondisk_log_start":"40'29556","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":22699,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 3s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1937178624,"num_objects":29559,"num_object_clones":0,"num_object_copies":88677,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29559,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29559,"num_write_kb":1891776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"40'29727","reported_seq":29761,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.594270+0000","last_change":"2026-02-23T13:03:08.709558+0000","last_active":"2026-02-23T13:04:21.594270+0000","last_peered":"2026-02-23T13:04:21.594270+0000","last_clean":"2026-02-23T13:04:21.594270+0000","last_became_active":"2026-02-23T13:03:08.709391+0000","last_became_peered":"2026-02-23T13:03:08.709391+0000","last_unstale":"2026-02-23T13:04:21.594270+0000","last_undegraded":"2026-02-23T13:04:21.594270+0000","last_fullsized":"2026-02-23T13:04:21.594270+0000","mapping_epoch":28,"log_start":"40'29724","ondisk_log_start":"40'29724","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:34.787615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1948188672,"num_objects":29727,"num_object_clones":0,"num_object_copies":89181,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29727,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29727,"num_write_kb":1902528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"40'29649","reported_seq":29683,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.596055+0000","last_change":"2026-02-23T13:03:08.711473+0000","last_active":"2026-02-23T13:04:21.596055+0000","last_peered":"2026-02-23T13:04:21.596055+0000","last_clean":"2026-02-23T13:04:21.596055+0000","last_became_active":"2026-02-23T13:03:08.711303+0000","last_became_peered":"2026-02-23T13:03:08.711303+0000","last_unstale":"2026-02-23T13:04:21.596055+0000","last_undegraded":"2026-02-23T13:04:21.596055+0000","last_fullsized":"2026-02-23T13:04:21.596055+0000","mapping_epoch":28,"log_start":"40'29646","ondisk_log_start":"40'29646","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:35.916414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1943076864,"num_objects":29649,"num_object_clones":0,"num_object_copies":88947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29649,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29649,"num_write_kb":1897536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":31188779008,"num_objects":475903,"num_object_clones":0,"num_object_copies":1427709,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":475903,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":475903,"num_write_kb":30457792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":93563977728,"data_stored":93563977728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":50,"ondisk_log_size":50,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247827,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28080020,"kb_used_data":26439552,"kb_used_omap":15,"kb_used_meta":1640432,"kb_avail":705923180,"statfs":{"total":751619276800,"available":722865336320,"internally_reserved":0,"allocated":27074101248,"data_stored":27073846953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15944,"internal_metadata":1679802808},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444054,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":22017940,"kb_used_data":20745664,"kb_used_omap":19,"kb_used_meta":1272236,"kb_avail":711985260,"statfs":{"total":751619276800,"available":729072906240,"internally_reserved":0,"allocated":21243559936,"data_stored":21243305641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19853,"internal_metadata":1302770291},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":24010500,"kb_used_data":22622832,"kb_used_omap":20,"kb_used_meta":1387627,"kb_avail":709992700,"statfs":{"total":751619276800,"available":727032524800,"internally_reserved":0,"allocated":23165779968,"data_stored":23165537104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20504,"internal_metadata":1420931048},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9,4,4,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705689,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":22005524,"kb_used_data":20733248,"kb_used_omap":23,"kb_used_meta":1272232,"kb_avail":711997676,"statfs":{"total":751619276800,"available":729085620224,"internally_reserved":0,"allocated":21230845952,"data_stored":21230591657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24410,"internal_metadata":1302765734},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21433155584,"data_stored":21433155584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23410573312,"data_stored":23410573312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21441216512,"data_stored":21441216512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":27279032320,"data_stored":27279032320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:04:23.309 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:04:23.446 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:23.656 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:23.654+0000 7f559025b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:23.656 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:23.655+0000 7f559025b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:23.752 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:04:23.790 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:04:23.790 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:04:23.803 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 74 16 488500 488484 412.536 344.125 0.00158728 0.00242284 2026-02-23T13:04:23.837 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2026-02-23T13:04:22.804788+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":31189369376,"num_objects":475905,"num_object_clones":0,"num_object_copies":1427715,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":475905,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":476038,"num_write_kb":30459942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53,"ondisk_log_size":53,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":96113984,"kb_used_data":90541296,"kb_used_omap":78,"kb_used_meta":5572529,"kb_avail":2839898816,"statfs":{"total":3006477107200,"available":2908056387584,"internally_reserved":0,"allocated":92714287104,"data_stored":92713281355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":80711,"internal_metadata":5706269881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,6,4,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2063663104,"num_objects":31489,"num_object_clones":0,"num_object_copies":94467,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31489,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31489,"num_write_kb":2015296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.204208"},"pg_stats":[{"pgid":"2.f","version":"40'29763","reported_seq":29797,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.595832+0000","last_change":"2026-02-23T13:03:08.711612+0000","last_active":"2026-02-23T13:04:21.595832+0000","last_peered":"2026-02-23T13:04:21.595832+0000","last_clean":"2026-02-23T13:04:21.595832+0000","last_became_active":"2026-02-23T13:03:08.711408+0000","last_became_peered":"2026-02-23T13:03:08.711408+0000","last_unstale":"2026-02-23T13:04:21.595832+0000","last_undegraded":"2026-02-23T13:04:21.595832+0000","last_fullsized":"2026-02-23T13:04:21.595832+0000","mapping_epoch":28,"log_start":"40'29760","ondisk_log_start":"40'29760","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1950547968,"num_objects":29763,"num_object_clones":0,"num_object_copies":89289,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29763,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29763,"num_write_kb":1904832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"40'30027","reported_seq":30061,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.599230+0000","last_change":"2026-02-23T13:03:08.711629+0000","last_active":"2026-02-23T13:04:21.599230+0000","last_peered":"2026-02-23T13:04:21.599230+0000","last_clean":"2026-02-23T13:04:21.599230+0000","last_became_active":"2026-02-23T13:03:08.711462+0000","last_became_peered":"2026-02-23T13:03:08.711462+0000","last_unstale":"2026-02-23T13:04:21.599230+0000","last_undegraded":"2026-02-23T13:04:21.599230+0000","last_fullsized":"2026-02-23T13:04:21.599230+0000","mapping_epoch":28,"log_start":"40'30024","ondisk_log_start":"40'30024","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:35.369081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1967849472,"num_objects":30027,"num_object_clones":0,"num_object_copies":90081,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30027,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30027,"num_write_kb":1921728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"40'29689","reported_seq":29723,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.603330+0000","last_change":"2026-02-23T13:03:08.712615+0000","last_active":"2026-02-23T13:04:21.603330+0000","last_peered":"2026-02-23T13:04:21.603330+0000","last_clean":"2026-02-23T13:04:21.603330+0000","last_became_active":"2026-02-23T13:03:08.712246+0000","last_became_peered":"2026-02-23T13:03:08.712246+0000","last_unstale":"2026-02-23T13:04:21.603330+0000","last_undegraded":"2026-02-23T13:04:21.603330+0000","last_fullsized":"2026-02-23T13:04:21.603330+0000","mapping_epoch":28,"log_start":"40'29686","ondisk_log_start":"40'29686","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:26.869038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1945698304,"num_objects":29689,"num_object_clones":0,"num_object_copies":89067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29689,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29689,"num_write_kb":1900096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"40'29883","reported_seq":29917,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.607381+0000","last_change":"2026-02-23T13:03:08.712832+0000","last_active":"2026-02-23T13:04:21.607381+0000","last_peered":"2026-02-23T13:04:21.607381+0000","last_clean":"2026-02-23T13:04:21.607381+0000","last_became_active":"2026-02-23T13:03:08.712348+0000","last_became_peered":"2026-02-23T13:03:08.712348+0000","last_unstale":"2026-02-23T13:04:21.607381+0000","last_undegraded":"2026-02-23T13:04:21.607381+0000","last_fullsized":"2026-02-23T13:04:21.607381+0000","mapping_epoch":28,"log_start":"40'29880","ondisk_log_start":"40'29880","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:23.478567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1958412288,"num_objects":29883,"num_object_clones":0,"num_object_copies":89649,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29883,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29883,"num_write_kb":1912512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":216,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:20.802549+0000","last_change":"2026-02-23T13:04:08.199097+0000","last_active":"2026-02-23T13:04:20.802549+0000","last_peered":"2026-02-23T13:04:20.802549+0000","last_clean":"2026-02-23T13:04:20.802549+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:04:20.802549+0000","last_undegraded":"2026-02-23T13:04:20.802549+0000","last_fullsized":"2026-02-23T13:04:20.802549+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:04:08.199036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:04:08.199036+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:23.231335+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"40'29721","reported_seq":30032,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.595707+0000","last_change":"2026-02-23T13:04:15.649890+0000","last_active":"2026-02-23T13:04:21.595707+0000","last_peered":"2026-02-23T13:04:21.595707+0000","last_clean":"2026-02-23T13:04:21.595707+0000","last_became_active":"2026-02-23T13:03:08.708695+0000","last_became_peered":"2026-02-23T13:03:08.708695+0000","last_unstale":"2026-02-23T13:04:21.595707+0000","last_undegraded":"2026-02-23T13:04:21.595707+0000","last_fullsized":"2026-02-23T13:04:21.595707+0000","mapping_epoch":28,"log_start":"40'29718","ondisk_log_start":"40'29718","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'27365","last_scrub_stamp":"2026-02-23T13:04:15.649815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:15.649815+0000","objects_scrubbed":26902,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:16.658945+0000","scrub_duration":2575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1947795456,"num_objects":29721,"num_object_clones":0,"num_object_copies":89163,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29721,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29721,"num_write_kb":1902144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"40'29848","reported_seq":29881,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.598796+0000","last_change":"2026-02-23T13:03:08.712038+0000","last_active":"2026-02-23T13:04:21.598796+0000","last_peered":"2026-02-23T13:04:21.598796+0000","last_clean":"2026-02-23T13:04:21.598796+0000","last_became_active":"2026-02-23T13:03:08.711847+0000","last_became_peered":"2026-02-23T13:03:08.711847+0000","last_unstale":"2026-02-23T13:04:21.598796+0000","last_undegraded":"2026-02-23T13:04:21.598796+0000","last_fullsized":"2026-02-23T13:04:21.598796+0000","mapping_epoch":28,"log_start":"40'29845","ondisk_log_start":"40'29845","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:25.087301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1956118528,"num_objects":29848,"num_object_clones":0,"num_object_copies":89544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29848,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29848,"num_write_kb":1910272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"40'29745","reported_seq":30051,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.598207+0000","last_change":"2026-02-23T13:04:14.687654+0000","last_active":"2026-02-23T13:04:21.598207+0000","last_peered":"2026-02-23T13:04:21.598207+0000","last_clean":"2026-02-23T13:04:21.598207+0000","last_became_active":"2026-02-23T13:03:08.712783+0000","last_became_peered":"2026-02-23T13:03:08.712783+0000","last_unstale":"2026-02-23T13:04:21.598207+0000","last_undegraded":"2026-02-23T13:04:21.598207+0000","last_fullsized":"2026-02-23T13:04:21.598207+0000","mapping_epoch":28,"log_start":"40'29740","ondisk_log_start":"40'29740","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'26930","last_scrub_stamp":"2026-02-23T13:04:14.687533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:14.687533+0000","objects_scrubbed":26390,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:29.989051+0000","scrub_duration":2902,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1949368320,"num_objects":29745,"num_object_clones":0,"num_object_copies":89235,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29745,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29745,"num_write_kb":1903680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"40'29661","reported_seq":29695,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.598754+0000","last_change":"2026-02-23T13:03:08.709181+0000","last_active":"2026-02-23T13:04:21.598754+0000","last_peered":"2026-02-23T13:04:21.598754+0000","last_clean":"2026-02-23T13:04:21.598754+0000","last_became_active":"2026-02-23T13:03:08.708821+0000","last_became_peered":"2026-02-23T13:03:08.708821+0000","last_unstale":"2026-02-23T13:04:21.598754+0000","last_undegraded":"2026-02-23T13:04:21.598754+0000","last_fullsized":"2026-02-23T13:04:21.598754+0000","mapping_epoch":28,"log_start":"40'29658","ondisk_log_start":"40'29658","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:22.653808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1943863296,"num_objects":29661,"num_object_clones":0,"num_object_copies":88983,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29661,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29661,"num_write_kb":1898304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"40'29620","reported_seq":29654,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.605648+0000","last_change":"2026-02-23T13:03:08.712493+0000","last_active":"2026-02-23T13:04:21.605648+0000","last_peered":"2026-02-23T13:04:21.605648+0000","last_clean":"2026-02-23T13:04:21.605648+0000","last_became_active":"2026-02-23T13:03:08.712152+0000","last_became_peered":"2026-02-23T13:03:08.712152+0000","last_unstale":"2026-02-23T13:04:21.605648+0000","last_undegraded":"2026-02-23T13:04:21.605648+0000","last_fullsized":"2026-02-23T13:04:21.605648+0000","mapping_epoch":28,"log_start":"40'29617","ondisk_log_start":"40'29617","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:33.900038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1941176320,"num_objects":29620,"num_object_clones":0,"num_object_copies":88860,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29620,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29620,"num_write_kb":1895680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"40'29510","reported_seq":29544,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.595158+0000","last_change":"2026-02-23T13:03:08.712205+0000","last_active":"2026-02-23T13:04:21.595158+0000","last_peered":"2026-02-23T13:04:21.595158+0000","last_clean":"2026-02-23T13:04:21.595158+0000","last_became_active":"2026-02-23T13:03:08.712055+0000","last_became_peered":"2026-02-23T13:03:08.712055+0000","last_unstale":"2026-02-23T13:04:21.595158+0000","last_undegraded":"2026-02-23T13:04:21.595158+0000","last_fullsized":"2026-02-23T13:04:21.595158+0000","mapping_epoch":28,"log_start":"40'29507","ondisk_log_start":"40'29507","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:37.263900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1933967360,"num_objects":29510,"num_object_clones":0,"num_object_copies":88530,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29510,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29510,"num_write_kb":1888640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"40'29786","reported_seq":29820,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.604971+0000","last_change":"2026-02-23T13:03:08.709028+0000","last_active":"2026-02-23T13:04:21.604971+0000","last_peered":"2026-02-23T13:04:21.604971+0000","last_clean":"2026-02-23T13:04:21.604971+0000","last_became_active":"2026-02-23T13:03:08.708852+0000","last_became_peered":"2026-02-23T13:03:08.708852+0000","last_unstale":"2026-02-23T13:04:21.604971+0000","last_undegraded":"2026-02-23T13:04:21.604971+0000","last_fullsized":"2026-02-23T13:04:21.604971+0000","mapping_epoch":28,"log_start":"40'29783","ondisk_log_start":"40'29783","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1952055296,"num_objects":29786,"num_object_clones":0,"num_object_copies":89358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29786,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29786,"num_write_kb":1906304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"40'29934","reported_seq":29968,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.595770+0000","last_change":"2026-02-23T13:03:08.708883+0000","last_active":"2026-02-23T13:04:21.595770+0000","last_peered":"2026-02-23T13:04:21.595770+0000","last_clean":"2026-02-23T13:04:21.595770+0000","last_became_active":"2026-02-23T13:03:08.708457+0000","last_became_peered":"2026-02-23T13:03:08.708457+0000","last_unstale":"2026-02-23T13:04:21.595770+0000","last_undegraded":"2026-02-23T13:04:21.595770+0000","last_fullsized":"2026-02-23T13:04:21.595770+0000","mapping_epoch":28,"log_start":"40'29931","ondisk_log_start":"40'29931","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:32.806938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1961754624,"num_objects":29934,"num_object_clones":0,"num_object_copies":89802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29934,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29934,"num_write_kb":1915776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"40'29781","reported_seq":29815,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.599543+0000","last_change":"2026-02-23T13:03:08.712176+0000","last_active":"2026-02-23T13:04:21.599543+0000","last_peered":"2026-02-23T13:04:21.599543+0000","last_clean":"2026-02-23T13:04:21.599543+0000","last_became_active":"2026-02-23T13:03:08.712010+0000","last_became_peered":"2026-02-23T13:03:08.712010+0000","last_unstale":"2026-02-23T13:04:21.599543+0000","last_undegraded":"2026-02-23T13:04:21.599543+0000","last_fullsized":"2026-02-23T13:04:21.599543+0000","mapping_epoch":28,"log_start":"40'29778","ondisk_log_start":"40'29778","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:29.753408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1951727616,"num_objects":29781,"num_object_clones":0,"num_object_copies":89343,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29781,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29781,"num_write_kb":1905984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"40'29559","reported_seq":29824,"reported_epoch":40,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:04:21.601400+0000","last_change":"2026-02-23T13:04:18.855737+0000","last_active":"2026-02-23T13:04:21.601400+0000","last_peered":"2026-02-23T13:04:21.601400+0000","last_clean":"2026-02-23T13:04:21.601400+0000","last_became_active":"2026-02-23T13:03:08.712763+0000","last_became_peered":"2026-02-23T13:03:08.712763+0000","last_unstale":"2026-02-23T13:04:21.601400+0000","last_undegraded":"2026-02-23T13:04:21.601400+0000","last_fullsized":"2026-02-23T13:04:21.601400+0000","mapping_epoch":28,"log_start":"40'29556","ondisk_log_start":"40'29556","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":22699,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 3s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1937178624,"num_objects":29559,"num_object_clones":0,"num_object_copies":88677,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29559,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29559,"num_write_kb":1891776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"40'29727","reported_seq":29761,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.594270+0000","last_change":"2026-02-23T13:03:08.709558+0000","last_active":"2026-02-23T13:04:21.594270+0000","last_peered":"2026-02-23T13:04:21.594270+0000","last_clean":"2026-02-23T13:04:21.594270+0000","last_became_active":"2026-02-23T13:03:08.709391+0000","last_became_peered":"2026-02-23T13:03:08.709391+0000","last_unstale":"2026-02-23T13:04:21.594270+0000","last_undegraded":"2026-02-23T13:04:21.594270+0000","last_fullsized":"2026-02-23T13:04:21.594270+0000","mapping_epoch":28,"log_start":"40'29724","ondisk_log_start":"40'29724","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:34.787615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1948188672,"num_objects":29727,"num_object_clones":0,"num_object_copies":89181,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29727,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29727,"num_write_kb":1902528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"40'29649","reported_seq":29683,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.596055+0000","last_change":"2026-02-23T13:03:08.711473+0000","last_active":"2026-02-23T13:04:21.596055+0000","last_peered":"2026-02-23T13:04:21.596055+0000","last_clean":"2026-02-23T13:04:21.596055+0000","last_became_active":"2026-02-23T13:03:08.711303+0000","last_became_peered":"2026-02-23T13:03:08.711303+0000","last_unstale":"2026-02-23T13:04:21.596055+0000","last_undegraded":"2026-02-23T13:04:21.596055+0000","last_fullsized":"2026-02-23T13:04:21.596055+0000","mapping_epoch":28,"log_start":"40'29646","ondisk_log_start":"40'29646","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:35.916414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1943076864,"num_objects":29649,"num_object_clones":0,"num_object_copies":88947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29649,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29649,"num_write_kb":1897536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":31188779008,"num_objects":475903,"num_object_clones":0,"num_object_copies":1427709,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":475903,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":475903,"num_write_kb":30457792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":93563977728,"data_stored":93563977728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":50,"ondisk_log_size":50,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247827,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28080020,"kb_used_data":26439552,"kb_used_omap":15,"kb_used_meta":1640432,"kb_avail":705923180,"statfs":{"total":751619276800,"available":722865336320,"internally_reserved":0,"allocated":27074101248,"data_stored":27073846953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15944,"internal_metadata":1679802808},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444054,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":22017940,"kb_used_data":20745664,"kb_used_omap":19,"kb_used_meta":1272236,"kb_avail":711985260,"statfs":{"total":751619276800,"available":729072906240,"internally_reserved":0,"allocated":21243559936,"data_stored":21243305641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19853,"internal_metadata":1302770291},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":24010500,"kb_used_data":22622832,"kb_used_omap":20,"kb_used_meta":1387627,"kb_avail":709992700,"statfs":{"total":751619276800,"available":727032524800,"internally_reserved":0,"allocated":23165779968,"data_stored":23165537104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20504,"internal_metadata":1420931048},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9,4,4,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705689,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":22005524,"kb_used_data":20733248,"kb_used_omap":23,"kb_used_meta":1272232,"kb_avail":711997676,"statfs":{"total":751619276800,"available":729085620224,"internally_reserved":0,"allocated":21230845952,"data_stored":21230591657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24410,"internal_metadata":1302765734},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21433155584,"data_stored":21433155584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23410573312,"data_stored":23410573312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21441216512,"data_stored":21441216512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":27279032320,"data_stored":27279032320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:04:23.839 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-23T13:04:23.839 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:04:23.839 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_0 2026-02-23T13:04:23.840 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:04:23.891 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:23.903 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:23 trial046 ceph-mon[38575]: pgmap v58: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 29 GiB data, 92 GiB used, 2.6 TiB / 2.7 TiB avail; 492 MiB/s wr, 7.87k op/s 2026-02-23T13:04:23.903 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:23 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4016212206' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-23T13:04:23.903 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:23 trial046 ceph-mon[38575]: osdmap e42: 4 total, 4 up, 4 in 2026-02-23T13:04:23.904 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:23 trial046 ceph-mon[38575]: 2.2 scrub starts 2026-02-23T13:04:23.904 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:23 trial046 ceph-mon[38575]: from='client.14474 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:04:23.904 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:23 trial046 ceph-mon[38575]: from='client.14476 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:04:24.016 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:24.015+0000 7fe0dc45f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:24.016 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:24.016+0000 7fe0dc45f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:24.019 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:24.032 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:04:24.032 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:04:24.046 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:04:24.046 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:04:24.059 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:04:24.060 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:04:24.073 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:04:24.073 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:04:24.136 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:24.135+0000 7fccad969640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:24.136 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:24.135+0000 7fccad969640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:24.270 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:04:24.270 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:04:24.318 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2026-02-23T13:04:22.804788+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":31189369376,"num_objects":475905,"num_object_clones":0,"num_object_copies":1427715,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":475905,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":476038,"num_write_kb":30459942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53,"ondisk_log_size":53,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":96113984,"kb_used_data":90541296,"kb_used_omap":78,"kb_used_meta":5572529,"kb_avail":2839898816,"statfs":{"total":3006477107200,"available":2908056387584,"internally_reserved":0,"allocated":92714287104,"data_stored":92713281355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":80711,"internal_metadata":5706269881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,6,4,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2063663104,"num_objects":31489,"num_object_clones":0,"num_object_copies":94467,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31489,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31489,"num_write_kb":2015296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.204208"},"pg_stats":[{"pgid":"2.f","version":"40'29763","reported_seq":29797,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.595832+0000","last_change":"2026-02-23T13:03:08.711612+0000","last_active":"2026-02-23T13:04:21.595832+0000","last_peered":"2026-02-23T13:04:21.595832+0000","last_clean":"2026-02-23T13:04:21.595832+0000","last_became_active":"2026-02-23T13:03:08.711408+0000","last_became_peered":"2026-02-23T13:03:08.711408+0000","last_unstale":"2026-02-23T13:04:21.595832+0000","last_undegraded":"2026-02-23T13:04:21.595832+0000","last_fullsized":"2026-02-23T13:04:21.595832+0000","mapping_epoch":28,"log_start":"40'29760","ondisk_log_start":"40'29760","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1950547968,"num_objects":29763,"num_object_clones":0,"num_object_copies":89289,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29763,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29763,"num_write_kb":1904832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"40'30027","reported_seq":30061,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.599230+0000","last_change":"2026-02-23T13:03:08.711629+0000","last_active":"2026-02-23T13:04:21.599230+0000","last_peered":"2026-02-23T13:04:21.599230+0000","last_clean":"2026-02-23T13:04:21.599230+0000","last_became_active":"2026-02-23T13:03:08.711462+0000","last_became_peered":"2026-02-23T13:03:08.711462+0000","last_unstale":"2026-02-23T13:04:21.599230+0000","last_undegraded":"2026-02-23T13:04:21.599230+0000","last_fullsized":"2026-02-23T13:04:21.599230+0000","mapping_epoch":28,"log_start":"40'30024","ondisk_log_start":"40'30024","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:35.369081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1967849472,"num_objects":30027,"num_object_clones":0,"num_object_copies":90081,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30027,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30027,"num_write_kb":1921728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"40'29689","reported_seq":29723,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.603330+0000","last_change":"2026-02-23T13:03:08.712615+0000","last_active":"2026-02-23T13:04:21.603330+0000","last_peered":"2026-02-23T13:04:21.603330+0000","last_clean":"2026-02-23T13:04:21.603330+0000","last_became_active":"2026-02-23T13:03:08.712246+0000","last_became_peered":"2026-02-23T13:03:08.712246+0000","last_unstale":"2026-02-23T13:04:21.603330+0000","last_undegraded":"2026-02-23T13:04:21.603330+0000","last_fullsized":"2026-02-23T13:04:21.603330+0000","mapping_epoch":28,"log_start":"40'29686","ondisk_log_start":"40'29686","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:26.869038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1945698304,"num_objects":29689,"num_object_clones":0,"num_object_copies":89067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29689,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29689,"num_write_kb":1900096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"40'29883","reported_seq":29917,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.607381+0000","last_change":"2026-02-23T13:03:08.712832+0000","last_active":"2026-02-23T13:04:21.607381+0000","last_peered":"2026-02-23T13:04:21.607381+0000","last_clean":"2026-02-23T13:04:21.607381+0000","last_became_active":"2026-02-23T13:03:08.712348+0000","last_became_peered":"2026-02-23T13:03:08.712348+0000","last_unstale":"2026-02-23T13:04:21.607381+0000","last_undegraded":"2026-02-23T13:04:21.607381+0000","last_fullsized":"2026-02-23T13:04:21.607381+0000","mapping_epoch":28,"log_start":"40'29880","ondisk_log_start":"40'29880","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:23.478567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1958412288,"num_objects":29883,"num_object_clones":0,"num_object_copies":89649,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29883,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29883,"num_write_kb":1912512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":216,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:20.802549+0000","last_change":"2026-02-23T13:04:08.199097+0000","last_active":"2026-02-23T13:04:20.802549+0000","last_peered":"2026-02-23T13:04:20.802549+0000","last_clean":"2026-02-23T13:04:20.802549+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:04:20.802549+0000","last_undegraded":"2026-02-23T13:04:20.802549+0000","last_fullsized":"2026-02-23T13:04:20.802549+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:04:08.199036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:04:08.199036+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:23.231335+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"40'29721","reported_seq":30032,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.595707+0000","last_change":"2026-02-23T13:04:15.649890+0000","last_active":"2026-02-23T13:04:21.595707+0000","last_peered":"2026-02-23T13:04:21.595707+0000","last_clean":"2026-02-23T13:04:21.595707+0000","last_became_active":"2026-02-23T13:03:08.708695+0000","last_became_peered":"2026-02-23T13:03:08.708695+0000","last_unstale":"2026-02-23T13:04:21.595707+0000","last_undegraded":"2026-02-23T13:04:21.595707+0000","last_fullsized":"2026-02-23T13:04:21.595707+0000","mapping_epoch":28,"log_start":"40'29718","ondisk_log_start":"40'29718","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'27365","last_scrub_stamp":"2026-02-23T13:04:15.649815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:15.649815+0000","objects_scrubbed":26902,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:16.658945+0000","scrub_duration":2575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1947795456,"num_objects":29721,"num_object_clones":0,"num_object_copies":89163,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29721,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29721,"num_write_kb":1902144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"40'29848","reported_seq":29881,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.598796+0000","last_change":"2026-02-23T13:03:08.712038+0000","last_active":"2026-02-23T13:04:21.598796+0000","last_peered":"2026-02-23T13:04:21.598796+0000","last_clean":"2026-02-23T13:04:21.598796+0000","last_became_active":"2026-02-23T13:03:08.711847+0000","last_became_peered":"2026-02-23T13:03:08.711847+0000","last_unstale":"2026-02-23T13:04:21.598796+0000","last_undegraded":"2026-02-23T13:04:21.598796+0000","last_fullsized":"2026-02-23T13:04:21.598796+0000","mapping_epoch":28,"log_start":"40'29845","ondisk_log_start":"40'29845","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:25.087301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1956118528,"num_objects":29848,"num_object_clones":0,"num_object_copies":89544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29848,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29848,"num_write_kb":1910272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"40'29745","reported_seq":30051,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.598207+0000","last_change":"2026-02-23T13:04:14.687654+0000","last_active":"2026-02-23T13:04:21.598207+0000","last_peered":"2026-02-23T13:04:21.598207+0000","last_clean":"2026-02-23T13:04:21.598207+0000","last_became_active":"2026-02-23T13:03:08.712783+0000","last_became_peered":"2026-02-23T13:03:08.712783+0000","last_unstale":"2026-02-23T13:04:21.598207+0000","last_undegraded":"2026-02-23T13:04:21.598207+0000","last_fullsized":"2026-02-23T13:04:21.598207+0000","mapping_epoch":28,"log_start":"40'29740","ondisk_log_start":"40'29740","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'26930","last_scrub_stamp":"2026-02-23T13:04:14.687533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:14.687533+0000","objects_scrubbed":26390,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:29.989051+0000","scrub_duration":2902,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1949368320,"num_objects":29745,"num_object_clones":0,"num_object_copies":89235,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29745,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29745,"num_write_kb":1903680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"40'29661","reported_seq":29695,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.598754+0000","last_change":"2026-02-23T13:03:08.709181+0000","last_active":"2026-02-23T13:04:21.598754+0000","last_peered":"2026-02-23T13:04:21.598754+0000","last_clean":"2026-02-23T13:04:21.598754+0000","last_became_active":"2026-02-23T13:03:08.708821+0000","last_became_peered":"2026-02-23T13:03:08.708821+0000","last_unstale":"2026-02-23T13:04:21.598754+0000","last_undegraded":"2026-02-23T13:04:21.598754+0000","last_fullsized":"2026-02-23T13:04:21.598754+0000","mapping_epoch":28,"log_start":"40'29658","ondisk_log_start":"40'29658","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:22.653808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1943863296,"num_objects":29661,"num_object_clones":0,"num_object_copies":88983,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29661,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29661,"num_write_kb":1898304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"40'29620","reported_seq":29654,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.605648+0000","last_change":"2026-02-23T13:03:08.712493+0000","last_active":"2026-02-23T13:04:21.605648+0000","last_peered":"2026-02-23T13:04:21.605648+0000","last_clean":"2026-02-23T13:04:21.605648+0000","last_became_active":"2026-02-23T13:03:08.712152+0000","last_became_peered":"2026-02-23T13:03:08.712152+0000","last_unstale":"2026-02-23T13:04:21.605648+0000","last_undegraded":"2026-02-23T13:04:21.605648+0000","last_fullsized":"2026-02-23T13:04:21.605648+0000","mapping_epoch":28,"log_start":"40'29617","ondisk_log_start":"40'29617","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:33.900038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1941176320,"num_objects":29620,"num_object_clones":0,"num_object_copies":88860,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29620,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29620,"num_write_kb":1895680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"40'29510","reported_seq":29544,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.595158+0000","last_change":"2026-02-23T13:03:08.712205+0000","last_active":"2026-02-23T13:04:21.595158+0000","last_peered":"2026-02-23T13:04:21.595158+0000","last_clean":"2026-02-23T13:04:21.595158+0000","last_became_active":"2026-02-23T13:03:08.712055+0000","last_became_peered":"2026-02-23T13:03:08.712055+0000","last_unstale":"2026-02-23T13:04:21.595158+0000","last_undegraded":"2026-02-23T13:04:21.595158+0000","last_fullsized":"2026-02-23T13:04:21.595158+0000","mapping_epoch":28,"log_start":"40'29507","ondisk_log_start":"40'29507","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:37.263900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1933967360,"num_objects":29510,"num_object_clones":0,"num_object_copies":88530,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29510,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29510,"num_write_kb":1888640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"40'29786","reported_seq":29820,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.604971+0000","last_change":"2026-02-23T13:03:08.709028+0000","last_active":"2026-02-23T13:04:21.604971+0000","last_peered":"2026-02-23T13:04:21.604971+0000","last_clean":"2026-02-23T13:04:21.604971+0000","last_became_active":"2026-02-23T13:03:08.708852+0000","last_became_peered":"2026-02-23T13:03:08.708852+0000","last_unstale":"2026-02-23T13:04:21.604971+0000","last_undegraded":"2026-02-23T13:04:21.604971+0000","last_fullsized":"2026-02-23T13:04:21.604971+0000","mapping_epoch":28,"log_start":"40'29783","ondisk_log_start":"40'29783","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1952055296,"num_objects":29786,"num_object_clones":0,"num_object_copies":89358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29786,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29786,"num_write_kb":1906304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"40'29934","reported_seq":29968,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.595770+0000","last_change":"2026-02-23T13:03:08.708883+0000","last_active":"2026-02-23T13:04:21.595770+0000","last_peered":"2026-02-23T13:04:21.595770+0000","last_clean":"2026-02-23T13:04:21.595770+0000","last_became_active":"2026-02-23T13:03:08.708457+0000","last_became_peered":"2026-02-23T13:03:08.708457+0000","last_unstale":"2026-02-23T13:04:21.595770+0000","last_undegraded":"2026-02-23T13:04:21.595770+0000","last_fullsized":"2026-02-23T13:04:21.595770+0000","mapping_epoch":28,"log_start":"40'29931","ondisk_log_start":"40'29931","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:32.806938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1961754624,"num_objects":29934,"num_object_clones":0,"num_object_copies":89802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29934,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29934,"num_write_kb":1915776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"40'29781","reported_seq":29815,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.599543+0000","last_change":"2026-02-23T13:03:08.712176+0000","last_active":"2026-02-23T13:04:21.599543+0000","last_peered":"2026-02-23T13:04:21.599543+0000","last_clean":"2026-02-23T13:04:21.599543+0000","last_became_active":"2026-02-23T13:03:08.712010+0000","last_became_peered":"2026-02-23T13:03:08.712010+0000","last_unstale":"2026-02-23T13:04:21.599543+0000","last_undegraded":"2026-02-23T13:04:21.599543+0000","last_fullsized":"2026-02-23T13:04:21.599543+0000","mapping_epoch":28,"log_start":"40'29778","ondisk_log_start":"40'29778","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:29.753408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1951727616,"num_objects":29781,"num_object_clones":0,"num_object_copies":89343,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29781,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29781,"num_write_kb":1905984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"40'29559","reported_seq":29824,"reported_epoch":40,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:04:21.601400+0000","last_change":"2026-02-23T13:04:18.855737+0000","last_active":"2026-02-23T13:04:21.601400+0000","last_peered":"2026-02-23T13:04:21.601400+0000","last_clean":"2026-02-23T13:04:21.601400+0000","last_became_active":"2026-02-23T13:03:08.712763+0000","last_became_peered":"2026-02-23T13:03:08.712763+0000","last_unstale":"2026-02-23T13:04:21.601400+0000","last_undegraded":"2026-02-23T13:04:21.601400+0000","last_fullsized":"2026-02-23T13:04:21.601400+0000","mapping_epoch":28,"log_start":"40'29556","ondisk_log_start":"40'29556","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":22699,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 3s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1937178624,"num_objects":29559,"num_object_clones":0,"num_object_copies":88677,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29559,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29559,"num_write_kb":1891776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"40'29727","reported_seq":29761,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.594270+0000","last_change":"2026-02-23T13:03:08.709558+0000","last_active":"2026-02-23T13:04:21.594270+0000","last_peered":"2026-02-23T13:04:21.594270+0000","last_clean":"2026-02-23T13:04:21.594270+0000","last_became_active":"2026-02-23T13:03:08.709391+0000","last_became_peered":"2026-02-23T13:03:08.709391+0000","last_unstale":"2026-02-23T13:04:21.594270+0000","last_undegraded":"2026-02-23T13:04:21.594270+0000","last_fullsized":"2026-02-23T13:04:21.594270+0000","mapping_epoch":28,"log_start":"40'29724","ondisk_log_start":"40'29724","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:34.787615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1948188672,"num_objects":29727,"num_object_clones":0,"num_object_copies":89181,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29727,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29727,"num_write_kb":1902528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"40'29649","reported_seq":29683,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-23T13:04:21.596055+0000","last_change":"2026-02-23T13:03:08.711473+0000","last_active":"2026-02-23T13:04:21.596055+0000","last_peered":"2026-02-23T13:04:21.596055+0000","last_clean":"2026-02-23T13:04:21.596055+0000","last_became_active":"2026-02-23T13:03:08.711303+0000","last_became_peered":"2026-02-23T13:03:08.711303+0000","last_unstale":"2026-02-23T13:04:21.596055+0000","last_undegraded":"2026-02-23T13:04:21.596055+0000","last_fullsized":"2026-02-23T13:04:21.596055+0000","mapping_epoch":28,"log_start":"40'29646","ondisk_log_start":"40'29646","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:35.916414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1943076864,"num_objects":29649,"num_object_clones":0,"num_object_copies":88947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29649,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29649,"num_write_kb":1897536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":31188779008,"num_objects":475903,"num_object_clones":0,"num_object_copies":1427709,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":475903,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":475903,"num_write_kb":30457792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":93563977728,"data_stored":93563977728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":50,"ondisk_log_size":50,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247827,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28080020,"kb_used_data":26439552,"kb_used_omap":15,"kb_used_meta":1640432,"kb_avail":705923180,"statfs":{"total":751619276800,"available":722865336320,"internally_reserved":0,"allocated":27074101248,"data_stored":27073846953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15944,"internal_metadata":1679802808},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444054,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":22017940,"kb_used_data":20745664,"kb_used_omap":19,"kb_used_meta":1272236,"kb_avail":711985260,"statfs":{"total":751619276800,"available":729072906240,"internally_reserved":0,"allocated":21243559936,"data_stored":21243305641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19853,"internal_metadata":1302770291},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":24010500,"kb_used_data":22622832,"kb_used_omap":20,"kb_used_meta":1387627,"kb_avail":709992700,"statfs":{"total":751619276800,"available":727032524800,"internally_reserved":0,"allocated":23165779968,"data_stored":23165537104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20504,"internal_metadata":1420931048},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9,4,4,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705689,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":22005524,"kb_used_data":20733248,"kb_used_omap":23,"kb_used_meta":1272232,"kb_avail":711997676,"statfs":{"total":751619276800,"available":729085620224,"internally_reserved":0,"allocated":21230845952,"data_stored":21230591657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24410,"internal_metadata":1302765734},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21433155584,"data_stored":21433155584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23410573312,"data_stored":23410573312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21441216512,"data_stored":21441216512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":27279032320,"data_stored":27279032320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:04:24.319 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:04:24.319 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_0 pg_num 46 2026-02-23T13:04:24.495 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:24.626 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:24.626+0000 7f21555ef640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:24.626 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:24.626+0000 7f21555ef640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:24.757 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:04:24.796 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:04:24.803 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 75 16 493133 493117 410.896 289.562 0.00720767 0.00243248 2026-02-23T13:04:25.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:24 trial046 ceph-mon[38575]: 2.c scrub starts 2026-02-23T13:04:25.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:24 trial046 ceph-mon[38575]: 2.f scrub starts 2026-02-23T13:04:25.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:24 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4049586276' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:04:25.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:24 trial046 ceph-mon[38575]: from='client.14480 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:04:25.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:24 trial046 ceph-mon[38575]: pgmap v60: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 29 GiB data, 92 GiB used, 2.6 TiB / 2.7 TiB avail; 410 MiB/s wr, 6.55k op/s 2026-02-23T13:04:25.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:24 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3523843983' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_0", "var": "pg_num", "val": "46"} : dispatch 2026-02-23T13:04:25.803 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 76 16 498075 498059 409.553 308.875 0.00271734 0.00244051 2026-02-23T13:04:26.088 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:25 trial046 ceph-mon[38575]: 2.6 scrub ok 2026-02-23T13:04:26.117 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:04:26.260 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:26.379 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:04:26 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:04:26] "GET /metrics HTTP/1.1" 200 4204 "" "Prometheus/3.6.0" 2026-02-23T13:04:26.561 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:04:26 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:04:26.087Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:04:26.688 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:26.687+0000 7fb714268640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:26.689 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:26.687+0000 7fb714268640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:26.703 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:04:26.703 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:04:26.716 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:04:26.716 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:04:26.728 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:04:26.728 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:04:26.741 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:04:26.741 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:04:26.803 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 77 16 503739 503723 408.831 354 0.00209092 0.00244482 2026-02-23T13:04:27.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:26 trial046 ceph-mon[38575]: 2.2 scrub ok 2026-02-23T13:04:27.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:26 trial046 ceph-mon[38575]: 2.f scrub ok 2026-02-23T13:04:27.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:26 trial046 ceph-mon[38575]: pgmap v61: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 29 GiB data, 94 GiB used, 2.6 TiB / 2.7 TiB avail; 345 MiB/s wr, 5.53k op/s 2026-02-23T13:04:27.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:26 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4225788857' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:04:27.804 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 78 16 510137 510121 408.716 399.875 0.00207437 0.0024455 2026-02-23T13:04:28.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:27 trial046 ceph-mon[38575]: 2.0 scrub starts 2026-02-23T13:04:28.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:27 trial046 ceph-mon[38575]: 2.c scrub ok 2026-02-23T13:04:28.788 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:04:28.804 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 79 15 516203 516188 408.342 379.188 0.0012186 0.00244774 2026-02-23T13:04:28.934 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:29.062 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:29.060+0000 7fa70a4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:29.062 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:29.060+0000 7fa70a4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:29.075 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:04:29.076 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:04:29.076 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:28 trial046 ceph-mon[38575]: 2.d scrub starts 2026-02-23T13:04:29.076 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:28 trial046 ceph-mon[38575]: pgmap v62: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 31 GiB data, 97 GiB used, 2.6 TiB / 2.7 TiB avail; 466 MiB/s wr, 7.46k op/s 2026-02-23T13:04:29.089 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:04:29.089 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:04:29.103 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:04:29.103 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:04:29.117 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:04:29.117 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:04:29.797 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:04:29.798 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:04:29.798 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:04:29.798 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:04:29.804 INFO:tasks.radosbench.radosbench.0.trial046.stdout:2026-02-23T13:04:29.803699+0000 min lat: 0.000702009 max lat: 0.0475158 avg lat: 0.00245425 2026-02-23T13:04:29.804 INFO:tasks.radosbench.radosbench.0.trial046.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-23T13:04:29.804 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 80 16 521351 521335 407.259 321.688 0.00623315 0.00245425 2026-02-23T13:04:29.940 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:30.132 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:29 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3923986719' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:04:30.319 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:30.263+0000 7f9ed1efa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:30.319 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:30.264+0000 7f9ed1efa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:30.405 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:04:30.406 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:04:30.804 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 81 16 526136 526120 405.922 299.062 0.00201784 0.00246236 2026-02-23T13:04:31.009 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:30 trial046 ceph-mon[38575]: 2.0 scrub ok 2026-02-23T13:04:31.010 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:30 trial046 ceph-mon[38575]: from='client.14488 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:04:31.010 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:30 trial046 ceph-mon[38575]: pgmap v63: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 31 GiB data, 97 GiB used, 2.6 TiB / 2.7 TiB avail; 190 MiB/s wr, 3.04k op/s 2026-02-23T13:04:31.010 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:30 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:04:31.031 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2026-02-23T13:04:28.601819+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":32941212192,"num_objects":502636,"num_object_clones":0,"num_object_copies":1507908,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":502636,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":502769,"num_write_kb":32170726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":101578284,"kb_used_data":95702748,"kb_used_omap":85,"kb_used_meta":5875370,"kb_avail":2834434516,"statfs":{"total":3006477107200,"available":2902460944384,"internally_reserved":0,"allocated":97999613952,"data_stored":97998537292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87872,"internal_metadata":6016379072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9,2,6,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3815505920,"num_objects":58220,"num_object_clones":0,"num_object_copies":174660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58220,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58220,"num_write_kb":3726080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.800561"},"pg_stats":[{"pgid":"2.f","version":"42'31430","reported_seq":31785,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:26.588411+0000","last_change":"2026-02-23T13:04:26.095439+0000","last_active":"2026-02-23T13:04:26.588411+0000","last_peered":"2026-02-23T13:04:26.588411+0000","last_clean":"2026-02-23T13:04:26.588411+0000","last_became_active":"2026-02-23T13:03:08.711408+0000","last_became_peered":"2026-02-23T13:03:08.711408+0000","last_unstale":"2026-02-23T13:04:26.588411+0000","last_undegraded":"2026-02-23T13:04:26.588411+0000","last_fullsized":"2026-02-23T13:04:26.588411+0000","mapping_epoch":28,"log_start":"42'31427","ondisk_log_start":"42'31427","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31256","last_scrub_stamp":"2026-02-23T13:04:26.095384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:26.095384+0000","objects_scrubbed":30901,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:37.117824+0000","scrub_duration":2252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2059796480,"num_objects":31430,"num_object_clones":0,"num_object_copies":94290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31430,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31430,"num_write_kb":2011520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"42'31713","reported_seq":31751,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:26.596236+0000","last_change":"2026-02-23T13:03:08.711629+0000","last_active":"2026-02-23T13:04:26.596236+0000","last_peered":"2026-02-23T13:04:26.596236+0000","last_clean":"2026-02-23T13:04:26.596236+0000","last_became_active":"2026-02-23T13:03:08.711462+0000","last_became_peered":"2026-02-23T13:03:08.711462+0000","last_unstale":"2026-02-23T13:04:26.596236+0000","last_undegraded":"2026-02-23T13:04:26.596236+0000","last_fullsized":"2026-02-23T13:04:26.596236+0000","mapping_epoch":28,"log_start":"42'31710","ondisk_log_start":"42'31710","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:35.369081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2078343168,"num_objects":31713,"num_object_clones":0,"num_object_copies":95139,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31713,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31713,"num_write_kb":2029632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"42'31428","reported_seq":31466,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:26.593235+0000","last_change":"2026-02-23T13:03:08.712615+0000","last_active":"2026-02-23T13:04:26.593235+0000","last_peered":"2026-02-23T13:04:26.593235+0000","last_clean":"2026-02-23T13:04:26.593235+0000","last_became_active":"2026-02-23T13:03:08.712246+0000","last_became_peered":"2026-02-23T13:03:08.712246+0000","last_unstale":"2026-02-23T13:04:26.593235+0000","last_undegraded":"2026-02-23T13:04:26.593235+0000","last_fullsized":"2026-02-23T13:04:26.593235+0000","mapping_epoch":28,"log_start":"42'31425","ondisk_log_start":"42'31425","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:26.869038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2059665408,"num_objects":31428,"num_object_clones":0,"num_object_copies":94284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31428,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31428,"num_write_kb":2011392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"42'31493","reported_seq":31787,"reported_epoch":42,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:04:26.600042+0000","last_change":"2026-02-23T13:04:23.777780+0000","last_active":"2026-02-23T13:04:26.600042+0000","last_peered":"2026-02-23T13:04:26.600042+0000","last_clean":"2026-02-23T13:04:26.600042+0000","last_became_active":"2026-02-23T13:03:08.712348+0000","last_became_peered":"2026-02-23T13:03:08.712348+0000","last_unstale":"2026-02-23T13:04:26.600042+0000","last_undegraded":"2026-02-23T13:04:26.600042+0000","last_fullsized":"2026-02-23T13:04:26.600042+0000","mapping_epoch":28,"log_start":"42'31490","ondisk_log_start":"42'31490","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":25449,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 3s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2063925248,"num_objects":31493,"num_object_clones":0,"num_object_copies":94479,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31493,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31493,"num_write_kb":2015552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":220,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:22.806187+0000","last_change":"2026-02-23T13:04:08.199097+0000","last_active":"2026-02-23T13:04:22.806187+0000","last_peered":"2026-02-23T13:04:22.806187+0000","last_clean":"2026-02-23T13:04:22.806187+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:04:22.806187+0000","last_undegraded":"2026-02-23T13:04:22.806187+0000","last_fullsized":"2026-02-23T13:04:22.806187+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:04:08.199036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:04:08.199036+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:23.231335+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"42'31386","reported_seq":31701,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:26.600022+0000","last_change":"2026-02-23T13:04:15.649890+0000","last_active":"2026-02-23T13:04:26.600022+0000","last_peered":"2026-02-23T13:04:26.600022+0000","last_clean":"2026-02-23T13:04:26.600022+0000","last_became_active":"2026-02-23T13:03:08.708695+0000","last_became_peered":"2026-02-23T13:03:08.708695+0000","last_unstale":"2026-02-23T13:04:26.600022+0000","last_undegraded":"2026-02-23T13:04:26.600022+0000","last_fullsized":"2026-02-23T13:04:26.600022+0000","mapping_epoch":28,"log_start":"42'31383","ondisk_log_start":"42'31383","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'27365","last_scrub_stamp":"2026-02-23T13:04:15.649815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:15.649815+0000","objects_scrubbed":26902,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:16.658945+0000","scrub_duration":2575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2056912896,"num_objects":31386,"num_object_clones":0,"num_object_copies":94158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31386,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31386,"num_write_kb":2008704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"42'31425","reported_seq":31461,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:26.598536+0000","last_change":"2026-02-23T13:03:08.712038+0000","last_active":"2026-02-23T13:04:26.598536+0000","last_peered":"2026-02-23T13:04:26.598536+0000","last_clean":"2026-02-23T13:04:26.598536+0000","last_became_active":"2026-02-23T13:03:08.711847+0000","last_became_peered":"2026-02-23T13:03:08.711847+0000","last_unstale":"2026-02-23T13:04:26.598536+0000","last_undegraded":"2026-02-23T13:04:26.598536+0000","last_fullsized":"2026-02-23T13:04:26.598536+0000","mapping_epoch":28,"log_start":"42'31422","ondisk_log_start":"42'31422","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2059468800,"num_objects":31425,"num_object_clones":0,"num_object_copies":94275,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31425,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31425,"num_write_kb":2011200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"42'31416","reported_seq":31726,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:26.597144+0000","last_change":"2026-02-23T13:04:14.687654+0000","last_active":"2026-02-23T13:04:26.597144+0000","last_peered":"2026-02-23T13:04:26.597144+0000","last_clean":"2026-02-23T13:04:26.597144+0000","last_became_active":"2026-02-23T13:03:08.712783+0000","last_became_peered":"2026-02-23T13:03:08.712783+0000","last_unstale":"2026-02-23T13:04:26.597144+0000","last_undegraded":"2026-02-23T13:04:26.597144+0000","last_fullsized":"2026-02-23T13:04:26.597144+0000","mapping_epoch":28,"log_start":"42'31413","ondisk_log_start":"42'31413","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'26930","last_scrub_stamp":"2026-02-23T13:04:14.687533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:14.687533+0000","objects_scrubbed":26390,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:29.989051+0000","scrub_duration":2902,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2058878976,"num_objects":31416,"num_object_clones":0,"num_object_copies":94248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31416,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31416,"num_write_kb":2010624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"42'31354","reported_seq":31706,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:26.593712+0000","last_change":"2026-02-23T13:04:25.882548+0000","last_active":"2026-02-23T13:04:26.593712+0000","last_peered":"2026-02-23T13:04:26.593712+0000","last_clean":"2026-02-23T13:04:26.593712+0000","last_became_active":"2026-02-23T13:03:08.708821+0000","last_became_peered":"2026-02-23T13:03:08.708821+0000","last_unstale":"2026-02-23T13:04:26.593712+0000","last_undegraded":"2026-02-23T13:04:26.593712+0000","last_fullsized":"2026-02-23T13:04:26.593712+0000","mapping_epoch":28,"log_start":"42'31351","ondisk_log_start":"42'31351","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31120","last_scrub_stamp":"2026-02-23T13:04:25.882487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:25.882487+0000","objects_scrubbed":30639,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:32.453655+0000","scrub_duration":2862,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2054815744,"num_objects":31354,"num_object_clones":0,"num_object_copies":94062,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31354,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31354,"num_write_kb":2006656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"42'31356","reported_seq":31393,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:26.589621+0000","last_change":"2026-02-23T13:03:08.712493+0000","last_active":"2026-02-23T13:04:26.589621+0000","last_peered":"2026-02-23T13:04:26.589621+0000","last_clean":"2026-02-23T13:04:26.589621+0000","last_became_active":"2026-02-23T13:03:08.712152+0000","last_became_peered":"2026-02-23T13:03:08.712152+0000","last_unstale":"2026-02-23T13:04:26.589621+0000","last_undegraded":"2026-02-23T13:04:26.589621+0000","last_fullsized":"2026-02-23T13:04:26.589621+0000","mapping_epoch":28,"log_start":"42'31353","ondisk_log_start":"42'31353","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:33.900038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2054946816,"num_objects":31356,"num_object_clones":0,"num_object_copies":94068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31356,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31356,"num_write_kb":2006784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"42'31127","reported_seq":31165,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:26.593139+0000","last_change":"2026-02-23T13:03:08.712205+0000","last_active":"2026-02-23T13:04:26.593139+0000","last_peered":"2026-02-23T13:04:26.593139+0000","last_clean":"2026-02-23T13:04:26.593139+0000","last_became_active":"2026-02-23T13:03:08.712055+0000","last_became_peered":"2026-02-23T13:03:08.712055+0000","last_unstale":"2026-02-23T13:04:26.593139+0000","last_undegraded":"2026-02-23T13:04:26.593139+0000","last_fullsized":"2026-02-23T13:04:26.593139+0000","mapping_epoch":28,"log_start":"42'31124","ondisk_log_start":"42'31124","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:37.263900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2039939072,"num_objects":31127,"num_object_clones":0,"num_object_copies":93381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31127,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31127,"num_write_kb":1992128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"42'31456","reported_seq":31809,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:26.596786+0000","last_change":"2026-02-23T13:04:25.319824+0000","last_active":"2026-02-23T13:04:26.596786+0000","last_peered":"2026-02-23T13:04:26.596786+0000","last_clean":"2026-02-23T13:04:26.596786+0000","last_became_active":"2026-02-23T13:03:08.708852+0000","last_became_peered":"2026-02-23T13:03:08.708852+0000","last_unstale":"2026-02-23T13:04:26.596786+0000","last_undegraded":"2026-02-23T13:04:26.596786+0000","last_fullsized":"2026-02-23T13:04:26.596786+0000","mapping_epoch":28,"log_start":"42'31453","ondisk_log_start":"42'31453","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31026","last_scrub_stamp":"2026-02-23T13:04:25.319785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:25.319785+0000","objects_scrubbed":30498,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:39.230588+0000","scrub_duration":3555,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2061500416,"num_objects":31456,"num_object_clones":0,"num_object_copies":94368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31456,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31456,"num_write_kb":2013184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"42'31615","reported_seq":31652,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:26.600932+0000","last_change":"2026-02-23T13:03:08.708883+0000","last_active":"2026-02-23T13:04:26.600932+0000","last_peered":"2026-02-23T13:04:26.600932+0000","last_clean":"2026-02-23T13:04:26.600932+0000","last_became_active":"2026-02-23T13:03:08.708457+0000","last_became_peered":"2026-02-23T13:03:08.708457+0000","last_unstale":"2026-02-23T13:04:26.600932+0000","last_undegraded":"2026-02-23T13:04:26.600932+0000","last_fullsized":"2026-02-23T13:04:26.600932+0000","mapping_epoch":28,"log_start":"42'31612","ondisk_log_start":"42'31612","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:32.806938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2071920640,"num_objects":31615,"num_object_clones":0,"num_object_copies":94845,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31615,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31615,"num_write_kb":2023360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"42'31448","reported_seq":31486,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:26.596027+0000","last_change":"2026-02-23T13:03:08.712176+0000","last_active":"2026-02-23T13:04:26.596027+0000","last_peered":"2026-02-23T13:04:26.596027+0000","last_clean":"2026-02-23T13:04:26.596027+0000","last_became_active":"2026-02-23T13:03:08.712010+0000","last_became_peered":"2026-02-23T13:03:08.712010+0000","last_unstale":"2026-02-23T13:04:26.596027+0000","last_undegraded":"2026-02-23T13:04:26.596027+0000","last_fullsized":"2026-02-23T13:04:26.596027+0000","mapping_epoch":28,"log_start":"42'31445","ondisk_log_start":"42'31445","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:29.753408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2060976128,"num_objects":31448,"num_object_clones":0,"num_object_copies":94344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31448,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31448,"num_write_kb":2012672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"42'31198","reported_seq":31539,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:26.597211+0000","last_change":"2026-02-23T13:04:22.389549+0000","last_active":"2026-02-23T13:04:26.597211+0000","last_peered":"2026-02-23T13:04:26.597211+0000","last_clean":"2026-02-23T13:04:26.597211+0000","last_became_active":"2026-02-23T13:03:08.712763+0000","last_became_peered":"2026-02-23T13:03:08.712763+0000","last_unstale":"2026-02-23T13:04:26.597211+0000","last_undegraded":"2026-02-23T13:04:26.597211+0000","last_fullsized":"2026-02-23T13:04:26.597211+0000","mapping_epoch":28,"log_start":"42'31195","ondisk_log_start":"42'31195","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'29812","last_scrub_stamp":"2026-02-23T13:04:22.389498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:22.389498+0000","objects_scrubbed":29176,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:26.761128+0000","scrub_duration":3534,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2044592128,"num_objects":31198,"num_object_clones":0,"num_object_copies":93594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31198,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31198,"num_write_kb":1996672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"42'31428","reported_seq":31466,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:26.596840+0000","last_change":"2026-02-23T13:03:08.709558+0000","last_active":"2026-02-23T13:04:26.596840+0000","last_peered":"2026-02-23T13:04:26.596840+0000","last_clean":"2026-02-23T13:04:26.596840+0000","last_became_active":"2026-02-23T13:03:08.709391+0000","last_became_peered":"2026-02-23T13:03:08.709391+0000","last_unstale":"2026-02-23T13:04:26.596840+0000","last_undegraded":"2026-02-23T13:04:26.596840+0000","last_fullsized":"2026-02-23T13:04:26.596840+0000","mapping_epoch":28,"log_start":"42'31425","ondisk_log_start":"42'31425","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:34.787615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2059665408,"num_objects":31428,"num_object_clones":0,"num_object_copies":94284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31428,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31428,"num_write_kb":2011392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"42'31361","reported_seq":31399,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:26.591657+0000","last_change":"2026-02-23T13:03:08.711473+0000","last_active":"2026-02-23T13:04:26.591657+0000","last_peered":"2026-02-23T13:04:26.591657+0000","last_clean":"2026-02-23T13:04:26.591657+0000","last_became_active":"2026-02-23T13:03:08.711303+0000","last_became_peered":"2026-02-23T13:03:08.711303+0000","last_unstale":"2026-02-23T13:04:26.591657+0000","last_undegraded":"2026-02-23T13:04:26.591657+0000","last_fullsized":"2026-02-23T13:04:26.591657+0000","mapping_epoch":28,"log_start":"42'31358","ondisk_log_start":"42'31358","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:35.916414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2055274496,"num_objects":31361,"num_object_clones":0,"num_object_copies":94083,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31361,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31361,"num_write_kb":2007104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":32940621824,"num_objects":502634,"num_object_clones":0,"num_object_copies":1507902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":502634,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":502634,"num_write_kb":32168576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98820816896,"data_stored":98820816896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247828,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":29655852,"kb_used_data":27943192,"kb_used_omap":16,"kb_used_meta":1712623,"kb_avail":704347348,"statfs":{"total":751619276800,"available":721251684352,"internally_reserved":0,"allocated":28613828608,"data_stored":28613558555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17246,"internal_metadata":1753726114},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444055,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":23273132,"kb_used_data":21921624,"kb_used_omap":20,"kb_used_meta":1351467,"kb_avail":710730068,"statfs":{"total":751619276800,"available":727787589632,"internally_reserved":0,"allocated":22447742976,"data_stored":22447472923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21155,"internal_metadata":1383902557},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":25382824,"kb_used_data":23922964,"kb_used_omap":23,"kb_used_meta":1459816,"kb_avail":708620376,"statfs":{"total":751619276800,"available":725627265024,"internally_reserved":0,"allocated":24497115136,"data_stored":24496848635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23759,"internal_metadata":1494852401},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,1,5,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705690,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":23266476,"kb_used_data":21914968,"kb_used_omap":25,"kb_used_meta":1351462,"kb_avail":710736724,"statfs":{"total":751619276800,"available":727794405376,"internally_reserved":0,"allocated":22440927232,"data_stored":22440657179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25712,"internal_metadata":1383898000},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":22634692608,"data_stored":22634692608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24725028864,"data_stored":24725028864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22653632512,"data_stored":22653632512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28807462912,"data_stored":28807462912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:04:31.033 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:04:31.034 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 31 2026-02-23T13:04:31.225 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:31.447 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:04:31.607 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:31.605+0000 7f542a59f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:31.608 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:31.605+0000 7f542a59f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:31.610 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:31.747 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:04:31.804 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 82 15 531263 531248 404.88 320.5 0.00320775 0.00246868 2026-02-23T13:04:32.032 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:31 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2526334693' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "31"} : dispatch 2026-02-23T13:04:32.307 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:04:32.608 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:32.569+0000 7f3fe34fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:32.608 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:32.569+0000 7f3fe34fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:32.608 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:04:32.608 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:04:32.608 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:04:32.608 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:04:32.613 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:04:32.614 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:04:32.626 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:04:32.626 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:04:32.804 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 83 16 536001 535985 403.569 296.062 0.00211649 0.00247672 2026-02-23T13:04:32.905 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:32 trial046 ceph-mon[38575]: 2.d scrub ok 2026-02-23T13:04:32.905 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:32 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4147455334' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:04:32.906 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:32 trial046 ceph-mon[38575]: pgmap v64: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 32 GiB data, 102 GiB used, 2.6 TiB / 2.7 TiB avail; 339 MiB/s wr, 5.43k op/s 2026-02-23T13:04:33.804 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 84 16 542137 542121 403.33 383.5 0.00162676 0.00247819 2026-02-23T13:04:34.804 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 85 16 549443 549427 403.956 456.625 0.0017164 0.00247435 2026-02-23T13:04:35.188 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:04:35.331 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:35.463 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:35.461+0000 7fb6f1f25640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:35.463 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:35.461+0000 7fb6f1f25640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:35.478 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:04:35.478 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:04:35.490 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:04:35.491 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:04:35.503 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:04:35.503 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:04:35.518 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:04:35.518 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:04:35.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:35 trial046 ceph-mon[38575]: pgmap v65: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 32 GiB data, 102 GiB used, 2.6 TiB / 2.7 TiB avail; 288 MiB/s wr, 4.60k op/s 2026-02-23T13:04:35.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:35 trial046 ceph-mon[38575]: 2.4 scrub starts 2026-02-23T13:04:35.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:35 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2442885266' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:04:35.804 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 86 16 555914 555898 403.962 404.438 0.00165326 0.00247432 2026-02-23T13:04:36.539 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:04:36 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:04:36] "GET /metrics HTTP/1.1" 200 4211 "" "Prometheus/3.6.0" 2026-02-23T13:04:36.560 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:04:36 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:04:36.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:04:36.804 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 87 16 561623 561607 403.419 356.812 0.00187432 0.00247763 2026-02-23T13:04:37.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:36 trial046 ceph-mon[38575]: 2.a scrub starts 2026-02-23T13:04:37.309 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:04:37.309 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:04:37.309 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_0 2026-02-23T13:04:37.310 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:04:37.454 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:37.561 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:04:37.804 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 88 16 566171 566155 402.065 284.25 0.000937666 0.00248544 2026-02-23T13:04:37.852 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:37.817+0000 7fba6c30e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:37.852 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:37.818+0000 7fba6c30e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:37.852 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:37 trial046 ceph-mon[38575]: pgmap v66: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 32 GiB data, 105 GiB used, 2.6 TiB / 2.7 TiB avail; 293 MiB/s wr, 4.68k op/s 2026-02-23T13:04:37.852 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:37 trial046 ceph-mon[38575]: 2.e scrub starts 2026-02-23T13:04:37.885 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:37.977 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:04:37.978 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:04:38.161 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2026-02-23T13:04:36.602916+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":34870526496,"num_objects":532075,"num_object_clones":0,"num_object_copies":1596225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":532075,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":532208,"num_write_kb":34054822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110038700,"kb_used_data":103693916,"kb_used_omap":85,"kb_used_meta":6344618,"kb_avail":2825974100,"statfs":{"total":3006477107200,"available":2893797478400,"internally_reserved":0,"allocated":106182569984,"data_stored":106181493324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87872,"internal_metadata":6496889024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3681157120,"num_objects":56170,"num_object_clones":0,"num_object_copies":168510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56170,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56170,"num_write_kb":3594880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001545"},"pg_stats":[{"pgid":"2.f","version":"42'35039","reported_seq":35394,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:36.595805+0000","last_change":"2026-02-23T13:04:26.095439+0000","last_active":"2026-02-23T13:04:36.595805+0000","last_peered":"2026-02-23T13:04:36.595805+0000","last_clean":"2026-02-23T13:04:36.595805+0000","last_became_active":"2026-02-23T13:03:08.711408+0000","last_became_peered":"2026-02-23T13:03:08.711408+0000","last_unstale":"2026-02-23T13:04:36.595805+0000","last_undegraded":"2026-02-23T13:04:36.595805+0000","last_fullsized":"2026-02-23T13:04:36.595805+0000","mapping_epoch":28,"log_start":"42'35036","ondisk_log_start":"42'35036","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31256","last_scrub_stamp":"2026-02-23T13:04:26.095384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:26.095384+0000","objects_scrubbed":30901,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:37.117824+0000","scrub_duration":2252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2296315904,"num_objects":35039,"num_object_clones":0,"num_object_copies":105117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35039,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35039,"num_write_kb":2242496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"42'33457","reported_seq":33495,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:31.611258+0000","last_change":"2026-02-23T13:03:08.711629+0000","last_active":"2026-02-23T13:04:31.611258+0000","last_peered":"2026-02-23T13:04:31.611258+0000","last_clean":"2026-02-23T13:04:31.611258+0000","last_became_active":"2026-02-23T13:03:08.711462+0000","last_became_peered":"2026-02-23T13:03:08.711462+0000","last_unstale":"2026-02-23T13:04:31.611258+0000","last_undegraded":"2026-02-23T13:04:31.611258+0000","last_fullsized":"2026-02-23T13:04:31.611258+0000","mapping_epoch":28,"log_start":"42'33454","ondisk_log_start":"42'33454","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:35.369081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2192637952,"num_objects":33457,"num_object_clones":0,"num_object_copies":100371,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33457,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33457,"num_write_kb":2141248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"42'33206","reported_seq":33545,"reported_epoch":42,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:04:31.615838+0000","last_change":"2026-02-23T13:04:27.748641+0000","last_active":"2026-02-23T13:04:31.615838+0000","last_peered":"2026-02-23T13:04:31.615838+0000","last_clean":"2026-02-23T13:04:31.615838+0000","last_became_active":"2026-02-23T13:03:08.712246+0000","last_became_peered":"2026-02-23T13:03:08.712246+0000","last_unstale":"2026-02-23T13:04:31.615838+0000","last_undegraded":"2026-02-23T13:04:31.615838+0000","last_fullsized":"2026-02-23T13:04:31.615838+0000","mapping_epoch":28,"log_start":"42'33203","ondisk_log_start":"42'33203","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":29849,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 4s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2176188416,"num_objects":33206,"num_object_clones":0,"num_object_copies":99618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33206,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33206,"num_write_kb":2125184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"42'33201","reported_seq":33559,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:31.606637+0000","last_change":"2026-02-23T13:04:27.262519+0000","last_active":"2026-02-23T13:04:31.606637+0000","last_peered":"2026-02-23T13:04:31.606637+0000","last_clean":"2026-02-23T13:04:31.606637+0000","last_became_active":"2026-02-23T13:03:08.712348+0000","last_became_peered":"2026-02-23T13:03:08.712348+0000","last_unstale":"2026-02-23T13:04:31.606637+0000","last_undegraded":"2026-02-23T13:04:31.606637+0000","last_fullsized":"2026-02-23T13:04:31.606637+0000","mapping_epoch":28,"log_start":"42'33198","ondisk_log_start":"42'33198","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31725","last_scrub_stamp":"2026-02-23T13:04:27.262379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:27.262379+0000","objects_scrubbed":31138,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:36.061346+0000","scrub_duration":3485,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2175860736,"num_objects":33201,"num_object_clones":0,"num_object_copies":99603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33201,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33201,"num_write_kb":2124864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":220,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:22.806187+0000","last_change":"2026-02-23T13:04:08.199097+0000","last_active":"2026-02-23T13:04:22.806187+0000","last_peered":"2026-02-23T13:04:22.806187+0000","last_clean":"2026-02-23T13:04:22.806187+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:04:22.806187+0000","last_undegraded":"2026-02-23T13:04:22.806187+0000","last_fullsized":"2026-02-23T13:04:22.806187+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:04:08.199036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:04:08.199036+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:23.231335+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"42'33072","reported_seq":33387,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:31.566395+0000","last_change":"2026-02-23T13:04:15.649890+0000","last_active":"2026-02-23T13:04:31.566395+0000","last_peered":"2026-02-23T13:04:31.566395+0000","last_clean":"2026-02-23T13:04:31.566395+0000","last_became_active":"2026-02-23T13:03:08.708695+0000","last_became_peered":"2026-02-23T13:03:08.708695+0000","last_unstale":"2026-02-23T13:04:31.566395+0000","last_undegraded":"2026-02-23T13:04:31.566395+0000","last_fullsized":"2026-02-23T13:04:31.566395+0000","mapping_epoch":28,"log_start":"42'33069","ondisk_log_start":"42'33069","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'27365","last_scrub_stamp":"2026-02-23T13:04:15.649815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:15.649815+0000","objects_scrubbed":26902,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:16.658945+0000","scrub_duration":2575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2167406592,"num_objects":33072,"num_object_clones":0,"num_object_copies":99216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33072,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33072,"num_write_kb":2116608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"42'33152","reported_seq":33520,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:31.600902+0000","last_change":"2026-02-23T13:04:30.014412+0000","last_active":"2026-02-23T13:04:31.600902+0000","last_peered":"2026-02-23T13:04:31.600902+0000","last_clean":"2026-02-23T13:04:31.600902+0000","last_became_active":"2026-02-23T13:03:08.711847+0000","last_became_peered":"2026-02-23T13:03:08.711847+0000","last_unstale":"2026-02-23T13:04:31.600902+0000","last_undegraded":"2026-02-23T13:04:31.600902+0000","last_fullsized":"2026-02-23T13:04:31.600902+0000","mapping_epoch":28,"log_start":"42'33149","ondisk_log_start":"42'33149","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'32670","last_scrub_stamp":"2026-02-23T13:04:30.014332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:30.014332+0000","objects_scrubbed":32128,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:50.241908+0000","scrub_duration":3026,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2172649472,"num_objects":33152,"num_object_clones":0,"num_object_copies":99456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33152,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33152,"num_write_kb":2121728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"42'33163","reported_seq":33473,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:31.605373+0000","last_change":"2026-02-23T13:04:14.687654+0000","last_active":"2026-02-23T13:04:31.605373+0000","last_peered":"2026-02-23T13:04:31.605373+0000","last_clean":"2026-02-23T13:04:31.605373+0000","last_became_active":"2026-02-23T13:03:08.712783+0000","last_became_peered":"2026-02-23T13:03:08.712783+0000","last_unstale":"2026-02-23T13:04:31.605373+0000","last_undegraded":"2026-02-23T13:04:31.605373+0000","last_fullsized":"2026-02-23T13:04:31.605373+0000","mapping_epoch":28,"log_start":"42'33160","ondisk_log_start":"42'33160","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'26930","last_scrub_stamp":"2026-02-23T13:04:14.687533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:14.687533+0000","objects_scrubbed":26390,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:29.989051+0000","scrub_duration":2902,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2173370368,"num_objects":33163,"num_object_clones":0,"num_object_copies":99489,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33163,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33163,"num_write_kb":2122432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"42'33064","reported_seq":33416,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:31.600985+0000","last_change":"2026-02-23T13:04:25.882548+0000","last_active":"2026-02-23T13:04:31.600985+0000","last_peered":"2026-02-23T13:04:31.600985+0000","last_clean":"2026-02-23T13:04:31.600985+0000","last_became_active":"2026-02-23T13:03:08.708821+0000","last_became_peered":"2026-02-23T13:03:08.708821+0000","last_unstale":"2026-02-23T13:04:31.600985+0000","last_undegraded":"2026-02-23T13:04:31.600985+0000","last_fullsized":"2026-02-23T13:04:31.600985+0000","mapping_epoch":28,"log_start":"42'33061","ondisk_log_start":"42'33061","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31120","last_scrub_stamp":"2026-02-23T13:04:25.882487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:25.882487+0000","objects_scrubbed":30639,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:32.453655+0000","scrub_duration":2862,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2166882304,"num_objects":33064,"num_object_clones":0,"num_object_copies":99192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33064,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33064,"num_write_kb":2116096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"42'33108","reported_seq":33146,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:31.614108+0000","last_change":"2026-02-23T13:03:08.712493+0000","last_active":"2026-02-23T13:04:31.614108+0000","last_peered":"2026-02-23T13:04:31.614108+0000","last_clean":"2026-02-23T13:04:31.614108+0000","last_became_active":"2026-02-23T13:03:08.712152+0000","last_became_peered":"2026-02-23T13:03:08.712152+0000","last_unstale":"2026-02-23T13:04:31.614108+0000","last_undegraded":"2026-02-23T13:04:31.614108+0000","last_fullsized":"2026-02-23T13:04:31.614108+0000","mapping_epoch":28,"log_start":"42'33105","ondisk_log_start":"42'33105","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:33.900038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2169765888,"num_objects":33108,"num_object_clones":0,"num_object_copies":99324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33108,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33108,"num_write_kb":2118912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"42'32830","reported_seq":32868,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:31.560948+0000","last_change":"2026-02-23T13:03:08.712205+0000","last_active":"2026-02-23T13:04:31.560948+0000","last_peered":"2026-02-23T13:04:31.560948+0000","last_clean":"2026-02-23T13:04:31.560948+0000","last_became_active":"2026-02-23T13:03:08.712055+0000","last_became_peered":"2026-02-23T13:03:08.712055+0000","last_unstale":"2026-02-23T13:04:31.560948+0000","last_undegraded":"2026-02-23T13:04:31.560948+0000","last_fullsized":"2026-02-23T13:04:31.560948+0000","mapping_epoch":28,"log_start":"42'32827","ondisk_log_start":"42'32827","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:37.263900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2151546880,"num_objects":32830,"num_object_clones":0,"num_object_copies":98490,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32830,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32830,"num_write_kb":2101120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"42'33125","reported_seq":33478,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:31.615515+0000","last_change":"2026-02-23T13:04:25.319824+0000","last_active":"2026-02-23T13:04:31.615515+0000","last_peered":"2026-02-23T13:04:31.615515+0000","last_clean":"2026-02-23T13:04:31.615515+0000","last_became_active":"2026-02-23T13:03:08.708852+0000","last_became_peered":"2026-02-23T13:03:08.708852+0000","last_unstale":"2026-02-23T13:04:31.615515+0000","last_undegraded":"2026-02-23T13:04:31.615515+0000","last_fullsized":"2026-02-23T13:04:31.615515+0000","mapping_epoch":28,"log_start":"42'33122","ondisk_log_start":"42'33122","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31026","last_scrub_stamp":"2026-02-23T13:04:25.319785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:25.319785+0000","objects_scrubbed":30498,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:39.230588+0000","scrub_duration":3555,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2170880000,"num_objects":33125,"num_object_clones":0,"num_object_copies":99375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33125,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33125,"num_write_kb":2120000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"42'33350","reported_seq":33388,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:31.600952+0000","last_change":"2026-02-23T13:03:08.708883+0000","last_active":"2026-02-23T13:04:31.600952+0000","last_peered":"2026-02-23T13:04:31.600952+0000","last_clean":"2026-02-23T13:04:31.600952+0000","last_became_active":"2026-02-23T13:03:08.708457+0000","last_became_peered":"2026-02-23T13:03:08.708457+0000","last_unstale":"2026-02-23T13:04:31.600952+0000","last_undegraded":"2026-02-23T13:04:31.600952+0000","last_fullsized":"2026-02-23T13:04:31.600952+0000","mapping_epoch":28,"log_start":"42'33347","ondisk_log_start":"42'33347","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:32.806938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2185625600,"num_objects":33350,"num_object_clones":0,"num_object_copies":100050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33350,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33350,"num_write_kb":2134400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"42'33237","reported_seq":33275,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:31.562257+0000","last_change":"2026-02-23T13:03:08.712176+0000","last_active":"2026-02-23T13:04:31.562257+0000","last_peered":"2026-02-23T13:04:31.562257+0000","last_clean":"2026-02-23T13:04:31.562257+0000","last_became_active":"2026-02-23T13:03:08.712010+0000","last_became_peered":"2026-02-23T13:03:08.712010+0000","last_unstale":"2026-02-23T13:04:31.562257+0000","last_undegraded":"2026-02-23T13:04:31.562257+0000","last_fullsized":"2026-02-23T13:04:31.562257+0000","mapping_epoch":28,"log_start":"42'33234","ondisk_log_start":"42'33234","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2178220032,"num_objects":33237,"num_object_clones":0,"num_object_copies":99711,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33237,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33237,"num_write_kb":2127168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"42'32885","reported_seq":33226,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:31.608751+0000","last_change":"2026-02-23T13:04:22.389549+0000","last_active":"2026-02-23T13:04:31.608751+0000","last_peered":"2026-02-23T13:04:31.608751+0000","last_clean":"2026-02-23T13:04:31.608751+0000","last_became_active":"2026-02-23T13:03:08.712763+0000","last_became_peered":"2026-02-23T13:03:08.712763+0000","last_unstale":"2026-02-23T13:04:31.608751+0000","last_undegraded":"2026-02-23T13:04:31.608751+0000","last_fullsized":"2026-02-23T13:04:31.608751+0000","mapping_epoch":28,"log_start":"42'32882","ondisk_log_start":"42'32882","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'29812","last_scrub_stamp":"2026-02-23T13:04:22.389498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:22.389498+0000","objects_scrubbed":29176,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:26.761128+0000","scrub_duration":3534,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2155151360,"num_objects":32885,"num_object_clones":0,"num_object_copies":98655,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32885,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32885,"num_write_kb":2104640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"42'33152","reported_seq":33190,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:31.614630+0000","last_change":"2026-02-23T13:03:08.709558+0000","last_active":"2026-02-23T13:04:31.614630+0000","last_peered":"2026-02-23T13:04:31.614630+0000","last_clean":"2026-02-23T13:04:31.614630+0000","last_became_active":"2026-02-23T13:03:08.709391+0000","last_became_peered":"2026-02-23T13:03:08.709391+0000","last_unstale":"2026-02-23T13:04:31.614630+0000","last_undegraded":"2026-02-23T13:04:31.614630+0000","last_fullsized":"2026-02-23T13:04:31.614630+0000","mapping_epoch":28,"log_start":"42'33149","ondisk_log_start":"42'33149","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:34.787615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2172649472,"num_objects":33152,"num_object_clones":0,"num_object_copies":99456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33152,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33152,"num_write_kb":2121728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"42'33032","reported_seq":33070,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:31.568423+0000","last_change":"2026-02-23T13:03:08.711473+0000","last_active":"2026-02-23T13:04:31.568423+0000","last_peered":"2026-02-23T13:04:31.568423+0000","last_clean":"2026-02-23T13:04:31.568423+0000","last_became_active":"2026-02-23T13:03:08.711303+0000","last_became_peered":"2026-02-23T13:03:08.711303+0000","last_unstale":"2026-02-23T13:04:31.568423+0000","last_undegraded":"2026-02-23T13:04:31.568423+0000","last_fullsized":"2026-02-23T13:04:31.568423+0000","mapping_epoch":28,"log_start":"42'33029","ondisk_log_start":"42'33029","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:04:35.916414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2164785152,"num_objects":33032,"num_object_clones":0,"num_object_copies":99096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33032,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33032,"num_write_kb":2114048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":34869936128,"num_objects":532073,"num_object_clones":0,"num_object_copies":1596219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":532073,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":532073,"num_write_kb":34052672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106961108992,"data_stored":106961108992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247829,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":31288876,"kb_used_data":29504024,"kb_used_omap":16,"kb_used_meta":1784815,"kb_avail":702714324,"statfs":{"total":751619276800,"available":719579467776,"internally_reserved":0,"allocated":30212120576,"data_stored":30211850523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17246,"internal_metadata":1827650722},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444057,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":25982316,"kb_used_data":24486424,"kb_used_omap":20,"kb_used_meta":1495851,"kb_avail":708020884,"statfs":{"total":751619276800,"available":725013385216,"internally_reserved":0,"allocated":25074098176,"data_stored":25073828123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21155,"internal_metadata":1531751773},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":26836072,"kb_used_data":25267924,"kb_used_omap":23,"kb_used_meta":1568104,"kb_avail":707167128,"statfs":{"total":751619276800,"available":724139139072,"internally_reserved":0,"allocated":25874354176,"data_stored":25874087675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23759,"internal_metadata":1605739313},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705692,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":25931436,"kb_used_data":24435544,"kb_used_omap":25,"kb_used_meta":1495846,"kb_avail":708071764,"statfs":{"total":751619276800,"available":725065486336,"internally_reserved":0,"allocated":25021997056,"data_stored":25021727003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25712,"internal_metadata":1531747216},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25238831104,"data_stored":25238831104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26080772096,"data_stored":26080772096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25258950656,"data_stored":25258950656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":30382555136,"data_stored":30382555136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:04:38.163 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:04:38.163 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_0 pg_num 56 2026-02-23T13:04:38.200 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:38.198+0000 7f0774316640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:38.200 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:38.198+0000 7f0774316640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:38.214 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:04:38.214 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:04:38.227 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:04:38.228 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:04:38.239 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:04:38.240 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:04:38.253 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:04:38.253 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:04:38.305 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:38.435 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:38.433+0000 7f28553e2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:38.435 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:38.433+0000 7f28553e2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:38.582 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:04:38.621 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:04:38.804 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 89 16 570784 570768 400.787 288.312 0.00119448 0.00249383 2026-02-23T13:04:39.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:38 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2479496072' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:04:39.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:38 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1038146892' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_0", "var": "pg_num", "val": "56"} : dispatch 2026-02-23T13:04:39.805 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Total time run: 90.0049 2026-02-23T13:04:39.805 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Total writes made: 575960 2026-02-23T13:04:39.805 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Write size: 65536 2026-02-23T13:04:39.805 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Object size: 65536 2026-02-23T13:04:39.805 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Bandwidth (MB/sec): 399.951 2026-02-23T13:04:39.805 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Stddev Bandwidth: 47.4196 2026-02-23T13:04:39.805 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Max bandwidth (MB/sec): 475.812 2026-02-23T13:04:39.805 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Min bandwidth (MB/sec): 284.25 2026-02-23T13:04:39.806 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Average IOPS: 6399 2026-02-23T13:04:39.806 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Stddev IOPS: 758.713 2026-02-23T13:04:39.806 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Max IOPS: 7613 2026-02-23T13:04:39.806 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Min IOPS: 4548 2026-02-23T13:04:39.806 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Average Latency(s): 0.0024991 2026-02-23T13:04:39.806 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Stddev Latency(s): 0.00196423 2026-02-23T13:04:39.806 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Max latency(s): 0.0501615 2026-02-23T13:04:39.806 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Min latency(s): 0.000702009 2026-02-23T13:04:39.807 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Cleaning up (deleting benchmark objects) 2026-02-23T13:04:40.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:39 trial046 ceph-mon[38575]: from='client.14496 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:04:40.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:39 trial046 ceph-mon[38575]: pgmap v67: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 34 GiB data, 108 GiB used, 2.6 TiB / 2.7 TiB avail; 432 MiB/s wr, 6.92k op/s 2026-02-23T13:04:40.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:39 trial046 ceph-mon[38575]: 2.4 scrub ok 2026-02-23T13:04:40.294 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:04:40.428 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:40.833 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:40 trial046 ceph-mon[38575]: 2.8 scrub starts 2026-02-23T13:04:40.834 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:40 trial046 ceph-mon[38575]: 2.a scrub ok 2026-02-23T13:04:40.845 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:40.790+0000 7f79814c6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:40.845 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:40.790+0000 7f79814c6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:40.845 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:04:40.846 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:04:40.846 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:04:40.846 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:04:40.846 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:04:40.847 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:04:40.847 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:04:40.847 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:04:42.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:41 trial046 ceph-mon[38575]: pgmap v68: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 34 GiB data, 108 GiB used, 2.6 TiB / 2.7 TiB avail; 302 MiB/s wr, 4.83k op/s 2026-02-23T13:04:42.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:41 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1189503097' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:04:42.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:41 trial046 ceph-mon[38575]: 2.e scrub ok 2026-02-23T13:04:43.387 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:04:43.531 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:43.622 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:04:43.622 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:04:43.622 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-23T13:04:43.623 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:04:43.759 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:43.874 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:43.872+0000 7f7627090640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:43.875 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:43.872+0000 7f7627090640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:43.890 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:04:43.890 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:04:43.905 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:04:43.905 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:04:43.918 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:04:43.918 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:04:43.918 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:43 trial046 ceph-mon[38575]: pgmap v69: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 35 GiB data, 111 GiB used, 2.6 TiB / 2.7 TiB avail; 85 B/s rd, 382 MiB/s wr, 6.94k op/s 2026-02-23T13:04:43.918 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:43 trial046 ceph-mon[38575]: 2.8 scrub ok 2026-02-23T13:04:43.932 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:04:43.932 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:04:43.936 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:43.935+0000 7f5c66b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:43.936 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:43.935+0000 7f5c66b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:44.091 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:04:44.092 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:04:44.136 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2026-02-23T13:04:42.603772+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":37095277112,"num_objects":566023,"num_object_clones":0,"num_object_copies":1698069,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":566023,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":586036,"num_write_kb":36863591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":116347000,"kb_used_data":109496744,"kb_used_omap":85,"kb_used_meta":6850026,"kb_avail":2819665800,"statfs":{"total":3006477107200,"available":2887337779200,"internally_reserved":0,"allocated":112124665856,"data_stored":112123576980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87872,"internal_metadata":7014426816},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1,2,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4154064920,"num_objects":63387,"num_object_clones":0,"num_object_copies":190161,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63387,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":83267,"num_write_kb":4692865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001674"},"pg_stats":[{"pgid":"2.f","version":"42'36675","reported_seq":37030,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:41.597048+0000","last_change":"2026-02-23T13:04:26.095439+0000","last_active":"2026-02-23T13:04:41.597048+0000","last_peered":"2026-02-23T13:04:41.597048+0000","last_clean":"2026-02-23T13:04:41.597048+0000","last_became_active":"2026-02-23T13:03:08.711408+0000","last_became_peered":"2026-02-23T13:03:08.711408+0000","last_unstale":"2026-02-23T13:04:41.597048+0000","last_undegraded":"2026-02-23T13:04:41.597048+0000","last_fullsized":"2026-02-23T13:04:41.597048+0000","mapping_epoch":28,"log_start":"42'36672","ondisk_log_start":"42'36672","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31256","last_scrub_stamp":"2026-02-23T13:04:26.095384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:26.095384+0000","objects_scrubbed":30901,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:37.117824+0000","scrub_duration":2252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2318991360,"num_objects":35385,"num_object_clones":0,"num_object_copies":106155,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35385,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36675,"num_write_kb":2305920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"42'36901","reported_seq":37306,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:41.627324+0000","last_change":"2026-02-23T13:04:41.483173+0000","last_active":"2026-02-23T13:04:41.627324+0000","last_peered":"2026-02-23T13:04:41.627324+0000","last_clean":"2026-02-23T13:04:41.627324+0000","last_became_active":"2026-02-23T13:03:08.711462+0000","last_became_peered":"2026-02-23T13:03:08.711462+0000","last_unstale":"2026-02-23T13:04:41.627324+0000","last_undegraded":"2026-02-23T13:04:41.627324+0000","last_fullsized":"2026-02-23T13:04:41.627324+0000","mapping_epoch":28,"log_start":"42'36898","ondisk_log_start":"42'36898","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'36827","last_scrub_stamp":"2026-02-23T13:04:41.482975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:41.482975+0000","objects_scrubbed":35883,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:55.333749+0000","scrub_duration":4566,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2334064640,"num_objects":35615,"num_object_clones":0,"num_object_copies":106845,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35615,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36901,"num_write_kb":2320512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"42'36617","reported_seq":36991,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:41.622866+0000","last_change":"2026-02-23T13:04:32.030814+0000","last_active":"2026-02-23T13:04:41.622866+0000","last_peered":"2026-02-23T13:04:41.622866+0000","last_clean":"2026-02-23T13:04:41.622866+0000","last_became_active":"2026-02-23T13:03:08.712246+0000","last_became_peered":"2026-02-23T13:03:08.712246+0000","last_unstale":"2026-02-23T13:04:41.622866+0000","last_undegraded":"2026-02-23T13:04:41.622866+0000","last_fullsized":"2026-02-23T13:04:41.622866+0000","mapping_epoch":28,"log_start":"42'36614","ondisk_log_start":"42'36614","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'33322","last_scrub_stamp":"2026-02-23T13:04:32.030772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:32.030772+0000","objects_scrubbed":32583,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:46.346152+0000","scrub_duration":4282,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2315649048,"num_objects":35335,"num_object_clones":0,"num_object_copies":106005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35335,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36617,"num_write_kb":2302401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"42'36777","reported_seq":37135,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:41.625321+0000","last_change":"2026-02-23T13:04:27.262519+0000","last_active":"2026-02-23T13:04:41.625321+0000","last_peered":"2026-02-23T13:04:41.625321+0000","last_clean":"2026-02-23T13:04:41.625321+0000","last_became_active":"2026-02-23T13:03:08.712348+0000","last_became_peered":"2026-02-23T13:03:08.712348+0000","last_unstale":"2026-02-23T13:04:41.625321+0000","last_undegraded":"2026-02-23T13:04:41.625321+0000","last_fullsized":"2026-02-23T13:04:41.625321+0000","mapping_epoch":28,"log_start":"42'36774","ondisk_log_start":"42'36774","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31725","last_scrub_stamp":"2026-02-23T13:04:27.262379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:27.262379+0000","objects_scrubbed":31138,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:36.061346+0000","scrub_duration":3485,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2325413888,"num_objects":35483,"num_object_clones":0,"num_object_copies":106449,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35483,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36777,"num_write_kb":2312320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":220,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:22.806187+0000","last_change":"2026-02-23T13:04:08.199097+0000","last_active":"2026-02-23T13:04:22.806187+0000","last_peered":"2026-02-23T13:04:22.806187+0000","last_clean":"2026-02-23T13:04:22.806187+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:04:22.806187+0000","last_undegraded":"2026-02-23T13:04:22.806187+0000","last_fullsized":"2026-02-23T13:04:22.806187+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:04:08.199036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:04:08.199036+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:23.231335+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"42'36525","reported_seq":36840,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:41.599107+0000","last_change":"2026-02-23T13:04:15.649890+0000","last_active":"2026-02-23T13:04:41.599107+0000","last_peered":"2026-02-23T13:04:41.599107+0000","last_clean":"2026-02-23T13:04:41.599107+0000","last_became_active":"2026-02-23T13:03:08.708695+0000","last_became_peered":"2026-02-23T13:03:08.708695+0000","last_unstale":"2026-02-23T13:04:41.599107+0000","last_undegraded":"2026-02-23T13:04:41.599107+0000","last_fullsized":"2026-02-23T13:04:41.599107+0000","mapping_epoch":28,"log_start":"42'36522","ondisk_log_start":"42'36522","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'27365","last_scrub_stamp":"2026-02-23T13:04:15.649815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:15.649815+0000","objects_scrubbed":26902,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:16.658945+0000","scrub_duration":2575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2317549568,"num_objects":35363,"num_object_clones":0,"num_object_copies":106089,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35363,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36525,"num_write_kb":2300416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"42'36559","reported_seq":36927,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:41.592366+0000","last_change":"2026-02-23T13:04:30.014412+0000","last_active":"2026-02-23T13:04:41.592366+0000","last_peered":"2026-02-23T13:04:41.592366+0000","last_clean":"2026-02-23T13:04:41.592366+0000","last_became_active":"2026-02-23T13:03:08.711847+0000","last_became_peered":"2026-02-23T13:03:08.711847+0000","last_unstale":"2026-02-23T13:04:41.592366+0000","last_undegraded":"2026-02-23T13:04:41.592366+0000","last_fullsized":"2026-02-23T13:04:41.592366+0000","mapping_epoch":28,"log_start":"42'36556","ondisk_log_start":"42'36556","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'32670","last_scrub_stamp":"2026-02-23T13:04:30.014332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:30.014332+0000","objects_scrubbed":32128,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:50.241908+0000","scrub_duration":3026,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2319253504,"num_objects":35389,"num_object_clones":0,"num_object_copies":106167,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35389,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36559,"num_write_kb":2302336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"42'36688","reported_seq":36998,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:41.630029+0000","last_change":"2026-02-23T13:04:14.687654+0000","last_active":"2026-02-23T13:04:41.630029+0000","last_peered":"2026-02-23T13:04:41.630029+0000","last_clean":"2026-02-23T13:04:41.630029+0000","last_became_active":"2026-02-23T13:03:08.712783+0000","last_became_peered":"2026-02-23T13:03:08.712783+0000","last_unstale":"2026-02-23T13:04:41.630029+0000","last_undegraded":"2026-02-23T13:04:41.630029+0000","last_fullsized":"2026-02-23T13:04:41.630029+0000","mapping_epoch":28,"log_start":"42'36685","ondisk_log_start":"42'36685","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'26930","last_scrub_stamp":"2026-02-23T13:04:14.687533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:14.687533+0000","objects_scrubbed":26390,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:29.989051+0000","scrub_duration":2902,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2327314432,"num_objects":35512,"num_object_clones":0,"num_object_copies":106536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35512,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36688,"num_write_kb":2310400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"42'36593","reported_seq":36945,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:41.599632+0000","last_change":"2026-02-23T13:04:25.882548+0000","last_active":"2026-02-23T13:04:41.599632+0000","last_peered":"2026-02-23T13:04:41.599632+0000","last_clean":"2026-02-23T13:04:41.599632+0000","last_became_active":"2026-02-23T13:03:08.708821+0000","last_became_peered":"2026-02-23T13:03:08.708821+0000","last_unstale":"2026-02-23T13:04:41.599632+0000","last_undegraded":"2026-02-23T13:04:41.599632+0000","last_fullsized":"2026-02-23T13:04:41.599632+0000","mapping_epoch":28,"log_start":"42'36590","ondisk_log_start":"42'36590","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31120","last_scrub_stamp":"2026-02-23T13:04:25.882487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:25.882487+0000","objects_scrubbed":30639,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:32.453655+0000","scrub_duration":2862,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2317680640,"num_objects":35365,"num_object_clones":0,"num_object_copies":106095,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35365,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36593,"num_write_kb":2302656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"42'36610","reported_seq":37010,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:41.625184+0000","last_change":"2026-02-23T13:04:39.437215+0000","last_active":"2026-02-23T13:04:41.625184+0000","last_peered":"2026-02-23T13:04:41.625184+0000","last_clean":"2026-02-23T13:04:41.625184+0000","last_became_active":"2026-02-23T13:03:08.712152+0000","last_became_peered":"2026-02-23T13:03:08.712152+0000","last_unstale":"2026-02-23T13:04:41.625184+0000","last_undegraded":"2026-02-23T13:04:41.625184+0000","last_fullsized":"2026-02-23T13:04:41.625184+0000","mapping_epoch":28,"log_start":"42'36607","ondisk_log_start":"42'36607","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'35859","last_scrub_stamp":"2026-02-23T13:04:39.437158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:39.437158+0000","objects_scrubbed":35127,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:52.724383+0000","scrub_duration":4536,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2316173312,"num_objects":35342,"num_object_clones":0,"num_object_copies":106026,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35342,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36610,"num_write_kb":2302464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"42'36314","reported_seq":36351,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:41.605012+0000","last_change":"2026-02-23T13:03:08.712205+0000","last_active":"2026-02-23T13:04:41.605012+0000","last_peered":"2026-02-23T13:04:41.605012+0000","last_clean":"2026-02-23T13:04:41.605012+0000","last_became_active":"2026-02-23T13:03:08.712055+0000","last_became_peered":"2026-02-23T13:03:08.712055+0000","last_unstale":"2026-02-23T13:04:41.605012+0000","last_undegraded":"2026-02-23T13:04:41.605012+0000","last_fullsized":"2026-02-23T13:04:41.605012+0000","mapping_epoch":28,"log_start":"42'36311","ondisk_log_start":"42'36311","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2300182528,"num_objects":35098,"num_object_clones":0,"num_object_copies":105294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35098,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36314,"num_write_kb":2285184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"42'36613","reported_seq":36965,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:41.629511+0000","last_change":"2026-02-23T13:04:25.319824+0000","last_active":"2026-02-23T13:04:41.629511+0000","last_peered":"2026-02-23T13:04:41.629511+0000","last_clean":"2026-02-23T13:04:41.629511+0000","last_became_active":"2026-02-23T13:03:08.708852+0000","last_became_peered":"2026-02-23T13:03:08.708852+0000","last_unstale":"2026-02-23T13:04:41.629511+0000","last_undegraded":"2026-02-23T13:04:41.629511+0000","last_fullsized":"2026-02-23T13:04:41.629511+0000","mapping_epoch":28,"log_start":"42'36610","ondisk_log_start":"42'36610","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31026","last_scrub_stamp":"2026-02-23T13:04:25.319785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:25.319785+0000","objects_scrubbed":30498,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:39.230588+0000","scrub_duration":3555,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2319646720,"num_objects":35395,"num_object_clones":0,"num_object_copies":106185,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35395,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36613,"num_write_kb":2304256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"42'36881","reported_seq":36919,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:41.600848+0000","last_change":"2026-02-23T13:03:08.708883+0000","last_active":"2026-02-23T13:04:41.600848+0000","last_peered":"2026-02-23T13:04:41.600848+0000","last_clean":"2026-02-23T13:04:41.600848+0000","last_became_active":"2026-02-23T13:03:08.708457+0000","last_became_peered":"2026-02-23T13:03:08.708457+0000","last_unstale":"2026-02-23T13:04:41.600848+0000","last_undegraded":"2026-02-23T13:04:41.600848+0000","last_fullsized":"2026-02-23T13:04:41.600848+0000","mapping_epoch":28,"log_start":"42'36878","ondisk_log_start":"42'36878","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2328297472,"num_objects":35527,"num_object_clones":0,"num_object_copies":106581,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35527,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36881,"num_write_kb":2317056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"42'36724","reported_seq":36959,"reported_epoch":42,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:04:41.597854+0000","last_change":"2026-02-23T13:04:39.887837+0000","last_active":"2026-02-23T13:04:41.597854+0000","last_peered":"2026-02-23T13:04:41.597854+0000","last_clean":"2026-02-23T13:04:41.597854+0000","last_became_active":"2026-02-23T13:03:08.712010+0000","last_became_peered":"2026-02-23T13:03:08.712010+0000","last_unstale":"2026-02-23T13:04:41.597854+0000","last_undegraded":"2026-02-23T13:04:41.597854+0000","last_fullsized":"2026-02-23T13:04:41.597854+0000","mapping_epoch":28,"log_start":"42'36721","ondisk_log_start":"42'36721","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":19299,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2326003712,"num_objects":35492,"num_object_clones":0,"num_object_copies":106476,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35492,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36724,"num_write_kb":2310912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"42'36369","reported_seq":36710,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:41.626327+0000","last_change":"2026-02-23T13:04:22.389549+0000","last_active":"2026-02-23T13:04:41.626327+0000","last_peered":"2026-02-23T13:04:41.626327+0000","last_clean":"2026-02-23T13:04:41.626327+0000","last_became_active":"2026-02-23T13:03:08.712763+0000","last_became_peered":"2026-02-23T13:03:08.712763+0000","last_unstale":"2026-02-23T13:04:41.626327+0000","last_undegraded":"2026-02-23T13:04:41.626327+0000","last_fullsized":"2026-02-23T13:04:41.626327+0000","mapping_epoch":28,"log_start":"42'36366","ondisk_log_start":"42'36366","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'29812","last_scrub_stamp":"2026-02-23T13:04:22.389498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:22.389498+0000","objects_scrubbed":29176,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:26.761128+0000","scrub_duration":3534,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2299330560,"num_objects":35085,"num_object_clones":0,"num_object_copies":105255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35085,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36369,"num_write_kb":2286528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"42'36650","reported_seq":37052,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:41.627006+0000","last_change":"2026-02-23T13:04:40.228341+0000","last_active":"2026-02-23T13:04:41.627006+0000","last_peered":"2026-02-23T13:04:41.627006+0000","last_clean":"2026-02-23T13:04:41.627006+0000","last_became_active":"2026-02-23T13:03:08.709391+0000","last_became_peered":"2026-02-23T13:03:08.709391+0000","last_unstale":"2026-02-23T13:04:41.627006+0000","last_undegraded":"2026-02-23T13:04:41.627006+0000","last_fullsized":"2026-02-23T13:04:41.627006+0000","mapping_epoch":28,"log_start":"42'36647","ondisk_log_start":"42'36647","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'36164","last_scrub_stamp":"2026-02-23T13:04:40.228295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:40.228295+0000","objects_scrubbed":35482,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:48.119450+0000","scrub_duration":4344,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2318401536,"num_objects":35376,"num_object_clones":0,"num_object_copies":106128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35376,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36650,"num_write_kb":2304832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"42'36405","reported_seq":36443,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:41.598901+0000","last_change":"2026-02-23T13:03:08.711473+0000","last_active":"2026-02-23T13:04:41.598901+0000","last_peered":"2026-02-23T13:04:41.598901+0000","last_clean":"2026-02-23T13:04:41.598901+0000","last_became_active":"2026-02-23T13:03:08.711303+0000","last_became_peered":"2026-02-23T13:03:08.711303+0000","last_unstale":"2026-02-23T13:04:41.598901+0000","last_undegraded":"2026-02-23T13:04:41.598901+0000","last_fullsized":"2026-02-23T13:04:41.598901+0000","mapping_epoch":28,"log_start":"42'36402","ondisk_log_start":"42'36402","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2310733824,"num_objects":35259,"num_object_clones":0,"num_object_copies":105777,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35259,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36405,"num_write_kb":2293248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":37094686744,"num_objects":566021,"num_object_clones":0,"num_object_copies":1698063,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":566021,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":585901,"num_write_kb":36861441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":111295475712,"data_stored":111295463496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247831,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":33907120,"kb_used_data":31905692,"kb_used_omap":16,"kb_used_meta":2001391,"kb_avail":700096080,"statfs":{"total":751619276800,"available":716898385920,"internally_reserved":0,"allocated":32671428608,"data_stored":32671154483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17246,"internal_metadata":2049424546},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444058,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":26670252,"kb_used_data":25102040,"kb_used_omap":20,"kb_used_meta":1568107,"kb_avail":707332948,"statfs":{"total":751619276800,"available":724308938752,"internally_reserved":0,"allocated":25704488960,"data_stored":25704218907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21155,"internal_metadata":1605741917},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":29076332,"kb_used_data":27363800,"kb_used_omap":23,"kb_used_meta":1712488,"kb_avail":704926868,"statfs":{"total":751619276800,"available":721845112832,"internally_reserved":0,"allocated":28020531200,"data_stored":28020260627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23759,"internal_metadata":1753588529},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,2,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705693,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":26693296,"kb_used_data":25125212,"kb_used_omap":25,"kb_used_meta":1568038,"kb_avail":707309904,"statfs":{"total":751619276800,"available":724285341696,"internally_reserved":0,"allocated":25728217088,"data_stored":25727942963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25712,"internal_metadata":1605671824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25499996160,"data_stored":25499992088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27834978304,"data_stored":27834974232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25511985152,"data_stored":25511985152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32448516096,"data_stored":32448512024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:04:44.138 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 31 2026-02-23T13:04:44.277 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:44.396 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:44.394+0000 7ff5a72f7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:44.396 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:44.394+0000 7ff5a72f7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:44.546 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-23T13:04:44.586 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:04:45.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:44 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2515047519' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:04:45.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:44 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3496560542' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "31"} : dispatch 2026-02-23T13:04:45.977 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:04:45.999 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:45 trial046 ceph-mon[38575]: from='client.14506 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:04:45.999 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:45 trial046 ceph-mon[38575]: pgmap v70: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 35 GiB data, 111 GiB used, 2.6 TiB / 2.7 TiB avail; 85 B/s rd, 238 MiB/s wr, 4.64k op/s 2026-02-23T13:04:46.114 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:46.229 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:46.227+0000 7f1290d60640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:46.229 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:46.227+0000 7f1290d60640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:46.243 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:04:46.243 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:04:46.256 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:04:46.257 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:04:46.257 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:04:46 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:04:46] "GET /metrics HTTP/1.1" 200 4239 "" "Prometheus/3.6.0" 2026-02-23T13:04:46.269 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:04:46.269 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:04:46.281 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:04:46.281 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:04:46.468 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:04:46 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:04:46.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:04:47.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:46 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:04:47.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:46 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1033834130' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:04:48.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:47 trial046 ceph-mon[38575]: pgmap v71: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 34 GiB data, 108 GiB used, 2.6 TiB / 2.7 TiB avail; 85 B/s rd, 238 MiB/s wr, 4.84k op/s 2026-02-23T13:04:48.321 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:04:48.457 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:48.580 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:48.577+0000 7ff413daf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:48.580 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:48.577+0000 7ff413daf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:48.594 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:04:48.595 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:04:48.608 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:04:48.608 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:04:48.619 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:04:48.620 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:04:48.632 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:04:48.632 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:04:49.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:48 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1782431543' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:04:49.587 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:04:49.588 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:04:49.588 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-23T13:04:49.588 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:04:49.718 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:49.837 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:49.834+0000 7f47d556b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:49.837 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:49.835+0000 7f47d556b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:49.978 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:04:49.978 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:04:49.979 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:49 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:04:49.979 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:49 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:04:49.979 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:49 trial046 ceph-mon[38575]: pgmap v72: 17 pgs: 17 active+clean; 32 GiB data, 104 GiB used, 2.6 TiB / 2.7 TiB avail; 85 B/s rd, 229 MiB/s wr, 7.73k op/s 2026-02-23T13:04:50.021 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2026-02-23T13:04:48.604591+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":34542584376,"num_objects":527072,"num_object_clones":0,"num_object_copies":1581216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":527072,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":624987,"num_write_kb":36863591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":109568120,"kb_used_data":102465192,"kb_used_omap":85,"kb_used_meta":7102634,"kb_avail":2826444680,"statfs":{"total":3006477107200,"available":2894279352320,"internally_reserved":0,"allocated":104924356608,"data_stored":104923267732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87872,"internal_metadata":7273097408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-327942120,"num_objects":-5003,"num_object_clones":0,"num_object_copies":-15009,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-5003,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":92779,"num_write_kb":2808769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001674"},"pg_stats":[{"pgid":"2.f","version":"42'39034","reported_seq":39389,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:46.594795+0000","last_change":"2026-02-23T13:04:26.095439+0000","last_active":"2026-02-23T13:04:46.594795+0000","last_peered":"2026-02-23T13:04:46.594795+0000","last_clean":"2026-02-23T13:04:46.594795+0000","last_became_active":"2026-02-23T13:03:08.711408+0000","last_became_peered":"2026-02-23T13:03:08.711408+0000","last_unstale":"2026-02-23T13:04:46.594795+0000","last_undegraded":"2026-02-23T13:04:46.594795+0000","last_fullsized":"2026-02-23T13:04:46.594795+0000","mapping_epoch":28,"log_start":"42'39031","ondisk_log_start":"42'39031","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31256","last_scrub_stamp":"2026-02-23T13:04:26.095384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:26.095384+0000","objects_scrubbed":30901,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:37.117824+0000","scrub_duration":2252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2164391936,"num_objects":33026,"num_object_clones":0,"num_object_copies":99078,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33026,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39034,"num_write_kb":2305920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"42'39397","reported_seq":39802,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:46.625769+0000","last_change":"2026-02-23T13:04:41.483173+0000","last_active":"2026-02-23T13:04:46.625769+0000","last_peered":"2026-02-23T13:04:46.625769+0000","last_clean":"2026-02-23T13:04:46.625769+0000","last_became_active":"2026-02-23T13:03:08.711462+0000","last_became_peered":"2026-02-23T13:03:08.711462+0000","last_unstale":"2026-02-23T13:04:46.625769+0000","last_undegraded":"2026-02-23T13:04:46.625769+0000","last_fullsized":"2026-02-23T13:04:46.625769+0000","mapping_epoch":28,"log_start":"42'39394","ondisk_log_start":"42'39394","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'36827","last_scrub_stamp":"2026-02-23T13:04:41.482975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:41.482975+0000","objects_scrubbed":35883,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:55.333749+0000","scrub_duration":4566,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2170486784,"num_objects":33119,"num_object_clones":0,"num_object_copies":99357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33119,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39397,"num_write_kb":2320512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"42'39077","reported_seq":39451,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:46.629610+0000","last_change":"2026-02-23T13:04:32.030814+0000","last_active":"2026-02-23T13:04:46.629610+0000","last_peered":"2026-02-23T13:04:46.629610+0000","last_clean":"2026-02-23T13:04:46.629610+0000","last_became_active":"2026-02-23T13:03:08.712246+0000","last_became_peered":"2026-02-23T13:03:08.712246+0000","last_unstale":"2026-02-23T13:04:46.629610+0000","last_undegraded":"2026-02-23T13:04:46.629610+0000","last_fullsized":"2026-02-23T13:04:46.629610+0000","mapping_epoch":28,"log_start":"42'39074","ondisk_log_start":"42'39074","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'33322","last_scrub_stamp":"2026-02-23T13:04:32.030772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:32.030772+0000","objects_scrubbed":32583,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:46.346152+0000","scrub_duration":4282,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2154430488,"num_objects":32875,"num_object_clones":0,"num_object_copies":98625,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32875,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":39077,"num_write_kb":2302401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"42'39270","reported_seq":39628,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:46.626448+0000","last_change":"2026-02-23T13:04:27.262519+0000","last_active":"2026-02-23T13:04:46.626448+0000","last_peered":"2026-02-23T13:04:46.626448+0000","last_clean":"2026-02-23T13:04:46.626448+0000","last_became_active":"2026-02-23T13:03:08.712348+0000","last_became_peered":"2026-02-23T13:03:08.712348+0000","last_unstale":"2026-02-23T13:04:46.626448+0000","last_undegraded":"2026-02-23T13:04:46.626448+0000","last_fullsized":"2026-02-23T13:04:46.626448+0000","mapping_epoch":28,"log_start":"42'39267","ondisk_log_start":"42'39267","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31725","last_scrub_stamp":"2026-02-23T13:04:27.262379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:27.262379+0000","objects_scrubbed":31138,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:36.061346+0000","scrub_duration":3485,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162032640,"num_objects":32990,"num_object_clones":0,"num_object_copies":98970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32990,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39270,"num_write_kb":2312320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":220,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:22.806187+0000","last_change":"2026-02-23T13:04:08.199097+0000","last_active":"2026-02-23T13:04:22.806187+0000","last_peered":"2026-02-23T13:04:22.806187+0000","last_clean":"2026-02-23T13:04:22.806187+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:04:22.806187+0000","last_undegraded":"2026-02-23T13:04:22.806187+0000","last_fullsized":"2026-02-23T13:04:22.806187+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:04:08.199036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:04:08.199036+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:23.231335+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"42'38957","reported_seq":39272,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:46.604011+0000","last_change":"2026-02-23T13:04:15.649890+0000","last_active":"2026-02-23T13:04:46.604011+0000","last_peered":"2026-02-23T13:04:46.604011+0000","last_clean":"2026-02-23T13:04:46.604011+0000","last_became_active":"2026-02-23T13:03:08.708695+0000","last_became_peered":"2026-02-23T13:03:08.708695+0000","last_unstale":"2026-02-23T13:04:46.604011+0000","last_undegraded":"2026-02-23T13:04:46.604011+0000","last_fullsized":"2026-02-23T13:04:46.604011+0000","mapping_epoch":28,"log_start":"42'38954","ondisk_log_start":"42'38954","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'27365","last_scrub_stamp":"2026-02-23T13:04:15.649815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:15.649815+0000","objects_scrubbed":26902,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:16.658945+0000","scrub_duration":2575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2158166016,"num_objects":32931,"num_object_clones":0,"num_object_copies":98793,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32931,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38957,"num_write_kb":2300416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"42'38917","reported_seq":39285,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:46.601671+0000","last_change":"2026-02-23T13:04:30.014412+0000","last_active":"2026-02-23T13:04:46.601671+0000","last_peered":"2026-02-23T13:04:46.601671+0000","last_clean":"2026-02-23T13:04:46.601671+0000","last_became_active":"2026-02-23T13:03:08.711847+0000","last_became_peered":"2026-02-23T13:03:08.711847+0000","last_unstale":"2026-02-23T13:04:46.601671+0000","last_undegraded":"2026-02-23T13:04:46.601671+0000","last_fullsized":"2026-02-23T13:04:46.601671+0000","mapping_epoch":28,"log_start":"42'38914","ondisk_log_start":"42'38914","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'32670","last_scrub_stamp":"2026-02-23T13:04:30.014332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:30.014332+0000","objects_scrubbed":32128,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:50.241908+0000","scrub_duration":3026,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2164719616,"num_objects":33031,"num_object_clones":0,"num_object_copies":99093,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33031,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38917,"num_write_kb":2302336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"42'39158","reported_seq":39468,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:46.626678+0000","last_change":"2026-02-23T13:04:14.687654+0000","last_active":"2026-02-23T13:04:46.626678+0000","last_peered":"2026-02-23T13:04:46.626678+0000","last_clean":"2026-02-23T13:04:46.626678+0000","last_became_active":"2026-02-23T13:03:08.712783+0000","last_became_peered":"2026-02-23T13:03:08.712783+0000","last_unstale":"2026-02-23T13:04:46.626678+0000","last_undegraded":"2026-02-23T13:04:46.626678+0000","last_fullsized":"2026-02-23T13:04:46.626678+0000","mapping_epoch":28,"log_start":"42'39155","ondisk_log_start":"42'39155","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'26930","last_scrub_stamp":"2026-02-23T13:04:14.687533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:14.687533+0000","objects_scrubbed":26390,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:29.989051+0000","scrub_duration":2902,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2165440512,"num_objects":33042,"num_object_clones":0,"num_object_copies":99126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33042,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39158,"num_write_kb":2310400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"42'39017","reported_seq":39369,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:46.599758+0000","last_change":"2026-02-23T13:04:25.882548+0000","last_active":"2026-02-23T13:04:46.599758+0000","last_peered":"2026-02-23T13:04:46.599758+0000","last_clean":"2026-02-23T13:04:46.599758+0000","last_became_active":"2026-02-23T13:03:08.708821+0000","last_became_peered":"2026-02-23T13:03:08.708821+0000","last_unstale":"2026-02-23T13:04:46.599758+0000","last_undegraded":"2026-02-23T13:04:46.599758+0000","last_fullsized":"2026-02-23T13:04:46.599758+0000","mapping_epoch":28,"log_start":"42'39014","ondisk_log_start":"42'39014","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31120","last_scrub_stamp":"2026-02-23T13:04:25.882487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:25.882487+0000","objects_scrubbed":30639,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:32.453655+0000","scrub_duration":2862,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2158821376,"num_objects":32941,"num_object_clones":0,"num_object_copies":98823,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32941,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39017,"num_write_kb":2302656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"42'38996","reported_seq":39396,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:46.628737+0000","last_change":"2026-02-23T13:04:39.437215+0000","last_active":"2026-02-23T13:04:46.628737+0000","last_peered":"2026-02-23T13:04:46.628737+0000","last_clean":"2026-02-23T13:04:46.628737+0000","last_became_active":"2026-02-23T13:03:08.712152+0000","last_became_peered":"2026-02-23T13:03:08.712152+0000","last_unstale":"2026-02-23T13:04:46.628737+0000","last_undegraded":"2026-02-23T13:04:46.628737+0000","last_fullsized":"2026-02-23T13:04:46.628737+0000","mapping_epoch":28,"log_start":"42'38993","ondisk_log_start":"42'38993","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'35859","last_scrub_stamp":"2026-02-23T13:04:39.437158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:39.437158+0000","objects_scrubbed":35127,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:52.724383+0000","scrub_duration":4536,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159804416,"num_objects":32956,"num_object_clones":0,"num_object_copies":98868,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32956,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38996,"num_write_kb":2302464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"42'38685","reported_seq":38723,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:46.601292+0000","last_change":"2026-02-23T13:03:08.712205+0000","last_active":"2026-02-23T13:04:46.601292+0000","last_peered":"2026-02-23T13:04:46.601292+0000","last_clean":"2026-02-23T13:04:46.601292+0000","last_became_active":"2026-02-23T13:03:08.712055+0000","last_became_peered":"2026-02-23T13:03:08.712055+0000","last_unstale":"2026-02-23T13:04:46.601292+0000","last_undegraded":"2026-02-23T13:04:46.601292+0000","last_fullsized":"2026-02-23T13:04:46.601292+0000","mapping_epoch":28,"log_start":"42'38682","ondisk_log_start":"42'38682","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2144796672,"num_objects":32727,"num_object_clones":0,"num_object_copies":98181,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32727,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38685,"num_write_kb":2285184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"42'39024","reported_seq":39376,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:46.630196+0000","last_change":"2026-02-23T13:04:25.319824+0000","last_active":"2026-02-23T13:04:46.630196+0000","last_peered":"2026-02-23T13:04:46.630196+0000","last_clean":"2026-02-23T13:04:46.630196+0000","last_became_active":"2026-02-23T13:03:08.708852+0000","last_became_peered":"2026-02-23T13:03:08.708852+0000","last_unstale":"2026-02-23T13:04:46.630196+0000","last_undegraded":"2026-02-23T13:04:46.630196+0000","last_fullsized":"2026-02-23T13:04:46.630196+0000","mapping_epoch":28,"log_start":"42'39021","ondisk_log_start":"42'39021","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31026","last_scrub_stamp":"2026-02-23T13:04:25.319785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:25.319785+0000","objects_scrubbed":30498,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:39.230588+0000","scrub_duration":3555,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2161639424,"num_objects":32984,"num_object_clones":0,"num_object_copies":98952,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32984,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39024,"num_write_kb":2304256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"42'39386","reported_seq":39424,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:46.603123+0000","last_change":"2026-02-23T13:03:08.708883+0000","last_active":"2026-02-23T13:04:46.603123+0000","last_peered":"2026-02-23T13:04:46.603123+0000","last_clean":"2026-02-23T13:04:46.603123+0000","last_became_active":"2026-02-23T13:03:08.708457+0000","last_became_peered":"2026-02-23T13:03:08.708457+0000","last_unstale":"2026-02-23T13:04:46.603123+0000","last_undegraded":"2026-02-23T13:04:46.603123+0000","last_fullsized":"2026-02-23T13:04:46.603123+0000","mapping_epoch":28,"log_start":"42'39383","ondisk_log_start":"42'39383","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2164129792,"num_objects":33022,"num_object_clones":0,"num_object_copies":99066,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33022,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39386,"num_write_kb":2317056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"42'39169","reported_seq":39573,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:46.604350+0000","last_change":"2026-02-23T13:04:43.225441+0000","last_active":"2026-02-23T13:04:46.604350+0000","last_peered":"2026-02-23T13:04:46.604350+0000","last_clean":"2026-02-23T13:04:46.604350+0000","last_became_active":"2026-02-23T13:03:08.712010+0000","last_became_peered":"2026-02-23T13:03:08.712010+0000","last_unstale":"2026-02-23T13:04:46.604350+0000","last_undegraded":"2026-02-23T13:04:46.604350+0000","last_fullsized":"2026-02-23T13:04:46.604350+0000","mapping_epoch":28,"log_start":"42'39166","ondisk_log_start":"42'39166","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'37378","last_scrub_stamp":"2026-02-23T13:04:43.225387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:43.225387+0000","objects_scrubbed":35509,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:53.679895+0000","scrub_duration":3337,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2165768192,"num_objects":33047,"num_object_clones":0,"num_object_copies":99141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33047,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39169,"num_write_kb":2310912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"42'38773","reported_seq":39113,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:46.627591+0000","last_change":"2026-02-23T13:04:22.389549+0000","last_active":"2026-02-23T13:04:46.627591+0000","last_peered":"2026-02-23T13:04:46.627591+0000","last_clean":"2026-02-23T13:04:46.627591+0000","last_became_active":"2026-02-23T13:03:08.712763+0000","last_became_peered":"2026-02-23T13:03:08.712763+0000","last_unstale":"2026-02-23T13:04:46.627591+0000","last_undegraded":"2026-02-23T13:04:46.627591+0000","last_fullsized":"2026-02-23T13:04:46.627591+0000","mapping_epoch":28,"log_start":"42'38770","ondisk_log_start":"42'38770","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'29812","last_scrub_stamp":"2026-02-23T13:04:22.389498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:22.389498+0000","objects_scrubbed":29176,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:26.761128+0000","scrub_duration":3534,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2141782016,"num_objects":32681,"num_object_clones":0,"num_object_copies":98043,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32681,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38773,"num_write_kb":2286528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"42'39132","reported_seq":39534,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:46.630267+0000","last_change":"2026-02-23T13:04:40.228341+0000","last_active":"2026-02-23T13:04:46.630267+0000","last_peered":"2026-02-23T13:04:46.630267+0000","last_clean":"2026-02-23T13:04:46.630267+0000","last_became_active":"2026-02-23T13:03:08.709391+0000","last_became_peered":"2026-02-23T13:03:08.709391+0000","last_unstale":"2026-02-23T13:04:46.630267+0000","last_undegraded":"2026-02-23T13:04:46.630267+0000","last_fullsized":"2026-02-23T13:04:46.630267+0000","mapping_epoch":28,"log_start":"42'39129","ondisk_log_start":"42'39129","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'36164","last_scrub_stamp":"2026-02-23T13:04:40.228295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:40.228295+0000","objects_scrubbed":35482,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:48.119450+0000","scrub_duration":4344,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2155741184,"num_objects":32894,"num_object_clones":0,"num_object_copies":98682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32894,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39132,"num_write_kb":2304832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"42'38860","reported_seq":38898,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:46.603538+0000","last_change":"2026-02-23T13:03:08.711473+0000","last_active":"2026-02-23T13:04:46.603538+0000","last_peered":"2026-02-23T13:04:46.603538+0000","last_clean":"2026-02-23T13:04:46.603538+0000","last_became_active":"2026-02-23T13:03:08.711303+0000","last_became_peered":"2026-02-23T13:03:08.711303+0000","last_unstale":"2026-02-23T13:04:46.603538+0000","last_undegraded":"2026-02-23T13:04:46.603538+0000","last_fullsized":"2026-02-23T13:04:46.603538+0000","mapping_epoch":28,"log_start":"42'38857","ondisk_log_start":"42'38857","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2149842944,"num_objects":32804,"num_object_clones":0,"num_object_copies":98412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32804,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38860,"num_write_kb":2293248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":34541994008,"num_objects":527070,"num_object_clones":0,"num_object_copies":1581210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":527070,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":624852,"num_write_kb":36861441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":103640543232,"data_stored":103640531016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247832,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":31895344,"kb_used_data":29839772,"kb_used_omap":16,"kb_used_meta":2055535,"kb_avail":702107856,"statfs":{"total":751619276800,"available":718958444544,"internally_reserved":0,"allocated":30555926528,"data_stored":30555652403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17246,"internal_metadata":2104868002},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444059,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":25070188,"kb_used_data":23429848,"kb_used_omap":20,"kb_used_meta":1640235,"kb_avail":708933012,"statfs":{"total":751619276800,"available":725947404288,"internally_reserved":0,"allocated":23992164352,"data_stored":23991894299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21155,"internal_metadata":1679600989},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27380012,"kb_used_data":25613336,"kb_used_omap":23,"kb_used_meta":1766632,"kb_avail":706623188,"statfs":{"total":751619276800,"available":723582144512,"internally_reserved":0,"allocated":26228056064,"data_stored":26227785491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23759,"internal_metadata":1809031985},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705694,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":25222576,"kb_used_data":23582236,"kb_used_omap":25,"kb_used_meta":1640230,"kb_avail":708780624,"statfs":{"total":751619276800,"available":725791358976,"internally_reserved":0,"allocated":24148209664,"data_stored":24147935539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25712,"internal_metadata":1679596432},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23750709248,"data_stored":23750705176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25913921536,"data_stored":25913917464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23759093760,"data_stored":23759093760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":30216818688,"data_stored":30216814616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:04:50.022 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 31 2026-02-23T13:04:50.153 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:50.266 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:50.264+0000 7fa24b67d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:50.267 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:50.265+0000 7fa24b67d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:50.390 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-23T13:04:50.426 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:04:50.674 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:04:50.804 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:50.921 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:50.919+0000 7f5d08638640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:50.921 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:50.919+0000 7f5d08638640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:50.935 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:04:50.935 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:04:50.935 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:50 trial046 ceph-mon[38575]: 2.7 scrub starts 2026-02-23T13:04:50.935 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:50 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1268168369' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "31"} : dispatch 2026-02-23T13:04:50.948 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:04:50.948 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:04:50.960 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:04:50.960 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:04:50.973 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:04:50.973 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:04:52.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:51 trial046 ceph-mon[38575]: from='client.14514 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:04:52.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:51 trial046 ceph-mon[38575]: pgmap v73: 17 pgs: 17 active+clean; 32 GiB data, 104 GiB used, 2.6 TiB / 2.7 TiB avail; 85 B/s rd, 80 MiB/s wr, 5.36k op/s 2026-02-23T13:04:52.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:51 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2008043597' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:04:53.013 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:04:53.151 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:53.549 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:53.546+0000 7fa54979e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:53.549 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:53.546+0000 7fa54979e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:53.562 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:04:53.562 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:04:53.577 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:04:53.578 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:04:53.589 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:04:53.589 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:04:53.600 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:04:53.600 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:04:53.914 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:53 trial046 ceph-mon[38575]: pgmap v74: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 30 GiB data, 96 GiB used, 2.6 TiB / 2.7 TiB avail; 85 B/s rd, 80 MiB/s wr, 8.46k op/s 2026-02-23T13:04:53.914 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:53 trial046 ceph-mon[38575]: 2.b scrub starts 2026-02-23T13:04:53.914 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:53 trial046 ceph-mon[38575]: 2.7 scrub ok 2026-02-23T13:04:53.914 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:53 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1752006231' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:04:55.428 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:04:55.428 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:04:55.428 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_0 2026-02-23T13:04:55.429 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:04:55.563 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:55.679 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:55.677+0000 7fb0e95bb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:55.680 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:55.677+0000 7fb0e95bb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:55.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:55 trial046 ceph-mon[38575]: pgmap v75: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 30 GiB data, 96 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 6.35k op/s 2026-02-23T13:04:55.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:55 trial046 ceph-mon[38575]: 2.5 scrub starts 2026-02-23T13:04:55.809 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:04:55.810 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:04:55.853 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2026-02-23T13:04:54.605339+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":32098550328,"num_objects":489779,"num_object_clones":0,"num_object_copies":1469337,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":489779,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":662280,"num_write_kb":36863591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":101127928,"kb_used_data":95003112,"kb_used_omap":73,"kb_used_meta":6124598,"kb_avail":2834884872,"statfs":{"total":3006477107200,"available":2902922108928,"internally_reserved":0,"allocated":97283186688,"data_stored":97282097812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":75726,"internal_metadata":6271588402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,3,3,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4996726784,"num_objects":-76244,"num_object_clones":0,"num_object_copies":-228732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-76244,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76244,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001567"},"pg_stats":[{"pgid":"2.f","version":"42'41412","reported_seq":41767,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:51.598049+0000","last_change":"2026-02-23T13:04:26.095439+0000","last_active":"2026-02-23T13:04:51.598049+0000","last_peered":"2026-02-23T13:04:51.598049+0000","last_clean":"2026-02-23T13:04:51.598049+0000","last_became_active":"2026-02-23T13:03:08.711408+0000","last_became_peered":"2026-02-23T13:03:08.711408+0000","last_unstale":"2026-02-23T13:04:51.598049+0000","last_undegraded":"2026-02-23T13:04:51.598049+0000","last_fullsized":"2026-02-23T13:04:51.598049+0000","mapping_epoch":28,"log_start":"42'41409","ondisk_log_start":"42'41409","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31256","last_scrub_stamp":"2026-02-23T13:04:26.095384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:26.095384+0000","objects_scrubbed":30901,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:37.117824+0000","scrub_duration":2252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2008547328,"num_objects":30648,"num_object_clones":0,"num_object_copies":91944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30648,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41412,"num_write_kb":2305920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"42'41741","reported_seq":42146,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:51.627193+0000","last_change":"2026-02-23T13:04:41.483173+0000","last_active":"2026-02-23T13:04:51.627193+0000","last_peered":"2026-02-23T13:04:51.627193+0000","last_clean":"2026-02-23T13:04:51.627193+0000","last_became_active":"2026-02-23T13:03:08.711462+0000","last_became_peered":"2026-02-23T13:03:08.711462+0000","last_unstale":"2026-02-23T13:04:51.627193+0000","last_undegraded":"2026-02-23T13:04:51.627193+0000","last_fullsized":"2026-02-23T13:04:51.627193+0000","mapping_epoch":28,"log_start":"42'41738","ondisk_log_start":"42'41738","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'36827","last_scrub_stamp":"2026-02-23T13:04:41.482975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:41.482975+0000","objects_scrubbed":35883,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:55.333749+0000","scrub_duration":4566,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2016870400,"num_objects":30775,"num_object_clones":0,"num_object_copies":92325,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30775,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41741,"num_write_kb":2320512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"42'41361","reported_seq":41735,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:51.631052+0000","last_change":"2026-02-23T13:04:32.030814+0000","last_active":"2026-02-23T13:04:51.631052+0000","last_peered":"2026-02-23T13:04:51.631052+0000","last_clean":"2026-02-23T13:04:51.631052+0000","last_became_active":"2026-02-23T13:03:08.712246+0000","last_became_peered":"2026-02-23T13:03:08.712246+0000","last_unstale":"2026-02-23T13:04:51.631052+0000","last_undegraded":"2026-02-23T13:04:51.631052+0000","last_fullsized":"2026-02-23T13:04:51.631052+0000","mapping_epoch":28,"log_start":"42'41358","ondisk_log_start":"42'41358","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'33322","last_scrub_stamp":"2026-02-23T13:04:32.030772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:32.030772+0000","objects_scrubbed":32583,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:46.346152+0000","scrub_duration":4282,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2004746264,"num_objects":30591,"num_object_clones":0,"num_object_copies":91773,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30591,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":41361,"num_write_kb":2302401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"42'41578","reported_seq":41935,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:51.617126+0000","last_change":"2026-02-23T13:04:27.262519+0000","last_active":"2026-02-23T13:04:51.617126+0000","last_peered":"2026-02-23T13:04:51.617126+0000","last_clean":"2026-02-23T13:04:51.617126+0000","last_became_active":"2026-02-23T13:03:08.712348+0000","last_became_peered":"2026-02-23T13:03:08.712348+0000","last_unstale":"2026-02-23T13:04:51.617126+0000","last_undegraded":"2026-02-23T13:04:51.617126+0000","last_fullsized":"2026-02-23T13:04:51.617126+0000","mapping_epoch":28,"log_start":"42'41575","ondisk_log_start":"42'41575","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31725","last_scrub_stamp":"2026-02-23T13:04:27.262379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:27.262379+0000","objects_scrubbed":31138,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:36.061346+0000","scrub_duration":3485,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2010775552,"num_objects":30682,"num_object_clones":0,"num_object_copies":92046,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30682,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41578,"num_write_kb":2312320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":220,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:22.806187+0000","last_change":"2026-02-23T13:04:08.199097+0000","last_active":"2026-02-23T13:04:22.806187+0000","last_peered":"2026-02-23T13:04:22.806187+0000","last_clean":"2026-02-23T13:04:22.806187+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:04:22.806187+0000","last_undegraded":"2026-02-23T13:04:22.806187+0000","last_fullsized":"2026-02-23T13:04:22.806187+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:04:08.199036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:04:08.199036+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:23.231335+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"42'41254","reported_seq":41569,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:51.603052+0000","last_change":"2026-02-23T13:04:15.649890+0000","last_active":"2026-02-23T13:04:51.603052+0000","last_peered":"2026-02-23T13:04:51.603052+0000","last_clean":"2026-02-23T13:04:51.603052+0000","last_became_active":"2026-02-23T13:03:08.708695+0000","last_became_peered":"2026-02-23T13:03:08.708695+0000","last_unstale":"2026-02-23T13:04:51.603052+0000","last_undegraded":"2026-02-23T13:04:51.603052+0000","last_fullsized":"2026-02-23T13:04:51.603052+0000","mapping_epoch":28,"log_start":"42'41251","ondisk_log_start":"42'41251","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'27365","last_scrub_stamp":"2026-02-23T13:04:15.649815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:15.649815+0000","objects_scrubbed":26902,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:16.658945+0000","scrub_duration":2575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2007629824,"num_objects":30634,"num_object_clones":0,"num_object_copies":91902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30634,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41254,"num_write_kb":2300416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"42'41342","reported_seq":41710,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:51.605892+0000","last_change":"2026-02-23T13:04:30.014412+0000","last_active":"2026-02-23T13:04:51.605892+0000","last_peered":"2026-02-23T13:04:51.605892+0000","last_clean":"2026-02-23T13:04:51.605892+0000","last_became_active":"2026-02-23T13:03:08.711847+0000","last_became_peered":"2026-02-23T13:03:08.711847+0000","last_unstale":"2026-02-23T13:04:51.605892+0000","last_undegraded":"2026-02-23T13:04:51.605892+0000","last_fullsized":"2026-02-23T13:04:51.605892+0000","mapping_epoch":28,"log_start":"42'41339","ondisk_log_start":"42'41339","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'32670","last_scrub_stamp":"2026-02-23T13:04:30.014332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:30.014332+0000","objects_scrubbed":32128,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:50.241908+0000","scrub_duration":3026,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2005794816,"num_objects":30606,"num_object_clones":0,"num_object_copies":91818,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30606,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41342,"num_write_kb":2302336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"42'41467","reported_seq":41777,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:51.629677+0000","last_change":"2026-02-23T13:04:14.687654+0000","last_active":"2026-02-23T13:04:51.629677+0000","last_peered":"2026-02-23T13:04:51.629677+0000","last_clean":"2026-02-23T13:04:51.629677+0000","last_became_active":"2026-02-23T13:03:08.712783+0000","last_became_peered":"2026-02-23T13:03:08.712783+0000","last_unstale":"2026-02-23T13:04:51.629677+0000","last_undegraded":"2026-02-23T13:04:51.629677+0000","last_fullsized":"2026-02-23T13:04:51.629677+0000","mapping_epoch":28,"log_start":"42'41464","ondisk_log_start":"42'41464","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'26930","last_scrub_stamp":"2026-02-23T13:04:14.687533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:14.687533+0000","objects_scrubbed":26390,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:29.989051+0000","scrub_duration":2902,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2014117888,"num_objects":30733,"num_object_clones":0,"num_object_copies":92199,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30733,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41467,"num_write_kb":2310400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"42'41359","reported_seq":41711,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:51.606878+0000","last_change":"2026-02-23T13:04:25.882548+0000","last_active":"2026-02-23T13:04:51.606878+0000","last_peered":"2026-02-23T13:04:51.606878+0000","last_clean":"2026-02-23T13:04:51.606878+0000","last_became_active":"2026-02-23T13:03:08.708821+0000","last_became_peered":"2026-02-23T13:03:08.708821+0000","last_unstale":"2026-02-23T13:04:51.606878+0000","last_undegraded":"2026-02-23T13:04:51.606878+0000","last_fullsized":"2026-02-23T13:04:51.606878+0000","mapping_epoch":28,"log_start":"42'41356","ondisk_log_start":"42'41356","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31120","last_scrub_stamp":"2026-02-23T13:04:25.882487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:25.882487+0000","objects_scrubbed":30639,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:32.453655+0000","scrub_duration":2862,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2005336064,"num_objects":30599,"num_object_clones":0,"num_object_copies":91797,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30599,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41359,"num_write_kb":2302656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"42'41301","reported_seq":41701,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:51.628062+0000","last_change":"2026-02-23T13:04:39.437215+0000","last_active":"2026-02-23T13:04:51.628062+0000","last_peered":"2026-02-23T13:04:51.628062+0000","last_clean":"2026-02-23T13:04:51.628062+0000","last_became_active":"2026-02-23T13:03:08.712152+0000","last_became_peered":"2026-02-23T13:03:08.712152+0000","last_unstale":"2026-02-23T13:04:51.628062+0000","last_undegraded":"2026-02-23T13:04:51.628062+0000","last_fullsized":"2026-02-23T13:04:51.628062+0000","mapping_epoch":28,"log_start":"42'41298","ondisk_log_start":"42'41298","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'35859","last_scrub_stamp":"2026-02-23T13:04:39.437158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:39.437158+0000","objects_scrubbed":35127,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:52.724383+0000","scrub_duration":4536,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2008743936,"num_objects":30651,"num_object_clones":0,"num_object_copies":91953,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30651,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41301,"num_write_kb":2302464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"42'41025","reported_seq":41063,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:51.597772+0000","last_change":"2026-02-23T13:03:08.712205+0000","last_active":"2026-02-23T13:04:51.597772+0000","last_peered":"2026-02-23T13:04:51.597772+0000","last_clean":"2026-02-23T13:04:51.597772+0000","last_became_active":"2026-02-23T13:03:08.712055+0000","last_became_peered":"2026-02-23T13:03:08.712055+0000","last_unstale":"2026-02-23T13:04:51.597772+0000","last_undegraded":"2026-02-23T13:04:51.597772+0000","last_fullsized":"2026-02-23T13:04:51.597772+0000","mapping_epoch":28,"log_start":"42'41022","ondisk_log_start":"42'41022","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1991442432,"num_objects":30387,"num_object_clones":0,"num_object_copies":91161,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30387,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41025,"num_write_kb":2285184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"42'41354","reported_seq":41707,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:51.628911+0000","last_change":"2026-02-23T13:04:25.319824+0000","last_active":"2026-02-23T13:04:51.628911+0000","last_peered":"2026-02-23T13:04:51.628911+0000","last_clean":"2026-02-23T13:04:51.628911+0000","last_became_active":"2026-02-23T13:03:08.708852+0000","last_became_peered":"2026-02-23T13:03:08.708852+0000","last_unstale":"2026-02-23T13:04:51.628911+0000","last_undegraded":"2026-02-23T13:04:51.628911+0000","last_fullsized":"2026-02-23T13:04:51.628911+0000","mapping_epoch":28,"log_start":"42'41351","ondisk_log_start":"42'41351","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31026","last_scrub_stamp":"2026-02-23T13:04:25.319785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:25.319785+0000","objects_scrubbed":30498,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:39.230588+0000","scrub_duration":3555,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2008940544,"num_objects":30654,"num_object_clones":0,"num_object_copies":91962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30654,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41354,"num_write_kb":2304256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"42'41771","reported_seq":41973,"reported_epoch":42,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:04:51.608465+0000","last_change":"2026-02-23T13:04:49.921738+0000","last_active":"2026-02-23T13:04:51.608465+0000","last_peered":"2026-02-23T13:04:51.608465+0000","last_clean":"2026-02-23T13:04:51.608465+0000","last_became_active":"2026-02-23T13:03:08.708457+0000","last_became_peered":"2026-02-23T13:03:08.708457+0000","last_unstale":"2026-02-23T13:04:51.608465+0000","last_undegraded":"2026-02-23T13:04:51.608465+0000","last_fullsized":"2026-02-23T13:04:51.608465+0000","mapping_epoch":28,"log_start":"42'41768","ondisk_log_start":"42'41768","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":15899,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2007826432,"num_objects":30637,"num_object_clones":0,"num_object_copies":91911,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30637,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41771,"num_write_kb":2317056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"42'41455","reported_seq":41859,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:51.606155+0000","last_change":"2026-02-23T13:04:43.225441+0000","last_active":"2026-02-23T13:04:51.606155+0000","last_peered":"2026-02-23T13:04:51.606155+0000","last_clean":"2026-02-23T13:04:51.606155+0000","last_became_active":"2026-02-23T13:03:08.712010+0000","last_became_peered":"2026-02-23T13:03:08.712010+0000","last_unstale":"2026-02-23T13:04:51.606155+0000","last_undegraded":"2026-02-23T13:04:51.606155+0000","last_fullsized":"2026-02-23T13:04:51.606155+0000","mapping_epoch":28,"log_start":"42'41452","ondisk_log_start":"42'41452","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'37378","last_scrub_stamp":"2026-02-23T13:04:43.225387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:43.225387+0000","objects_scrubbed":35509,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:53.679895+0000","scrub_duration":3337,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2015952896,"num_objects":30761,"num_object_clones":0,"num_object_copies":92283,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30761,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41455,"num_write_kb":2310912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"42'41104","reported_seq":41445,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:51.626882+0000","last_change":"2026-02-23T13:04:22.389549+0000","last_active":"2026-02-23T13:04:51.626882+0000","last_peered":"2026-02-23T13:04:51.626882+0000","last_clean":"2026-02-23T13:04:51.626882+0000","last_became_active":"2026-02-23T13:03:08.712763+0000","last_became_peered":"2026-02-23T13:03:08.712763+0000","last_unstale":"2026-02-23T13:04:51.626882+0000","last_undegraded":"2026-02-23T13:04:51.626882+0000","last_fullsized":"2026-02-23T13:04:51.626882+0000","mapping_epoch":28,"log_start":"42'41101","ondisk_log_start":"42'41101","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'29812","last_scrub_stamp":"2026-02-23T13:04:22.389498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:22.389498+0000","objects_scrubbed":29176,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:26.761128+0000","scrub_duration":3534,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1989017600,"num_objects":30350,"num_object_clones":0,"num_object_copies":91050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30350,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41104,"num_write_kb":2286528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"42'41443","reported_seq":41846,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:51.627408+0000","last_change":"2026-02-23T13:04:40.228341+0000","last_active":"2026-02-23T13:04:51.627408+0000","last_peered":"2026-02-23T13:04:51.627408+0000","last_clean":"2026-02-23T13:04:51.627408+0000","last_became_active":"2026-02-23T13:03:08.709391+0000","last_became_peered":"2026-02-23T13:03:08.709391+0000","last_unstale":"2026-02-23T13:04:51.627408+0000","last_undegraded":"2026-02-23T13:04:51.627408+0000","last_fullsized":"2026-02-23T13:04:51.627408+0000","mapping_epoch":28,"log_start":"42'41440","ondisk_log_start":"42'41440","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'36164","last_scrub_stamp":"2026-02-23T13:04:40.228295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:40.228295+0000","objects_scrubbed":35482,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:48.119450+0000","scrub_duration":4344,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2004287488,"num_objects":30583,"num_object_clones":0,"num_object_copies":91749,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30583,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41443,"num_write_kb":2304832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"42'41178","reported_seq":41216,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:51.600047+0000","last_change":"2026-02-23T13:03:08.711473+0000","last_active":"2026-02-23T13:04:51.600047+0000","last_peered":"2026-02-23T13:04:51.600047+0000","last_clean":"2026-02-23T13:04:51.600047+0000","last_became_active":"2026-02-23T13:03:08.711303+0000","last_became_peered":"2026-02-23T13:03:08.711303+0000","last_unstale":"2026-02-23T13:04:51.600047+0000","last_undegraded":"2026-02-23T13:04:51.600047+0000","last_fullsized":"2026-02-23T13:04:51.600047+0000","mapping_epoch":28,"log_start":"42'41175","ondisk_log_start":"42'41175","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1997930496,"num_objects":30486,"num_object_clones":0,"num_object_copies":91458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30486,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41178,"num_write_kb":2293248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":32097959960,"num_objects":489777,"num_object_clones":0,"num_object_copies":1469331,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":489777,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":662145,"num_write_kb":36861441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":96305295360,"data_stored":96305283144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247833,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28591920,"kb_used_data":27658780,"kb_used_omap":4,"kb_used_meta":933115,"kb_avail":705411280,"statfs":{"total":751619276800,"available":722341150720,"internally_reserved":0,"allocated":28322590720,"data_stored":28322316595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4449,"internal_metadata":955510431},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,3,3,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444060,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":23441772,"kb_used_data":21747288,"kb_used_omap":20,"kb_used_meta":1694379,"kb_avail":710561428,"statfs":{"total":751619276800,"available":727614902272,"internally_reserved":0,"allocated":22269222912,"data_stored":22268952859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21155,"internal_metadata":1735044445},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":25582700,"kb_used_data":23761880,"kb_used_omap":23,"kb_used_meta":1820776,"kb_avail":708420500,"statfs":{"total":751619276800,"available":725422592000,"internally_reserved":0,"allocated":24332165120,"data_stored":24331894547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23759,"internal_metadata":1864475441},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705695,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":23511536,"kb_used_data":21835164,"kb_used_omap":25,"kb_used_meta":1676326,"kb_avail":710491664,"statfs":{"total":751619276800,"available":727543463936,"internally_reserved":0,"allocated":22359207936,"data_stored":22358933811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26363,"internal_metadata":1716558085},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":22070824960,"data_stored":22070820888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24080945152,"data_stored":24080941080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22077702144,"data_stored":22077702144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28075823104,"data_stored":28075819032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:04:55.855 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_0 pgp_num 56 2026-02-23T13:04:55.990 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:56.116 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:56.114+0000 7fa5a2c2f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:56.116 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:56.114+0000 7fa5a2c2f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:56.179 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:04:56.256 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-23T13:04:56.294 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:04:56.318 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:56.343 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:04:56 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:04:56] "GET /metrics HTTP/1.1" 200 4239 "" "Prometheus/3.6.0" 2026-02-23T13:04:56.435 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:56.433+0000 7ff6c00de640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:56.435 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:56.433+0000 7ff6c00de640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:56.448 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:04:56.449 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:04:56.460 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:04:56.460 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:04:56.474 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:04:56.474 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:04:56.486 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:04:56.487 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:04:56.560 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:04:56 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:04:56.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:04:57.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:56 trial046 ceph-mon[38575]: from='client.14522 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:04:57.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:56 trial046 ceph-mon[38575]: 2.b scrub ok 2026-02-23T13:04:57.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:56 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2904110683' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_0", "var": "pgp_num", "val": "56"} : dispatch 2026-02-23T13:04:57.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:56 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2291144638' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:04:58.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:57 trial046 ceph-mon[38575]: pgmap v76: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 30 GiB data, 94 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 6.52k op/s 2026-02-23T13:04:58.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:57 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:04:58.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:57 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:04:58.528 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:04:58.667 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:04:58.791 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:58.790+0000 7f836cec1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:58.791 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:04:58.790+0000 7f836cec1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:04:58.806 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:04:58.806 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:04:58.806 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:58 trial046 ceph-mon[38575]: 2.5 scrub ok 2026-02-23T13:04:58.818 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:04:58.818 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:04:58.830 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:04:58.830 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:04:58.843 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:04:58.843 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:05:00.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:59 trial046 ceph-mon[38575]: pgmap v77: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 28 GiB data, 91 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 8.96k op/s 2026-02-23T13:05:00.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:59 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:05:00.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:59 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:05:00.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:59 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:05:00.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:59 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:05:00.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:04:59 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/607081472' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:05:00.883 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:05:01.019 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:01.291 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:01.290+0000 7f0b1090c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:01.291 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:01.290+0000 7f0b1090c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:01.294 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:05:01.294 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:05:01.295 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:05:01.304 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:05:01.304 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:05:01.319 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:05:01.319 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:05:01.331 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:05:01.331 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:05:01.344 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:05:01.344 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:05:01.433 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:01.555 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:01.553+0000 7f64c9d6a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:01.555 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:01.554+0000 7f64c9d6a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:01.698 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:05:01.698 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:05:01.741 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:01 trial046 ceph-mon[38575]: pgmap v78: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 28 GiB data, 91 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 5.91k op/s 2026-02-23T13:05:01.742 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:01 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:05:01.742 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:01 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3222860447' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:05:01.743 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2026-02-23T13:05:00.606123+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29893591608,"num_objects":456134,"num_object_clones":0,"num_object_copies":1368402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":456134,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":695925,"num_write_kb":36863591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":94901816,"kb_used_data":88614568,"kb_used_omap":73,"kb_used_meta":6287030,"kb_avail":2841110984,"statfs":{"total":3006477107200,"available":2909297647616,"internally_reserved":0,"allocated":90741317632,"data_stored":90740228756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":75726,"internal_metadata":6437918770},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4648992768,"num_objects":-70938,"num_object_clones":0,"num_object_copies":-212814,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-70938,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70938,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001531"},"pg_stats":[{"pgid":"2.f","version":"42'43462","reported_seq":43817,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:56.595060+0000","last_change":"2026-02-23T13:04:26.095439+0000","last_active":"2026-02-23T13:04:56.595060+0000","last_peered":"2026-02-23T13:04:56.595060+0000","last_clean":"2026-02-23T13:04:56.595060+0000","last_became_active":"2026-02-23T13:03:08.711408+0000","last_became_peered":"2026-02-23T13:03:08.711408+0000","last_unstale":"2026-02-23T13:04:56.595060+0000","last_undegraded":"2026-02-23T13:04:56.595060+0000","last_fullsized":"2026-02-23T13:04:56.595060+0000","mapping_epoch":28,"log_start":"42'43459","ondisk_log_start":"42'43459","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31256","last_scrub_stamp":"2026-02-23T13:04:26.095384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:26.095384+0000","objects_scrubbed":30901,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:37.117824+0000","scrub_duration":2252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1874198528,"num_objects":28598,"num_object_clones":0,"num_object_copies":85794,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28598,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43462,"num_write_kb":2305920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"42'43917","reported_seq":44322,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:56.624385+0000","last_change":"2026-02-23T13:04:41.483173+0000","last_active":"2026-02-23T13:04:56.624385+0000","last_peered":"2026-02-23T13:04:56.624385+0000","last_clean":"2026-02-23T13:04:56.624385+0000","last_became_active":"2026-02-23T13:03:08.711462+0000","last_became_peered":"2026-02-23T13:03:08.711462+0000","last_unstale":"2026-02-23T13:04:56.624385+0000","last_undegraded":"2026-02-23T13:04:56.624385+0000","last_fullsized":"2026-02-23T13:04:56.624385+0000","mapping_epoch":28,"log_start":"42'43914","ondisk_log_start":"42'43914","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'36827","last_scrub_stamp":"2026-02-23T13:04:41.482975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:41.482975+0000","objects_scrubbed":35883,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:55.333749+0000","scrub_duration":4566,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1874264064,"num_objects":28599,"num_object_clones":0,"num_object_copies":85797,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28599,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43917,"num_write_kb":2320512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"42'43435","reported_seq":43808,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:56.630980+0000","last_change":"2026-02-23T13:04:32.030814+0000","last_active":"2026-02-23T13:04:56.630980+0000","last_peered":"2026-02-23T13:04:56.630980+0000","last_clean":"2026-02-23T13:04:56.630980+0000","last_became_active":"2026-02-23T13:03:08.712246+0000","last_became_peered":"2026-02-23T13:03:08.712246+0000","last_unstale":"2026-02-23T13:04:56.630980+0000","last_undegraded":"2026-02-23T13:04:56.630980+0000","last_fullsized":"2026-02-23T13:04:56.630980+0000","mapping_epoch":28,"log_start":"42'43431","ondisk_log_start":"42'43431","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'33322","last_scrub_stamp":"2026-02-23T13:04:32.030772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:32.030772+0000","objects_scrubbed":32583,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:46.346152+0000","scrub_duration":4282,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1868824600,"num_objects":28517,"num_object_clones":0,"num_object_copies":85551,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28517,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":43435,"num_write_kb":2302401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"42'43610","reported_seq":43968,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:56.625244+0000","last_change":"2026-02-23T13:04:27.262519+0000","last_active":"2026-02-23T13:04:56.625244+0000","last_peered":"2026-02-23T13:04:56.625244+0000","last_clean":"2026-02-23T13:04:56.625244+0000","last_became_active":"2026-02-23T13:03:08.712348+0000","last_became_peered":"2026-02-23T13:03:08.712348+0000","last_unstale":"2026-02-23T13:04:56.625244+0000","last_undegraded":"2026-02-23T13:04:56.625244+0000","last_fullsized":"2026-02-23T13:04:56.625244+0000","mapping_epoch":28,"log_start":"42'43607","ondisk_log_start":"42'43607","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31725","last_scrub_stamp":"2026-02-23T13:04:27.262379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:27.262379+0000","objects_scrubbed":31138,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:36.061346+0000","scrub_duration":3485,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1877606400,"num_objects":28650,"num_object_clones":0,"num_object_copies":85950,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28650,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43610,"num_write_kb":2312320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":220,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:22.806187+0000","last_change":"2026-02-23T13:04:08.199097+0000","last_active":"2026-02-23T13:04:22.806187+0000","last_peered":"2026-02-23T13:04:22.806187+0000","last_clean":"2026-02-23T13:04:22.806187+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:04:22.806187+0000","last_undegraded":"2026-02-23T13:04:22.806187+0000","last_fullsized":"2026-02-23T13:04:22.806187+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:04:08.199036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:04:08.199036+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:23.231335+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"42'43412","reported_seq":43727,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:56.602320+0000","last_change":"2026-02-23T13:04:15.649890+0000","last_active":"2026-02-23T13:04:56.602320+0000","last_peered":"2026-02-23T13:04:56.602320+0000","last_clean":"2026-02-23T13:04:56.602320+0000","last_became_active":"2026-02-23T13:03:08.708695+0000","last_became_peered":"2026-02-23T13:03:08.708695+0000","last_unstale":"2026-02-23T13:04:56.602320+0000","last_undegraded":"2026-02-23T13:04:56.602320+0000","last_fullsized":"2026-02-23T13:04:56.602320+0000","mapping_epoch":28,"log_start":"42'43409","ondisk_log_start":"42'43409","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'27365","last_scrub_stamp":"2026-02-23T13:04:15.649815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:15.649815+0000","objects_scrubbed":26902,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:16.658945+0000","scrub_duration":2575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1866203136,"num_objects":28476,"num_object_clones":0,"num_object_copies":85428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28476,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43412,"num_write_kb":2300416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"42'43409","reported_seq":43776,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:56.604666+0000","last_change":"2026-02-23T13:04:30.014412+0000","last_active":"2026-02-23T13:04:56.604666+0000","last_peered":"2026-02-23T13:04:56.604666+0000","last_clean":"2026-02-23T13:04:56.604666+0000","last_became_active":"2026-02-23T13:03:08.711847+0000","last_became_peered":"2026-02-23T13:03:08.711847+0000","last_unstale":"2026-02-23T13:04:56.604666+0000","last_undegraded":"2026-02-23T13:04:56.604666+0000","last_fullsized":"2026-02-23T13:04:56.604666+0000","mapping_epoch":28,"log_start":"42'43406","ondisk_log_start":"42'43406","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'32670","last_scrub_stamp":"2026-02-23T13:04:30.014332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:30.014332+0000","objects_scrubbed":32128,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:50.241908+0000","scrub_duration":3026,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1870331904,"num_objects":28539,"num_object_clones":0,"num_object_copies":85617,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28539,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43409,"num_write_kb":2302336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"42'43578","reported_seq":43887,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:56.623541+0000","last_change":"2026-02-23T13:04:14.687654+0000","last_active":"2026-02-23T13:04:56.623541+0000","last_peered":"2026-02-23T13:04:56.623541+0000","last_clean":"2026-02-23T13:04:56.623541+0000","last_became_active":"2026-02-23T13:03:08.712783+0000","last_became_peered":"2026-02-23T13:03:08.712783+0000","last_unstale":"2026-02-23T13:04:56.623541+0000","last_undegraded":"2026-02-23T13:04:56.623541+0000","last_fullsized":"2026-02-23T13:04:56.623541+0000","mapping_epoch":28,"log_start":"42'43575","ondisk_log_start":"42'43575","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'26930","last_scrub_stamp":"2026-02-23T13:04:14.687533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:14.687533+0000","objects_scrubbed":26390,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:29.989051+0000","scrub_duration":2902,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1875771392,"num_objects":28622,"num_object_clones":0,"num_object_copies":85866,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28622,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43578,"num_write_kb":2310400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"42'43533","reported_seq":43885,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:56.606893+0000","last_change":"2026-02-23T13:04:25.882548+0000","last_active":"2026-02-23T13:04:56.606893+0000","last_peered":"2026-02-23T13:04:56.606893+0000","last_clean":"2026-02-23T13:04:56.606893+0000","last_became_active":"2026-02-23T13:03:08.708821+0000","last_became_peered":"2026-02-23T13:03:08.708821+0000","last_unstale":"2026-02-23T13:04:56.606893+0000","last_undegraded":"2026-02-23T13:04:56.606893+0000","last_fullsized":"2026-02-23T13:04:56.606893+0000","mapping_epoch":28,"log_start":"42'43530","ondisk_log_start":"42'43530","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31120","last_scrub_stamp":"2026-02-23T13:04:25.882487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:25.882487+0000","objects_scrubbed":30639,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:32.453655+0000","scrub_duration":2862,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1862860800,"num_objects":28425,"num_object_clones":0,"num_object_copies":85275,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28425,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43533,"num_write_kb":2302656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"42'43461","reported_seq":43861,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:56.626211+0000","last_change":"2026-02-23T13:04:39.437215+0000","last_active":"2026-02-23T13:04:56.626211+0000","last_peered":"2026-02-23T13:04:56.626211+0000","last_clean":"2026-02-23T13:04:56.626211+0000","last_became_active":"2026-02-23T13:03:08.712152+0000","last_became_peered":"2026-02-23T13:03:08.712152+0000","last_unstale":"2026-02-23T13:04:56.626211+0000","last_undegraded":"2026-02-23T13:04:56.626211+0000","last_fullsized":"2026-02-23T13:04:56.626211+0000","mapping_epoch":28,"log_start":"42'43458","ondisk_log_start":"42'43458","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'35859","last_scrub_stamp":"2026-02-23T13:04:39.437158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:39.437158+0000","objects_scrubbed":35127,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:52.724383+0000","scrub_duration":4536,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1867186176,"num_objects":28491,"num_object_clones":0,"num_object_copies":85473,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28491,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43461,"num_write_kb":2302464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"42'43128","reported_seq":43319,"reported_epoch":42,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:04:56.607928+0000","last_change":"2026-02-23T13:04:55.110283+0000","last_active":"2026-02-23T13:04:56.607928+0000","last_peered":"2026-02-23T13:04:56.607928+0000","last_clean":"2026-02-23T13:04:56.607928+0000","last_became_active":"2026-02-23T13:03:08.712055+0000","last_became_peered":"2026-02-23T13:03:08.712055+0000","last_unstale":"2026-02-23T13:04:56.607928+0000","last_undegraded":"2026-02-23T13:04:56.607928+0000","last_fullsized":"2026-02-23T13:04:56.607928+0000","mapping_epoch":28,"log_start":"42'43125","ondisk_log_start":"42'43125","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:03:07.696567+0000","objects_scrubbed":14849,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1853620224,"num_objects":28284,"num_object_clones":0,"num_object_copies":84852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28284,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43128,"num_write_kb":2285184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"42'43479","reported_seq":43832,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:56.625342+0000","last_change":"2026-02-23T13:04:25.319824+0000","last_active":"2026-02-23T13:04:56.625342+0000","last_peered":"2026-02-23T13:04:56.625342+0000","last_clean":"2026-02-23T13:04:56.625342+0000","last_became_active":"2026-02-23T13:03:08.708852+0000","last_became_peered":"2026-02-23T13:03:08.708852+0000","last_unstale":"2026-02-23T13:04:56.625342+0000","last_undegraded":"2026-02-23T13:04:56.625342+0000","last_fullsized":"2026-02-23T13:04:56.625342+0000","mapping_epoch":28,"log_start":"42'43476","ondisk_log_start":"42'43476","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31026","last_scrub_stamp":"2026-02-23T13:04:25.319785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:25.319785+0000","objects_scrubbed":30498,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:39.230588+0000","scrub_duration":3555,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1869676544,"num_objects":28529,"num_object_clones":0,"num_object_copies":85587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28529,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43479,"num_write_kb":2304256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"42'43827","reported_seq":44182,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:56.602385+0000","last_change":"2026-02-23T13:04:53.166360+0000","last_active":"2026-02-23T13:04:56.602385+0000","last_peered":"2026-02-23T13:04:56.602385+0000","last_clean":"2026-02-23T13:04:56.602385+0000","last_became_active":"2026-02-23T13:03:08.708457+0000","last_became_peered":"2026-02-23T13:03:08.708457+0000","last_unstale":"2026-02-23T13:04:56.602385+0000","last_undegraded":"2026-02-23T13:04:56.602385+0000","last_fullsized":"2026-02-23T13:04:56.602385+0000","mapping_epoch":28,"log_start":"42'43824","ondisk_log_start":"42'43824","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'42452","last_scrub_stamp":"2026-02-23T13:04:53.166176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:53.166176+0000","objects_scrubbed":30649,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:57.240381+0000","scrub_duration":3244,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1873084416,"num_objects":28581,"num_object_clones":0,"num_object_copies":85743,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28581,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43827,"num_write_kb":2317056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"42'43563","reported_seq":43967,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:56.606139+0000","last_change":"2026-02-23T13:04:43.225441+0000","last_active":"2026-02-23T13:04:56.606139+0000","last_peered":"2026-02-23T13:04:56.606139+0000","last_clean":"2026-02-23T13:04:56.606139+0000","last_became_active":"2026-02-23T13:03:08.712010+0000","last_became_peered":"2026-02-23T13:03:08.712010+0000","last_unstale":"2026-02-23T13:04:56.606139+0000","last_undegraded":"2026-02-23T13:04:56.606139+0000","last_fullsized":"2026-02-23T13:04:56.606139+0000","mapping_epoch":28,"log_start":"42'43560","ondisk_log_start":"42'43560","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'37378","last_scrub_stamp":"2026-02-23T13:04:43.225387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:43.225387+0000","objects_scrubbed":35509,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:53.679895+0000","scrub_duration":3337,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1877803008,"num_objects":28653,"num_object_clones":0,"num_object_copies":85959,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28653,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43563,"num_write_kb":2310912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"42'43093","reported_seq":43434,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:56.629246+0000","last_change":"2026-02-23T13:04:22.389549+0000","last_active":"2026-02-23T13:04:56.629246+0000","last_peered":"2026-02-23T13:04:56.629246+0000","last_clean":"2026-02-23T13:04:56.629246+0000","last_became_active":"2026-02-23T13:03:08.712763+0000","last_became_peered":"2026-02-23T13:03:08.712763+0000","last_unstale":"2026-02-23T13:04:56.629246+0000","last_undegraded":"2026-02-23T13:04:56.629246+0000","last_fullsized":"2026-02-23T13:04:56.629246+0000","mapping_epoch":28,"log_start":"42'43090","ondisk_log_start":"42'43090","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'29812","last_scrub_stamp":"2026-02-23T13:04:22.389498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:22.389498+0000","objects_scrubbed":29176,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:26.761128+0000","scrub_duration":3534,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1858666496,"num_objects":28361,"num_object_clones":0,"num_object_copies":85083,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28361,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43093,"num_write_kb":2286528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"42'43579","reported_seq":43982,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:56.629156+0000","last_change":"2026-02-23T13:04:40.228341+0000","last_active":"2026-02-23T13:04:56.629156+0000","last_peered":"2026-02-23T13:04:56.629156+0000","last_clean":"2026-02-23T13:04:56.629156+0000","last_became_active":"2026-02-23T13:03:08.709391+0000","last_became_peered":"2026-02-23T13:03:08.709391+0000","last_unstale":"2026-02-23T13:04:56.629156+0000","last_undegraded":"2026-02-23T13:04:56.629156+0000","last_fullsized":"2026-02-23T13:04:56.629156+0000","mapping_epoch":28,"log_start":"42'43576","ondisk_log_start":"42'43576","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'36164","last_scrub_stamp":"2026-02-23T13:04:40.228295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:40.228295+0000","objects_scrubbed":35482,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:48.119450+0000","scrub_duration":4344,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1864302592,"num_objects":28447,"num_object_clones":0,"num_object_copies":85341,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28447,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43579,"num_write_kb":2304832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"42'43304","reported_seq":43644,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:56.599523+0000","last_change":"2026-02-23T13:04:55.969591+0000","last_active":"2026-02-23T13:04:56.599523+0000","last_peered":"2026-02-23T13:04:56.599523+0000","last_clean":"2026-02-23T13:04:56.599523+0000","last_became_active":"2026-02-23T13:03:08.711303+0000","last_became_peered":"2026-02-23T13:03:08.711303+0000","last_unstale":"2026-02-23T13:04:56.599523+0000","last_undegraded":"2026-02-23T13:04:56.599523+0000","last_fullsized":"2026-02-23T13:04:56.599523+0000","mapping_epoch":28,"log_start":"42'43301","ondisk_log_start":"42'43301","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'42977","last_scrub_stamp":"2026-02-23T13:04:55.969549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:55.969549+0000","objects_scrubbed":29308,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:10.033838+0000","scrub_duration":2936,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1858600960,"num_objects":28360,"num_object_clones":0,"num_object_copies":85080,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28360,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43304,"num_write_kb":2293248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":29893001240,"num_objects":456132,"num_object_clones":0,"num_object_copies":1368396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":456132,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":695790,"num_write_kb":36861441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":89689763840,"data_stored":89689751624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247834,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":26712880,"kb_used_data":25743580,"kb_used_omap":4,"kb_used_meta":969211,"kb_avail":707290320,"statfs":{"total":751619276800,"available":724265287680,"internally_reserved":0,"allocated":26361425920,"data_stored":26361151795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4449,"internal_metadata":992472735},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444061,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":22030124,"kb_used_data":20299608,"kb_used_omap":20,"kb_used_meta":1730475,"kb_avail":711973076,"statfs":{"total":751619276800,"available":729060429824,"internally_reserved":0,"allocated":20786798592,"data_stored":20786528539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21155,"internal_metadata":1772006749},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":24051052,"kb_used_data":22194136,"kb_used_omap":23,"kb_used_meta":1856872,"kb_avail":709952148,"statfs":{"total":751619276800,"available":726990999552,"internally_reserved":0,"allocated":22726795264,"data_stored":22726524691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23759,"internal_metadata":1901437745},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705696,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":22107760,"kb_used_data":20377244,"kb_used_omap":25,"kb_used_meta":1730470,"kb_avail":711895440,"statfs":{"total":751619276800,"available":728980930560,"internally_reserved":0,"allocated":20866297856,"data_stored":20866023731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26363,"internal_metadata":1772001541},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20563103744,"data_stored":20563099672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22425505792,"data_stored":22425501720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20546650112,"data_stored":20546650112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26154504192,"data_stored":26154500120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:05:03.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:02 trial046 ceph-mon[38575]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:05:03.386 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:05:03.528 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:03.650 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:03.648+0000 7ff37f0cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:03.650 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:03.649+0000 7ff37f0cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:03.666 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:05:03.666 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:05:03.683 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:05:03.683 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:05:03.698 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:05:03.699 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:05:03.715 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:05:03.715 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:05:04.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:03 trial046 ceph-mon[38575]: pgmap v79: 17 pgs: 17 active+clean; 26 GiB data, 84 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 9.00k op/s 2026-02-23T13:05:04.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:03 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/510961850' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:05:05.754 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:05:05.898 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:05.948 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:05 trial046 ceph-mon[38575]: pgmap v80: 17 pgs: 17 active+clean; 26 GiB data, 84 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 5.89k op/s 2026-02-23T13:05:06.039 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:06.038+0000 7f9392c01640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:06.039 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:06.038+0000 7f9392c01640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:06.054 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:05:06.054 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:05:06.066 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:05:06.066 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:05:06.077 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:05:06.077 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:05:06.091 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:05:06.091 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:05:06.289 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:05:06 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:05:06] "GET /metrics HTTP/1.1" 200 4231 "" "Prometheus/3.6.0" 2026-02-23T13:05:06.560 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:05:06 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:05:06.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:05:06.746 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:05:06.746 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:05:06.746 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:05:06.747 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:05:06.878 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:06.995 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:06 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/863427394' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:05:07.268 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:07.254+0000 7f7c1cddb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:07.268 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:07.254+0000 7f7c1cddb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:07.389 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:05:07.390 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:05:07.904 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:07 trial046 ceph-mon[38575]: pgmap v81: 17 pgs: 17 active+clean; 25 GiB data, 80 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 6.09k op/s 2026-02-23T13:05:07.904 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:07 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-23T13:05:07.904 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:07 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:05:07.904 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:07 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-23T13:05:07.904 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:07 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:05:07.904 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:07 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-23T13:05:07.924 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2026-02-23T13:05:06.606869+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":27304985144,"num_objects":416635,"num_object_clones":0,"num_object_copies":1249905,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":416635,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":735424,"num_write_kb":36863591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":84279416,"kb_used_data":77685288,"kb_used_omap":75,"kb_used_meta":6593844,"kb_avail":2851733384,"statfs":{"total":3006477107200,"available":2920174985216,"internally_reserved":0,"allocated":79549734912,"data_stored":79548646036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":77680,"internal_metadata":6752096400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,2,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4793565184,"num_objects":-73144,"num_object_clones":0,"num_object_copies":-219432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-73144,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73144,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001530"},"pg_stats":[{"pgid":"2.f","version":"42'48206","reported_seq":48561,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:06.598929+0000","last_change":"2026-02-23T13:04:26.095439+0000","last_active":"2026-02-23T13:05:06.598929+0000","last_peered":"2026-02-23T13:05:06.598929+0000","last_clean":"2026-02-23T13:05:06.598929+0000","last_became_active":"2026-02-23T13:03:08.711408+0000","last_became_peered":"2026-02-23T13:03:08.711408+0000","last_unstale":"2026-02-23T13:05:06.598929+0000","last_undegraded":"2026-02-23T13:05:06.598929+0000","last_fullsized":"2026-02-23T13:05:06.598929+0000","mapping_epoch":28,"log_start":"42'48203","ondisk_log_start":"42'48203","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31256","last_scrub_stamp":"2026-02-23T13:04:26.095384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:26.095384+0000","objects_scrubbed":30901,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:37.117824+0000","scrub_duration":2252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563295744,"num_objects":23854,"num_object_clones":0,"num_object_copies":71562,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23854,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48206,"num_write_kb":2305920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"42'46243","reported_seq":46648,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:01.628768+0000","last_change":"2026-02-23T13:04:41.483173+0000","last_active":"2026-02-23T13:05:01.628768+0000","last_peered":"2026-02-23T13:05:01.628768+0000","last_clean":"2026-02-23T13:05:01.628768+0000","last_became_active":"2026-02-23T13:03:08.711462+0000","last_became_peered":"2026-02-23T13:03:08.711462+0000","last_unstale":"2026-02-23T13:05:01.628768+0000","last_undegraded":"2026-02-23T13:05:01.628768+0000","last_fullsized":"2026-02-23T13:05:01.628768+0000","mapping_epoch":28,"log_start":"42'46240","ondisk_log_start":"42'46240","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'36827","last_scrub_stamp":"2026-02-23T13:04:41.482975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:41.482975+0000","objects_scrubbed":35883,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:55.333749+0000","scrub_duration":4566,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1721827328,"num_objects":26273,"num_object_clones":0,"num_object_copies":78819,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26273,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46243,"num_write_kb":2320512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"42'45652","reported_seq":46026,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:01.627555+0000","last_change":"2026-02-23T13:04:32.030814+0000","last_active":"2026-02-23T13:05:01.627555+0000","last_peered":"2026-02-23T13:05:01.627555+0000","last_clean":"2026-02-23T13:05:01.627555+0000","last_became_active":"2026-02-23T13:03:08.712246+0000","last_became_peered":"2026-02-23T13:03:08.712246+0000","last_unstale":"2026-02-23T13:05:01.627555+0000","last_undegraded":"2026-02-23T13:05:01.627555+0000","last_fullsized":"2026-02-23T13:05:01.627555+0000","mapping_epoch":28,"log_start":"42'45649","ondisk_log_start":"42'45649","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'33322","last_scrub_stamp":"2026-02-23T13:04:32.030772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:32.030772+0000","objects_scrubbed":32583,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:46.346152+0000","scrub_duration":4282,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1723531288,"num_objects":26300,"num_object_clones":0,"num_object_copies":78900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26300,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":45652,"num_write_kb":2302401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"42'45978","reported_seq":46335,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:01.631065+0000","last_change":"2026-02-23T13:04:27.262519+0000","last_active":"2026-02-23T13:05:01.631065+0000","last_peered":"2026-02-23T13:05:01.631065+0000","last_clean":"2026-02-23T13:05:01.631065+0000","last_became_active":"2026-02-23T13:03:08.712348+0000","last_became_peered":"2026-02-23T13:03:08.712348+0000","last_unstale":"2026-02-23T13:05:01.631065+0000","last_undegraded":"2026-02-23T13:05:01.631065+0000","last_fullsized":"2026-02-23T13:05:01.631065+0000","mapping_epoch":28,"log_start":"42'45975","ondisk_log_start":"42'45975","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31725","last_scrub_stamp":"2026-02-23T13:04:27.262379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:27.262379+0000","objects_scrubbed":31138,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:36.061346+0000","scrub_duration":3485,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1722417152,"num_objects":26282,"num_object_clones":0,"num_object_copies":78846,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26282,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45978,"num_write_kb":2312320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":221,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:22.806251+0000","last_change":"2026-02-23T13:04:08.199097+0000","last_active":"2026-02-23T13:04:22.806251+0000","last_peered":"2026-02-23T13:04:22.806251+0000","last_clean":"2026-02-23T13:04:22.806251+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:04:22.806251+0000","last_undegraded":"2026-02-23T13:04:22.806251+0000","last_fullsized":"2026-02-23T13:04:22.806251+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:04:08.199036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:04:08.199036+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:23.231335+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"42'45655","reported_seq":45970,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:01.606343+0000","last_change":"2026-02-23T13:04:15.649890+0000","last_active":"2026-02-23T13:05:01.606343+0000","last_peered":"2026-02-23T13:05:01.606343+0000","last_clean":"2026-02-23T13:05:01.606343+0000","last_became_active":"2026-02-23T13:03:08.708695+0000","last_became_peered":"2026-02-23T13:03:08.708695+0000","last_unstale":"2026-02-23T13:05:01.606343+0000","last_undegraded":"2026-02-23T13:05:01.606343+0000","last_fullsized":"2026-02-23T13:05:01.606343+0000","mapping_epoch":28,"log_start":"42'45652","ondisk_log_start":"42'45652","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'27365","last_scrub_stamp":"2026-02-23T13:04:15.649815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:15.649815+0000","objects_scrubbed":26902,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:16.658945+0000","scrub_duration":2575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1719205888,"num_objects":26233,"num_object_clones":0,"num_object_copies":78699,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26233,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45655,"num_write_kb":2300416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"42'45664","reported_seq":46032,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:01.603076+0000","last_change":"2026-02-23T13:04:30.014412+0000","last_active":"2026-02-23T13:05:01.603076+0000","last_peered":"2026-02-23T13:05:01.603076+0000","last_clean":"2026-02-23T13:05:01.603076+0000","last_became_active":"2026-02-23T13:03:08.711847+0000","last_became_peered":"2026-02-23T13:03:08.711847+0000","last_unstale":"2026-02-23T13:05:01.603076+0000","last_undegraded":"2026-02-23T13:05:01.603076+0000","last_fullsized":"2026-02-23T13:05:01.603076+0000","mapping_epoch":28,"log_start":"42'45661","ondisk_log_start":"42'45661","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'32670","last_scrub_stamp":"2026-02-23T13:04:30.014332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:30.014332+0000","objects_scrubbed":32128,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:50.241908+0000","scrub_duration":3026,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1722548224,"num_objects":26284,"num_object_clones":0,"num_object_copies":78852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26284,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45664,"num_write_kb":2302336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"42'45924","reported_seq":46234,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:01.622854+0000","last_change":"2026-02-23T13:04:14.687654+0000","last_active":"2026-02-23T13:05:01.622854+0000","last_peered":"2026-02-23T13:05:01.622854+0000","last_clean":"2026-02-23T13:05:01.622854+0000","last_became_active":"2026-02-23T13:03:08.712783+0000","last_became_peered":"2026-02-23T13:03:08.712783+0000","last_unstale":"2026-02-23T13:05:01.622854+0000","last_undegraded":"2026-02-23T13:05:01.622854+0000","last_fullsized":"2026-02-23T13:05:01.622854+0000","mapping_epoch":28,"log_start":"42'45921","ondisk_log_start":"42'45921","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'26930","last_scrub_stamp":"2026-02-23T13:04:14.687533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:14.687533+0000","objects_scrubbed":26390,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:29.989051+0000","scrub_duration":2902,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1722023936,"num_objects":26276,"num_object_clones":0,"num_object_copies":78828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26276,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45924,"num_write_kb":2310400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"42'45956","reported_seq":46308,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:01.606149+0000","last_change":"2026-02-23T13:04:25.882548+0000","last_active":"2026-02-23T13:05:01.606149+0000","last_peered":"2026-02-23T13:05:01.606149+0000","last_clean":"2026-02-23T13:05:01.606149+0000","last_became_active":"2026-02-23T13:03:08.708821+0000","last_became_peered":"2026-02-23T13:03:08.708821+0000","last_unstale":"2026-02-23T13:05:01.606149+0000","last_undegraded":"2026-02-23T13:05:01.606149+0000","last_fullsized":"2026-02-23T13:05:01.606149+0000","mapping_epoch":28,"log_start":"42'45953","ondisk_log_start":"42'45953","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31120","last_scrub_stamp":"2026-02-23T13:04:25.882487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:25.882487+0000","objects_scrubbed":30639,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:32.453655+0000","scrub_duration":2862,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1704067072,"num_objects":26002,"num_object_clones":0,"num_object_copies":78006,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26002,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45956,"num_write_kb":2302656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"42'45787","reported_seq":46187,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:01.631933+0000","last_change":"2026-02-23T13:04:39.437215+0000","last_active":"2026-02-23T13:05:01.631933+0000","last_peered":"2026-02-23T13:05:01.631933+0000","last_clean":"2026-02-23T13:05:01.631933+0000","last_became_active":"2026-02-23T13:03:08.712152+0000","last_became_peered":"2026-02-23T13:03:08.712152+0000","last_unstale":"2026-02-23T13:05:01.631933+0000","last_undegraded":"2026-02-23T13:05:01.631933+0000","last_fullsized":"2026-02-23T13:05:01.631933+0000","mapping_epoch":28,"log_start":"42'45784","ondisk_log_start":"42'45784","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'35859","last_scrub_stamp":"2026-02-23T13:04:39.437158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:39.437158+0000","objects_scrubbed":35127,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:52.724383+0000","scrub_duration":4536,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1714749440,"num_objects":26165,"num_object_clones":0,"num_object_copies":78495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26165,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45787,"num_write_kb":2302464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"42'45447","reported_seq":45778,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:01.602413+0000","last_change":"2026-02-23T13:04:57.975495+0000","last_active":"2026-02-23T13:05:01.602413+0000","last_peered":"2026-02-23T13:05:01.602413+0000","last_clean":"2026-02-23T13:05:01.602413+0000","last_became_active":"2026-02-23T13:03:08.712055+0000","last_became_peered":"2026-02-23T13:03:08.712055+0000","last_unstale":"2026-02-23T13:05:01.602413+0000","last_undegraded":"2026-02-23T13:05:01.602413+0000","last_fullsized":"2026-02-23T13:05:01.602413+0000","mapping_epoch":28,"log_start":"42'45444","ondisk_log_start":"42'45444","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'43718","last_scrub_stamp":"2026-02-23T13:04:57.975448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:57.975448+0000","objects_scrubbed":28325,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:22.148320+0000","scrub_duration":2865,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1701642240,"num_objects":25965,"num_object_clones":0,"num_object_copies":77895,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25965,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45447,"num_write_kb":2285184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"42'45787","reported_seq":46140,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:01.629805+0000","last_change":"2026-02-23T13:04:25.319824+0000","last_active":"2026-02-23T13:05:01.629805+0000","last_peered":"2026-02-23T13:05:01.629805+0000","last_clean":"2026-02-23T13:05:01.629805+0000","last_became_active":"2026-02-23T13:03:08.708852+0000","last_became_peered":"2026-02-23T13:03:08.708852+0000","last_unstale":"2026-02-23T13:05:01.629805+0000","last_undegraded":"2026-02-23T13:05:01.629805+0000","last_fullsized":"2026-02-23T13:05:01.629805+0000","mapping_epoch":28,"log_start":"42'45784","ondisk_log_start":"42'45784","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31026","last_scrub_stamp":"2026-02-23T13:04:25.319785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:25.319785+0000","objects_scrubbed":30498,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:39.230588+0000","scrub_duration":3555,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1718419456,"num_objects":26221,"num_object_clones":0,"num_object_copies":78663,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26221,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45787,"num_write_kb":2304256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"42'46120","reported_seq":46475,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:01.606114+0000","last_change":"2026-02-23T13:04:53.166360+0000","last_active":"2026-02-23T13:05:01.606114+0000","last_peered":"2026-02-23T13:05:01.606114+0000","last_clean":"2026-02-23T13:05:01.606114+0000","last_became_active":"2026-02-23T13:03:08.708457+0000","last_became_peered":"2026-02-23T13:03:08.708457+0000","last_unstale":"2026-02-23T13:05:01.606114+0000","last_undegraded":"2026-02-23T13:05:01.606114+0000","last_fullsized":"2026-02-23T13:05:01.606114+0000","mapping_epoch":28,"log_start":"42'46117","ondisk_log_start":"42'46117","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'42452","last_scrub_stamp":"2026-02-23T13:04:53.166176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:53.166176+0000","objects_scrubbed":30649,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:57.240381+0000","scrub_duration":3244,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1722810368,"num_objects":26288,"num_object_clones":0,"num_object_copies":78864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26288,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46120,"num_write_kb":2317056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"42'45867","reported_seq":46271,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:01.607411+0000","last_change":"2026-02-23T13:04:43.225441+0000","last_active":"2026-02-23T13:05:01.607411+0000","last_peered":"2026-02-23T13:05:01.607411+0000","last_clean":"2026-02-23T13:05:01.607411+0000","last_became_active":"2026-02-23T13:03:08.712010+0000","last_became_peered":"2026-02-23T13:03:08.712010+0000","last_unstale":"2026-02-23T13:05:01.607411+0000","last_undegraded":"2026-02-23T13:05:01.607411+0000","last_fullsized":"2026-02-23T13:05:01.607411+0000","mapping_epoch":28,"log_start":"42'45864","ondisk_log_start":"42'45864","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'37378","last_scrub_stamp":"2026-02-23T13:04:43.225387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:43.225387+0000","objects_scrubbed":35509,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:53.679895+0000","scrub_duration":3337,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1726808064,"num_objects":26349,"num_object_clones":0,"num_object_copies":79047,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26349,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45867,"num_write_kb":2310912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"42'45435","reported_seq":45775,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:01.632410+0000","last_change":"2026-02-23T13:04:22.389549+0000","last_active":"2026-02-23T13:05:01.632410+0000","last_peered":"2026-02-23T13:05:01.632410+0000","last_clean":"2026-02-23T13:05:01.632410+0000","last_became_active":"2026-02-23T13:03:08.712763+0000","last_became_peered":"2026-02-23T13:03:08.712763+0000","last_unstale":"2026-02-23T13:05:01.632410+0000","last_undegraded":"2026-02-23T13:05:01.632410+0000","last_fullsized":"2026-02-23T13:05:01.632410+0000","mapping_epoch":28,"log_start":"42'45432","ondisk_log_start":"42'45432","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'29812","last_scrub_stamp":"2026-02-23T13:04:22.389498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:22.389498+0000","objects_scrubbed":29176,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:26.761128+0000","scrub_duration":3534,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1705181184,"num_objects":26019,"num_object_clones":0,"num_object_copies":78057,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26019,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45435,"num_write_kb":2286528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"42'45937","reported_seq":46339,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:01.630901+0000","last_change":"2026-02-23T13:04:40.228341+0000","last_active":"2026-02-23T13:05:01.630901+0000","last_peered":"2026-02-23T13:05:01.630901+0000","last_clean":"2026-02-23T13:05:01.630901+0000","last_became_active":"2026-02-23T13:03:08.709391+0000","last_became_peered":"2026-02-23T13:03:08.709391+0000","last_unstale":"2026-02-23T13:05:01.630901+0000","last_undegraded":"2026-02-23T13:05:01.630901+0000","last_fullsized":"2026-02-23T13:05:01.630901+0000","mapping_epoch":28,"log_start":"42'45934","ondisk_log_start":"42'45934","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'36164","last_scrub_stamp":"2026-02-23T13:04:40.228295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:40.228295+0000","objects_scrubbed":35482,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:48.119450+0000","scrub_duration":4344,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1709768704,"num_objects":26089,"num_object_clones":0,"num_object_copies":78267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26089,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45937,"num_write_kb":2304832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"42'45631","reported_seq":45971,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:01.607633+0000","last_change":"2026-02-23T13:04:55.969591+0000","last_active":"2026-02-23T13:05:01.607633+0000","last_peered":"2026-02-23T13:05:01.607633+0000","last_clean":"2026-02-23T13:05:01.607633+0000","last_became_active":"2026-02-23T13:03:08.711303+0000","last_became_peered":"2026-02-23T13:03:08.711303+0000","last_unstale":"2026-02-23T13:05:01.607633+0000","last_undegraded":"2026-02-23T13:05:01.607633+0000","last_fullsized":"2026-02-23T13:05:01.607633+0000","mapping_epoch":28,"log_start":"42'45628","ondisk_log_start":"42'45628","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'42977","last_scrub_stamp":"2026-02-23T13:04:55.969549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:55.969549+0000","objects_scrubbed":29308,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:10.033838+0000","scrub_duration":2936,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1706098688,"num_objects":26033,"num_object_clones":0,"num_object_copies":78099,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26033,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45631,"num_write_kb":2293248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":27304394776,"num_objects":416633,"num_object_clones":0,"num_object_copies":1249899,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":416633,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":735289,"num_write_kb":36861441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":78845915136,"data_stored":78845902920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247835,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":24653424,"kb_used_data":23611932,"kb_used_omap":4,"kb_used_meta":1041403,"kb_avail":709349776,"statfs":{"total":751619276800,"available":726374170624,"internally_reserved":0,"allocated":24178618368,"data_stored":24178344243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5101,"internal_metadata":1066396691},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444063,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":18738476,"kb_used_data":16917720,"kb_used_omap":21,"kb_used_meta":1820714,"kb_avail":715264724,"statfs":{"total":751619276800,"available":732431077376,"internally_reserved":0,"allocated":17323745280,"data_stored":17323475227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21806,"internal_metadata":1864411858},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":22327980,"kb_used_data":20416856,"kb_used_omap":23,"kb_used_meta":1911016,"kb_avail":711675220,"statfs":{"total":751619276800,"available":728755425280,"internally_reserved":0,"allocated":20906860544,"data_stored":20906589971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24410,"internal_metadata":1956880550},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,2,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705698,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":18559536,"kb_used_data":16738780,"kb_used_omap":25,"kb_used_meta":1820710,"kb_avail":715443664,"statfs":{"total":751619276800,"available":732614311936,"internally_reserved":0,"allocated":17140510720,"data_stored":17140236595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26363,"internal_metadata":1864407301},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17120366592,"data_stored":17120362520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20603736064,"data_stored":20603731992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17088446464,"data_stored":17088446464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24033366016,"data_stored":24033361944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:05:07.926 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:05:07.926 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 41 2026-02-23T13:05:08.073 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:08.138 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:05:08.194 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:08.193+0000 7ff257a31640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:08.194 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:08.193+0000 7ff257a31640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:08.276 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:08.342 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:05:08.379 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:05:08.395 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:08.394+0000 7f50e71a0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:08.395 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:08.394+0000 7f50e71a0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:08.408 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:05:08.409 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:05:08.420 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:05:08.420 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:05:08.433 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:05:08.433 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:05:08.445 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:05:08.445 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:05:09.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:08 trial046 ceph-mon[38575]: from='client.14538 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:05:09.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:08 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/838067397' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "41"} : dispatch 2026-02-23T13:05:09.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:08 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1132171700' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:05:10.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:09 trial046 ceph-mon[38575]: pgmap v82: 17 pgs: 17 active+clean; 23 GiB data, 75 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 9.02k op/s 2026-02-23T13:05:10.486 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:05:10.622 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:10.818 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:10.816+0000 7fa48a05b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:10.819 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:10.816+0000 7fa48a05b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:10.834 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:05:10.834 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:05:10.848 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:05:10.848 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:05:10.861 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:05:10.861 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:05:10.874 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:05:10.874 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:05:12.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:11 trial046 ceph-mon[38575]: pgmap v83: 17 pgs: 17 active+clean; 23 GiB data, 75 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 6.39k op/s 2026-02-23T13:05:12.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:11 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4082606243' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:05:13.342 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:05:13.380 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:05:13.380 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:05:13.380 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-23T13:05:13.381 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:05:13.481 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:13.536 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:13.896 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:13 trial046 ceph-mon[38575]: pgmap v84: 17 pgs: 17 active+clean; 21 GiB data, 68 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 9.44k op/s 2026-02-23T13:05:13.912 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:13.865+0000 7f35402e0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:13.912 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:13.865+0000 7f35402e0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:13.912 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:05:13.912 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:05:13.913 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:05:13.913 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:05:13.913 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:05:13.913 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:05:13.921 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:05:13.921 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:05:14.605 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:14.603+0000 7f4aa3082640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:14.605 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:14.603+0000 7f4aa3082640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:14.741 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:05:14.742 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:14 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/409338679' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:05:14.743 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:05:14.782 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2026-02-23T13:05:14.607880+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22469411384,"num_objects":342850,"num_object_clones":0,"num_object_copies":1028550,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":342850,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":809209,"num_write_kb":36863591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":71564152,"kb_used_data":66664296,"kb_used_omap":56,"kb_used_meta":4899591,"kb_avail":2864448648,"statfs":{"total":3006477107200,"available":2933195415552,"internally_reserved":0,"allocated":68264239104,"data_stored":68263150228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57716,"internal_metadata":5017181836},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4996399104,"num_objects":-76239,"num_object_clones":0,"num_object_copies":-228717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-76239,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76239,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001527"},"pg_stats":[{"pgid":"2.f","version":"42'50507","reported_seq":50862,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:11.602410+0000","last_change":"2026-02-23T13:04:26.095439+0000","last_active":"2026-02-23T13:05:11.602410+0000","last_peered":"2026-02-23T13:05:11.602410+0000","last_clean":"2026-02-23T13:05:11.602410+0000","last_became_active":"2026-02-23T13:03:08.711408+0000","last_became_peered":"2026-02-23T13:03:08.711408+0000","last_unstale":"2026-02-23T13:05:11.602410+0000","last_undegraded":"2026-02-23T13:05:11.602410+0000","last_fullsized":"2026-02-23T13:05:11.602410+0000","mapping_epoch":28,"log_start":"42'50504","ondisk_log_start":"42'50504","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31256","last_scrub_stamp":"2026-02-23T13:04:26.095384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:26.095384+0000","objects_scrubbed":30901,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:37.117824+0000","scrub_duration":2252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1412497408,"num_objects":21553,"num_object_clones":0,"num_object_copies":64659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21553,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50507,"num_write_kb":2305920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"42'51056","reported_seq":51461,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:11.631519+0000","last_change":"2026-02-23T13:04:41.483173+0000","last_active":"2026-02-23T13:05:11.631519+0000","last_peered":"2026-02-23T13:05:11.631519+0000","last_clean":"2026-02-23T13:05:11.631519+0000","last_became_active":"2026-02-23T13:03:08.711462+0000","last_became_peered":"2026-02-23T13:03:08.711462+0000","last_unstale":"2026-02-23T13:05:11.631519+0000","last_undegraded":"2026-02-23T13:05:11.631519+0000","last_fullsized":"2026-02-23T13:05:11.631519+0000","mapping_epoch":28,"log_start":"42'51053","ondisk_log_start":"42'51053","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'36827","last_scrub_stamp":"2026-02-23T13:04:41.482975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:41.482975+0000","objects_scrubbed":35883,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:55.333749+0000","scrub_duration":4566,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1406402560,"num_objects":21460,"num_object_clones":0,"num_object_copies":64380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21460,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51056,"num_write_kb":2320512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"42'50377","reported_seq":50751,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:11.631316+0000","last_change":"2026-02-23T13:04:32.030814+0000","last_active":"2026-02-23T13:05:11.631316+0000","last_peered":"2026-02-23T13:05:11.631316+0000","last_clean":"2026-02-23T13:05:11.631316+0000","last_became_active":"2026-02-23T13:03:08.712246+0000","last_became_peered":"2026-02-23T13:03:08.712246+0000","last_unstale":"2026-02-23T13:05:11.631316+0000","last_undegraded":"2026-02-23T13:05:11.631316+0000","last_fullsized":"2026-02-23T13:05:11.631316+0000","mapping_epoch":28,"log_start":"42'50374","ondisk_log_start":"42'50374","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'33322","last_scrub_stamp":"2026-02-23T13:04:32.030772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:32.030772+0000","objects_scrubbed":32583,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:46.346152+0000","scrub_duration":4282,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1413873688,"num_objects":21575,"num_object_clones":0,"num_object_copies":64725,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21575,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":50377,"num_write_kb":2302401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"42'50674","reported_seq":51032,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:11.629625+0000","last_change":"2026-02-23T13:04:27.262519+0000","last_active":"2026-02-23T13:05:11.629625+0000","last_peered":"2026-02-23T13:05:11.629625+0000","last_clean":"2026-02-23T13:05:11.629625+0000","last_became_active":"2026-02-23T13:03:08.712348+0000","last_became_peered":"2026-02-23T13:03:08.712348+0000","last_unstale":"2026-02-23T13:05:11.629625+0000","last_undegraded":"2026-02-23T13:05:11.629625+0000","last_fullsized":"2026-02-23T13:05:11.629625+0000","mapping_epoch":28,"log_start":"42'50671","ondisk_log_start":"42'50671","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31725","last_scrub_stamp":"2026-02-23T13:04:27.262379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:27.262379+0000","objects_scrubbed":31138,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:36.061346+0000","scrub_duration":3485,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1414660096,"num_objects":21586,"num_object_clones":0,"num_object_copies":64758,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21586,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50674,"num_write_kb":2312320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":221,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:22.806251+0000","last_change":"2026-02-23T13:04:08.199097+0000","last_active":"2026-02-23T13:04:22.806251+0000","last_peered":"2026-02-23T13:04:22.806251+0000","last_clean":"2026-02-23T13:04:22.806251+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:04:22.806251+0000","last_undegraded":"2026-02-23T13:04:22.806251+0000","last_fullsized":"2026-02-23T13:04:22.806251+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:04:08.199036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:04:08.199036+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:23.231335+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"42'50426","reported_seq":50741,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:11.606129+0000","last_change":"2026-02-23T13:04:15.649890+0000","last_active":"2026-02-23T13:05:11.606129+0000","last_peered":"2026-02-23T13:05:11.606129+0000","last_clean":"2026-02-23T13:05:11.606129+0000","last_became_active":"2026-02-23T13:03:08.708695+0000","last_became_peered":"2026-02-23T13:03:08.708695+0000","last_unstale":"2026-02-23T13:05:11.606129+0000","last_undegraded":"2026-02-23T13:05:11.606129+0000","last_fullsized":"2026-02-23T13:05:11.606129+0000","mapping_epoch":28,"log_start":"42'50423","ondisk_log_start":"42'50423","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'27365","last_scrub_stamp":"2026-02-23T13:04:15.649815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:15.649815+0000","objects_scrubbed":26902,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:16.658945+0000","scrub_duration":2575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1406533632,"num_objects":21462,"num_object_clones":0,"num_object_copies":64386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21462,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50426,"num_write_kb":2300416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"42'50516","reported_seq":50884,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:11.610361+0000","last_change":"2026-02-23T13:04:30.014412+0000","last_active":"2026-02-23T13:05:11.610361+0000","last_peered":"2026-02-23T13:05:11.610361+0000","last_clean":"2026-02-23T13:05:11.610361+0000","last_became_active":"2026-02-23T13:03:08.711847+0000","last_became_peered":"2026-02-23T13:03:08.711847+0000","last_unstale":"2026-02-23T13:05:11.610361+0000","last_undegraded":"2026-02-23T13:05:11.610361+0000","last_fullsized":"2026-02-23T13:05:11.610361+0000","mapping_epoch":28,"log_start":"42'50513","ondisk_log_start":"42'50513","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'32670","last_scrub_stamp":"2026-02-23T13:04:30.014332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:30.014332+0000","objects_scrubbed":32128,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:50.241908+0000","scrub_duration":3026,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1404567552,"num_objects":21432,"num_object_clones":0,"num_object_copies":64296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21432,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50516,"num_write_kb":2302336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"42'50623","reported_seq":50933,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:11.631396+0000","last_change":"2026-02-23T13:04:14.687654+0000","last_active":"2026-02-23T13:05:11.631396+0000","last_peered":"2026-02-23T13:05:11.631396+0000","last_clean":"2026-02-23T13:05:11.631396+0000","last_became_active":"2026-02-23T13:03:08.712783+0000","last_became_peered":"2026-02-23T13:03:08.712783+0000","last_unstale":"2026-02-23T13:05:11.631396+0000","last_undegraded":"2026-02-23T13:05:11.631396+0000","last_fullsized":"2026-02-23T13:05:11.631396+0000","mapping_epoch":28,"log_start":"42'50620","ondisk_log_start":"42'50620","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'26930","last_scrub_stamp":"2026-02-23T13:04:14.687533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:14.687533+0000","objects_scrubbed":26390,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:29.989051+0000","scrub_duration":2902,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1414070272,"num_objects":21577,"num_object_clones":0,"num_object_copies":64731,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21577,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50623,"num_write_kb":2310400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"42'50781","reported_seq":51133,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:11.606070+0000","last_change":"2026-02-23T13:04:25.882548+0000","last_active":"2026-02-23T13:05:11.606070+0000","last_peered":"2026-02-23T13:05:11.606070+0000","last_clean":"2026-02-23T13:05:11.606070+0000","last_became_active":"2026-02-23T13:03:08.708821+0000","last_became_peered":"2026-02-23T13:03:08.708821+0000","last_unstale":"2026-02-23T13:05:11.606070+0000","last_undegraded":"2026-02-23T13:05:11.606070+0000","last_fullsized":"2026-02-23T13:05:11.606070+0000","mapping_epoch":28,"log_start":"42'50778","ondisk_log_start":"42'50778","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31120","last_scrub_stamp":"2026-02-23T13:04:25.882487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:25.882487+0000","objects_scrubbed":30639,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:32.453655+0000","scrub_duration":2862,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1387855872,"num_objects":21177,"num_object_clones":0,"num_object_copies":63531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21177,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50781,"num_write_kb":2302656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"42'50484","reported_seq":50883,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:11.632538+0000","last_change":"2026-02-23T13:04:39.437215+0000","last_active":"2026-02-23T13:05:11.632538+0000","last_peered":"2026-02-23T13:05:11.632538+0000","last_clean":"2026-02-23T13:05:11.632538+0000","last_became_active":"2026-02-23T13:03:08.712152+0000","last_became_peered":"2026-02-23T13:03:08.712152+0000","last_unstale":"2026-02-23T13:05:11.632538+0000","last_undegraded":"2026-02-23T13:05:11.632538+0000","last_fullsized":"2026-02-23T13:05:11.632538+0000","mapping_epoch":28,"log_start":"42'50481","ondisk_log_start":"42'50481","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'35859","last_scrub_stamp":"2026-02-23T13:04:39.437158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:39.437158+0000","objects_scrubbed":35127,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:52.724383+0000","scrub_duration":4536,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1406926848,"num_objects":21468,"num_object_clones":0,"num_object_copies":64404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21468,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50484,"num_write_kb":2302464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"42'50219","reported_seq":50550,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:11.605181+0000","last_change":"2026-02-23T13:04:57.975495+0000","last_active":"2026-02-23T13:05:11.605181+0000","last_peered":"2026-02-23T13:05:11.605181+0000","last_clean":"2026-02-23T13:05:11.605181+0000","last_became_active":"2026-02-23T13:03:08.712055+0000","last_became_peered":"2026-02-23T13:03:08.712055+0000","last_unstale":"2026-02-23T13:05:11.605181+0000","last_undegraded":"2026-02-23T13:05:11.605181+0000","last_fullsized":"2026-02-23T13:05:11.605181+0000","mapping_epoch":28,"log_start":"42'50216","ondisk_log_start":"42'50216","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'43718","last_scrub_stamp":"2026-02-23T13:04:57.975448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:57.975448+0000","objects_scrubbed":28325,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:22.148320+0000","scrub_duration":2865,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1388904448,"num_objects":21193,"num_object_clones":0,"num_object_copies":63579,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21193,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50219,"num_write_kb":2285184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"42'50594","reported_seq":50947,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:11.629153+0000","last_change":"2026-02-23T13:04:25.319824+0000","last_active":"2026-02-23T13:05:11.629153+0000","last_peered":"2026-02-23T13:05:11.629153+0000","last_clean":"2026-02-23T13:05:11.629153+0000","last_became_active":"2026-02-23T13:03:08.708852+0000","last_became_peered":"2026-02-23T13:03:08.708852+0000","last_unstale":"2026-02-23T13:05:11.629153+0000","last_undegraded":"2026-02-23T13:05:11.629153+0000","last_fullsized":"2026-02-23T13:05:11.629153+0000","mapping_epoch":28,"log_start":"42'50591","ondisk_log_start":"42'50591","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31026","last_scrub_stamp":"2026-02-23T13:04:25.319785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:25.319785+0000","objects_scrubbed":30498,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:39.230588+0000","scrub_duration":3555,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1403387904,"num_objects":21414,"num_object_clones":0,"num_object_copies":64242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21414,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50594,"num_write_kb":2304256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"42'50895","reported_seq":51250,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:11.603646+0000","last_change":"2026-02-23T13:04:53.166360+0000","last_active":"2026-02-23T13:05:11.603646+0000","last_peered":"2026-02-23T13:05:11.603646+0000","last_clean":"2026-02-23T13:05:11.603646+0000","last_became_active":"2026-02-23T13:03:08.708457+0000","last_became_peered":"2026-02-23T13:03:08.708457+0000","last_unstale":"2026-02-23T13:05:11.603646+0000","last_undegraded":"2026-02-23T13:05:11.603646+0000","last_fullsized":"2026-02-23T13:05:11.603646+0000","mapping_epoch":28,"log_start":"42'50892","ondisk_log_start":"42'50892","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'42452","last_scrub_stamp":"2026-02-23T13:04:53.166176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:53.166176+0000","objects_scrubbed":30649,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:57.240381+0000","scrub_duration":3244,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1409875968,"num_objects":21513,"num_object_clones":0,"num_object_copies":64539,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21513,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50895,"num_write_kb":2317056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"42'50622","reported_seq":51026,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:11.605432+0000","last_change":"2026-02-23T13:04:43.225441+0000","last_active":"2026-02-23T13:05:11.605432+0000","last_peered":"2026-02-23T13:05:11.605432+0000","last_clean":"2026-02-23T13:05:11.605432+0000","last_became_active":"2026-02-23T13:03:08.712010+0000","last_became_peered":"2026-02-23T13:03:08.712010+0000","last_unstale":"2026-02-23T13:05:11.605432+0000","last_undegraded":"2026-02-23T13:05:11.605432+0000","last_fullsized":"2026-02-23T13:05:11.605432+0000","mapping_epoch":28,"log_start":"42'50619","ondisk_log_start":"42'50619","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'37378","last_scrub_stamp":"2026-02-23T13:04:43.225387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:43.225387+0000","objects_scrubbed":35509,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:53.679895+0000","scrub_duration":3337,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1415184384,"num_objects":21594,"num_object_clones":0,"num_object_copies":64782,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21594,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50622,"num_write_kb":2310912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"42'50319","reported_seq":50659,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:11.629779+0000","last_change":"2026-02-23T13:04:22.389549+0000","last_active":"2026-02-23T13:05:11.629779+0000","last_peered":"2026-02-23T13:05:11.629779+0000","last_clean":"2026-02-23T13:05:11.629779+0000","last_became_active":"2026-02-23T13:03:08.712763+0000","last_became_peered":"2026-02-23T13:03:08.712763+0000","last_unstale":"2026-02-23T13:05:11.629779+0000","last_undegraded":"2026-02-23T13:05:11.629779+0000","last_fullsized":"2026-02-23T13:05:11.629779+0000","mapping_epoch":28,"log_start":"42'50316","ondisk_log_start":"42'50316","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'29812","last_scrub_stamp":"2026-02-23T13:04:22.389498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:22.389498+0000","objects_scrubbed":29176,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:26.761128+0000","scrub_duration":3534,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1385103360,"num_objects":21135,"num_object_clones":0,"num_object_copies":63405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21135,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50319,"num_write_kb":2286528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"42'50571","reported_seq":50974,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:11.630263+0000","last_change":"2026-02-23T13:04:40.228341+0000","last_active":"2026-02-23T13:05:11.630263+0000","last_peered":"2026-02-23T13:05:11.630263+0000","last_clean":"2026-02-23T13:05:11.630263+0000","last_became_active":"2026-02-23T13:03:08.709391+0000","last_became_peered":"2026-02-23T13:03:08.709391+0000","last_unstale":"2026-02-23T13:05:11.630263+0000","last_undegraded":"2026-02-23T13:05:11.630263+0000","last_fullsized":"2026-02-23T13:05:11.630263+0000","mapping_epoch":28,"log_start":"42'50568","ondisk_log_start":"42'50568","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'36164","last_scrub_stamp":"2026-02-23T13:04:40.228295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:40.228295+0000","objects_scrubbed":35482,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:48.119450+0000","scrub_duration":4344,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1406074880,"num_objects":21455,"num_object_clones":0,"num_object_copies":64365,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21455,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50571,"num_write_kb":2304832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"42'50410","reported_seq":50750,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:11.609229+0000","last_change":"2026-02-23T13:04:55.969591+0000","last_active":"2026-02-23T13:05:11.609229+0000","last_peered":"2026-02-23T13:05:11.609229+0000","last_clean":"2026-02-23T13:05:11.609229+0000","last_became_active":"2026-02-23T13:03:08.711303+0000","last_became_peered":"2026-02-23T13:03:08.711303+0000","last_unstale":"2026-02-23T13:05:11.609229+0000","last_undegraded":"2026-02-23T13:05:11.609229+0000","last_fullsized":"2026-02-23T13:05:11.609229+0000","mapping_epoch":28,"log_start":"42'50407","ondisk_log_start":"42'50407","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'42977","last_scrub_stamp":"2026-02-23T13:04:55.969549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:55.969549+0000","objects_scrubbed":29308,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:10.033838+0000","scrub_duration":2936,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1392902144,"num_objects":21254,"num_object_clones":0,"num_object_copies":63762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21254,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50410,"num_write_kb":2293248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":22468821016,"num_objects":342848,"num_object_clones":0,"num_object_copies":1028544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":342848,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":809074,"num_write_kb":36861441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":67419648000,"data_stored":67419635784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247837,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":19721136,"kb_used_data":19320284,"kb_used_omap":4,"kb_used_meta":400763,"kb_avail":714282064,"statfs":{"total":751619276800,"available":731424833536,"internally_reserved":0,"allocated":19783970816,"data_stored":19783696691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5101,"internal_metadata":410381331},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444064,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":17120620,"kb_used_data":15263768,"kb_used_omap":21,"kb_used_meta":1856810,"kb_avail":716882580,"statfs":{"total":751619276800,"available":734087761920,"internally_reserved":0,"allocated":15630098432,"data_stored":15629828379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21806,"internal_metadata":1901374162},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":17481900,"kb_used_data":16696664,"kb_used_omap":4,"kb_used_meta":785211,"kb_avail":716521300,"statfs":{"total":751619276800,"available":733717811200,"internally_reserved":0,"allocated":17097383936,"data_stored":17097113363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4446,"internal_metadata":804056738},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705699,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":17240496,"kb_used_data":15383580,"kb_used_omap":25,"kb_used_meta":1856806,"kb_avail":716762704,"statfs":{"total":751619276800,"available":733965008896,"internally_reserved":0,"allocated":15752785920,"data_stored":15752511795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26363,"internal_metadata":1901369605},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15462830080,"data_stored":15462826008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16856322048,"data_stored":16856317976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15441264640,"data_stored":15441264640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19659231232,"data_stored":19659227160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:05:14.785 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 41 2026-02-23T13:05:14.922 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:15.037 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:15.035+0000 7fd767f7e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:15.037 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:15.035+0000 7fd767f7e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:15.174 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-23T13:05:15.210 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:05:16.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:15 trial046 ceph-mon[38575]: pgmap v85: 17 pgs: 17 active+clean; 21 GiB data, 68 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 6.35k op/s 2026-02-23T13:05:16.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:15 trial046 ceph-mon[38575]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:05:16.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:15 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1131633244' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "41"} : dispatch 2026-02-23T13:05:16.429 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:05:16.453 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:05:16 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:05:16] "GET /metrics HTTP/1.1" 200 4226 "" "Prometheus/3.6.0" 2026-02-23T13:05:16.469 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:05:16 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:05:16.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:05:16.571 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:16.692 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:16.689+0000 7fef45a5e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:16.692 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:16.689+0000 7fef45a5e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:16.705 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:05:16.705 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:05:16.705 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:16 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:05:16.706 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:16 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3354705937' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:05:16.716 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:05:16.716 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:05:16.726 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:05:16.727 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:05:16.739 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:05:16.740 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:05:18.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:17 trial046 ceph-mon[38575]: pgmap v86: 17 pgs: 17 active+clean; 21 GiB data, 62 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 6.54k op/s 2026-02-23T13:05:18.780 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:05:18.917 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:19.032 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:19.030+0000 7f8c97f32640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:19.033 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:19.030+0000 7f8c97f32640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:19.046 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:05:19.047 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:05:19.060 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:05:19.061 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:05:19.075 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:05:19.075 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:05:19.090 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:05:19.090 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:05:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:19 trial046 ceph-mon[38575]: pgmap v87: 17 pgs: 17 active+clean; 19 GiB data, 59 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 9.23k op/s 2026-02-23T13:05:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:19 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2569877494' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:05:20.211 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:05:20.211 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-23T13:05:20.353 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:20.740 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:20.695+0000 7f0770b18640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:20.740 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:20.696+0000 7f0770b18640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:21.131 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:05:21.268 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:21.452 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:21.450+0000 7efe4053e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:21.452 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:21.450+0000 7efe4053e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:21.465 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:05:21.465 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:05:21.477 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:05:21.477 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:05:21.488 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:05:21.489 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:05:21.500 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:05:21.500 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:05:21.700 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.0 to 1 (10000) 2026-02-23T13:05:21.711 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:21 trial046 ceph-mon[38575]: pgmap v88: 17 pgs: 17 active+clean; 19 GiB data, 59 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 6.13k op/s 2026-02-23T13:05:21.711 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:21 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1957364861' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-23T13:05:21.711 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:21 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/892280280' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:05:21.744 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-23T13:05:21.879 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:22.008 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:22.005+0000 7f26d555c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:22.008 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:22.006+0000 7f26d555c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:22.702 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.1 to 1 (10000) 2026-02-23T13:05:22.745 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-23T13:05:22.885 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:22.954 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:22 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1957364861' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-23T13:05:22.955 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:22 trial046 ceph-mon[38575]: osdmap e43: 4 total, 4 up, 4 in 2026-02-23T13:05:22.955 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:22 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3711194915' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-23T13:05:23.015 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:23.013+0000 7f5f82b04640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:23.016 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:23.013+0000 7f5f82b04640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:23.539 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:05:23.683 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:23.705 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.2 to 1 (10000) 2026-02-23T13:05:23.767 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-23T13:05:23.808 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:23.806+0000 7f3a8668c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:23.808 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:23.806+0000 7f3a8668c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:23.824 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:05:23.825 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:05:23.825 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:23 trial046 ceph-mon[38575]: pgmap v90: 17 pgs: 17 active+clean; 16 GiB data, 51 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 7.86k op/s 2026-02-23T13:05:23.825 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:23 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3711194915' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-23T13:05:23.825 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:23 trial046 ceph-mon[38575]: osdmap e44: 4 total, 4 up, 4 in 2026-02-23T13:05:23.825 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:23 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/155548906' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-23T13:05:23.839 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:05:23.839 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:05:23.853 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:05:23.853 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:05:23.868 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:05:23.868 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:05:23.913 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:24.028 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:24.026+0000 7f02d256c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:24.028 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:24.026+0000 7f02d256c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:24.708 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.3 to 1 (10000) 2026-02-23T13:05:24.758 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-23T13:05:24.758 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:05:24.937 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:24.963 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:24 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/155548906' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-23T13:05:24.963 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:24 trial046 ceph-mon[38575]: osdmap e45: 4 total, 4 up, 4 in 2026-02-23T13:05:24.963 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:24 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1300595927' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:05:24.963 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:24 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2044345908' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-23T13:05:25.059 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:25.057+0000 7ff4995f0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:25.059 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:25.057+0000 7ff4995f0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:25.200 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:05:25.201 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:05:25.247 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2026-02-23T13:05:24.707149+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":17316774456,"num_objects":264227,"num_object_clones":0,"num_object_copies":792681,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":264227,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":887832,"num_write_kb":36863591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":53237880,"kb_used_data":51550696,"kb_used_omap":18,"kb_used_meta":1687021,"kb_avail":2882774920,"statfs":{"total":3006477107200,"available":2951961518080,"internally_reserved":0,"allocated":52787912704,"data_stored":52786823828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18444,"internal_metadata":1727510516},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2729050112,"num_objects":-41642,"num_object_clones":0,"num_object_copies":-124926,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-41642,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41642,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.098564"},"pg_stats":[{"pgid":"2.f","version":"42'55432","reported_seq":55786,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.603007+0000","last_change":"2026-02-23T13:04:26.095439+0000","last_active":"2026-02-23T13:05:21.603007+0000","last_peered":"2026-02-23T13:05:21.603007+0000","last_clean":"2026-02-23T13:05:21.603007+0000","last_became_active":"2026-02-23T13:03:08.711408+0000","last_became_peered":"2026-02-23T13:03:08.711408+0000","last_unstale":"2026-02-23T13:05:21.603007+0000","last_undegraded":"2026-02-23T13:05:21.603007+0000","last_fullsized":"2026-02-23T13:05:21.603007+0000","mapping_epoch":28,"log_start":"42'55429","ondisk_log_start":"42'55429","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31256","last_scrub_stamp":"2026-02-23T13:04:26.095384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:26.095384+0000","objects_scrubbed":30901,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:37.117824+0000","scrub_duration":2252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1089732608,"num_objects":16628,"num_object_clones":0,"num_object_copies":49884,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16628,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55432,"num_write_kb":2305920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"42'55996","reported_seq":56401,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.633546+0000","last_change":"2026-02-23T13:04:41.483173+0000","last_active":"2026-02-23T13:05:21.633546+0000","last_peered":"2026-02-23T13:05:21.633546+0000","last_clean":"2026-02-23T13:05:21.633546+0000","last_became_active":"2026-02-23T13:03:08.711462+0000","last_became_peered":"2026-02-23T13:03:08.711462+0000","last_unstale":"2026-02-23T13:05:21.633546+0000","last_undegraded":"2026-02-23T13:05:21.633546+0000","last_fullsized":"2026-02-23T13:05:21.633546+0000","mapping_epoch":28,"log_start":"42'55993","ondisk_log_start":"42'55993","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'36827","last_scrub_stamp":"2026-02-23T13:04:41.482975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:41.482975+0000","objects_scrubbed":35883,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:55.333749+0000","scrub_duration":4566,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1082654720,"num_objects":16520,"num_object_clones":0,"num_object_copies":49560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16520,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55996,"num_write_kb":2320512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"42'55272","reported_seq":55646,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.626471+0000","last_change":"2026-02-23T13:04:32.030814+0000","last_active":"2026-02-23T13:05:21.626471+0000","last_peered":"2026-02-23T13:05:21.626471+0000","last_clean":"2026-02-23T13:05:21.626471+0000","last_became_active":"2026-02-23T13:03:08.712246+0000","last_became_peered":"2026-02-23T13:03:08.712246+0000","last_unstale":"2026-02-23T13:05:21.626471+0000","last_undegraded":"2026-02-23T13:05:21.626471+0000","last_fullsized":"2026-02-23T13:05:21.626471+0000","mapping_epoch":28,"log_start":"42'55269","ondisk_log_start":"42'55269","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'33322","last_scrub_stamp":"2026-02-23T13:04:32.030772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:32.030772+0000","objects_scrubbed":32583,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:46.346152+0000","scrub_duration":4282,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1093074968,"num_objects":16680,"num_object_clones":0,"num_object_copies":50040,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16680,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":55272,"num_write_kb":2302401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"42'55735","reported_seq":56093,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.630839+0000","last_change":"2026-02-23T13:04:27.262519+0000","last_active":"2026-02-23T13:05:21.630839+0000","last_peered":"2026-02-23T13:05:21.630839+0000","last_clean":"2026-02-23T13:05:21.630839+0000","last_became_active":"2026-02-23T13:03:08.712348+0000","last_became_peered":"2026-02-23T13:03:08.712348+0000","last_unstale":"2026-02-23T13:05:21.630839+0000","last_undegraded":"2026-02-23T13:05:21.630839+0000","last_fullsized":"2026-02-23T13:05:21.630839+0000","mapping_epoch":28,"log_start":"42'55732","ondisk_log_start":"42'55732","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31725","last_scrub_stamp":"2026-02-23T13:04:27.262379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:27.262379+0000","objects_scrubbed":31138,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:36.061346+0000","scrub_duration":3485,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1082982400,"num_objects":16525,"num_object_clones":0,"num_object_copies":49575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16525,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55735,"num_write_kb":2312320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":221,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:22.806251+0000","last_change":"2026-02-23T13:04:08.199097+0000","last_active":"2026-02-23T13:04:22.806251+0000","last_peered":"2026-02-23T13:04:22.806251+0000","last_clean":"2026-02-23T13:04:22.806251+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:04:22.806251+0000","last_undegraded":"2026-02-23T13:04:22.806251+0000","last_fullsized":"2026-02-23T13:04:22.806251+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:04:08.199036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:04:08.199036+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:23.231335+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"42'55295","reported_seq":55610,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.611336+0000","last_change":"2026-02-23T13:04:15.649890+0000","last_active":"2026-02-23T13:05:21.611336+0000","last_peered":"2026-02-23T13:05:21.611336+0000","last_clean":"2026-02-23T13:05:21.611336+0000","last_became_active":"2026-02-23T13:03:08.708695+0000","last_became_peered":"2026-02-23T13:03:08.708695+0000","last_unstale":"2026-02-23T13:05:21.611336+0000","last_undegraded":"2026-02-23T13:05:21.611336+0000","last_fullsized":"2026-02-23T13:05:21.611336+0000","mapping_epoch":28,"log_start":"42'55291","ondisk_log_start":"42'55291","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'27365","last_scrub_stamp":"2026-02-23T13:04:15.649815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:15.649815+0000","objects_scrubbed":26902,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"queued for scrub","scrub_duration":2575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1087438848,"num_objects":16593,"num_object_clones":0,"num_object_copies":49779,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16593,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55295,"num_write_kb":2300416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"42'55549","reported_seq":55918,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.609791+0000","last_change":"2026-02-23T13:04:30.014412+0000","last_active":"2026-02-23T13:05:21.609791+0000","last_peered":"2026-02-23T13:05:21.609791+0000","last_clean":"2026-02-23T13:05:21.609791+0000","last_became_active":"2026-02-23T13:03:08.711847+0000","last_became_peered":"2026-02-23T13:03:08.711847+0000","last_unstale":"2026-02-23T13:05:21.609791+0000","last_undegraded":"2026-02-23T13:05:21.609791+0000","last_fullsized":"2026-02-23T13:05:21.609791+0000","mapping_epoch":28,"log_start":"42'55546","ondisk_log_start":"42'55546","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'32670","last_scrub_stamp":"2026-02-23T13:04:30.014332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:30.014332+0000","objects_scrubbed":32128,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:50.241908+0000","scrub_duration":3026,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1074724864,"num_objects":16399,"num_object_clones":0,"num_object_copies":49197,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16399,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55549,"num_write_kb":2302336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"42'55521","reported_seq":55830,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.632680+0000","last_change":"2026-02-23T13:04:14.687654+0000","last_active":"2026-02-23T13:05:21.632680+0000","last_peered":"2026-02-23T13:05:21.632680+0000","last_clean":"2026-02-23T13:05:21.632680+0000","last_became_active":"2026-02-23T13:03:08.712783+0000","last_became_peered":"2026-02-23T13:03:08.712783+0000","last_unstale":"2026-02-23T13:05:21.632680+0000","last_undegraded":"2026-02-23T13:05:21.632680+0000","last_fullsized":"2026-02-23T13:05:21.632680+0000","mapping_epoch":28,"log_start":"42'55518","ondisk_log_start":"42'55518","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'26930","last_scrub_stamp":"2026-02-23T13:04:14.687533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:14.687533+0000","objects_scrubbed":26390,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:29.989051+0000","scrub_duration":2902,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1093074944,"num_objects":16679,"num_object_clones":0,"num_object_copies":50037,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16679,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55521,"num_write_kb":2310400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"42'55603","reported_seq":55956,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.608953+0000","last_change":"2026-02-23T13:04:25.882548+0000","last_active":"2026-02-23T13:05:21.608953+0000","last_peered":"2026-02-23T13:05:21.608953+0000","last_clean":"2026-02-23T13:05:21.608953+0000","last_became_active":"2026-02-23T13:03:08.708821+0000","last_became_peered":"2026-02-23T13:03:08.708821+0000","last_unstale":"2026-02-23T13:05:21.608953+0000","last_undegraded":"2026-02-23T13:05:21.608953+0000","last_fullsized":"2026-02-23T13:05:21.608953+0000","mapping_epoch":28,"log_start":"42'55600","ondisk_log_start":"42'55600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31120","last_scrub_stamp":"2026-02-23T13:04:25.882487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:25.882487+0000","objects_scrubbed":30639,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:32.453655+0000","scrub_duration":2862,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1071841280,"num_objects":16355,"num_object_clones":0,"num_object_copies":49065,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55603,"num_write_kb":2302656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"42'55325","reported_seq":55725,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.630341+0000","last_change":"2026-02-23T13:04:39.437215+0000","last_active":"2026-02-23T13:05:21.630341+0000","last_peered":"2026-02-23T13:05:21.630341+0000","last_clean":"2026-02-23T13:05:21.630341+0000","last_became_active":"2026-02-23T13:03:08.712152+0000","last_became_peered":"2026-02-23T13:03:08.712152+0000","last_unstale":"2026-02-23T13:05:21.630341+0000","last_undegraded":"2026-02-23T13:05:21.630341+0000","last_fullsized":"2026-02-23T13:05:21.630341+0000","mapping_epoch":28,"log_start":"42'55322","ondisk_log_start":"42'55322","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'35859","last_scrub_stamp":"2026-02-23T13:04:39.437158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:39.437158+0000","objects_scrubbed":35127,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:52.724383+0000","scrub_duration":4536,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1089667072,"num_objects":16627,"num_object_clones":0,"num_object_copies":49881,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16627,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55325,"num_write_kb":2302464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"42'55111","reported_seq":55442,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.607097+0000","last_change":"2026-02-23T13:04:57.975495+0000","last_active":"2026-02-23T13:05:21.607097+0000","last_peered":"2026-02-23T13:05:21.607097+0000","last_clean":"2026-02-23T13:05:21.607097+0000","last_became_active":"2026-02-23T13:03:08.712055+0000","last_became_peered":"2026-02-23T13:03:08.712055+0000","last_unstale":"2026-02-23T13:05:21.607097+0000","last_undegraded":"2026-02-23T13:05:21.607097+0000","last_fullsized":"2026-02-23T13:05:21.607097+0000","mapping_epoch":28,"log_start":"42'55108","ondisk_log_start":"42'55108","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'43718","last_scrub_stamp":"2026-02-23T13:04:57.975448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:57.975448+0000","objects_scrubbed":28325,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:22.148320+0000","scrub_duration":2865,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068302336,"num_objects":16301,"num_object_clones":0,"num_object_copies":48903,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16301,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55111,"num_write_kb":2285184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"42'55560","reported_seq":55913,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.635380+0000","last_change":"2026-02-23T13:04:25.319824+0000","last_active":"2026-02-23T13:05:21.635380+0000","last_peered":"2026-02-23T13:05:21.635380+0000","last_clean":"2026-02-23T13:05:21.635380+0000","last_became_active":"2026-02-23T13:03:08.708852+0000","last_became_peered":"2026-02-23T13:03:08.708852+0000","last_unstale":"2026-02-23T13:05:21.635380+0000","last_undegraded":"2026-02-23T13:05:21.635380+0000","last_fullsized":"2026-02-23T13:05:21.635380+0000","mapping_epoch":28,"log_start":"42'55557","ondisk_log_start":"42'55557","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31026","last_scrub_stamp":"2026-02-23T13:04:25.319785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:25.319785+0000","objects_scrubbed":30498,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:39.230588+0000","scrub_duration":3555,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1077936128,"num_objects":16448,"num_object_clones":0,"num_object_copies":49344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16448,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55560,"num_write_kb":2304256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"42'55792","reported_seq":56146,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.606275+0000","last_change":"2026-02-23T13:04:53.166360+0000","last_active":"2026-02-23T13:05:21.606275+0000","last_peered":"2026-02-23T13:05:21.606275+0000","last_clean":"2026-02-23T13:05:21.606275+0000","last_became_active":"2026-02-23T13:03:08.708457+0000","last_became_peered":"2026-02-23T13:03:08.708457+0000","last_unstale":"2026-02-23T13:05:21.606275+0000","last_undegraded":"2026-02-23T13:05:21.606275+0000","last_fullsized":"2026-02-23T13:05:21.606275+0000","mapping_epoch":28,"log_start":"42'55789","ondisk_log_start":"42'55789","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'42452","last_scrub_stamp":"2026-02-23T13:04:53.166176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:53.166176+0000","objects_scrubbed":30649,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:57.240381+0000","scrub_duration":3244,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1088946176,"num_objects":16616,"num_object_clones":0,"num_object_copies":49848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16616,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55792,"num_write_kb":2317056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"42'55605","reported_seq":56009,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.606852+0000","last_change":"2026-02-23T13:04:43.225441+0000","last_active":"2026-02-23T13:05:21.606852+0000","last_peered":"2026-02-23T13:05:21.606852+0000","last_clean":"2026-02-23T13:05:21.606852+0000","last_became_active":"2026-02-23T13:03:08.712010+0000","last_became_peered":"2026-02-23T13:03:08.712010+0000","last_unstale":"2026-02-23T13:05:21.606852+0000","last_undegraded":"2026-02-23T13:05:21.606852+0000","last_fullsized":"2026-02-23T13:05:21.606852+0000","mapping_epoch":28,"log_start":"42'55602","ondisk_log_start":"42'55602","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'37378","last_scrub_stamp":"2026-02-23T13:04:43.225387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:43.225387+0000","objects_scrubbed":35509,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:53.679895+0000","scrub_duration":3337,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1088618496,"num_objects":16611,"num_object_clones":0,"num_object_copies":49833,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16611,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55605,"num_write_kb":2310912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"42'55184","reported_seq":55525,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.634134+0000","last_change":"2026-02-23T13:04:22.389549+0000","last_active":"2026-02-23T13:05:21.634134+0000","last_peered":"2026-02-23T13:05:21.634134+0000","last_clean":"2026-02-23T13:05:21.634134+0000","last_became_active":"2026-02-23T13:03:08.712763+0000","last_became_peered":"2026-02-23T13:03:08.712763+0000","last_unstale":"2026-02-23T13:05:21.634134+0000","last_undegraded":"2026-02-23T13:05:21.634134+0000","last_fullsized":"2026-02-23T13:05:21.634134+0000","mapping_epoch":28,"log_start":"42'55181","ondisk_log_start":"42'55181","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'29812","last_scrub_stamp":"2026-02-23T13:04:22.389498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:22.389498+0000","objects_scrubbed":29176,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:26.761128+0000","scrub_duration":3534,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1066270720,"num_objects":16270,"num_object_clones":0,"num_object_copies":48810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16270,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55184,"num_write_kb":2286528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"42'55502","reported_seq":55905,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.634720+0000","last_change":"2026-02-23T13:04:40.228341+0000","last_active":"2026-02-23T13:05:21.634720+0000","last_peered":"2026-02-23T13:05:21.634720+0000","last_clean":"2026-02-23T13:05:21.634720+0000","last_became_active":"2026-02-23T13:03:08.709391+0000","last_became_peered":"2026-02-23T13:03:08.709391+0000","last_unstale":"2026-02-23T13:05:21.634720+0000","last_undegraded":"2026-02-23T13:05:21.634720+0000","last_fullsized":"2026-02-23T13:05:21.634720+0000","mapping_epoch":28,"log_start":"42'55499","ondisk_log_start":"42'55499","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'36164","last_scrub_stamp":"2026-02-23T13:04:40.228295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:40.228295+0000","objects_scrubbed":35482,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:48.119450+0000","scrub_duration":4344,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1082916864,"num_objects":16524,"num_object_clones":0,"num_object_copies":49572,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55502,"num_write_kb":2304832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"42'55215","reported_seq":55555,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.608912+0000","last_change":"2026-02-23T13:04:55.969591+0000","last_active":"2026-02-23T13:05:21.608912+0000","last_peered":"2026-02-23T13:05:21.608912+0000","last_clean":"2026-02-23T13:05:21.608912+0000","last_became_active":"2026-02-23T13:03:08.711303+0000","last_became_peered":"2026-02-23T13:03:08.711303+0000","last_unstale":"2026-02-23T13:05:21.608912+0000","last_undegraded":"2026-02-23T13:05:21.608912+0000","last_fullsized":"2026-02-23T13:05:21.608912+0000","mapping_epoch":28,"log_start":"42'55212","ondisk_log_start":"42'55212","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'42977","last_scrub_stamp":"2026-02-23T13:04:55.969549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:55.969549+0000","objects_scrubbed":29308,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:10.033838+0000","scrub_duration":2936,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1078001664,"num_objects":16449,"num_object_clones":0,"num_object_copies":49347,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55215,"num_write_kb":2293248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":17316184088,"num_objects":264225,"num_object_clones":0,"num_object_copies":792675,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":264225,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":887697,"num_write_kb":36861441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51963703296,"data_stored":51963691080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247839,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":15540912,"kb_used_data":15013788,"kb_used_omap":4,"kb_used_meta":527099,"kb_avail":718462288,"statfs":{"total":751619276800,"available":735705382912,"internally_reserved":0,"allocated":15374118912,"data_stored":15373844787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5101,"internal_metadata":539749395},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444066,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":12003692,"kb_used_data":11853400,"kb_used_omap":4,"kb_used_meta":150267,"kb_avail":721999508,"statfs":{"total":751619276800,"available":739327496192,"internally_reserved":0,"allocated":12137881600,"data_stored":12137611547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4447,"internal_metadata":153874081},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":13255084,"kb_used_data":12984344,"kb_used_omap":4,"kb_used_meta":270651,"kb_avail":720748116,"statfs":{"total":751619276800,"available":738046070784,"internally_reserved":0,"allocated":13295968256,"data_stored":13295697683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4446,"internal_metadata":277147298},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705701,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":12438192,"kb_used_data":11699164,"kb_used_omap":4,"kb_used_meta":739003,"kb_avail":721565008,"statfs":{"total":751619276800,"available":738882568192,"internally_reserved":0,"allocated":11979943936,"data_stored":11979669811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4450,"internal_metadata":756739742},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11916283904,"data_stored":11916279832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12986880000,"data_stored":12986875928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11912282112,"data_stored":11912282112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15148257280,"data_stored":15148253208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:05:25.249 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:05:25.382 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:25.505 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:25.503+0000 7ff0f20cf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:25.505 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:25.503+0000 7ff0f20cf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:25.645 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:05:25.645 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:05:25.692 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2026-02-23T13:05:24.707149+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":17316774456,"num_objects":264227,"num_object_clones":0,"num_object_copies":792681,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":264227,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":887832,"num_write_kb":36863591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":53237880,"kb_used_data":51550696,"kb_used_omap":18,"kb_used_meta":1687021,"kb_avail":2882774920,"statfs":{"total":3006477107200,"available":2951961518080,"internally_reserved":0,"allocated":52787912704,"data_stored":52786823828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18444,"internal_metadata":1727510516},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2729050112,"num_objects":-41642,"num_object_clones":0,"num_object_copies":-124926,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-41642,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41642,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.098564"},"pg_stats":[{"pgid":"2.f","version":"42'55432","reported_seq":55786,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.603007+0000","last_change":"2026-02-23T13:04:26.095439+0000","last_active":"2026-02-23T13:05:21.603007+0000","last_peered":"2026-02-23T13:05:21.603007+0000","last_clean":"2026-02-23T13:05:21.603007+0000","last_became_active":"2026-02-23T13:03:08.711408+0000","last_became_peered":"2026-02-23T13:03:08.711408+0000","last_unstale":"2026-02-23T13:05:21.603007+0000","last_undegraded":"2026-02-23T13:05:21.603007+0000","last_fullsized":"2026-02-23T13:05:21.603007+0000","mapping_epoch":28,"log_start":"42'55429","ondisk_log_start":"42'55429","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31256","last_scrub_stamp":"2026-02-23T13:04:26.095384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:26.095384+0000","objects_scrubbed":30901,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:37.117824+0000","scrub_duration":2252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1089732608,"num_objects":16628,"num_object_clones":0,"num_object_copies":49884,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16628,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55432,"num_write_kb":2305920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"42'55996","reported_seq":56401,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.633546+0000","last_change":"2026-02-23T13:04:41.483173+0000","last_active":"2026-02-23T13:05:21.633546+0000","last_peered":"2026-02-23T13:05:21.633546+0000","last_clean":"2026-02-23T13:05:21.633546+0000","last_became_active":"2026-02-23T13:03:08.711462+0000","last_became_peered":"2026-02-23T13:03:08.711462+0000","last_unstale":"2026-02-23T13:05:21.633546+0000","last_undegraded":"2026-02-23T13:05:21.633546+0000","last_fullsized":"2026-02-23T13:05:21.633546+0000","mapping_epoch":28,"log_start":"42'55993","ondisk_log_start":"42'55993","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'36827","last_scrub_stamp":"2026-02-23T13:04:41.482975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:41.482975+0000","objects_scrubbed":35883,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:55.333749+0000","scrub_duration":4566,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1082654720,"num_objects":16520,"num_object_clones":0,"num_object_copies":49560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16520,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55996,"num_write_kb":2320512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"42'55272","reported_seq":55646,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.626471+0000","last_change":"2026-02-23T13:04:32.030814+0000","last_active":"2026-02-23T13:05:21.626471+0000","last_peered":"2026-02-23T13:05:21.626471+0000","last_clean":"2026-02-23T13:05:21.626471+0000","last_became_active":"2026-02-23T13:03:08.712246+0000","last_became_peered":"2026-02-23T13:03:08.712246+0000","last_unstale":"2026-02-23T13:05:21.626471+0000","last_undegraded":"2026-02-23T13:05:21.626471+0000","last_fullsized":"2026-02-23T13:05:21.626471+0000","mapping_epoch":28,"log_start":"42'55269","ondisk_log_start":"42'55269","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'33322","last_scrub_stamp":"2026-02-23T13:04:32.030772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:32.030772+0000","objects_scrubbed":32583,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:46.346152+0000","scrub_duration":4282,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1093074968,"num_objects":16680,"num_object_clones":0,"num_object_copies":50040,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16680,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":55272,"num_write_kb":2302401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"42'55735","reported_seq":56093,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.630839+0000","last_change":"2026-02-23T13:04:27.262519+0000","last_active":"2026-02-23T13:05:21.630839+0000","last_peered":"2026-02-23T13:05:21.630839+0000","last_clean":"2026-02-23T13:05:21.630839+0000","last_became_active":"2026-02-23T13:03:08.712348+0000","last_became_peered":"2026-02-23T13:03:08.712348+0000","last_unstale":"2026-02-23T13:05:21.630839+0000","last_undegraded":"2026-02-23T13:05:21.630839+0000","last_fullsized":"2026-02-23T13:05:21.630839+0000","mapping_epoch":28,"log_start":"42'55732","ondisk_log_start":"42'55732","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31725","last_scrub_stamp":"2026-02-23T13:04:27.262379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:27.262379+0000","objects_scrubbed":31138,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:36.061346+0000","scrub_duration":3485,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1082982400,"num_objects":16525,"num_object_clones":0,"num_object_copies":49575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16525,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55735,"num_write_kb":2312320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":221,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:22.806251+0000","last_change":"2026-02-23T13:04:08.199097+0000","last_active":"2026-02-23T13:04:22.806251+0000","last_peered":"2026-02-23T13:04:22.806251+0000","last_clean":"2026-02-23T13:04:22.806251+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:04:22.806251+0000","last_undegraded":"2026-02-23T13:04:22.806251+0000","last_fullsized":"2026-02-23T13:04:22.806251+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:04:08.199036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:04:08.199036+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:23.231335+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"42'55295","reported_seq":55610,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.611336+0000","last_change":"2026-02-23T13:04:15.649890+0000","last_active":"2026-02-23T13:05:21.611336+0000","last_peered":"2026-02-23T13:05:21.611336+0000","last_clean":"2026-02-23T13:05:21.611336+0000","last_became_active":"2026-02-23T13:03:08.708695+0000","last_became_peered":"2026-02-23T13:03:08.708695+0000","last_unstale":"2026-02-23T13:05:21.611336+0000","last_undegraded":"2026-02-23T13:05:21.611336+0000","last_fullsized":"2026-02-23T13:05:21.611336+0000","mapping_epoch":28,"log_start":"42'55291","ondisk_log_start":"42'55291","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'27365","last_scrub_stamp":"2026-02-23T13:04:15.649815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:15.649815+0000","objects_scrubbed":26902,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"queued for scrub","scrub_duration":2575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1087438848,"num_objects":16593,"num_object_clones":0,"num_object_copies":49779,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16593,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55295,"num_write_kb":2300416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"42'55549","reported_seq":55918,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.609791+0000","last_change":"2026-02-23T13:04:30.014412+0000","last_active":"2026-02-23T13:05:21.609791+0000","last_peered":"2026-02-23T13:05:21.609791+0000","last_clean":"2026-02-23T13:05:21.609791+0000","last_became_active":"2026-02-23T13:03:08.711847+0000","last_became_peered":"2026-02-23T13:03:08.711847+0000","last_unstale":"2026-02-23T13:05:21.609791+0000","last_undegraded":"2026-02-23T13:05:21.609791+0000","last_fullsized":"2026-02-23T13:05:21.609791+0000","mapping_epoch":28,"log_start":"42'55546","ondisk_log_start":"42'55546","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'32670","last_scrub_stamp":"2026-02-23T13:04:30.014332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:30.014332+0000","objects_scrubbed":32128,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:50.241908+0000","scrub_duration":3026,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1074724864,"num_objects":16399,"num_object_clones":0,"num_object_copies":49197,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16399,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55549,"num_write_kb":2302336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"42'55521","reported_seq":55830,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.632680+0000","last_change":"2026-02-23T13:04:14.687654+0000","last_active":"2026-02-23T13:05:21.632680+0000","last_peered":"2026-02-23T13:05:21.632680+0000","last_clean":"2026-02-23T13:05:21.632680+0000","last_became_active":"2026-02-23T13:03:08.712783+0000","last_became_peered":"2026-02-23T13:03:08.712783+0000","last_unstale":"2026-02-23T13:05:21.632680+0000","last_undegraded":"2026-02-23T13:05:21.632680+0000","last_fullsized":"2026-02-23T13:05:21.632680+0000","mapping_epoch":28,"log_start":"42'55518","ondisk_log_start":"42'55518","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'26930","last_scrub_stamp":"2026-02-23T13:04:14.687533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:14.687533+0000","objects_scrubbed":26390,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:29.989051+0000","scrub_duration":2902,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1093074944,"num_objects":16679,"num_object_clones":0,"num_object_copies":50037,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16679,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55521,"num_write_kb":2310400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"42'55603","reported_seq":55956,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.608953+0000","last_change":"2026-02-23T13:04:25.882548+0000","last_active":"2026-02-23T13:05:21.608953+0000","last_peered":"2026-02-23T13:05:21.608953+0000","last_clean":"2026-02-23T13:05:21.608953+0000","last_became_active":"2026-02-23T13:03:08.708821+0000","last_became_peered":"2026-02-23T13:03:08.708821+0000","last_unstale":"2026-02-23T13:05:21.608953+0000","last_undegraded":"2026-02-23T13:05:21.608953+0000","last_fullsized":"2026-02-23T13:05:21.608953+0000","mapping_epoch":28,"log_start":"42'55600","ondisk_log_start":"42'55600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31120","last_scrub_stamp":"2026-02-23T13:04:25.882487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:25.882487+0000","objects_scrubbed":30639,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:32.453655+0000","scrub_duration":2862,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1071841280,"num_objects":16355,"num_object_clones":0,"num_object_copies":49065,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55603,"num_write_kb":2302656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"42'55325","reported_seq":55725,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.630341+0000","last_change":"2026-02-23T13:04:39.437215+0000","last_active":"2026-02-23T13:05:21.630341+0000","last_peered":"2026-02-23T13:05:21.630341+0000","last_clean":"2026-02-23T13:05:21.630341+0000","last_became_active":"2026-02-23T13:03:08.712152+0000","last_became_peered":"2026-02-23T13:03:08.712152+0000","last_unstale":"2026-02-23T13:05:21.630341+0000","last_undegraded":"2026-02-23T13:05:21.630341+0000","last_fullsized":"2026-02-23T13:05:21.630341+0000","mapping_epoch":28,"log_start":"42'55322","ondisk_log_start":"42'55322","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'35859","last_scrub_stamp":"2026-02-23T13:04:39.437158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:39.437158+0000","objects_scrubbed":35127,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:52.724383+0000","scrub_duration":4536,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1089667072,"num_objects":16627,"num_object_clones":0,"num_object_copies":49881,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16627,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55325,"num_write_kb":2302464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"42'55111","reported_seq":55442,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.607097+0000","last_change":"2026-02-23T13:04:57.975495+0000","last_active":"2026-02-23T13:05:21.607097+0000","last_peered":"2026-02-23T13:05:21.607097+0000","last_clean":"2026-02-23T13:05:21.607097+0000","last_became_active":"2026-02-23T13:03:08.712055+0000","last_became_peered":"2026-02-23T13:03:08.712055+0000","last_unstale":"2026-02-23T13:05:21.607097+0000","last_undegraded":"2026-02-23T13:05:21.607097+0000","last_fullsized":"2026-02-23T13:05:21.607097+0000","mapping_epoch":28,"log_start":"42'55108","ondisk_log_start":"42'55108","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'43718","last_scrub_stamp":"2026-02-23T13:04:57.975448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:57.975448+0000","objects_scrubbed":28325,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:22.148320+0000","scrub_duration":2865,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068302336,"num_objects":16301,"num_object_clones":0,"num_object_copies":48903,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16301,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55111,"num_write_kb":2285184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"42'55560","reported_seq":55913,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.635380+0000","last_change":"2026-02-23T13:04:25.319824+0000","last_active":"2026-02-23T13:05:21.635380+0000","last_peered":"2026-02-23T13:05:21.635380+0000","last_clean":"2026-02-23T13:05:21.635380+0000","last_became_active":"2026-02-23T13:03:08.708852+0000","last_became_peered":"2026-02-23T13:03:08.708852+0000","last_unstale":"2026-02-23T13:05:21.635380+0000","last_undegraded":"2026-02-23T13:05:21.635380+0000","last_fullsized":"2026-02-23T13:05:21.635380+0000","mapping_epoch":28,"log_start":"42'55557","ondisk_log_start":"42'55557","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31026","last_scrub_stamp":"2026-02-23T13:04:25.319785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:25.319785+0000","objects_scrubbed":30498,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:39.230588+0000","scrub_duration":3555,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1077936128,"num_objects":16448,"num_object_clones":0,"num_object_copies":49344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16448,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55560,"num_write_kb":2304256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"42'55792","reported_seq":56146,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.606275+0000","last_change":"2026-02-23T13:04:53.166360+0000","last_active":"2026-02-23T13:05:21.606275+0000","last_peered":"2026-02-23T13:05:21.606275+0000","last_clean":"2026-02-23T13:05:21.606275+0000","last_became_active":"2026-02-23T13:03:08.708457+0000","last_became_peered":"2026-02-23T13:03:08.708457+0000","last_unstale":"2026-02-23T13:05:21.606275+0000","last_undegraded":"2026-02-23T13:05:21.606275+0000","last_fullsized":"2026-02-23T13:05:21.606275+0000","mapping_epoch":28,"log_start":"42'55789","ondisk_log_start":"42'55789","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'42452","last_scrub_stamp":"2026-02-23T13:04:53.166176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:53.166176+0000","objects_scrubbed":30649,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:57.240381+0000","scrub_duration":3244,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1088946176,"num_objects":16616,"num_object_clones":0,"num_object_copies":49848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16616,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55792,"num_write_kb":2317056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"42'55605","reported_seq":56009,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.606852+0000","last_change":"2026-02-23T13:04:43.225441+0000","last_active":"2026-02-23T13:05:21.606852+0000","last_peered":"2026-02-23T13:05:21.606852+0000","last_clean":"2026-02-23T13:05:21.606852+0000","last_became_active":"2026-02-23T13:03:08.712010+0000","last_became_peered":"2026-02-23T13:03:08.712010+0000","last_unstale":"2026-02-23T13:05:21.606852+0000","last_undegraded":"2026-02-23T13:05:21.606852+0000","last_fullsized":"2026-02-23T13:05:21.606852+0000","mapping_epoch":28,"log_start":"42'55602","ondisk_log_start":"42'55602","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'37378","last_scrub_stamp":"2026-02-23T13:04:43.225387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:43.225387+0000","objects_scrubbed":35509,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:53.679895+0000","scrub_duration":3337,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1088618496,"num_objects":16611,"num_object_clones":0,"num_object_copies":49833,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16611,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55605,"num_write_kb":2310912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"42'55184","reported_seq":55525,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.634134+0000","last_change":"2026-02-23T13:04:22.389549+0000","last_active":"2026-02-23T13:05:21.634134+0000","last_peered":"2026-02-23T13:05:21.634134+0000","last_clean":"2026-02-23T13:05:21.634134+0000","last_became_active":"2026-02-23T13:03:08.712763+0000","last_became_peered":"2026-02-23T13:03:08.712763+0000","last_unstale":"2026-02-23T13:05:21.634134+0000","last_undegraded":"2026-02-23T13:05:21.634134+0000","last_fullsized":"2026-02-23T13:05:21.634134+0000","mapping_epoch":28,"log_start":"42'55181","ondisk_log_start":"42'55181","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'29812","last_scrub_stamp":"2026-02-23T13:04:22.389498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:22.389498+0000","objects_scrubbed":29176,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:26.761128+0000","scrub_duration":3534,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1066270720,"num_objects":16270,"num_object_clones":0,"num_object_copies":48810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16270,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55184,"num_write_kb":2286528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"42'55502","reported_seq":55905,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.634720+0000","last_change":"2026-02-23T13:04:40.228341+0000","last_active":"2026-02-23T13:05:21.634720+0000","last_peered":"2026-02-23T13:05:21.634720+0000","last_clean":"2026-02-23T13:05:21.634720+0000","last_became_active":"2026-02-23T13:03:08.709391+0000","last_became_peered":"2026-02-23T13:03:08.709391+0000","last_unstale":"2026-02-23T13:05:21.634720+0000","last_undegraded":"2026-02-23T13:05:21.634720+0000","last_fullsized":"2026-02-23T13:05:21.634720+0000","mapping_epoch":28,"log_start":"42'55499","ondisk_log_start":"42'55499","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'36164","last_scrub_stamp":"2026-02-23T13:04:40.228295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:40.228295+0000","objects_scrubbed":35482,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:48.119450+0000","scrub_duration":4344,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1082916864,"num_objects":16524,"num_object_clones":0,"num_object_copies":49572,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55502,"num_write_kb":2304832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"42'55215","reported_seq":55555,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.608912+0000","last_change":"2026-02-23T13:04:55.969591+0000","last_active":"2026-02-23T13:05:21.608912+0000","last_peered":"2026-02-23T13:05:21.608912+0000","last_clean":"2026-02-23T13:05:21.608912+0000","last_became_active":"2026-02-23T13:03:08.711303+0000","last_became_peered":"2026-02-23T13:03:08.711303+0000","last_unstale":"2026-02-23T13:05:21.608912+0000","last_undegraded":"2026-02-23T13:05:21.608912+0000","last_fullsized":"2026-02-23T13:05:21.608912+0000","mapping_epoch":28,"log_start":"42'55212","ondisk_log_start":"42'55212","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'42977","last_scrub_stamp":"2026-02-23T13:04:55.969549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:55.969549+0000","objects_scrubbed":29308,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:10.033838+0000","scrub_duration":2936,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1078001664,"num_objects":16449,"num_object_clones":0,"num_object_copies":49347,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55215,"num_write_kb":2293248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":17316184088,"num_objects":264225,"num_object_clones":0,"num_object_copies":792675,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":264225,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":887697,"num_write_kb":36861441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51963703296,"data_stored":51963691080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247839,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":15540912,"kb_used_data":15013788,"kb_used_omap":4,"kb_used_meta":527099,"kb_avail":718462288,"statfs":{"total":751619276800,"available":735705382912,"internally_reserved":0,"allocated":15374118912,"data_stored":15373844787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5101,"internal_metadata":539749395},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444066,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":12003692,"kb_used_data":11853400,"kb_used_omap":4,"kb_used_meta":150267,"kb_avail":721999508,"statfs":{"total":751619276800,"available":739327496192,"internally_reserved":0,"allocated":12137881600,"data_stored":12137611547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4447,"internal_metadata":153874081},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":13255084,"kb_used_data":12984344,"kb_used_omap":4,"kb_used_meta":270651,"kb_avail":720748116,"statfs":{"total":751619276800,"available":738046070784,"internally_reserved":0,"allocated":13295968256,"data_stored":13295697683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4446,"internal_metadata":277147298},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705701,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":12438192,"kb_used_data":11699164,"kb_used_omap":4,"kb_used_meta":739003,"kb_avail":721565008,"statfs":{"total":751619276800,"available":738882568192,"internally_reserved":0,"allocated":11979943936,"data_stored":11979669811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4450,"internal_metadata":756739742},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11916283904,"data_stored":11916279832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12986880000,"data_stored":12986875928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11912282112,"data_stored":11912282112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15148257280,"data_stored":15148253208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:05:25.694 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-23T13:05:25.694 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:05:25.694 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_0 2026-02-23T13:05:25.695 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:05:25.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:25 trial046 ceph-mon[38575]: pgmap v93: 17 pgs: 17 active+clean; 16 GiB data, 51 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 6.94k op/s 2026-02-23T13:05:25.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:25 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2044345908' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-23T13:05:25.790 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:25 trial046 ceph-mon[38575]: osdmap e46: 4 total, 4 up, 4 in 2026-02-23T13:05:25.836 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:25.912 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:05:25.957 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:25.955+0000 7f34e6697640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:25.957 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:25.955+0000 7f34e6697640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:26.052 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:26.098 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:05:26.098 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:05:26.141 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2026-02-23T13:05:24.707149+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":17316774456,"num_objects":264227,"num_object_clones":0,"num_object_copies":792681,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":264227,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":887832,"num_write_kb":36863591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":53237880,"kb_used_data":51550696,"kb_used_omap":18,"kb_used_meta":1687021,"kb_avail":2882774920,"statfs":{"total":3006477107200,"available":2951961518080,"internally_reserved":0,"allocated":52787912704,"data_stored":52786823828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18444,"internal_metadata":1727510516},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2729050112,"num_objects":-41642,"num_object_clones":0,"num_object_copies":-124926,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-41642,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41642,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.098564"},"pg_stats":[{"pgid":"2.f","version":"42'55432","reported_seq":55786,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.603007+0000","last_change":"2026-02-23T13:04:26.095439+0000","last_active":"2026-02-23T13:05:21.603007+0000","last_peered":"2026-02-23T13:05:21.603007+0000","last_clean":"2026-02-23T13:05:21.603007+0000","last_became_active":"2026-02-23T13:03:08.711408+0000","last_became_peered":"2026-02-23T13:03:08.711408+0000","last_unstale":"2026-02-23T13:05:21.603007+0000","last_undegraded":"2026-02-23T13:05:21.603007+0000","last_fullsized":"2026-02-23T13:05:21.603007+0000","mapping_epoch":28,"log_start":"42'55429","ondisk_log_start":"42'55429","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31256","last_scrub_stamp":"2026-02-23T13:04:26.095384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:26.095384+0000","objects_scrubbed":30901,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:37.117824+0000","scrub_duration":2252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1089732608,"num_objects":16628,"num_object_clones":0,"num_object_copies":49884,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16628,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55432,"num_write_kb":2305920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"42'55996","reported_seq":56401,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.633546+0000","last_change":"2026-02-23T13:04:41.483173+0000","last_active":"2026-02-23T13:05:21.633546+0000","last_peered":"2026-02-23T13:05:21.633546+0000","last_clean":"2026-02-23T13:05:21.633546+0000","last_became_active":"2026-02-23T13:03:08.711462+0000","last_became_peered":"2026-02-23T13:03:08.711462+0000","last_unstale":"2026-02-23T13:05:21.633546+0000","last_undegraded":"2026-02-23T13:05:21.633546+0000","last_fullsized":"2026-02-23T13:05:21.633546+0000","mapping_epoch":28,"log_start":"42'55993","ondisk_log_start":"42'55993","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'36827","last_scrub_stamp":"2026-02-23T13:04:41.482975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:41.482975+0000","objects_scrubbed":35883,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:55.333749+0000","scrub_duration":4566,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1082654720,"num_objects":16520,"num_object_clones":0,"num_object_copies":49560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16520,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55996,"num_write_kb":2320512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"42'55272","reported_seq":55646,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.626471+0000","last_change":"2026-02-23T13:04:32.030814+0000","last_active":"2026-02-23T13:05:21.626471+0000","last_peered":"2026-02-23T13:05:21.626471+0000","last_clean":"2026-02-23T13:05:21.626471+0000","last_became_active":"2026-02-23T13:03:08.712246+0000","last_became_peered":"2026-02-23T13:03:08.712246+0000","last_unstale":"2026-02-23T13:05:21.626471+0000","last_undegraded":"2026-02-23T13:05:21.626471+0000","last_fullsized":"2026-02-23T13:05:21.626471+0000","mapping_epoch":28,"log_start":"42'55269","ondisk_log_start":"42'55269","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'33322","last_scrub_stamp":"2026-02-23T13:04:32.030772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:32.030772+0000","objects_scrubbed":32583,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:46.346152+0000","scrub_duration":4282,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1093074968,"num_objects":16680,"num_object_clones":0,"num_object_copies":50040,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16680,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":55272,"num_write_kb":2302401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"42'55735","reported_seq":56093,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.630839+0000","last_change":"2026-02-23T13:04:27.262519+0000","last_active":"2026-02-23T13:05:21.630839+0000","last_peered":"2026-02-23T13:05:21.630839+0000","last_clean":"2026-02-23T13:05:21.630839+0000","last_became_active":"2026-02-23T13:03:08.712348+0000","last_became_peered":"2026-02-23T13:03:08.712348+0000","last_unstale":"2026-02-23T13:05:21.630839+0000","last_undegraded":"2026-02-23T13:05:21.630839+0000","last_fullsized":"2026-02-23T13:05:21.630839+0000","mapping_epoch":28,"log_start":"42'55732","ondisk_log_start":"42'55732","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31725","last_scrub_stamp":"2026-02-23T13:04:27.262379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:27.262379+0000","objects_scrubbed":31138,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:36.061346+0000","scrub_duration":3485,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1082982400,"num_objects":16525,"num_object_clones":0,"num_object_copies":49575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16525,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55735,"num_write_kb":2312320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":221,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:04:22.806251+0000","last_change":"2026-02-23T13:04:08.199097+0000","last_active":"2026-02-23T13:04:22.806251+0000","last_peered":"2026-02-23T13:04:22.806251+0000","last_clean":"2026-02-23T13:04:22.806251+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:04:22.806251+0000","last_undegraded":"2026-02-23T13:04:22.806251+0000","last_fullsized":"2026-02-23T13:04:22.806251+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:04:08.199036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:04:08.199036+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:23.231335+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"42'55295","reported_seq":55610,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.611336+0000","last_change":"2026-02-23T13:04:15.649890+0000","last_active":"2026-02-23T13:05:21.611336+0000","last_peered":"2026-02-23T13:05:21.611336+0000","last_clean":"2026-02-23T13:05:21.611336+0000","last_became_active":"2026-02-23T13:03:08.708695+0000","last_became_peered":"2026-02-23T13:03:08.708695+0000","last_unstale":"2026-02-23T13:05:21.611336+0000","last_undegraded":"2026-02-23T13:05:21.611336+0000","last_fullsized":"2026-02-23T13:05:21.611336+0000","mapping_epoch":28,"log_start":"42'55291","ondisk_log_start":"42'55291","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'27365","last_scrub_stamp":"2026-02-23T13:04:15.649815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:15.649815+0000","objects_scrubbed":26902,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"queued for scrub","scrub_duration":2575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1087438848,"num_objects":16593,"num_object_clones":0,"num_object_copies":49779,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16593,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55295,"num_write_kb":2300416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"42'55549","reported_seq":55918,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.609791+0000","last_change":"2026-02-23T13:04:30.014412+0000","last_active":"2026-02-23T13:05:21.609791+0000","last_peered":"2026-02-23T13:05:21.609791+0000","last_clean":"2026-02-23T13:05:21.609791+0000","last_became_active":"2026-02-23T13:03:08.711847+0000","last_became_peered":"2026-02-23T13:03:08.711847+0000","last_unstale":"2026-02-23T13:05:21.609791+0000","last_undegraded":"2026-02-23T13:05:21.609791+0000","last_fullsized":"2026-02-23T13:05:21.609791+0000","mapping_epoch":28,"log_start":"42'55546","ondisk_log_start":"42'55546","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'32670","last_scrub_stamp":"2026-02-23T13:04:30.014332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:30.014332+0000","objects_scrubbed":32128,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:50.241908+0000","scrub_duration":3026,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1074724864,"num_objects":16399,"num_object_clones":0,"num_object_copies":49197,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16399,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55549,"num_write_kb":2302336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"42'55521","reported_seq":55830,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.632680+0000","last_change":"2026-02-23T13:04:14.687654+0000","last_active":"2026-02-23T13:05:21.632680+0000","last_peered":"2026-02-23T13:05:21.632680+0000","last_clean":"2026-02-23T13:05:21.632680+0000","last_became_active":"2026-02-23T13:03:08.712783+0000","last_became_peered":"2026-02-23T13:03:08.712783+0000","last_unstale":"2026-02-23T13:05:21.632680+0000","last_undegraded":"2026-02-23T13:05:21.632680+0000","last_fullsized":"2026-02-23T13:05:21.632680+0000","mapping_epoch":28,"log_start":"42'55518","ondisk_log_start":"42'55518","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'26930","last_scrub_stamp":"2026-02-23T13:04:14.687533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:14.687533+0000","objects_scrubbed":26390,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:29.989051+0000","scrub_duration":2902,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1093074944,"num_objects":16679,"num_object_clones":0,"num_object_copies":50037,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16679,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55521,"num_write_kb":2310400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"42'55603","reported_seq":55956,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.608953+0000","last_change":"2026-02-23T13:04:25.882548+0000","last_active":"2026-02-23T13:05:21.608953+0000","last_peered":"2026-02-23T13:05:21.608953+0000","last_clean":"2026-02-23T13:05:21.608953+0000","last_became_active":"2026-02-23T13:03:08.708821+0000","last_became_peered":"2026-02-23T13:03:08.708821+0000","last_unstale":"2026-02-23T13:05:21.608953+0000","last_undegraded":"2026-02-23T13:05:21.608953+0000","last_fullsized":"2026-02-23T13:05:21.608953+0000","mapping_epoch":28,"log_start":"42'55600","ondisk_log_start":"42'55600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31120","last_scrub_stamp":"2026-02-23T13:04:25.882487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:25.882487+0000","objects_scrubbed":30639,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:32.453655+0000","scrub_duration":2862,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1071841280,"num_objects":16355,"num_object_clones":0,"num_object_copies":49065,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55603,"num_write_kb":2302656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"42'55325","reported_seq":55725,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.630341+0000","last_change":"2026-02-23T13:04:39.437215+0000","last_active":"2026-02-23T13:05:21.630341+0000","last_peered":"2026-02-23T13:05:21.630341+0000","last_clean":"2026-02-23T13:05:21.630341+0000","last_became_active":"2026-02-23T13:03:08.712152+0000","last_became_peered":"2026-02-23T13:03:08.712152+0000","last_unstale":"2026-02-23T13:05:21.630341+0000","last_undegraded":"2026-02-23T13:05:21.630341+0000","last_fullsized":"2026-02-23T13:05:21.630341+0000","mapping_epoch":28,"log_start":"42'55322","ondisk_log_start":"42'55322","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'35859","last_scrub_stamp":"2026-02-23T13:04:39.437158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:39.437158+0000","objects_scrubbed":35127,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:52.724383+0000","scrub_duration":4536,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1089667072,"num_objects":16627,"num_object_clones":0,"num_object_copies":49881,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16627,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55325,"num_write_kb":2302464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"42'55111","reported_seq":55442,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.607097+0000","last_change":"2026-02-23T13:04:57.975495+0000","last_active":"2026-02-23T13:05:21.607097+0000","last_peered":"2026-02-23T13:05:21.607097+0000","last_clean":"2026-02-23T13:05:21.607097+0000","last_became_active":"2026-02-23T13:03:08.712055+0000","last_became_peered":"2026-02-23T13:03:08.712055+0000","last_unstale":"2026-02-23T13:05:21.607097+0000","last_undegraded":"2026-02-23T13:05:21.607097+0000","last_fullsized":"2026-02-23T13:05:21.607097+0000","mapping_epoch":28,"log_start":"42'55108","ondisk_log_start":"42'55108","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'43718","last_scrub_stamp":"2026-02-23T13:04:57.975448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:57.975448+0000","objects_scrubbed":28325,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:22.148320+0000","scrub_duration":2865,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068302336,"num_objects":16301,"num_object_clones":0,"num_object_copies":48903,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16301,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55111,"num_write_kb":2285184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"42'55560","reported_seq":55913,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.635380+0000","last_change":"2026-02-23T13:04:25.319824+0000","last_active":"2026-02-23T13:05:21.635380+0000","last_peered":"2026-02-23T13:05:21.635380+0000","last_clean":"2026-02-23T13:05:21.635380+0000","last_became_active":"2026-02-23T13:03:08.708852+0000","last_became_peered":"2026-02-23T13:03:08.708852+0000","last_unstale":"2026-02-23T13:05:21.635380+0000","last_undegraded":"2026-02-23T13:05:21.635380+0000","last_fullsized":"2026-02-23T13:05:21.635380+0000","mapping_epoch":28,"log_start":"42'55557","ondisk_log_start":"42'55557","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31026","last_scrub_stamp":"2026-02-23T13:04:25.319785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:25.319785+0000","objects_scrubbed":30498,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:39.230588+0000","scrub_duration":3555,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1077936128,"num_objects":16448,"num_object_clones":0,"num_object_copies":49344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16448,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55560,"num_write_kb":2304256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"42'55792","reported_seq":56146,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.606275+0000","last_change":"2026-02-23T13:04:53.166360+0000","last_active":"2026-02-23T13:05:21.606275+0000","last_peered":"2026-02-23T13:05:21.606275+0000","last_clean":"2026-02-23T13:05:21.606275+0000","last_became_active":"2026-02-23T13:03:08.708457+0000","last_became_peered":"2026-02-23T13:03:08.708457+0000","last_unstale":"2026-02-23T13:05:21.606275+0000","last_undegraded":"2026-02-23T13:05:21.606275+0000","last_fullsized":"2026-02-23T13:05:21.606275+0000","mapping_epoch":28,"log_start":"42'55789","ondisk_log_start":"42'55789","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'42452","last_scrub_stamp":"2026-02-23T13:04:53.166176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:53.166176+0000","objects_scrubbed":30649,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:57.240381+0000","scrub_duration":3244,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1088946176,"num_objects":16616,"num_object_clones":0,"num_object_copies":49848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16616,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55792,"num_write_kb":2317056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"42'55605","reported_seq":56009,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.606852+0000","last_change":"2026-02-23T13:04:43.225441+0000","last_active":"2026-02-23T13:05:21.606852+0000","last_peered":"2026-02-23T13:05:21.606852+0000","last_clean":"2026-02-23T13:05:21.606852+0000","last_became_active":"2026-02-23T13:03:08.712010+0000","last_became_peered":"2026-02-23T13:03:08.712010+0000","last_unstale":"2026-02-23T13:05:21.606852+0000","last_undegraded":"2026-02-23T13:05:21.606852+0000","last_fullsized":"2026-02-23T13:05:21.606852+0000","mapping_epoch":28,"log_start":"42'55602","ondisk_log_start":"42'55602","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'37378","last_scrub_stamp":"2026-02-23T13:04:43.225387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:43.225387+0000","objects_scrubbed":35509,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:53.679895+0000","scrub_duration":3337,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1088618496,"num_objects":16611,"num_object_clones":0,"num_object_copies":49833,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16611,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55605,"num_write_kb":2310912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"42'55184","reported_seq":55525,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.634134+0000","last_change":"2026-02-23T13:04:22.389549+0000","last_active":"2026-02-23T13:05:21.634134+0000","last_peered":"2026-02-23T13:05:21.634134+0000","last_clean":"2026-02-23T13:05:21.634134+0000","last_became_active":"2026-02-23T13:03:08.712763+0000","last_became_peered":"2026-02-23T13:03:08.712763+0000","last_unstale":"2026-02-23T13:05:21.634134+0000","last_undegraded":"2026-02-23T13:05:21.634134+0000","last_fullsized":"2026-02-23T13:05:21.634134+0000","mapping_epoch":28,"log_start":"42'55181","ondisk_log_start":"42'55181","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'29812","last_scrub_stamp":"2026-02-23T13:04:22.389498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:22.389498+0000","objects_scrubbed":29176,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:26.761128+0000","scrub_duration":3534,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1066270720,"num_objects":16270,"num_object_clones":0,"num_object_copies":48810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16270,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55184,"num_write_kb":2286528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"42'55502","reported_seq":55905,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.634720+0000","last_change":"2026-02-23T13:04:40.228341+0000","last_active":"2026-02-23T13:05:21.634720+0000","last_peered":"2026-02-23T13:05:21.634720+0000","last_clean":"2026-02-23T13:05:21.634720+0000","last_became_active":"2026-02-23T13:03:08.709391+0000","last_became_peered":"2026-02-23T13:03:08.709391+0000","last_unstale":"2026-02-23T13:05:21.634720+0000","last_undegraded":"2026-02-23T13:05:21.634720+0000","last_fullsized":"2026-02-23T13:05:21.634720+0000","mapping_epoch":28,"log_start":"42'55499","ondisk_log_start":"42'55499","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'36164","last_scrub_stamp":"2026-02-23T13:04:40.228295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:40.228295+0000","objects_scrubbed":35482,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:48.119450+0000","scrub_duration":4344,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1082916864,"num_objects":16524,"num_object_clones":0,"num_object_copies":49572,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55502,"num_write_kb":2304832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"42'55215","reported_seq":55555,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-23T13:05:21.608912+0000","last_change":"2026-02-23T13:04:55.969591+0000","last_active":"2026-02-23T13:05:21.608912+0000","last_peered":"2026-02-23T13:05:21.608912+0000","last_clean":"2026-02-23T13:05:21.608912+0000","last_became_active":"2026-02-23T13:03:08.711303+0000","last_became_peered":"2026-02-23T13:03:08.711303+0000","last_unstale":"2026-02-23T13:05:21.608912+0000","last_undegraded":"2026-02-23T13:05:21.608912+0000","last_fullsized":"2026-02-23T13:05:21.608912+0000","mapping_epoch":28,"log_start":"42'55212","ondisk_log_start":"42'55212","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'42977","last_scrub_stamp":"2026-02-23T13:04:55.969549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:55.969549+0000","objects_scrubbed":29308,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:10.033838+0000","scrub_duration":2936,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1078001664,"num_objects":16449,"num_object_clones":0,"num_object_copies":49347,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55215,"num_write_kb":2293248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":17316184088,"num_objects":264225,"num_object_clones":0,"num_object_copies":792675,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":264225,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":887697,"num_write_kb":36861441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51963703296,"data_stored":51963691080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247839,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":15540912,"kb_used_data":15013788,"kb_used_omap":4,"kb_used_meta":527099,"kb_avail":718462288,"statfs":{"total":751619276800,"available":735705382912,"internally_reserved":0,"allocated":15374118912,"data_stored":15373844787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5101,"internal_metadata":539749395},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444066,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":12003692,"kb_used_data":11853400,"kb_used_omap":4,"kb_used_meta":150267,"kb_avail":721999508,"statfs":{"total":751619276800,"available":739327496192,"internally_reserved":0,"allocated":12137881600,"data_stored":12137611547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4447,"internal_metadata":153874081},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":13255084,"kb_used_data":12984344,"kb_used_omap":4,"kb_used_meta":270651,"kb_avail":720748116,"statfs":{"total":751619276800,"available":738046070784,"internally_reserved":0,"allocated":13295968256,"data_stored":13295697683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4446,"internal_metadata":277147298},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705701,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":12438192,"kb_used_data":11699164,"kb_used_omap":4,"kb_used_meta":739003,"kb_avail":721565008,"statfs":{"total":751619276800,"available":738882568192,"internally_reserved":0,"allocated":11979943936,"data_stored":11979669811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4450,"internal_metadata":756739742},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11916283904,"data_stored":11916279832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12986880000,"data_stored":12986875928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11912282112,"data_stored":11912282112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15148257280,"data_stored":15148253208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:05:26.143 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_0 pgp_num 56 2026-02-23T13:05:26.175 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:26.173+0000 7fab17d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:26.175 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:26.173+0000 7fab17d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:26.190 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:05:26.190 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:05:26.203 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:05:26.203 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:05:26.215 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:05:26.215 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:05:26.227 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:05:26.227 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:05:26.311 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:26.338 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:05:26 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:05:26] "GET /metrics HTTP/1.1" 200 4226 "" "Prometheus/3.6.0" 2026-02-23T13:05:26.526 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:26.477+0000 7f3cf4687640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:26.527 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:26.477+0000 7f3cf4687640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:26.561 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:05:26 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:05:26.087Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:05:26.614 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-23T13:05:26.969 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:26 trial046 ceph-mon[38575]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:05:26.969 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:26 trial046 ceph-mon[38575]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:05:26.969 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:26 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/322941192' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:05:26.969 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:26 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/299366302' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_0", "var": "pgp_num", "val": "56"} : dispatch 2026-02-23T13:05:27.236 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:05:28.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:27 trial046 ceph-mon[38575]: from='client.14572 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:05:28.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:27 trial046 ceph-mon[38575]: pgmap v95: 17 pgs: 17 active+clean; 16 GiB data, 47 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 553 op/s 2026-02-23T13:05:28.268 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:05:28.407 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:28.878 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:28 trial046 ceph-mon[38575]: 2.3 scrub starts 2026-02-23T13:05:28.912 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:28.875+0000 7faeea4f9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:28.912 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:28.875+0000 7faeea4f9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:28.912 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:05:28.912 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:05:28.913 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:05:28.913 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:05:28.919 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:05:28.919 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:05:28.932 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:05:28.932 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:05:30.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:29 trial046 ceph-mon[38575]: pgmap v96: 17 pgs: 17 active+clean; 13 GiB data, 43 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 7.32k op/s 2026-02-23T13:05:30.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:29 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1718004702' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:05:30.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:29 trial046 ceph-mon[38575]: 1.0 scrub starts 2026-02-23T13:05:30.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:29 trial046 ceph-mon[38575]: 1.0 scrub ok 2026-02-23T13:05:31.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:30 trial046 ceph-mon[38575]: 2.3 scrub ok 2026-02-23T13:05:31.482 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:05:31.617 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:31.741 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:31.739+0000 7fbc4515e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:31.741 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:31.739+0000 7fbc4515e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:31.755 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:05:31.755 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:05:31.768 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:05:31.768 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:05:31.768 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:31 trial046 ceph-mon[38575]: pgmap v97: 17 pgs: 17 active+clean; 13 GiB data, 43 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 5.55k op/s 2026-02-23T13:05:31.768 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:31 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:05:31.769 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:31 trial046 ceph-mon[38575]: 2.9 scrub starts 2026-02-23T13:05:31.782 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:05:31.782 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:05:31.797 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:05:31.797 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:05:32.237 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:05:32.237 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:05:32.238 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_0 2026-02-23T13:05:32.238 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:05:32.374 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:32.499 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:32.497+0000 7fb6cc50c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:32.499 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:32.497+0000 7fb6cc50c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:32.635 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:05:32.636 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:05:32.676 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2026-02-23T13:05:32.610058+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":12047745592,"num_objects":183828,"num_object_clones":0,"num_object_copies":551484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183828,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":968231,"num_write_kb":36863591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":37440056,"kb_used_data":35906536,"kb_used_omap":28,"kb_used_meta":1533283,"kb_avail":2898572744,"statfs":{"total":3006477107200,"available":2968138489856,"internally_reserved":0,"allocated":36768292864,"data_stored":36767077924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29061,"internal_metadata":1570082427},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5269028864,"num_objects":-80399,"num_object_clones":0,"num_object_copies":-241197,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-80399,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80399,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.905530"},"pg_stats":[{"pgid":"2.f","version":"46'60441","reported_seq":60805,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:31.601228+0000","last_change":"2026-02-23T13:04:26.095439+0000","last_active":"2026-02-23T13:05:31.601228+0000","last_peered":"2026-02-23T13:05:31.601228+0000","last_clean":"2026-02-23T13:05:31.601228+0000","last_became_active":"2026-02-23T13:03:08.711408+0000","last_became_peered":"2026-02-23T13:03:08.711408+0000","last_unstale":"2026-02-23T13:05:31.601228+0000","last_undegraded":"2026-02-23T13:05:31.601228+0000","last_fullsized":"2026-02-23T13:05:31.601228+0000","mapping_epoch":28,"log_start":"46'60438","ondisk_log_start":"46'60438","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31256","last_scrub_stamp":"2026-02-23T13:04:26.095384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:26.095384+0000","objects_scrubbed":30901,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:37.117824+0000","scrub_duration":2252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":761462784,"num_objects":11619,"num_object_clones":0,"num_object_copies":34857,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11619,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60441,"num_write_kb":2305920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"46'61105","reported_seq":61519,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:31.635170+0000","last_change":"2026-02-23T13:04:41.483173+0000","last_active":"2026-02-23T13:05:31.635170+0000","last_peered":"2026-02-23T13:05:31.635170+0000","last_clean":"2026-02-23T13:05:31.635170+0000","last_became_active":"2026-02-23T13:03:08.711462+0000","last_became_peered":"2026-02-23T13:03:08.711462+0000","last_unstale":"2026-02-23T13:05:31.635170+0000","last_undegraded":"2026-02-23T13:05:31.635170+0000","last_fullsized":"2026-02-23T13:05:31.635170+0000","mapping_epoch":28,"log_start":"46'61102","ondisk_log_start":"46'61102","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'36827","last_scrub_stamp":"2026-02-23T13:04:41.482975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:41.482975+0000","objects_scrubbed":35883,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:55.333749+0000","scrub_duration":4566,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":747831296,"num_objects":11411,"num_object_clones":0,"num_object_copies":34233,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11411,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61105,"num_write_kb":2320512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"46'60463","reported_seq":60844,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:31.641665+0000","last_change":"2026-02-23T13:04:32.030814+0000","last_active":"2026-02-23T13:05:31.641665+0000","last_peered":"2026-02-23T13:05:31.641665+0000","last_clean":"2026-02-23T13:05:31.641665+0000","last_became_active":"2026-02-23T13:03:08.712246+0000","last_became_peered":"2026-02-23T13:03:08.712246+0000","last_unstale":"2026-02-23T13:05:31.641665+0000","last_undegraded":"2026-02-23T13:05:31.641665+0000","last_fullsized":"2026-02-23T13:05:31.641665+0000","mapping_epoch":28,"log_start":"46'60460","ondisk_log_start":"46'60460","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'33322","last_scrub_stamp":"2026-02-23T13:04:32.030772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:32.030772+0000","objects_scrubbed":32583,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:46.346152+0000","scrub_duration":4282,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":752877592,"num_objects":11489,"num_object_clones":0,"num_object_copies":34467,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11489,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":60463,"num_write_kb":2302401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"46'60707","reported_seq":61073,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:31.640727+0000","last_change":"2026-02-23T13:04:27.262519+0000","last_active":"2026-02-23T13:05:31.640727+0000","last_peered":"2026-02-23T13:05:31.640727+0000","last_clean":"2026-02-23T13:05:31.640727+0000","last_became_active":"2026-02-23T13:03:08.712348+0000","last_became_peered":"2026-02-23T13:03:08.712348+0000","last_unstale":"2026-02-23T13:05:31.640727+0000","last_undegraded":"2026-02-23T13:05:31.640727+0000","last_fullsized":"2026-02-23T13:05:31.640727+0000","mapping_epoch":28,"log_start":"46'60704","ondisk_log_start":"46'60704","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31725","last_scrub_stamp":"2026-02-23T13:04:27.262379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:27.262379+0000","objects_scrubbed":31138,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:36.061346+0000","scrub_duration":3485,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":757137408,"num_objects":11553,"num_object_clones":0,"num_object_copies":34659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11553,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60707,"num_write_kb":2312320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":237,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:29.192008+0000","last_change":"2026-02-23T13:05:29.192008+0000","last_active":"2026-02-23T13:05:29.192008+0000","last_peered":"2026-02-23T13:05:29.192008+0000","last_clean":"2026-02-23T13:05:29.192008+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:05:29.192008+0000","last_undegraded":"2026-02-23T13:05:29.192008+0000","last_fullsized":"2026-02-23T13:05:29.192008+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:05:29.191972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:05:29.191972+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:50.435825+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"46'60470","reported_seq":60931,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:31.601861+0000","last_change":"2026-02-23T13:05:29.505689+0000","last_active":"2026-02-23T13:05:31.601861+0000","last_peered":"2026-02-23T13:05:31.601861+0000","last_clean":"2026-02-23T13:05:31.601861+0000","last_became_active":"2026-02-23T13:03:08.708695+0000","last_became_peered":"2026-02-23T13:03:08.708695+0000","last_unstale":"2026-02-23T13:05:31.601861+0000","last_undegraded":"2026-02-23T13:05:31.601861+0000","last_fullsized":"2026-02-23T13:05:31.601861+0000","mapping_epoch":28,"log_start":"46'60467","ondisk_log_start":"46'60467","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'59353","last_scrub_stamp":"2026-02-23T13:05:29.505604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:05:29.505604+0000","objects_scrubbed":12769,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:38.841173+0000","scrub_duration":1353,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":748290048,"num_objects":11418,"num_object_clones":0,"num_object_copies":34254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11418,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60470,"num_write_kb":2300416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"46'60563","reported_seq":60939,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:31.612947+0000","last_change":"2026-02-23T13:04:30.014412+0000","last_active":"2026-02-23T13:05:31.612947+0000","last_peered":"2026-02-23T13:05:31.612947+0000","last_clean":"2026-02-23T13:05:31.612947+0000","last_became_active":"2026-02-23T13:03:08.711847+0000","last_became_peered":"2026-02-23T13:03:08.711847+0000","last_unstale":"2026-02-23T13:05:31.612947+0000","last_undegraded":"2026-02-23T13:05:31.612947+0000","last_fullsized":"2026-02-23T13:05:31.612947+0000","mapping_epoch":28,"log_start":"46'60560","ondisk_log_start":"46'60560","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'32670","last_scrub_stamp":"2026-02-23T13:04:30.014332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:30.014332+0000","objects_scrubbed":32128,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:50.241908+0000","scrub_duration":3026,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":746127360,"num_objects":11385,"num_object_clones":0,"num_object_copies":34155,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11385,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60563,"num_write_kb":2302336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"46'60496","reported_seq":60815,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:31.640883+0000","last_change":"2026-02-23T13:04:14.687654+0000","last_active":"2026-02-23T13:05:31.640883+0000","last_peered":"2026-02-23T13:05:31.640883+0000","last_clean":"2026-02-23T13:05:31.640883+0000","last_became_active":"2026-02-23T13:03:08.712783+0000","last_became_peered":"2026-02-23T13:03:08.712783+0000","last_unstale":"2026-02-23T13:05:31.640883+0000","last_undegraded":"2026-02-23T13:05:31.640883+0000","last_fullsized":"2026-02-23T13:05:31.640883+0000","mapping_epoch":28,"log_start":"46'60493","ondisk_log_start":"46'60493","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'26930","last_scrub_stamp":"2026-02-23T13:04:14.687533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:14.687533+0000","objects_scrubbed":26390,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"queued for scrub","scrub_duration":2902,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":767033344,"num_objects":11704,"num_object_clones":0,"num_object_copies":35112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11704,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60496,"num_write_kb":2310400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"46'60522","reported_seq":60882,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:31.612936+0000","last_change":"2026-02-23T13:04:25.882548+0000","last_active":"2026-02-23T13:05:31.612936+0000","last_peered":"2026-02-23T13:05:31.612936+0000","last_clean":"2026-02-23T13:05:31.612936+0000","last_became_active":"2026-02-23T13:03:08.708821+0000","last_became_peered":"2026-02-23T13:03:08.708821+0000","last_unstale":"2026-02-23T13:05:31.612936+0000","last_undegraded":"2026-02-23T13:05:31.612936+0000","last_fullsized":"2026-02-23T13:05:31.612936+0000","mapping_epoch":28,"log_start":"46'60518","ondisk_log_start":"46'60518","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31120","last_scrub_stamp":"2026-02-23T13:04:25.882487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:25.882487+0000","objects_scrubbed":30639,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:32.453655+0000","scrub_duration":2862,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":749469696,"num_objects":11436,"num_object_clones":0,"num_object_copies":34308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11436,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60522,"num_write_kb":2302656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"46'60319","reported_seq":60726,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:31.641812+0000","last_change":"2026-02-23T13:04:39.437215+0000","last_active":"2026-02-23T13:05:31.641812+0000","last_peered":"2026-02-23T13:05:31.641812+0000","last_clean":"2026-02-23T13:05:31.641812+0000","last_became_active":"2026-02-23T13:03:08.712152+0000","last_became_peered":"2026-02-23T13:03:08.712152+0000","last_unstale":"2026-02-23T13:05:31.641812+0000","last_undegraded":"2026-02-23T13:05:31.641812+0000","last_fullsized":"2026-02-23T13:05:31.641812+0000","mapping_epoch":28,"log_start":"46'60316","ondisk_log_start":"46'60316","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'35859","last_scrub_stamp":"2026-02-23T13:04:39.437158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:39.437158+0000","objects_scrubbed":35127,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:52.724383+0000","scrub_duration":4536,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":762380288,"num_objects":11633,"num_object_clones":0,"num_object_copies":34899,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11633,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60319,"num_write_kb":2302464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"46'60070","reported_seq":60409,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:31.610576+0000","last_change":"2026-02-23T13:04:57.975495+0000","last_active":"2026-02-23T13:05:31.610576+0000","last_peered":"2026-02-23T13:05:31.610576+0000","last_clean":"2026-02-23T13:05:31.610576+0000","last_became_active":"2026-02-23T13:03:08.712055+0000","last_became_peered":"2026-02-23T13:03:08.712055+0000","last_unstale":"2026-02-23T13:05:31.610576+0000","last_undegraded":"2026-02-23T13:05:31.610576+0000","last_fullsized":"2026-02-23T13:05:31.610576+0000","mapping_epoch":28,"log_start":"46'60067","ondisk_log_start":"46'60067","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'43718","last_scrub_stamp":"2026-02-23T13:04:57.975448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:57.975448+0000","objects_scrubbed":28325,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:22.148320+0000","scrub_duration":2865,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":743309312,"num_objects":11342,"num_object_clones":0,"num_object_copies":34026,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11342,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60070,"num_write_kb":2285184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"46'60609","reported_seq":60971,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:31.638774+0000","last_change":"2026-02-23T13:04:25.319824+0000","last_active":"2026-02-23T13:05:31.638774+0000","last_peered":"2026-02-23T13:05:31.638774+0000","last_clean":"2026-02-23T13:05:31.638774+0000","last_became_active":"2026-02-23T13:03:08.708852+0000","last_became_peered":"2026-02-23T13:03:08.708852+0000","last_unstale":"2026-02-23T13:05:31.638774+0000","last_undegraded":"2026-02-23T13:05:31.638774+0000","last_fullsized":"2026-02-23T13:05:31.638774+0000","mapping_epoch":28,"log_start":"46'60606","ondisk_log_start":"46'60606","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31026","last_scrub_stamp":"2026-02-23T13:04:25.319785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:25.319785+0000","objects_scrubbed":30498,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:39.230588+0000","scrub_duration":3555,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":747044864,"num_objects":11399,"num_object_clones":0,"num_object_copies":34197,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11399,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60609,"num_write_kb":2304256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"46'60776","reported_seq":61139,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:31.608652+0000","last_change":"2026-02-23T13:04:53.166360+0000","last_active":"2026-02-23T13:05:31.608652+0000","last_peered":"2026-02-23T13:05:31.608652+0000","last_clean":"2026-02-23T13:05:31.608652+0000","last_became_active":"2026-02-23T13:03:08.708457+0000","last_became_peered":"2026-02-23T13:03:08.708457+0000","last_unstale":"2026-02-23T13:05:31.608652+0000","last_undegraded":"2026-02-23T13:05:31.608652+0000","last_fullsized":"2026-02-23T13:05:31.608652+0000","mapping_epoch":28,"log_start":"46'60773","ondisk_log_start":"46'60773","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'42452","last_scrub_stamp":"2026-02-23T13:04:53.166176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:53.166176+0000","objects_scrubbed":30649,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:57.240381+0000","scrub_duration":3244,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":762314752,"num_objects":11632,"num_object_clones":0,"num_object_copies":34896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11632,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60776,"num_write_kb":2317056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"46'60692","reported_seq":61104,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:31.610996+0000","last_change":"2026-02-23T13:04:43.225441+0000","last_active":"2026-02-23T13:05:31.610996+0000","last_peered":"2026-02-23T13:05:31.610996+0000","last_clean":"2026-02-23T13:05:31.610996+0000","last_became_active":"2026-02-23T13:03:08.712010+0000","last_became_peered":"2026-02-23T13:03:08.712010+0000","last_unstale":"2026-02-23T13:05:31.610996+0000","last_undegraded":"2026-02-23T13:05:31.610996+0000","last_fullsized":"2026-02-23T13:05:31.610996+0000","mapping_epoch":28,"log_start":"46'60689","ondisk_log_start":"46'60689","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'37378","last_scrub_stamp":"2026-02-23T13:04:43.225387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:43.225387+0000","objects_scrubbed":35509,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:53.679895+0000","scrub_duration":3337,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":755236864,"num_objects":11524,"num_object_clones":0,"num_object_copies":34572,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60692,"num_write_kb":2310912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"46'60141","reported_seq":60571,"reported_epoch":46,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:05:31.634077+0000","last_change":"2026-02-23T13:05:30.868608+0000","last_active":"2026-02-23T13:05:31.634077+0000","last_peered":"2026-02-23T13:05:31.634077+0000","last_clean":"2026-02-23T13:05:31.634077+0000","last_became_active":"2026-02-23T13:03:08.712763+0000","last_became_peered":"2026-02-23T13:03:08.712763+0000","last_unstale":"2026-02-23T13:05:31.634077+0000","last_undegraded":"2026-02-23T13:05:31.634077+0000","last_fullsized":"2026-02-23T13:05:31.634077+0000","mapping_epoch":28,"log_start":"46'60138","ondisk_log_start":"46'60138","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'29812","last_scrub_stamp":"2026-02-23T13:04:22.389498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:22.389498+0000","objects_scrubbed":7849,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"scrubbing for 1s","scrub_duration":3534,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":741408768,"num_objects":11313,"num_object_clones":0,"num_object_copies":33939,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11313,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60141,"num_write_kb":2286528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"46'60471","reported_seq":60882,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:31.633856+0000","last_change":"2026-02-23T13:04:40.228341+0000","last_active":"2026-02-23T13:05:31.633856+0000","last_peered":"2026-02-23T13:05:31.633856+0000","last_clean":"2026-02-23T13:05:31.633856+0000","last_became_active":"2026-02-23T13:03:08.709391+0000","last_became_peered":"2026-02-23T13:03:08.709391+0000","last_unstale":"2026-02-23T13:05:31.633856+0000","last_undegraded":"2026-02-23T13:05:31.633856+0000","last_fullsized":"2026-02-23T13:05:31.633856+0000","mapping_epoch":28,"log_start":"46'60468","ondisk_log_start":"46'60468","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'36164","last_scrub_stamp":"2026-02-23T13:04:40.228295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:40.228295+0000","objects_scrubbed":35482,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:48.119450+0000","scrub_duration":4344,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":757268480,"num_objects":11555,"num_object_clones":0,"num_object_copies":34665,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11555,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60471,"num_write_kb":2304832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"46'60251","reported_seq":60600,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:31.611102+0000","last_change":"2026-02-23T13:04:55.969591+0000","last_active":"2026-02-23T13:05:31.611102+0000","last_peered":"2026-02-23T13:05:31.611102+0000","last_clean":"2026-02-23T13:05:31.611102+0000","last_became_active":"2026-02-23T13:03:08.711303+0000","last_became_peered":"2026-02-23T13:03:08.711303+0000","last_unstale":"2026-02-23T13:05:31.611102+0000","last_undegraded":"2026-02-23T13:05:31.611102+0000","last_fullsized":"2026-02-23T13:05:31.611102+0000","mapping_epoch":28,"log_start":"46'60248","ondisk_log_start":"46'60248","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'42977","last_scrub_stamp":"2026-02-23T13:04:55.969549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:55.969549+0000","objects_scrubbed":29308,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:10.033838+0000","scrub_duration":2936,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":747962368,"num_objects":11413,"num_object_clones":0,"num_object_copies":34239,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11413,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60251,"num_write_kb":2293248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":12047155224,"num_objects":183826,"num_object_clones":0,"num_object_copies":551478,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183826,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":968096,"num_write_kb":36861441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36156026880,"data_stored":36156014664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":186,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1676,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247841,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":11109536,"kb_used_data":10456076,"kb_used_omap":7,"kb_used_meta":653432,"kb_avail":722893664,"statfs":{"total":751619276800,"available":740243111936,"internally_reserved":0,"allocated":10707021824,"data_stored":10706716183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7894,"internal_metadata":669114666},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444068,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":8518620,"kb_used_data":8259976,"kb_used_omap":6,"kb_used_meta":258553,"kb_avail":725484580,"statfs":{"total":751619276800,"available":742896209920,"internally_reserved":0,"allocated":8458215424,"data_stored":8457913855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7055,"internal_metadata":264758385},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":9469980,"kb_used_data":9090952,"kb_used_omap":6,"kb_used_meta":378937,"kb_avail":724533220,"statfs":{"total":751619276800,"available":741922017280,"internally_reserved":0,"allocated":9309134848,"data_stored":9308832759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7054,"internal_metadata":388031602},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":8341920,"kb_used_data":8099532,"kb_used_omap":6,"kb_used_meta":242361,"kb_avail":725661280,"statfs":{"total":751619276800,"available":743077150720,"internally_reserved":0,"allocated":8293920768,"data_stored":8293615127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7058,"internal_metadata":248177774},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1676,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8291422208,"data_stored":8291418136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9035124736,"data_stored":9035120664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8288337920,"data_stored":8288337920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10541142016,"data_stored":10541137944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93,"internal_metadata":0}]}} 2026-02-23T13:05:32.678 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_0 pgp_num 56 2026-02-23T13:05:32.816 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:32.888 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:32 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2045039946' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:05:32.888 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:32 trial046 ceph-mon[38575]: 2.1 scrub starts 2026-02-23T13:05:32.888 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:32 trial046 ceph-mon[38575]: 2.9 scrub ok 2026-02-23T13:05:32.938 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:32.936+0000 7f779f93c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:32.938 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:32.936+0000 7f779f93c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:33.075 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-23T13:05:33.114 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:05:33.839 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:05:33.980 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:34.005 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:33 trial046 ceph-mon[38575]: pgmap v98: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 11 GiB data, 36 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 9.03k op/s 2026-02-23T13:05:34.005 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:33 trial046 ceph-mon[38575]: from='client.14582 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:05:34.006 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:33 trial046 ceph-mon[38575]: 2.1 scrub ok 2026-02-23T13:05:34.006 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:33 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2449910415' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_0", "var": "pgp_num", "val": "56"} : dispatch 2026-02-23T13:05:34.006 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:33 trial046 ceph-mon[38575]: 2.2 scrub starts 2026-02-23T13:05:34.102 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:34.100+0000 7faa0f60e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:34.102 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:34.101+0000 7faa0f60e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:34.116 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:05:34.116 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:05:34.128 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:05:34.128 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:05:34.140 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:05:34.140 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:05:34.154 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:05:34.154 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:05:35.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:34 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3177377616' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:05:36.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:35 trial046 ceph-mon[38575]: 2.2 scrub ok 2026-02-23T13:05:36.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:35 trial046 ceph-mon[38575]: pgmap v99: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 11 GiB data, 36 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 8.04k op/s 2026-02-23T13:05:36.539 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:05:36 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:05:36] "GET /metrics HTTP/1.1" 200 4210 "" "Prometheus/3.6.0" 2026-02-23T13:05:36.561 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:05:36 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:05:36.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:05:36.702 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:05:36.834 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:36.948 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:36.946+0000 7fe30089c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:36.948 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:36.946+0000 7fe30089c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:36.964 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:05:36.964 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:05:36.979 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:05:36.979 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:05:36.992 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:05:36.992 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:05:37.005 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:05:37.006 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:05:38.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:37 trial046 ceph-mon[38575]: pgmap v100: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 11 GiB data, 33 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 6.95k op/s 2026-02-23T13:05:38.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:37 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/262024333' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:05:38.116 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:05:38.116 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:05:38.116 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_0 2026-02-23T13:05:38.117 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:05:38.251 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:38.370 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:38.368+0000 7fe009a3e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:38.371 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:38.368+0000 7fe009a3e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:38.510 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:05:38.511 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:05:38.552 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2026-02-23T13:05:36.610587+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":11892884024,"num_objects":181465,"num_object_clones":0,"num_object_copies":544395,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181465,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":970594,"num_write_kb":36863591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":34276216,"kb_used_data":32652520,"kb_used_omap":28,"kb_used_meta":1623523,"kb_avail":2901736584,"statfs":{"total":3006477107200,"available":2971378262016,"internally_reserved":0,"allocated":33436180480,"data_stored":33434965540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29061,"internal_metadata":1662488187},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5423890432,"num_objects":-82762,"num_object_clones":0,"num_object_copies":-248286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-82762,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82762,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.903438"},"pg_stats":[{"pgid":"2.f","version":"46'62804","reported_seq":63168,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:36.595278+0000","last_change":"2026-02-23T13:04:26.095439+0000","last_active":"2026-02-23T13:05:36.595278+0000","last_peered":"2026-02-23T13:05:36.595278+0000","last_clean":"2026-02-23T13:05:36.595278+0000","last_became_active":"2026-02-23T13:03:08.711408+0000","last_became_peered":"2026-02-23T13:03:08.711408+0000","last_unstale":"2026-02-23T13:05:36.595278+0000","last_undegraded":"2026-02-23T13:05:36.595278+0000","last_fullsized":"2026-02-23T13:05:36.595278+0000","mapping_epoch":28,"log_start":"46'62801","ondisk_log_start":"46'62801","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31256","last_scrub_stamp":"2026-02-23T13:04:26.095384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:26.095384+0000","objects_scrubbed":30901,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:37.117824+0000","scrub_duration":2252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606601216,"num_objects":9256,"num_object_clones":0,"num_object_copies":27768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9256,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62804,"num_write_kb":2305920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"46'61105","reported_seq":61519,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:31.635170+0000","last_change":"2026-02-23T13:04:41.483173+0000","last_active":"2026-02-23T13:05:31.635170+0000","last_peered":"2026-02-23T13:05:31.635170+0000","last_clean":"2026-02-23T13:05:31.635170+0000","last_became_active":"2026-02-23T13:03:08.711462+0000","last_became_peered":"2026-02-23T13:03:08.711462+0000","last_unstale":"2026-02-23T13:05:31.635170+0000","last_undegraded":"2026-02-23T13:05:31.635170+0000","last_fullsized":"2026-02-23T13:05:31.635170+0000","mapping_epoch":28,"log_start":"46'61102","ondisk_log_start":"46'61102","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'36827","last_scrub_stamp":"2026-02-23T13:04:41.482975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:41.482975+0000","objects_scrubbed":35883,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:55.333749+0000","scrub_duration":4566,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":747831296,"num_objects":11411,"num_object_clones":0,"num_object_copies":34233,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11411,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61105,"num_write_kb":2320512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"46'60463","reported_seq":60844,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:31.641665+0000","last_change":"2026-02-23T13:04:32.030814+0000","last_active":"2026-02-23T13:05:31.641665+0000","last_peered":"2026-02-23T13:05:31.641665+0000","last_clean":"2026-02-23T13:05:31.641665+0000","last_became_active":"2026-02-23T13:03:08.712246+0000","last_became_peered":"2026-02-23T13:03:08.712246+0000","last_unstale":"2026-02-23T13:05:31.641665+0000","last_undegraded":"2026-02-23T13:05:31.641665+0000","last_fullsized":"2026-02-23T13:05:31.641665+0000","mapping_epoch":28,"log_start":"46'60460","ondisk_log_start":"46'60460","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'33322","last_scrub_stamp":"2026-02-23T13:04:32.030772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:32.030772+0000","objects_scrubbed":32583,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:46.346152+0000","scrub_duration":4282,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":752877592,"num_objects":11489,"num_object_clones":0,"num_object_copies":34467,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11489,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":60463,"num_write_kb":2302401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"46'60707","reported_seq":61073,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:31.640727+0000","last_change":"2026-02-23T13:04:27.262519+0000","last_active":"2026-02-23T13:05:31.640727+0000","last_peered":"2026-02-23T13:05:31.640727+0000","last_clean":"2026-02-23T13:05:31.640727+0000","last_became_active":"2026-02-23T13:03:08.712348+0000","last_became_peered":"2026-02-23T13:03:08.712348+0000","last_unstale":"2026-02-23T13:05:31.640727+0000","last_undegraded":"2026-02-23T13:05:31.640727+0000","last_fullsized":"2026-02-23T13:05:31.640727+0000","mapping_epoch":28,"log_start":"46'60704","ondisk_log_start":"46'60704","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31725","last_scrub_stamp":"2026-02-23T13:04:27.262379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:27.262379+0000","objects_scrubbed":31138,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:36.061346+0000","scrub_duration":3485,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":757137408,"num_objects":11553,"num_object_clones":0,"num_object_copies":34659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11553,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60707,"num_write_kb":2312320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":237,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:29.192008+0000","last_change":"2026-02-23T13:05:29.192008+0000","last_active":"2026-02-23T13:05:29.192008+0000","last_peered":"2026-02-23T13:05:29.192008+0000","last_clean":"2026-02-23T13:05:29.192008+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:05:29.192008+0000","last_undegraded":"2026-02-23T13:05:29.192008+0000","last_fullsized":"2026-02-23T13:05:29.192008+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:05:29.191972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:05:29.191972+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:50.435825+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"46'60470","reported_seq":60931,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:31.601861+0000","last_change":"2026-02-23T13:05:29.505689+0000","last_active":"2026-02-23T13:05:31.601861+0000","last_peered":"2026-02-23T13:05:31.601861+0000","last_clean":"2026-02-23T13:05:31.601861+0000","last_became_active":"2026-02-23T13:03:08.708695+0000","last_became_peered":"2026-02-23T13:03:08.708695+0000","last_unstale":"2026-02-23T13:05:31.601861+0000","last_undegraded":"2026-02-23T13:05:31.601861+0000","last_fullsized":"2026-02-23T13:05:31.601861+0000","mapping_epoch":28,"log_start":"46'60467","ondisk_log_start":"46'60467","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'59353","last_scrub_stamp":"2026-02-23T13:05:29.505604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:05:29.505604+0000","objects_scrubbed":12769,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:38.841173+0000","scrub_duration":1353,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":748290048,"num_objects":11418,"num_object_clones":0,"num_object_copies":34254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11418,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60470,"num_write_kb":2300416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"46'60563","reported_seq":60939,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:31.612947+0000","last_change":"2026-02-23T13:04:30.014412+0000","last_active":"2026-02-23T13:05:31.612947+0000","last_peered":"2026-02-23T13:05:31.612947+0000","last_clean":"2026-02-23T13:05:31.612947+0000","last_became_active":"2026-02-23T13:03:08.711847+0000","last_became_peered":"2026-02-23T13:03:08.711847+0000","last_unstale":"2026-02-23T13:05:31.612947+0000","last_undegraded":"2026-02-23T13:05:31.612947+0000","last_fullsized":"2026-02-23T13:05:31.612947+0000","mapping_epoch":28,"log_start":"46'60560","ondisk_log_start":"46'60560","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'32670","last_scrub_stamp":"2026-02-23T13:04:30.014332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:30.014332+0000","objects_scrubbed":32128,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:50.241908+0000","scrub_duration":3026,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":746127360,"num_objects":11385,"num_object_clones":0,"num_object_copies":34155,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11385,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60563,"num_write_kb":2302336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"46'60496","reported_seq":60815,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:31.640883+0000","last_change":"2026-02-23T13:04:14.687654+0000","last_active":"2026-02-23T13:05:31.640883+0000","last_peered":"2026-02-23T13:05:31.640883+0000","last_clean":"2026-02-23T13:05:31.640883+0000","last_became_active":"2026-02-23T13:03:08.712783+0000","last_became_peered":"2026-02-23T13:03:08.712783+0000","last_unstale":"2026-02-23T13:05:31.640883+0000","last_undegraded":"2026-02-23T13:05:31.640883+0000","last_fullsized":"2026-02-23T13:05:31.640883+0000","mapping_epoch":28,"log_start":"46'60493","ondisk_log_start":"46'60493","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'26930","last_scrub_stamp":"2026-02-23T13:04:14.687533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:14.687533+0000","objects_scrubbed":26390,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"queued for scrub","scrub_duration":2902,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":767033344,"num_objects":11704,"num_object_clones":0,"num_object_copies":35112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11704,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60496,"num_write_kb":2310400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"46'60522","reported_seq":60882,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:31.612936+0000","last_change":"2026-02-23T13:04:25.882548+0000","last_active":"2026-02-23T13:05:31.612936+0000","last_peered":"2026-02-23T13:05:31.612936+0000","last_clean":"2026-02-23T13:05:31.612936+0000","last_became_active":"2026-02-23T13:03:08.708821+0000","last_became_peered":"2026-02-23T13:03:08.708821+0000","last_unstale":"2026-02-23T13:05:31.612936+0000","last_undegraded":"2026-02-23T13:05:31.612936+0000","last_fullsized":"2026-02-23T13:05:31.612936+0000","mapping_epoch":28,"log_start":"46'60518","ondisk_log_start":"46'60518","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31120","last_scrub_stamp":"2026-02-23T13:04:25.882487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:25.882487+0000","objects_scrubbed":30639,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:32.453655+0000","scrub_duration":2862,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":749469696,"num_objects":11436,"num_object_clones":0,"num_object_copies":34308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11436,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60522,"num_write_kb":2302656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"46'60319","reported_seq":60726,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:31.641812+0000","last_change":"2026-02-23T13:04:39.437215+0000","last_active":"2026-02-23T13:05:31.641812+0000","last_peered":"2026-02-23T13:05:31.641812+0000","last_clean":"2026-02-23T13:05:31.641812+0000","last_became_active":"2026-02-23T13:03:08.712152+0000","last_became_peered":"2026-02-23T13:03:08.712152+0000","last_unstale":"2026-02-23T13:05:31.641812+0000","last_undegraded":"2026-02-23T13:05:31.641812+0000","last_fullsized":"2026-02-23T13:05:31.641812+0000","mapping_epoch":28,"log_start":"46'60316","ondisk_log_start":"46'60316","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'35859","last_scrub_stamp":"2026-02-23T13:04:39.437158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:39.437158+0000","objects_scrubbed":35127,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:52.724383+0000","scrub_duration":4536,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":762380288,"num_objects":11633,"num_object_clones":0,"num_object_copies":34899,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11633,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60319,"num_write_kb":2302464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"46'60070","reported_seq":60409,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:31.610576+0000","last_change":"2026-02-23T13:04:57.975495+0000","last_active":"2026-02-23T13:05:31.610576+0000","last_peered":"2026-02-23T13:05:31.610576+0000","last_clean":"2026-02-23T13:05:31.610576+0000","last_became_active":"2026-02-23T13:03:08.712055+0000","last_became_peered":"2026-02-23T13:03:08.712055+0000","last_unstale":"2026-02-23T13:05:31.610576+0000","last_undegraded":"2026-02-23T13:05:31.610576+0000","last_fullsized":"2026-02-23T13:05:31.610576+0000","mapping_epoch":28,"log_start":"46'60067","ondisk_log_start":"46'60067","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'43718","last_scrub_stamp":"2026-02-23T13:04:57.975448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:57.975448+0000","objects_scrubbed":28325,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:22.148320+0000","scrub_duration":2865,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":743309312,"num_objects":11342,"num_object_clones":0,"num_object_copies":34026,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11342,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60070,"num_write_kb":2285184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"46'60609","reported_seq":60971,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:31.638774+0000","last_change":"2026-02-23T13:04:25.319824+0000","last_active":"2026-02-23T13:05:31.638774+0000","last_peered":"2026-02-23T13:05:31.638774+0000","last_clean":"2026-02-23T13:05:31.638774+0000","last_became_active":"2026-02-23T13:03:08.708852+0000","last_became_peered":"2026-02-23T13:03:08.708852+0000","last_unstale":"2026-02-23T13:05:31.638774+0000","last_undegraded":"2026-02-23T13:05:31.638774+0000","last_fullsized":"2026-02-23T13:05:31.638774+0000","mapping_epoch":28,"log_start":"46'60606","ondisk_log_start":"46'60606","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31026","last_scrub_stamp":"2026-02-23T13:04:25.319785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:25.319785+0000","objects_scrubbed":30498,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:39.230588+0000","scrub_duration":3555,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":747044864,"num_objects":11399,"num_object_clones":0,"num_object_copies":34197,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11399,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60609,"num_write_kb":2304256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"46'60776","reported_seq":61139,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:31.608652+0000","last_change":"2026-02-23T13:04:53.166360+0000","last_active":"2026-02-23T13:05:31.608652+0000","last_peered":"2026-02-23T13:05:31.608652+0000","last_clean":"2026-02-23T13:05:31.608652+0000","last_became_active":"2026-02-23T13:03:08.708457+0000","last_became_peered":"2026-02-23T13:03:08.708457+0000","last_unstale":"2026-02-23T13:05:31.608652+0000","last_undegraded":"2026-02-23T13:05:31.608652+0000","last_fullsized":"2026-02-23T13:05:31.608652+0000","mapping_epoch":28,"log_start":"46'60773","ondisk_log_start":"46'60773","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'42452","last_scrub_stamp":"2026-02-23T13:04:53.166176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:53.166176+0000","objects_scrubbed":30649,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:57.240381+0000","scrub_duration":3244,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":762314752,"num_objects":11632,"num_object_clones":0,"num_object_copies":34896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11632,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60776,"num_write_kb":2317056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"46'60692","reported_seq":61104,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:31.610996+0000","last_change":"2026-02-23T13:04:43.225441+0000","last_active":"2026-02-23T13:05:31.610996+0000","last_peered":"2026-02-23T13:05:31.610996+0000","last_clean":"2026-02-23T13:05:31.610996+0000","last_became_active":"2026-02-23T13:03:08.712010+0000","last_became_peered":"2026-02-23T13:03:08.712010+0000","last_unstale":"2026-02-23T13:05:31.610996+0000","last_undegraded":"2026-02-23T13:05:31.610996+0000","last_fullsized":"2026-02-23T13:05:31.610996+0000","mapping_epoch":28,"log_start":"46'60689","ondisk_log_start":"46'60689","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'37378","last_scrub_stamp":"2026-02-23T13:04:43.225387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:43.225387+0000","objects_scrubbed":35509,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:53.679895+0000","scrub_duration":3337,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":755236864,"num_objects":11524,"num_object_clones":0,"num_object_copies":34572,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60692,"num_write_kb":2310912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"46'60141","reported_seq":60571,"reported_epoch":46,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:05:31.634077+0000","last_change":"2026-02-23T13:05:30.868608+0000","last_active":"2026-02-23T13:05:31.634077+0000","last_peered":"2026-02-23T13:05:31.634077+0000","last_clean":"2026-02-23T13:05:31.634077+0000","last_became_active":"2026-02-23T13:03:08.712763+0000","last_became_peered":"2026-02-23T13:03:08.712763+0000","last_unstale":"2026-02-23T13:05:31.634077+0000","last_undegraded":"2026-02-23T13:05:31.634077+0000","last_fullsized":"2026-02-23T13:05:31.634077+0000","mapping_epoch":28,"log_start":"46'60138","ondisk_log_start":"46'60138","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'29812","last_scrub_stamp":"2026-02-23T13:04:22.389498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:22.389498+0000","objects_scrubbed":7849,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"scrubbing for 1s","scrub_duration":3534,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":741408768,"num_objects":11313,"num_object_clones":0,"num_object_copies":33939,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11313,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60141,"num_write_kb":2286528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"46'60471","reported_seq":60882,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:31.633856+0000","last_change":"2026-02-23T13:04:40.228341+0000","last_active":"2026-02-23T13:05:31.633856+0000","last_peered":"2026-02-23T13:05:31.633856+0000","last_clean":"2026-02-23T13:05:31.633856+0000","last_became_active":"2026-02-23T13:03:08.709391+0000","last_became_peered":"2026-02-23T13:03:08.709391+0000","last_unstale":"2026-02-23T13:05:31.633856+0000","last_undegraded":"2026-02-23T13:05:31.633856+0000","last_fullsized":"2026-02-23T13:05:31.633856+0000","mapping_epoch":28,"log_start":"46'60468","ondisk_log_start":"46'60468","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'36164","last_scrub_stamp":"2026-02-23T13:04:40.228295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:40.228295+0000","objects_scrubbed":35482,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:48.119450+0000","scrub_duration":4344,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":757268480,"num_objects":11555,"num_object_clones":0,"num_object_copies":34665,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11555,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60471,"num_write_kb":2304832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"46'60251","reported_seq":60600,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:31.611102+0000","last_change":"2026-02-23T13:04:55.969591+0000","last_active":"2026-02-23T13:05:31.611102+0000","last_peered":"2026-02-23T13:05:31.611102+0000","last_clean":"2026-02-23T13:05:31.611102+0000","last_became_active":"2026-02-23T13:03:08.711303+0000","last_became_peered":"2026-02-23T13:03:08.711303+0000","last_unstale":"2026-02-23T13:05:31.611102+0000","last_undegraded":"2026-02-23T13:05:31.611102+0000","last_fullsized":"2026-02-23T13:05:31.611102+0000","mapping_epoch":28,"log_start":"46'60248","ondisk_log_start":"46'60248","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'42977","last_scrub_stamp":"2026-02-23T13:04:55.969549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:55.969549+0000","objects_scrubbed":29308,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:10.033838+0000","scrub_duration":2936,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":747962368,"num_objects":11413,"num_object_clones":0,"num_object_copies":34239,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11413,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60251,"num_write_kb":2293248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":11892293656,"num_objects":181463,"num_object_clones":0,"num_object_copies":544389,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181463,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":970459,"num_write_kb":36861441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32827977728,"data_stored":32827965512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":186,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1676,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247841,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":11109536,"kb_used_data":10456076,"kb_used_omap":7,"kb_used_meta":653432,"kb_avail":722893664,"statfs":{"total":751619276800,"available":740243111936,"internally_reserved":0,"allocated":10707021824,"data_stored":10706716183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7894,"internal_metadata":669114666},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444069,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6918492,"kb_used_data":6623816,"kb_used_omap":6,"kb_used_meta":294649,"kb_avail":727084708,"statfs":{"total":751619276800,"available":744534740992,"internally_reserved":0,"allocated":6782787584,"data_stored":6782486015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7055,"internal_metadata":301720689},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":9469980,"kb_used_data":9090952,"kb_used_omap":6,"kb_used_meta":378937,"kb_avail":724533220,"statfs":{"total":751619276800,"available":741922017280,"internally_reserved":0,"allocated":9309134848,"data_stored":9308832759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7054,"internal_metadata":388031602},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6778208,"kb_used_data":6481676,"kb_used_omap":6,"kb_used_meta":296505,"kb_avail":727224992,"statfs":{"total":751619276800,"available":744678391808,"internally_reserved":0,"allocated":6637236224,"data_stored":6636930583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7058,"internal_metadata":303621230},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1676,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6629429248,"data_stored":6629425176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9035124736,"data_stored":9035120664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6622281728,"data_stored":6622281728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10541142016,"data_stored":10541137944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93,"internal_metadata":0}]}} 2026-02-23T13:05:38.554 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:05:38.555 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_0 pg_num 66 2026-02-23T13:05:38.683 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:38.802 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:38.799+0000 7ff42e95f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:38.802 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:38.799+0000 7ff42e95f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:38.939 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:05:38.979 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:05:39.045 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:05:39.185 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:39.296 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:39.293+0000 7f5486abf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:39.296 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:39.293+0000 7f5486abf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:39.309 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:05:39.309 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:05:39.326 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:05:39.326 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:05:39.340 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:05:39.341 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:05:39.353 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:05:39.353 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:05:40.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:39 trial046 ceph-mon[38575]: 2.f scrub starts 2026-02-23T13:05:40.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:39 trial046 ceph-mon[38575]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:05:40.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:39 trial046 ceph-mon[38575]: pgmap v101: 17 pgs: 17 active+clean; 9.0 GiB data, 29 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 9.55k op/s 2026-02-23T13:05:40.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:39 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2514439523' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_0", "var": "pg_num", "val": "66"} : dispatch 2026-02-23T13:05:40.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:39 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/260199326' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:05:41.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:40 trial046 ceph-mon[38575]: 2.f scrub ok 2026-02-23T13:05:41.394 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:05:41.536 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:41.657 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:41.655+0000 7f41dce91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:41.657 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:41.655+0000 7f41dce91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:41.671 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:05:41.671 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:05:41.684 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:05:41.684 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:05:41.697 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:05:41.698 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:05:41.709 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:05:41.710 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:05:42.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:41 trial046 ceph-mon[38575]: pgmap v102: 17 pgs: 17 active+clean; 9.0 GiB data, 29 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 6.12k op/s 2026-02-23T13:05:42.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:41 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2821573094' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:05:43.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:42 trial046 ceph-mon[38575]: 2.c scrub starts 2026-02-23T13:05:43.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:42 trial046 ceph-mon[38575]: 2.c scrub ok 2026-02-23T13:05:43.754 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:05:43.894 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:43.980 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:05:43.981 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:05:43.981 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:05:43.981 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:05:44.006 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:43 trial046 ceph-mon[38575]: pgmap v103: 17 pgs: 17 active+clean; 6.6 GiB data, 22 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 9.38k op/s 2026-02-23T13:05:44.009 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:44.008+0000 7fd58ed0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:44.009 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:44.008+0000 7fd58ed0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:44.022 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:05:44.023 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:05:44.037 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:05:44.037 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:05:44.049 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:05:44.049 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:05:44.061 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:05:44.061 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:05:44.128 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:44.254 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:44.253+0000 7ff4c577f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:44.255 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:44.253+0000 7ff4c577f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:44.395 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:05:44.395 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:05:44.441 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2026-02-23T13:05:42.611287+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7056589368,"num_objects":107669,"num_object_clones":0,"num_object_copies":323007,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107669,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":1044390,"num_write_kb":36863591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":23292600,"kb_used_data":21362024,"kb_used_omap":28,"kb_used_meta":1930339,"kb_avail":2912720200,"statfs":{"total":3006477107200,"available":2982625484800,"internally_reserved":0,"allocated":21874712576,"data_stored":21873497636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29431,"internal_metadata":1976667401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7381843968,"num_objects":-112638,"num_object_clones":0,"num_object_copies":-337914,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-112638,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112638,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001466"},"pg_stats":[{"pgid":"2.f","version":"46'65319","reported_seq":65775,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:41.600092+0000","last_change":"2026-02-23T13:05:38.792380+0000","last_active":"2026-02-23T13:05:41.600092+0000","last_peered":"2026-02-23T13:05:41.600092+0000","last_clean":"2026-02-23T13:05:41.600092+0000","last_became_active":"2026-02-23T13:03:08.711408+0000","last_became_peered":"2026-02-23T13:03:08.711408+0000","last_unstale":"2026-02-23T13:05:41.600092+0000","last_undegraded":"2026-02-23T13:05:41.600092+0000","last_fullsized":"2026-02-23T13:05:41.600092+0000","mapping_epoch":28,"log_start":"46'65316","ondisk_log_start":"46'65316","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'63839","last_scrub_stamp":"2026-02-23T13:05:38.792313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:05:38.792313+0000","objects_scrubbed":8378,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:59.973428+0000","scrub_duration":608,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441778176,"num_objects":6741,"num_object_clones":0,"num_object_copies":20223,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6741,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65319,"num_write_kb":2305920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"46'65800","reported_seq":66214,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:41.637950+0000","last_change":"2026-02-23T13:04:41.483173+0000","last_active":"2026-02-23T13:05:41.637950+0000","last_peered":"2026-02-23T13:05:41.637950+0000","last_clean":"2026-02-23T13:05:41.637950+0000","last_became_active":"2026-02-23T13:03:08.711462+0000","last_became_peered":"2026-02-23T13:03:08.711462+0000","last_unstale":"2026-02-23T13:05:41.637950+0000","last_undegraded":"2026-02-23T13:05:41.637950+0000","last_fullsized":"2026-02-23T13:05:41.637950+0000","mapping_epoch":28,"log_start":"46'65797","ondisk_log_start":"46'65797","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'36827","last_scrub_stamp":"2026-02-23T13:04:41.482975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:41.482975+0000","objects_scrubbed":35883,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:55.333749+0000","scrub_duration":4566,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440139776,"num_objects":6716,"num_object_clones":0,"num_object_copies":20148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6716,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65800,"num_write_kb":2320512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"46'65165","reported_seq":65547,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:41.643328+0000","last_change":"2026-02-23T13:04:32.030814+0000","last_active":"2026-02-23T13:05:41.643328+0000","last_peered":"2026-02-23T13:05:41.643328+0000","last_clean":"2026-02-23T13:05:41.643328+0000","last_became_active":"2026-02-23T13:03:08.712246+0000","last_became_peered":"2026-02-23T13:03:08.712246+0000","last_unstale":"2026-02-23T13:05:41.643328+0000","last_undegraded":"2026-02-23T13:05:41.643328+0000","last_fullsized":"2026-02-23T13:05:41.643328+0000","mapping_epoch":28,"log_start":"46'65162","ondisk_log_start":"46'65162","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'33322","last_scrub_stamp":"2026-02-23T13:04:32.030772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:32.030772+0000","objects_scrubbed":32583,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:46.346152+0000","scrub_duration":4282,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444727320,"num_objects":6787,"num_object_clones":0,"num_object_copies":20361,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6787,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":65165,"num_write_kb":2302401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"46'65531","reported_seq":65897,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:41.642219+0000","last_change":"2026-02-23T13:04:27.262519+0000","last_active":"2026-02-23T13:05:41.642219+0000","last_peered":"2026-02-23T13:05:41.642219+0000","last_clean":"2026-02-23T13:05:41.642219+0000","last_became_active":"2026-02-23T13:03:08.712348+0000","last_became_peered":"2026-02-23T13:03:08.712348+0000","last_unstale":"2026-02-23T13:05:41.642219+0000","last_undegraded":"2026-02-23T13:05:41.642219+0000","last_fullsized":"2026-02-23T13:05:41.642219+0000","mapping_epoch":28,"log_start":"46'65528","ondisk_log_start":"46'65528","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31725","last_scrub_stamp":"2026-02-23T13:04:27.262379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:27.262379+0000","objects_scrubbed":31138,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"queued for scrub","scrub_duration":3485,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440991744,"num_objects":6729,"num_object_clones":0,"num_object_copies":20187,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6729,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65531,"num_write_kb":2312320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":237,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:29.192008+0000","last_change":"2026-02-23T13:05:29.192008+0000","last_active":"2026-02-23T13:05:29.192008+0000","last_peered":"2026-02-23T13:05:29.192008+0000","last_clean":"2026-02-23T13:05:29.192008+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:05:29.192008+0000","last_undegraded":"2026-02-23T13:05:29.192008+0000","last_fullsized":"2026-02-23T13:05:29.192008+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:05:29.191972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:05:29.191972+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:50.435825+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"46'65187","reported_seq":65648,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:41.612732+0000","last_change":"2026-02-23T13:05:29.505689+0000","last_active":"2026-02-23T13:05:41.612732+0000","last_peered":"2026-02-23T13:05:41.612732+0000","last_clean":"2026-02-23T13:05:41.612732+0000","last_became_active":"2026-02-23T13:03:08.708695+0000","last_became_peered":"2026-02-23T13:03:08.708695+0000","last_unstale":"2026-02-23T13:05:41.612732+0000","last_undegraded":"2026-02-23T13:05:41.612732+0000","last_fullsized":"2026-02-23T13:05:41.612732+0000","mapping_epoch":28,"log_start":"46'65184","ondisk_log_start":"46'65184","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'59353","last_scrub_stamp":"2026-02-23T13:05:29.505604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:05:29.505604+0000","objects_scrubbed":12769,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:38.841173+0000","scrub_duration":1353,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":439156736,"num_objects":6701,"num_object_clones":0,"num_object_copies":20103,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6701,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65187,"num_write_kb":2300416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"46'65278","reported_seq":65654,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:41.609537+0000","last_change":"2026-02-23T13:04:30.014412+0000","last_active":"2026-02-23T13:05:41.609537+0000","last_peered":"2026-02-23T13:05:41.609537+0000","last_clean":"2026-02-23T13:05:41.609537+0000","last_became_active":"2026-02-23T13:03:08.711847+0000","last_became_peered":"2026-02-23T13:03:08.711847+0000","last_unstale":"2026-02-23T13:05:41.609537+0000","last_undegraded":"2026-02-23T13:05:41.609537+0000","last_fullsized":"2026-02-23T13:05:41.609537+0000","mapping_epoch":28,"log_start":"46'65275","ondisk_log_start":"46'65275","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'32670","last_scrub_stamp":"2026-02-23T13:04:30.014332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:30.014332+0000","objects_scrubbed":32128,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:50.241908+0000","scrub_duration":3026,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":437125120,"num_objects":6670,"num_object_clones":0,"num_object_copies":20010,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6670,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65278,"num_write_kb":2302336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"46'65373","reported_seq":65813,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:41.643137+0000","last_change":"2026-02-23T13:05:32.941612+0000","last_active":"2026-02-23T13:05:41.643137+0000","last_peered":"2026-02-23T13:05:41.643137+0000","last_clean":"2026-02-23T13:05:41.643137+0000","last_became_active":"2026-02-23T13:03:08.712783+0000","last_became_peered":"2026-02-23T13:03:08.712783+0000","last_unstale":"2026-02-23T13:05:41.643137+0000","last_undegraded":"2026-02-23T13:05:41.643137+0000","last_fullsized":"2026-02-23T13:05:41.643137+0000","mapping_epoch":28,"log_start":"46'65370","ondisk_log_start":"46'65370","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'61091","last_scrub_stamp":"2026-02-23T13:05:32.941555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:05:32.941555+0000","objects_scrubbed":11358,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:55.728330+0000","scrub_duration":1097,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":447414272,"num_objects":6827,"num_object_clones":0,"num_object_copies":20481,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6827,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65373,"num_write_kb":2310400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"46'65205","reported_seq":65679,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:41.607334+0000","last_change":"2026-02-23T13:05:34.382428+0000","last_active":"2026-02-23T13:05:41.607334+0000","last_peered":"2026-02-23T13:05:41.607334+0000","last_clean":"2026-02-23T13:05:41.607334+0000","last_became_active":"2026-02-23T13:03:08.708821+0000","last_became_peered":"2026-02-23T13:03:08.708821+0000","last_unstale":"2026-02-23T13:05:41.607334+0000","last_undegraded":"2026-02-23T13:05:41.607334+0000","last_fullsized":"2026-02-23T13:05:41.607334+0000","mapping_epoch":28,"log_start":"46'65202","ondisk_log_start":"46'65202","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'61767","last_scrub_stamp":"2026-02-23T13:05:34.382391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:05:34.382391+0000","objects_scrubbed":10404,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:03.977565+0000","scrub_duration":1187,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442564608,"num_objects":6753,"num_object_clones":0,"num_object_copies":20259,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6753,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65205,"num_write_kb":2302656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"46'65128","reported_seq":65535,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:41.641692+0000","last_change":"2026-02-23T13:04:39.437215+0000","last_active":"2026-02-23T13:05:41.641692+0000","last_peered":"2026-02-23T13:05:41.641692+0000","last_clean":"2026-02-23T13:05:41.641692+0000","last_became_active":"2026-02-23T13:03:08.712152+0000","last_became_peered":"2026-02-23T13:03:08.712152+0000","last_unstale":"2026-02-23T13:05:41.641692+0000","last_undegraded":"2026-02-23T13:05:41.641692+0000","last_fullsized":"2026-02-23T13:05:41.641692+0000","mapping_epoch":28,"log_start":"46'65125","ondisk_log_start":"46'65125","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'35859","last_scrub_stamp":"2026-02-23T13:04:39.437158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:39.437158+0000","objects_scrubbed":35127,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:52.724383+0000","scrub_duration":4536,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":447217664,"num_objects":6824,"num_object_clones":0,"num_object_copies":20472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6824,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65128,"num_write_kb":2302464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"46'64754","reported_seq":65093,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:41.613383+0000","last_change":"2026-02-23T13:04:57.975495+0000","last_active":"2026-02-23T13:05:41.613383+0000","last_peered":"2026-02-23T13:05:41.613383+0000","last_clean":"2026-02-23T13:05:41.613383+0000","last_became_active":"2026-02-23T13:03:08.712055+0000","last_became_peered":"2026-02-23T13:03:08.712055+0000","last_unstale":"2026-02-23T13:05:41.613383+0000","last_undegraded":"2026-02-23T13:05:41.613383+0000","last_fullsized":"2026-02-23T13:05:41.613383+0000","mapping_epoch":28,"log_start":"46'64751","ondisk_log_start":"46'64751","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'43718","last_scrub_stamp":"2026-02-23T13:04:57.975448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:57.975448+0000","objects_scrubbed":28325,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:22.148320+0000","scrub_duration":2865,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436338688,"num_objects":6658,"num_object_clones":0,"num_object_copies":19974,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6658,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64754,"num_write_kb":2285184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"46'65363","reported_seq":65725,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:41.641764+0000","last_change":"2026-02-23T13:04:25.319824+0000","last_active":"2026-02-23T13:05:41.641764+0000","last_peered":"2026-02-23T13:05:41.641764+0000","last_clean":"2026-02-23T13:05:41.641764+0000","last_became_active":"2026-02-23T13:03:08.708852+0000","last_became_peered":"2026-02-23T13:03:08.708852+0000","last_unstale":"2026-02-23T13:05:41.641764+0000","last_undegraded":"2026-02-23T13:05:41.641764+0000","last_fullsized":"2026-02-23T13:05:41.641764+0000","mapping_epoch":28,"log_start":"46'65360","ondisk_log_start":"46'65360","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31026","last_scrub_stamp":"2026-02-23T13:04:25.319785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:25.319785+0000","objects_scrubbed":30498,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"queued for scrub","scrub_duration":3555,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435486720,"num_objects":6645,"num_object_clones":0,"num_object_copies":19935,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6645,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65363,"num_write_kb":2304256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"46'65628","reported_seq":65991,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:41.609743+0000","last_change":"2026-02-23T13:04:53.166360+0000","last_active":"2026-02-23T13:05:41.609743+0000","last_peered":"2026-02-23T13:05:41.609743+0000","last_clean":"2026-02-23T13:05:41.609743+0000","last_became_active":"2026-02-23T13:03:08.708457+0000","last_became_peered":"2026-02-23T13:03:08.708457+0000","last_unstale":"2026-02-23T13:05:41.609743+0000","last_undegraded":"2026-02-23T13:05:41.609743+0000","last_fullsized":"2026-02-23T13:05:41.609743+0000","mapping_epoch":28,"log_start":"46'65625","ondisk_log_start":"46'65625","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'42452","last_scrub_stamp":"2026-02-23T13:04:53.166176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:53.166176+0000","objects_scrubbed":30649,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:57.240381+0000","scrub_duration":3244,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444334080,"num_objects":6780,"num_object_clones":0,"num_object_copies":20340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6780,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65628,"num_write_kb":2317056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"46'65404","reported_seq":65815,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:41.614263+0000","last_change":"2026-02-23T13:04:43.225441+0000","last_active":"2026-02-23T13:05:41.614263+0000","last_peered":"2026-02-23T13:05:41.614263+0000","last_clean":"2026-02-23T13:05:41.614263+0000","last_became_active":"2026-02-23T13:03:08.712010+0000","last_became_peered":"2026-02-23T13:03:08.712010+0000","last_unstale":"2026-02-23T13:05:41.614263+0000","last_undegraded":"2026-02-23T13:05:41.614263+0000","last_fullsized":"2026-02-23T13:05:41.614263+0000","mapping_epoch":28,"log_start":"46'65400","ondisk_log_start":"46'65400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'37378","last_scrub_stamp":"2026-02-23T13:04:43.225387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:43.225387+0000","objects_scrubbed":35509,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:53.679895+0000","scrub_duration":3337,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":446431232,"num_objects":6812,"num_object_clones":0,"num_object_copies":20436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6812,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65404,"num_write_kb":2310912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"46'64861","reported_seq":65333,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:41.643270+0000","last_change":"2026-02-23T13:05:31.985252+0000","last_active":"2026-02-23T13:05:41.643270+0000","last_peered":"2026-02-23T13:05:41.643270+0000","last_clean":"2026-02-23T13:05:41.643270+0000","last_became_active":"2026-02-23T13:03:08.712763+0000","last_became_peered":"2026-02-23T13:03:08.712763+0000","last_unstale":"2026-02-23T13:05:41.643270+0000","last_undegraded":"2026-02-23T13:05:41.643270+0000","last_fullsized":"2026-02-23T13:05:41.643270+0000","mapping_epoch":28,"log_start":"46'64858","ondisk_log_start":"46'64858","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'60290","last_scrub_stamp":"2026-02-23T13:05:31.985202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:05:31.985202+0000","objects_scrubbed":11395,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:57.484989+0000","scrub_duration":1116,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432078848,"num_objects":6593,"num_object_clones":0,"num_object_copies":19779,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6593,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64861,"num_write_kb":2286528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"46'65274","reported_seq":65685,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:41.643948+0000","last_change":"2026-02-23T13:04:40.228341+0000","last_active":"2026-02-23T13:05:41.643948+0000","last_peered":"2026-02-23T13:05:41.643948+0000","last_clean":"2026-02-23T13:05:41.643948+0000","last_became_active":"2026-02-23T13:03:08.709391+0000","last_became_peered":"2026-02-23T13:03:08.709391+0000","last_unstale":"2026-02-23T13:05:41.643948+0000","last_undegraded":"2026-02-23T13:05:41.643948+0000","last_fullsized":"2026-02-23T13:05:41.643948+0000","mapping_epoch":28,"log_start":"46'65271","ondisk_log_start":"46'65271","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'36164","last_scrub_stamp":"2026-02-23T13:04:40.228295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:40.228295+0000","objects_scrubbed":35482,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:48.119450+0000","scrub_duration":4344,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442499072,"num_objects":6752,"num_object_clones":0,"num_object_copies":20256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6752,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65274,"num_write_kb":2304832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"46'64985","reported_seq":65334,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:41.605690+0000","last_change":"2026-02-23T13:04:55.969591+0000","last_active":"2026-02-23T13:05:41.605690+0000","last_peered":"2026-02-23T13:05:41.605690+0000","last_clean":"2026-02-23T13:05:41.605690+0000","last_became_active":"2026-02-23T13:03:08.711303+0000","last_became_peered":"2026-02-23T13:03:08.711303+0000","last_unstale":"2026-02-23T13:05:41.605690+0000","last_undegraded":"2026-02-23T13:05:41.605690+0000","last_fullsized":"2026-02-23T13:05:41.605690+0000","mapping_epoch":28,"log_start":"46'64982","ondisk_log_start":"46'64982","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'42977","last_scrub_stamp":"2026-02-23T13:04:55.969549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:55.969549+0000","objects_scrubbed":29308,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:10.033838+0000","scrub_duration":2936,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":437714944,"num_objects":6679,"num_object_clones":0,"num_object_copies":20037,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6679,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64985,"num_write_kb":2293248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":7055999000,"num_objects":107667,"num_object_clones":0,"num_object_copies":323001,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107667,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1044255,"num_write_kb":36861441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":21185572864,"data_stored":21185560648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1311,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1252,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247843,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6934624,"kb_used_data":6172812,"kb_used_omap":7,"kb_used_meta":761720,"kb_avail":727068576,"statfs":{"total":751619276800,"available":744518221824,"internally_reserved":0,"allocated":6320959488,"data_stored":6320653847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7985,"internal_metadata":780001487},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444070,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5253404,"kb_used_data":4904584,"kb_used_omap":6,"kb_used_meta":348793,"kb_avail":728749796,"statfs":{"total":751619276800,"available":746239791104,"internally_reserved":0,"allocated":5022294016,"data_stored":5021992447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7148,"internal_metadata":357164052},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5974300,"kb_used_data":5505096,"kb_used_omap":7,"kb_used_meta":469176,"kb_avail":728028900,"statfs":{"total":751619276800,"available":745501593600,"internally_reserved":0,"allocated":5637218304,"data_stored":5636916215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7240,"internal_metadata":480437176},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705705,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5130272,"kb_used_data":4779532,"kb_used_omap":6,"kb_used_meta":350649,"kb_avail":728872928,"statfs":{"total":751619276800,"available":746365878272,"internally_reserved":0,"allocated":4894240768,"data_stored":4893935127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7058,"internal_metadata":359064686},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1252,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4861988864,"data_stored":4861984792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5288628224,"data_stored":5288624152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":186,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4860280832,"data_stored":4860280832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6174674944,"data_stored":6174670872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1032,"internal_metadata":0}]}} 2026-02-23T13:05:44.443 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:05:44.443 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 51 2026-02-23T13:05:44.615 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:44.735 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:44.734+0000 7f3835b28640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:44.736 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:44.734+0000 7f3835b28640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:44.864 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:05:44.900 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:05:44.920 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:44 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3431540768' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:05:46.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:45 trial046 ceph-mon[38575]: from='client.14600 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:05:46.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:45 trial046 ceph-mon[38575]: pgmap v104: 17 pgs: 17 active+clean; 6.6 GiB data, 22 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 6.34k op/s 2026-02-23T13:05:46.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:45 trial046 ceph-mon[38575]: 2.6 scrub starts 2026-02-23T13:05:46.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:45 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4067429510' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "51"} : dispatch 2026-02-23T13:05:46.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:45 trial046 ceph-mon[38575]: 2.6 scrub ok 2026-02-23T13:05:46.104 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:05:46.242 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:46.357 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:05:46 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:05:46] "GET /metrics HTTP/1.1" 200 4226 "" "Prometheus/3.6.0" 2026-02-23T13:05:46.362 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:46.360+0000 7f99f8a76640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:46.362 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:46.361+0000 7f99f8a76640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:46.377 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:05:46.378 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:05:46.389 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:05:46.390 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:05:46.401 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:05:46.402 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:05:46.415 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:05:46.415 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:05:46.469 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:05:46 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:05:46.085Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:05:47.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:46 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:05:47.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:46 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/704807850' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:05:48.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:47 trial046 ceph-mon[38575]: pgmap v105: 17 pgs: 17 active+clean; 6.4 GiB data, 19 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 6.54k op/s 2026-02-23T13:05:48.457 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:05:48.600 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:48.721 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:48.720+0000 7f4fd01f8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:48.721 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:48.720+0000 7f4fd01f8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:48.735 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:05:48.735 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:05:48.748 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:05:48.748 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:05:48.760 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:05:48.760 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:05:48.774 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:05:48.774 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:05:49.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:48 trial046 ceph-mon[38575]: 2.d scrub starts 2026-02-23T13:05:49.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:48 trial046 ceph-mon[38575]: 2.d scrub ok 2026-02-23T13:05:49.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:48 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2115465792' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:05:49.901 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:05:49.902 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:05:49.902 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_0 2026-02-23T13:05:49.902 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:05:50.038 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:50.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:49 trial046 ceph-mon[38575]: pgmap v106: 17 pgs: 17 active+clean; 4.2 GiB data, 15 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 9.35k op/s 2026-02-23T13:05:50.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:49 trial046 ceph-mon[38575]: 2.a scrub starts 2026-02-23T13:05:50.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:49 trial046 ceph-mon[38575]: 2.a scrub ok 2026-02-23T13:05:50.154 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:50.152+0000 7fd9ab8c9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:50.154 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:50.153+0000 7fd9ab8c9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:50.289 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:05:50.289 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:05:50.332 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":106,"stamp":"2026-02-23T13:05:48.612060+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4535878200,"num_objects":69206,"num_object_clones":0,"num_object_copies":207618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69206,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":1082853,"num_write_kb":36863591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":16147192,"kb_used_data":14018152,"kb_used_omap":28,"kb_used_meta":2128867,"kb_avail":2919865608,"statfs":{"total":3006477107200,"available":2989942382592,"internally_reserved":0,"allocated":14354587648,"data_stored":14353372708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29611,"internal_metadata":2179959893},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7357005824,"num_objects":-112259,"num_object_clones":0,"num_object_copies":-336777,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-112259,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112259,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001472"},"pg_stats":[{"pgid":"2.f","version":"46'67715","reported_seq":68171,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:46.600627+0000","last_change":"2026-02-23T13:05:38.792380+0000","last_active":"2026-02-23T13:05:46.600627+0000","last_peered":"2026-02-23T13:05:46.600627+0000","last_clean":"2026-02-23T13:05:46.600627+0000","last_became_active":"2026-02-23T13:03:08.711408+0000","last_became_peered":"2026-02-23T13:03:08.711408+0000","last_unstale":"2026-02-23T13:05:46.600627+0000","last_undegraded":"2026-02-23T13:05:46.600627+0000","last_fullsized":"2026-02-23T13:05:46.600627+0000","mapping_epoch":28,"log_start":"46'67712","ondisk_log_start":"46'67712","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'63839","last_scrub_stamp":"2026-02-23T13:05:38.792313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:05:38.792313+0000","objects_scrubbed":8378,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:59.973428+0000","scrub_duration":608,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284753920,"num_objects":4345,"num_object_clones":0,"num_object_copies":13035,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4345,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67715,"num_write_kb":2305920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"46'68240","reported_seq":68654,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:46.643095+0000","last_change":"2026-02-23T13:04:41.483173+0000","last_active":"2026-02-23T13:05:46.643095+0000","last_peered":"2026-02-23T13:05:46.643095+0000","last_clean":"2026-02-23T13:05:46.643095+0000","last_became_active":"2026-02-23T13:03:08.711462+0000","last_became_peered":"2026-02-23T13:03:08.711462+0000","last_unstale":"2026-02-23T13:05:46.643095+0000","last_undegraded":"2026-02-23T13:05:46.643095+0000","last_fullsized":"2026-02-23T13:05:46.643095+0000","mapping_epoch":28,"log_start":"46'68237","ondisk_log_start":"46'68237","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'36827","last_scrub_stamp":"2026-02-23T13:04:41.482975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:41.482975+0000","objects_scrubbed":35883,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:55.333749+0000","scrub_duration":4566,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":280231936,"num_objects":4276,"num_object_clones":0,"num_object_copies":12828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4276,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68240,"num_write_kb":2320512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"46'67672","reported_seq":68054,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:46.639318+0000","last_change":"2026-02-23T13:04:32.030814+0000","last_active":"2026-02-23T13:05:46.639318+0000","last_peered":"2026-02-23T13:05:46.639318+0000","last_clean":"2026-02-23T13:05:46.639318+0000","last_became_active":"2026-02-23T13:03:08.712246+0000","last_became_peered":"2026-02-23T13:03:08.712246+0000","last_unstale":"2026-02-23T13:05:46.639318+0000","last_undegraded":"2026-02-23T13:05:46.639318+0000","last_fullsized":"2026-02-23T13:05:46.639318+0000","mapping_epoch":28,"log_start":"46'67669","ondisk_log_start":"46'67669","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'33322","last_scrub_stamp":"2026-02-23T13:04:32.030772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:32.030772+0000","objects_scrubbed":32583,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"queued for scrub","scrub_duration":4282,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":280428568,"num_objects":4280,"num_object_clones":0,"num_object_copies":12840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4280,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":67672,"num_write_kb":2302401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"46'67877","reported_seq":68317,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:46.639485+0000","last_change":"2026-02-23T13:05:42.588562+0000","last_active":"2026-02-23T13:05:46.639485+0000","last_peered":"2026-02-23T13:05:46.639485+0000","last_clean":"2026-02-23T13:05:46.639485+0000","last_became_active":"2026-02-23T13:03:08.712348+0000","last_became_peered":"2026-02-23T13:03:08.712348+0000","last_unstale":"2026-02-23T13:05:46.639485+0000","last_undegraded":"2026-02-23T13:05:46.639485+0000","last_fullsized":"2026-02-23T13:05:46.639485+0000","mapping_epoch":28,"log_start":"46'67874","ondisk_log_start":"46'67874","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'65970","last_scrub_stamp":"2026-02-23T13:05:42.588512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:05:42.588512+0000","objects_scrubbed":6490,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:00.851739+0000","scrub_duration":857,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287244288,"num_objects":4383,"num_object_clones":0,"num_object_copies":13149,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4383,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67877,"num_write_kb":2312320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":237,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:29.192008+0000","last_change":"2026-02-23T13:05:29.192008+0000","last_active":"2026-02-23T13:05:29.192008+0000","last_peered":"2026-02-23T13:05:29.192008+0000","last_clean":"2026-02-23T13:05:29.192008+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:05:29.192008+0000","last_undegraded":"2026-02-23T13:05:29.192008+0000","last_fullsized":"2026-02-23T13:05:29.192008+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:05:29.191972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:05:29.191972+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:50.435825+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"46'67580","reported_seq":68041,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:46.614405+0000","last_change":"2026-02-23T13:05:29.505689+0000","last_active":"2026-02-23T13:05:46.614405+0000","last_peered":"2026-02-23T13:05:46.614405+0000","last_clean":"2026-02-23T13:05:46.614405+0000","last_became_active":"2026-02-23T13:03:08.708695+0000","last_became_peered":"2026-02-23T13:03:08.708695+0000","last_unstale":"2026-02-23T13:05:46.614405+0000","last_undegraded":"2026-02-23T13:05:46.614405+0000","last_fullsized":"2026-02-23T13:05:46.614405+0000","mapping_epoch":28,"log_start":"46'67577","ondisk_log_start":"46'67577","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'59353","last_scrub_stamp":"2026-02-23T13:05:29.505604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:05:29.505604+0000","objects_scrubbed":12769,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:38.841173+0000","scrub_duration":1353,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":282329088,"num_objects":4308,"num_object_clones":0,"num_object_copies":12924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4308,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67580,"num_write_kb":2300416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"46'67665","reported_seq":68042,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:46.614218+0000","last_change":"2026-02-23T13:04:30.014412+0000","last_active":"2026-02-23T13:05:46.614218+0000","last_peered":"2026-02-23T13:05:46.614218+0000","last_clean":"2026-02-23T13:05:46.614218+0000","last_became_active":"2026-02-23T13:03:08.711847+0000","last_became_peered":"2026-02-23T13:03:08.711847+0000","last_unstale":"2026-02-23T13:05:46.614218+0000","last_undegraded":"2026-02-23T13:05:46.614218+0000","last_fullsized":"2026-02-23T13:05:46.614218+0000","mapping_epoch":28,"log_start":"46'67662","ondisk_log_start":"46'67662","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'32670","last_scrub_stamp":"2026-02-23T13:04:30.014332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:30.014332+0000","objects_scrubbed":32128,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:50.241908+0000","scrub_duration":3026,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":280690688,"num_objects":4283,"num_object_clones":0,"num_object_copies":12849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4283,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67665,"num_write_kb":2302336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"46'67775","reported_seq":68216,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:46.643283+0000","last_change":"2026-02-23T13:05:32.941612+0000","last_active":"2026-02-23T13:05:46.643283+0000","last_peered":"2026-02-23T13:05:46.643283+0000","last_clean":"2026-02-23T13:05:46.643283+0000","last_became_active":"2026-02-23T13:03:08.712783+0000","last_became_peered":"2026-02-23T13:03:08.712783+0000","last_unstale":"2026-02-23T13:05:46.643283+0000","last_undegraded":"2026-02-23T13:05:46.643283+0000","last_fullsized":"2026-02-23T13:05:46.643283+0000","mapping_epoch":28,"log_start":"46'67772","ondisk_log_start":"46'67772","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'61091","last_scrub_stamp":"2026-02-23T13:05:32.941555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:05:32.941555+0000","objects_scrubbed":11358,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:55.728330+0000","scrub_duration":1097,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289996800,"num_objects":4425,"num_object_clones":0,"num_object_copies":13275,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4425,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67775,"num_write_kb":2310400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"46'67582","reported_seq":68056,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:46.610407+0000","last_change":"2026-02-23T13:05:34.382428+0000","last_active":"2026-02-23T13:05:46.610407+0000","last_peered":"2026-02-23T13:05:46.610407+0000","last_clean":"2026-02-23T13:05:46.610407+0000","last_became_active":"2026-02-23T13:03:08.708821+0000","last_became_peered":"2026-02-23T13:03:08.708821+0000","last_unstale":"2026-02-23T13:05:46.610407+0000","last_undegraded":"2026-02-23T13:05:46.610407+0000","last_fullsized":"2026-02-23T13:05:46.610407+0000","mapping_epoch":28,"log_start":"46'67579","ondisk_log_start":"46'67579","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'61767","last_scrub_stamp":"2026-02-23T13:05:34.382391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:05:34.382391+0000","objects_scrubbed":10404,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:03.977565+0000","scrub_duration":1187,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286785536,"num_objects":4376,"num_object_clones":0,"num_object_copies":13128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4376,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67582,"num_write_kb":2302656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"46'67592","reported_seq":67999,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:46.643163+0000","last_change":"2026-02-23T13:04:39.437215+0000","last_active":"2026-02-23T13:05:46.643163+0000","last_peered":"2026-02-23T13:05:46.643163+0000","last_clean":"2026-02-23T13:05:46.643163+0000","last_became_active":"2026-02-23T13:03:08.712152+0000","last_became_peered":"2026-02-23T13:03:08.712152+0000","last_unstale":"2026-02-23T13:05:46.643163+0000","last_undegraded":"2026-02-23T13:05:46.643163+0000","last_fullsized":"2026-02-23T13:05:46.643163+0000","mapping_epoch":28,"log_start":"46'67589","ondisk_log_start":"46'67589","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'35859","last_scrub_stamp":"2026-02-23T13:04:39.437158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:39.437158+0000","objects_scrubbed":35127,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:52.724383+0000","scrub_duration":4536,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285736960,"num_objects":4360,"num_object_clones":0,"num_object_copies":13080,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4360,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67592,"num_write_kb":2302464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"46'67080","reported_seq":67418,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:46.610593+0000","last_change":"2026-02-23T13:04:57.975495+0000","last_active":"2026-02-23T13:05:46.610593+0000","last_peered":"2026-02-23T13:05:46.610593+0000","last_clean":"2026-02-23T13:05:46.610593+0000","last_became_active":"2026-02-23T13:03:08.712055+0000","last_became_peered":"2026-02-23T13:03:08.712055+0000","last_unstale":"2026-02-23T13:05:46.610593+0000","last_undegraded":"2026-02-23T13:05:46.610593+0000","last_fullsized":"2026-02-23T13:05:46.610593+0000","mapping_epoch":28,"log_start":"46'67077","ondisk_log_start":"46'67077","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'43718","last_scrub_stamp":"2026-02-23T13:04:57.975448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:57.975448+0000","objects_scrubbed":28325,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:22.148320+0000","scrub_duration":2865,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":283901952,"num_objects":4332,"num_object_clones":0,"num_object_copies":12996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4332,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67080,"num_write_kb":2285184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"46'67726","reported_seq":68148,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:46.645980+0000","last_change":"2026-02-23T13:05:45.448778+0000","last_active":"2026-02-23T13:05:46.645980+0000","last_peered":"2026-02-23T13:05:46.645980+0000","last_clean":"2026-02-23T13:05:46.645980+0000","last_became_active":"2026-02-23T13:03:08.708852+0000","last_became_peered":"2026-02-23T13:03:08.708852+0000","last_unstale":"2026-02-23T13:05:46.645980+0000","last_undegraded":"2026-02-23T13:05:46.645980+0000","last_fullsized":"2026-02-23T13:05:46.645980+0000","mapping_epoch":28,"log_start":"46'67723","ondisk_log_start":"46'67723","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'67168","last_scrub_stamp":"2026-02-23T13:05:45.448741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:05:45.448741+0000","objects_scrubbed":5002,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:04.489685+0000","scrub_duration":694,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":280625152,"num_objects":4282,"num_object_clones":0,"num_object_copies":12846,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4282,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67726,"num_write_kb":2304256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"46'68060","reported_seq":68422,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:46.605904+0000","last_change":"2026-02-23T13:04:53.166360+0000","last_active":"2026-02-23T13:05:46.605904+0000","last_peered":"2026-02-23T13:05:46.605904+0000","last_clean":"2026-02-23T13:05:46.605904+0000","last_became_active":"2026-02-23T13:03:08.708457+0000","last_became_peered":"2026-02-23T13:03:08.708457+0000","last_unstale":"2026-02-23T13:05:46.605904+0000","last_undegraded":"2026-02-23T13:05:46.605904+0000","last_fullsized":"2026-02-23T13:05:46.605904+0000","mapping_epoch":28,"log_start":"46'68057","ondisk_log_start":"46'68057","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'42452","last_scrub_stamp":"2026-02-23T13:04:53.166176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:53.166176+0000","objects_scrubbed":30649,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:57.240381+0000","scrub_duration":3244,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284950528,"num_objects":4348,"num_object_clones":0,"num_object_copies":13044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4348,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68060,"num_write_kb":2317056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"46'67814","reported_seq":68226,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:46.611094+0000","last_change":"2026-02-23T13:04:43.225441+0000","last_active":"2026-02-23T13:05:46.611094+0000","last_peered":"2026-02-23T13:05:46.611094+0000","last_clean":"2026-02-23T13:05:46.611094+0000","last_became_active":"2026-02-23T13:03:08.712010+0000","last_became_peered":"2026-02-23T13:03:08.712010+0000","last_unstale":"2026-02-23T13:05:46.611094+0000","last_undegraded":"2026-02-23T13:05:46.611094+0000","last_fullsized":"2026-02-23T13:05:46.611094+0000","mapping_epoch":28,"log_start":"46'67811","ondisk_log_start":"46'67811","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'37378","last_scrub_stamp":"2026-02-23T13:04:43.225387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:43.225387+0000","objects_scrubbed":35509,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:53.679895+0000","scrub_duration":3337,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288489472,"num_objects":4402,"num_object_clones":0,"num_object_copies":13206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4402,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67814,"num_write_kb":2310912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"46'67204","reported_seq":67677,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:46.641511+0000","last_change":"2026-02-23T13:05:31.985252+0000","last_active":"2026-02-23T13:05:46.641511+0000","last_peered":"2026-02-23T13:05:46.641511+0000","last_clean":"2026-02-23T13:05:46.641511+0000","last_became_active":"2026-02-23T13:03:08.712763+0000","last_became_peered":"2026-02-23T13:03:08.712763+0000","last_unstale":"2026-02-23T13:05:46.641511+0000","last_undegraded":"2026-02-23T13:05:46.641511+0000","last_fullsized":"2026-02-23T13:05:46.641511+0000","mapping_epoch":28,"log_start":"46'67201","ondisk_log_start":"46'67201","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'60290","last_scrub_stamp":"2026-02-23T13:05:31.985202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:05:31.985202+0000","objects_scrubbed":11395,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:57.484989+0000","scrub_duration":1116,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278528000,"num_objects":4250,"num_object_clones":0,"num_object_copies":12750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4250,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67204,"num_write_kb":2286528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"46'67719","reported_seq":68130,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:46.643519+0000","last_change":"2026-02-23T13:04:40.228341+0000","last_active":"2026-02-23T13:05:46.643519+0000","last_peered":"2026-02-23T13:05:46.643519+0000","last_clean":"2026-02-23T13:05:46.643519+0000","last_became_active":"2026-02-23T13:03:08.709391+0000","last_became_peered":"2026-02-23T13:03:08.709391+0000","last_unstale":"2026-02-23T13:05:46.643519+0000","last_undegraded":"2026-02-23T13:05:46.643519+0000","last_fullsized":"2026-02-23T13:05:46.643519+0000","mapping_epoch":28,"log_start":"46'67716","ondisk_log_start":"46'67716","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'36164","last_scrub_stamp":"2026-02-23T13:04:40.228295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:40.228295+0000","objects_scrubbed":35482,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:48.119450+0000","scrub_duration":4344,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":282263552,"num_objects":4307,"num_object_clones":0,"num_object_copies":12921,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4307,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67719,"num_write_kb":2304832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"46'67417","reported_seq":67766,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:46.611050+0000","last_change":"2026-02-23T13:04:55.969591+0000","last_active":"2026-02-23T13:05:46.611050+0000","last_peered":"2026-02-23T13:05:46.611050+0000","last_clean":"2026-02-23T13:05:46.611050+0000","last_became_active":"2026-02-23T13:03:08.711303+0000","last_became_peered":"2026-02-23T13:03:08.711303+0000","last_unstale":"2026-02-23T13:05:46.611050+0000","last_undegraded":"2026-02-23T13:05:46.611050+0000","last_fullsized":"2026-02-23T13:05:46.611050+0000","mapping_epoch":28,"log_start":"46'67414","ondisk_log_start":"46'67414","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'42977","last_scrub_stamp":"2026-02-23T13:04:55.969549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:55.969549+0000","objects_scrubbed":29308,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:10.033838+0000","scrub_duration":2936,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278331392,"num_objects":4247,"num_object_clones":0,"num_object_copies":12741,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4247,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67417,"num_write_kb":2293248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":4535287832,"num_objects":69204,"num_object_clones":0,"num_object_copies":207612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69204,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1082718,"num_write_kb":36861441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13623504896,"data_stored":13623492680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2559,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1252,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247844,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4907104,"kb_used_data":4073100,"kb_used_omap":7,"kb_used_meta":833912,"kb_avail":729096096,"statfs":{"total":751619276800,"available":746594402304,"internally_reserved":0,"allocated":4170854400,"data_stored":4170548759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7985,"internal_metadata":853926095},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444071,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3595996,"kb_used_data":3211080,"kb_used_omap":6,"kb_used_meta":384889,"kb_avail":730407204,"statfs":{"total":751619276800,"available":747936976896,"internally_reserved":0,"allocated":3288145920,"data_stored":3287844351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7148,"internal_metadata":394126356},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4164252,"kb_used_data":3640904,"kb_used_omap":7,"kb_used_meta":523320,"kb_avail":729838948,"statfs":{"total":751619276800,"available":747355082752,"internally_reserved":0,"allocated":3728285696,"data_stored":3727983607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7420,"internal_metadata":535880452},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705706,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3479840,"kb_used_data":3093068,"kb_used_omap":6,"kb_used_meta":386745,"kb_avail":730523360,"statfs":{"total":751619276800,"available":748055920640,"internally_reserved":0,"allocated":3167301632,"data_stored":3166995991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7058,"internal_metadata":396026990},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1252,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3127644160,"data_stored":3127640088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3396014080,"data_stored":3396010008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1434,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3125215232,"data_stored":3125215232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3974631424,"data_stored":3974627352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1032,"internal_metadata":0}]}} 2026-02-23T13:05:50.334 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:05:50.334 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_0 pg_num 76 2026-02-23T13:05:50.465 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:50.579 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:50.578+0000 7fd102aaf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:50.579 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:50.578+0000 7fd102aaf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:50.714 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:05:50.750 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:05:50.814 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:05:50.838 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:50 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2774633369' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_0", "var": "pg_num", "val": "76"} : dispatch 2026-02-23T13:05:50.950 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:51.062 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:51.061+0000 7f804c3b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:51.062 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:51.062+0000 7f804c3b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:51.078 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:05:51.078 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:05:51.090 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:05:51.091 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:05:51.103 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:05:51.103 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:05:51.116 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:05:51.116 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:05:52.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:51 trial046 ceph-mon[38575]: from='client.14608 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:05:52.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:51 trial046 ceph-mon[38575]: pgmap v107: 17 pgs: 17 active+clean; 4.2 GiB data, 15 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 6.47k op/s 2026-02-23T13:05:52.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:51 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2027058863' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:05:52.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:51 trial046 ceph-mon[38575]: 2.0 scrub starts 2026-02-23T13:05:53.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:52 trial046 ceph-mon[38575]: 2.0 scrub ok 2026-02-23T13:05:53.157 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:05:53.292 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:53.822 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:53 trial046 ceph-mon[38575]: pgmap v108: 17 pgs: 17 active+clean; 1.9 GiB data, 8.7 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 9.58k op/s 2026-02-23T13:05:53.903 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:53.819+0000 7f3c28aa9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:53.904 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:53.820+0000 7f3c28aa9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:53.904 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:05:53.904 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:05:53.904 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:05:53.905 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:05:53.905 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:05:53.905 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:05:53.905 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:05:53.905 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:05:54.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:54 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/800265820' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:05:55.751 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:05:55.752 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:05:55.752 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:05:55.887 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:56.003 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:55 trial046 ceph-mon[38575]: pgmap v109: 17 pgs: 17 active+clean; 1.9 GiB data, 8.7 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 6.32k op/s 2026-02-23T13:05:56.266 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:05:56 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:05:56] "GET /metrics HTTP/1.1" 200 4226 "" "Prometheus/3.6.0" 2026-02-23T13:05:56.269 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Removed 575960 objects 2026-02-23T13:05:56.269 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Clean up completed and total clean up time :76.4626 2026-02-23T13:05:56.309 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:56.263+0000 7fa38a883640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:56.309 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:56.263+0000 7fa38a883640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:56.376 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:05:56.376 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:05:56.526 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:05:56.561 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:05:56 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:05:56.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:05:56.835 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:56.845 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:56 trial046 ceph-mon[38575]: 2.4 scrub starts 2026-02-23T13:05:56.846 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:56 trial046 ceph-mon[38575]: 2.4 scrub ok 2026-02-23T13:05:56.864 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":109,"stamp":"2026-02-23T13:05:54.612881+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2087125560,"num_objects":31841,"num_object_clones":0,"num_object_copies":95523,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31841,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":1120218,"num_write_kb":36863591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53,"ondisk_log_size":53,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":9144760,"kb_used_data":6799080,"kb_used_omap":29,"kb_used_meta":2345442,"kb_avail":2926868040,"statfs":{"total":3006477107200,"available":2997112872960,"internally_reserved":0,"allocated":6962257920,"data_stored":6961042980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29802,"internal_metadata":2401733526},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,3],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4969463808,"num_objects":-75828,"num_object_clones":0,"num_object_copies":-227484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-75828,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75828,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001594"},"pg_stats":[{"pgid":"2.f","version":"46'69998","reported_seq":70454,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:51.601722+0000","last_change":"2026-02-23T13:05:38.792380+0000","last_active":"2026-02-23T13:05:51.601722+0000","last_peered":"2026-02-23T13:05:51.601722+0000","last_clean":"2026-02-23T13:05:51.601722+0000","last_became_active":"2026-02-23T13:03:08.711408+0000","last_became_peered":"2026-02-23T13:03:08.711408+0000","last_unstale":"2026-02-23T13:05:51.601722+0000","last_undegraded":"2026-02-23T13:05:51.601722+0000","last_fullsized":"2026-02-23T13:05:51.601722+0000","mapping_epoch":28,"log_start":"46'69995","ondisk_log_start":"46'69995","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'63839","last_scrub_stamp":"2026-02-23T13:05:38.792313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:05:38.792313+0000","objects_scrubbed":8378,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:59.973428+0000","scrub_duration":608,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135135232,"num_objects":2062,"num_object_clones":0,"num_object_copies":6186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2062,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69998,"num_write_kb":2305920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"46'70589","reported_seq":71003,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:51.644946+0000","last_change":"2026-02-23T13:04:41.483173+0000","last_active":"2026-02-23T13:05:51.644946+0000","last_peered":"2026-02-23T13:05:51.644946+0000","last_clean":"2026-02-23T13:05:51.644946+0000","last_became_active":"2026-02-23T13:03:08.711462+0000","last_became_peered":"2026-02-23T13:03:08.711462+0000","last_unstale":"2026-02-23T13:05:51.644946+0000","last_undegraded":"2026-02-23T13:05:51.644946+0000","last_fullsized":"2026-02-23T13:05:51.644946+0000","mapping_epoch":28,"log_start":"46'70586","ondisk_log_start":"46'70586","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'36827","last_scrub_stamp":"2026-02-23T13:04:41.482975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:41.482975+0000","objects_scrubbed":35883,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:55.333749+0000","scrub_duration":4566,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126287872,"num_objects":1927,"num_object_clones":0,"num_object_copies":5781,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1927,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70589,"num_write_kb":2320512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"46'69994","reported_seq":70422,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:51.647903+0000","last_change":"2026-02-23T13:05:48.328368+0000","last_active":"2026-02-23T13:05:51.647903+0000","last_peered":"2026-02-23T13:05:51.647903+0000","last_clean":"2026-02-23T13:05:51.647903+0000","last_became_active":"2026-02-23T13:03:08.712246+0000","last_became_peered":"2026-02-23T13:03:08.712246+0000","last_unstale":"2026-02-23T13:05:51.647903+0000","last_undegraded":"2026-02-23T13:05:51.647903+0000","last_fullsized":"2026-02-23T13:05:51.647903+0000","mapping_epoch":28,"log_start":"46'69991","ondisk_log_start":"46'69991","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'68505","last_scrub_stamp":"2026-02-23T13:05:48.328339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:05:48.328339+0000","objects_scrubbed":3558,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:53.421981+0000","scrub_duration":520,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128253976,"num_objects":1958,"num_object_clones":0,"num_object_copies":5874,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1958,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":69994,"num_write_kb":2302401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"46'70218","reported_seq":70658,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:51.646770+0000","last_change":"2026-02-23T13:05:42.588562+0000","last_active":"2026-02-23T13:05:51.646770+0000","last_peered":"2026-02-23T13:05:51.646770+0000","last_clean":"2026-02-23T13:05:51.646770+0000","last_became_active":"2026-02-23T13:03:08.712348+0000","last_became_peered":"2026-02-23T13:03:08.712348+0000","last_unstale":"2026-02-23T13:05:51.646770+0000","last_undegraded":"2026-02-23T13:05:51.646770+0000","last_fullsized":"2026-02-23T13:05:51.646770+0000","mapping_epoch":28,"log_start":"46'70215","ondisk_log_start":"46'70215","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'65970","last_scrub_stamp":"2026-02-23T13:05:42.588512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:05:42.588512+0000","objects_scrubbed":6490,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:00.851739+0000","scrub_duration":857,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133824512,"num_objects":2042,"num_object_clones":0,"num_object_copies":6126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2042,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70218,"num_write_kb":2312320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":237,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:29.192008+0000","last_change":"2026-02-23T13:05:29.192008+0000","last_active":"2026-02-23T13:05:29.192008+0000","last_peered":"2026-02-23T13:05:29.192008+0000","last_clean":"2026-02-23T13:05:29.192008+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:05:29.192008+0000","last_undegraded":"2026-02-23T13:05:29.192008+0000","last_fullsized":"2026-02-23T13:05:29.192008+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:05:29.191972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:05:29.191972+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:50.435825+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"46'69918","reported_seq":70377,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:51.610342+0000","last_change":"2026-02-23T13:05:29.505689+0000","last_active":"2026-02-23T13:05:51.610342+0000","last_peered":"2026-02-23T13:05:51.610342+0000","last_clean":"2026-02-23T13:05:51.610342+0000","last_became_active":"2026-02-23T13:03:08.708695+0000","last_became_peered":"2026-02-23T13:03:08.708695+0000","last_unstale":"2026-02-23T13:05:51.610342+0000","last_undegraded":"2026-02-23T13:05:51.610342+0000","last_fullsized":"2026-02-23T13:05:51.610342+0000","mapping_epoch":28,"log_start":"46'69915","ondisk_log_start":"46'69915","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'59353","last_scrub_stamp":"2026-02-23T13:05:29.505604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:05:29.505604+0000","objects_scrubbed":12769,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:38.841173+0000","scrub_duration":1353,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129105920,"num_objects":1970,"num_object_clones":0,"num_object_copies":5910,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1970,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69918,"num_write_kb":2300416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"46'69982","reported_seq":70389,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:51.610034+0000","last_change":"2026-02-23T13:05:51.487046+0000","last_active":"2026-02-23T13:05:51.610034+0000","last_peered":"2026-02-23T13:05:51.610034+0000","last_clean":"2026-02-23T13:05:51.610034+0000","last_became_active":"2026-02-23T13:03:08.711847+0000","last_became_peered":"2026-02-23T13:03:08.711847+0000","last_unstale":"2026-02-23T13:05:51.610034+0000","last_undegraded":"2026-02-23T13:05:51.610034+0000","last_fullsized":"2026-02-23T13:05:51.610034+0000","mapping_epoch":28,"log_start":"46'69979","ondisk_log_start":"46'69979","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'69919","last_scrub_stamp":"2026-02-23T13:05:51.486984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:05:51.486984+0000","objects_scrubbed":2092,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:19.913207+0000","scrub_duration":286,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128843776,"num_objects":1966,"num_object_clones":0,"num_object_copies":5898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1966,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69982,"num_write_kb":2302336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"46'70178","reported_seq":70619,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:51.639650+0000","last_change":"2026-02-23T13:05:32.941612+0000","last_active":"2026-02-23T13:05:51.639650+0000","last_peered":"2026-02-23T13:05:51.639650+0000","last_clean":"2026-02-23T13:05:51.639650+0000","last_became_active":"2026-02-23T13:03:08.712783+0000","last_became_peered":"2026-02-23T13:03:08.712783+0000","last_unstale":"2026-02-23T13:05:51.639650+0000","last_undegraded":"2026-02-23T13:05:51.639650+0000","last_fullsized":"2026-02-23T13:05:51.639650+0000","mapping_epoch":28,"log_start":"46'70175","ondisk_log_start":"46'70175","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'61091","last_scrub_stamp":"2026-02-23T13:05:32.941555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:05:32.941555+0000","objects_scrubbed":11358,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:55.728330+0000","scrub_duration":1097,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132513792,"num_objects":2022,"num_object_clones":0,"num_object_copies":6066,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2022,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70178,"num_write_kb":2310400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"46'69961","reported_seq":70434,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:51.611665+0000","last_change":"2026-02-23T13:05:34.382428+0000","last_active":"2026-02-23T13:05:51.611665+0000","last_peered":"2026-02-23T13:05:51.611665+0000","last_clean":"2026-02-23T13:05:51.611665+0000","last_became_active":"2026-02-23T13:03:08.708821+0000","last_became_peered":"2026-02-23T13:03:08.708821+0000","last_unstale":"2026-02-23T13:05:51.611665+0000","last_undegraded":"2026-02-23T13:05:51.611665+0000","last_fullsized":"2026-02-23T13:05:51.611665+0000","mapping_epoch":28,"log_start":"46'69958","ondisk_log_start":"46'69958","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'61767","last_scrub_stamp":"2026-02-23T13:05:34.382391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:05:34.382391+0000","objects_scrubbed":10404,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:03.977565+0000","scrub_duration":1187,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130875392,"num_objects":1997,"num_object_clones":0,"num_object_copies":5991,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1997,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69961,"num_write_kb":2302656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"46'69930","reported_seq":70338,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:51.641879+0000","last_change":"2026-02-23T13:04:39.437215+0000","last_active":"2026-02-23T13:05:51.641879+0000","last_peered":"2026-02-23T13:05:51.641879+0000","last_clean":"2026-02-23T13:05:51.641879+0000","last_became_active":"2026-02-23T13:03:08.712152+0000","last_became_peered":"2026-02-23T13:03:08.712152+0000","last_unstale":"2026-02-23T13:05:51.641879+0000","last_undegraded":"2026-02-23T13:05:51.641879+0000","last_fullsized":"2026-02-23T13:05:51.641879+0000","mapping_epoch":28,"log_start":"46'69927","ondisk_log_start":"46'69927","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'35859","last_scrub_stamp":"2026-02-23T13:04:39.437158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:39.437158+0000","objects_scrubbed":35127,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:52.724383+0000","scrub_duration":4536,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132513792,"num_objects":2022,"num_object_clones":0,"num_object_copies":6066,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2022,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69930,"num_write_kb":2302464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"46'69397","reported_seq":69736,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:51.604290+0000","last_change":"2026-02-23T13:04:57.975495+0000","last_active":"2026-02-23T13:05:51.604290+0000","last_peered":"2026-02-23T13:05:51.604290+0000","last_clean":"2026-02-23T13:05:51.604290+0000","last_became_active":"2026-02-23T13:03:08.712055+0000","last_became_peered":"2026-02-23T13:03:08.712055+0000","last_unstale":"2026-02-23T13:05:51.604290+0000","last_undegraded":"2026-02-23T13:05:51.604290+0000","last_fullsized":"2026-02-23T13:05:51.604290+0000","mapping_epoch":28,"log_start":"46'69394","ondisk_log_start":"46'69394","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'43718","last_scrub_stamp":"2026-02-23T13:04:57.975448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:57.975448+0000","objects_scrubbed":28325,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:22.148320+0000","scrub_duration":2865,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132055040,"num_objects":2015,"num_object_clones":0,"num_object_copies":6045,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2015,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69397,"num_write_kb":2285184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"46'70038","reported_seq":70460,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:51.645889+0000","last_change":"2026-02-23T13:05:45.448778+0000","last_active":"2026-02-23T13:05:51.645889+0000","last_peered":"2026-02-23T13:05:51.645889+0000","last_clean":"2026-02-23T13:05:51.645889+0000","last_became_active":"2026-02-23T13:03:08.708852+0000","last_became_peered":"2026-02-23T13:03:08.708852+0000","last_unstale":"2026-02-23T13:05:51.645889+0000","last_undegraded":"2026-02-23T13:05:51.645889+0000","last_fullsized":"2026-02-23T13:05:51.645889+0000","mapping_epoch":28,"log_start":"46'70033","ondisk_log_start":"46'70033","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'67168","last_scrub_stamp":"2026-02-23T13:05:45.448741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:05:45.448741+0000","objects_scrubbed":5002,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:04.489685+0000","scrub_duration":694,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129105920,"num_objects":1970,"num_object_clones":0,"num_object_copies":5910,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1970,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70038,"num_write_kb":2304256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"46'70395","reported_seq":70758,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:51.603475+0000","last_change":"2026-02-23T13:04:53.166360+0000","last_active":"2026-02-23T13:05:51.603475+0000","last_peered":"2026-02-23T13:05:51.603475+0000","last_clean":"2026-02-23T13:05:51.603475+0000","last_became_active":"2026-02-23T13:03:08.708457+0000","last_became_peered":"2026-02-23T13:03:08.708457+0000","last_unstale":"2026-02-23T13:05:51.603475+0000","last_undegraded":"2026-02-23T13:05:51.603475+0000","last_fullsized":"2026-02-23T13:05:51.603475+0000","mapping_epoch":28,"log_start":"46'70392","ondisk_log_start":"46'70392","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'42452","last_scrub_stamp":"2026-02-23T13:04:53.166176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:53.166176+0000","objects_scrubbed":30649,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:57.240381+0000","scrub_duration":3244,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131923968,"num_objects":2013,"num_object_clones":0,"num_object_copies":6039,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2013,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70395,"num_write_kb":2317056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"46'70182","reported_seq":70594,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:51.613367+0000","last_change":"2026-02-23T13:04:43.225441+0000","last_active":"2026-02-23T13:05:51.613367+0000","last_peered":"2026-02-23T13:05:51.613367+0000","last_clean":"2026-02-23T13:05:51.613367+0000","last_became_active":"2026-02-23T13:03:08.712010+0000","last_became_peered":"2026-02-23T13:03:08.712010+0000","last_unstale":"2026-02-23T13:05:51.613367+0000","last_undegraded":"2026-02-23T13:05:51.613367+0000","last_fullsized":"2026-02-23T13:05:51.613367+0000","mapping_epoch":28,"log_start":"46'70179","ondisk_log_start":"46'70179","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'37378","last_scrub_stamp":"2026-02-23T13:04:43.225387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:43.225387+0000","objects_scrubbed":35509,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:05:53.679895+0000","scrub_duration":3337,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133300224,"num_objects":2034,"num_object_clones":0,"num_object_copies":6102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2034,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70182,"num_write_kb":2310912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"46'69503","reported_seq":69976,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:51.644004+0000","last_change":"2026-02-23T13:05:31.985252+0000","last_active":"2026-02-23T13:05:51.644004+0000","last_peered":"2026-02-23T13:05:51.644004+0000","last_clean":"2026-02-23T13:05:51.644004+0000","last_became_active":"2026-02-23T13:03:08.712763+0000","last_became_peered":"2026-02-23T13:03:08.712763+0000","last_unstale":"2026-02-23T13:05:51.644004+0000","last_undegraded":"2026-02-23T13:05:51.644004+0000","last_fullsized":"2026-02-23T13:05:51.644004+0000","mapping_epoch":28,"log_start":"46'69500","ondisk_log_start":"46'69500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'60290","last_scrub_stamp":"2026-02-23T13:05:31.985202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:05:31.985202+0000","objects_scrubbed":11395,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:57.484989+0000","scrub_duration":1116,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127860736,"num_objects":1951,"num_object_clones":0,"num_object_copies":5853,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1951,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69503,"num_write_kb":2286528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"46'70103","reported_seq":70555,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:51.643936+0000","last_change":"2026-02-23T13:05:49.231975+0000","last_active":"2026-02-23T13:05:51.643936+0000","last_peered":"2026-02-23T13:05:51.643936+0000","last_clean":"2026-02-23T13:05:51.643936+0000","last_became_active":"2026-02-23T13:03:08.709391+0000","last_became_peered":"2026-02-23T13:03:08.709391+0000","last_unstale":"2026-02-23T13:05:51.643936+0000","last_undegraded":"2026-02-23T13:05:51.643936+0000","last_fullsized":"2026-02-23T13:05:51.643936+0000","mapping_epoch":28,"log_start":"46'70100","ondisk_log_start":"46'70100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'68901","last_scrub_stamp":"2026-02-23T13:05:49.231935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:05:49.231935+0000","objects_scrubbed":3198,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:59.387884+0000","scrub_duration":428,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126025728,"num_objects":1923,"num_object_clones":0,"num_object_copies":5769,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1923,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70103,"num_write_kb":2304832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"46'69697","reported_seq":70046,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:51.613958+0000","last_change":"2026-02-23T13:04:55.969591+0000","last_active":"2026-02-23T13:05:51.613958+0000","last_peered":"2026-02-23T13:05:51.613958+0000","last_clean":"2026-02-23T13:05:51.613958+0000","last_became_active":"2026-02-23T13:03:08.711303+0000","last_became_peered":"2026-02-23T13:03:08.711303+0000","last_unstale":"2026-02-23T13:05:51.613958+0000","last_undegraded":"2026-02-23T13:05:51.613958+0000","last_fullsized":"2026-02-23T13:05:51.613958+0000","mapping_epoch":28,"log_start":"46'69694","ondisk_log_start":"46'69694","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'42977","last_scrub_stamp":"2026-02-23T13:04:55.969549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:03:07.696567+0000","last_clean_scrub_stamp":"2026-02-23T13:04:55.969549+0000","objects_scrubbed":29308,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:10.033838+0000","scrub_duration":2936,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128909312,"num_objects":1967,"num_object_clones":0,"num_object_copies":5901,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1967,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69697,"num_write_kb":2293248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":2086535192,"num_objects":31839,"num_object_clones":0,"num_object_copies":95517,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31839,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1120083,"num_write_kb":36861441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6277509120,"data_stored":6277496904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4107,"internal_metadata":0},"log_size":50,"ondisk_log_size":50,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1008,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247845,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2856160,"kb_used_data":1968076,"kb_used_omap":7,"kb_used_meta":888056,"kb_avail":731147040,"statfs":{"total":751619276800,"available":748694568960,"internally_reserved":0,"allocated":2015309824,"data_stored":2015004183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7985,"internal_metadata":909369551},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444072,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2009180,"kb_used_data":1570056,"kb_used_omap":6,"kb_used_meta":439033,"kb_avail":731994020,"statfs":{"total":751619276800,"available":749561876480,"internally_reserved":0,"allocated":1607737344,"data_stored":1607435775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7148,"internal_metadata":449569812},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2400668,"kb_used_data":1823176,"kb_used_omap":7,"kb_used_meta":577464,"kb_avail":731602532,"statfs":{"total":751619276800,"available":749160992768,"internally_reserved":0,"allocated":1866932224,"data_stored":1866630135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7611,"internal_metadata":591323717},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705707,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1878752,"kb_used_data":1437772,"kb_used_omap":6,"kb_used_meta":440889,"kb_avail":732124448,"statfs":{"total":751619276800,"available":749695434752,"internally_reserved":0,"allocated":1472278528,"data_stored":1471972887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7058,"internal_metadata":451470446},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1008,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1449398272,"data_stored":1449394200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1552486400,"data_stored":1552482328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3165,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1441792000,"data_stored":1441792000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1833832448,"data_stored":1833828376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":849,"internal_metadata":0}]}} 2026-02-23T13:05:56.935 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:56.933+0000 7f1e16f8f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:56.936 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:56.933+0000 7f1e16f8f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:56.947 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:05:56.947 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:05:56.957 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:05:56.957 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:05:56.968 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:05:56.969 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:05:56.979 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:05:56.980 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:05:58.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:57 trial046 ceph-mon[38575]: from='client.14616 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:05:58.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:57 trial046 ceph-mon[38575]: pgmap v110: 17 pgs: 17 active+clean; 1.8 GiB data, 6.1 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 6.49k op/s 2026-02-23T13:05:58.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:57 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/776153951' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:05:58.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:57 trial046 ceph-mon[38575]: 2.8 scrub starts 2026-02-23T13:05:59.012 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:05:59.037 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:58 trial046 ceph-mon[38575]: 2.8 scrub ok 2026-02-23T13:05:59.132 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:05:59.229 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:59.227+0000 7fea94dcb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:59.229 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:05:59.227+0000 7fea94dcb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:05:59.242 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:05:59.242 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:05:59.252 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:05:59.252 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:05:59.264 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:05:59.265 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:05:59.274 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:05:59.275 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:06:00.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:59 trial046 ceph-mon[38575]: 2.7 scrub starts 2026-02-23T13:06:00.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:59 trial046 ceph-mon[38575]: 2.7 scrub ok 2026-02-23T13:06:00.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:59 trial046 ceph-mon[38575]: pgmap v111: 17 pgs: 17 active+clean; 577 KiB data, 2.7 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 8.77k op/s 2026-02-23T13:06:00.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:05:59 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/196406163' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:06:00.587 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_0 2026-02-23T13:06:00.587 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2026-02-23T13:06:00.704 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:00.805 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:00.803+0000 7fbd384ae640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:00.806 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:00.803+0000 7fbd384ae640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:01.310 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:06:01.428 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:01.530 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:01.528+0000 7f64f7d90640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:01.530 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:01.528+0000 7f64f7d90640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:01.542 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:06:01.542 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:06:01.552 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:06:01.552 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:06:01.563 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:06:01.564 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:06:01.575 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:06:01.575 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:06:01.752 INFO:teuthology.orchestra.run.trial046.stderr:pool 'unique_pool_0' removed 2026-02-23T13:06:01.801 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2026-02-23T13:06:01.802 INFO:tasks.radosbench:Beginning radosbench... 2026-02-23T13:06:01.802 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_1 2026-02-23T13:06:01.802 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool create unique_pool_1 16 2026-02-23T13:06:01.866 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:06:01.867 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:06:01.929 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:01.952 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:01 trial046 ceph-mon[38575]: pgmap v112: 17 pgs: 17 active+clean; 577 KiB data, 2.7 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 5.77k op/s 2026-02-23T13:06:01.952 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:01 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:06:01.952 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:01 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2594283677' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true} : dispatch 2026-02-23T13:06:01.952 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:01 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2440651912' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:06:02.041 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:02.039+0000 7f53b8cd4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:02.042 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:02.039+0000 7f53b8cd4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:02.759 INFO:teuthology.orchestra.run.trial046.stderr:pool 'unique_pool_1' created 2026-02-23T13:06:02.799 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool application enable unique_pool_1 rados --yes-i-really-mean-it || true 2026-02-23T13:06:02.917 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:03.024 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:03.022+0000 7f973a471640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:03.025 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:02 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2594283677' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]': finished 2026-02-23T13:06:03.025 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:02 trial046 ceph-mon[38575]: osdmap e47: 4 total, 4 up, 4 in 2026-02-23T13:06:03.026 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:02 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2831265990' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "unique_pool_1", "pg_num": 16} : dispatch 2026-02-23T13:06:03.026 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:03.022+0000 7f973a471640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:03.611 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:06:03.729 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:03.759 INFO:teuthology.orchestra.run.trial046.stderr:enabled application 'rados' on pool 'unique_pool_1' 2026-02-23T13:06:03.835 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:03.833+0000 7fbbfdfa5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:03.835 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:03.833+0000 7fbbfdfa5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:03.847 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:06:03.847 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:06:03.859 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:06:03.859 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:06:03.871 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:06:03.871 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:06:03.883 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:06:03.883 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:06:03.889 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:03 trial046 ceph-mon[38575]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 2.4 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-23T13:06:03.889 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:03 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2831265990' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_1", "pg_num": 16}]': finished 2026-02-23T13:06:03.890 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:03 trial046 ceph-mon[38575]: osdmap e48: 4 total, 4 up, 4 in 2026-02-23T13:06:03.890 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:03 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1102712133' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "unique_pool_1", "app": "rados", "yes_i_really_mean_it": true} : dispatch 2026-02-23T13:06:04.802 DEBUG:teuthology.orchestra.run.trial046:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -t 16 -b 65536 --object-size 65536 -p unique_pool_1 bench 90 write' 2026-02-23T13:06:04.803 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_1 2026-02-23T13:06:04.803 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:06:04.806 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2026-02-23T13:06:04.806 INFO:teuthology.orchestra.run:waiting for 3000 2026-02-23T13:06:04.852 INFO:tasks.radosbench.radosbench.0.trial046.stdout:hints = 1 2026-02-23T13:06:04.853 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2026-02-23T13:06:04.853 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Object prefix: benchmark_data_trial046_96322 2026-02-23T13:06:04.853 INFO:tasks.radosbench.radosbench.0.trial046.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-23T13:06:04.853 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 0 0 0 0 0 0 - 0 2026-02-23T13:06:04.944 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:05.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:04 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1102712133' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_1", "app": "rados", "yes_i_really_mean_it": true}]': finished 2026-02-23T13:06:05.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:04 trial046 ceph-mon[38575]: osdmap e49: 4 total, 4 up, 4 in 2026-02-23T13:06:05.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:04 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1718252562' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:06:05.072 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:05.069+0000 7f4d41a0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:05.072 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:05.069+0000 7f4d41a0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:05.226 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:06:05.226 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:06:05.270 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":118,"stamp":"2026-02-23T13:06:04.766944+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":2522732,"kb_used_data":3548,"kb_used_omap":29,"kb_used_meta":2519074,"kb_avail":2933490068,"statfs":{"total":3006477107200,"available":3003893829632,"internally_reserved":0,"allocated":3633152,"data_stored":2430428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29953,"internal_metadata":2579532543},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-1151922,"num_write_kb":-36861441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.153368"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:06:02.754918+0000","last_change":"2026-02-23T13:06:02.754918+0000","last_active":"2026-02-23T13:06:02.754918+0000","last_peered":"2026-02-23T13:06:02.754918+0000","last_clean":"2026-02-23T13:06:02.754918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:06:02.754918+0000","last_undegraded":"2026-02-23T13:06:02.754918+0000","last_fullsized":"2026-02-23T13:06:02.754918+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:06:02.754918+0000","last_change":"2026-02-23T13:06:02.754918+0000","last_active":"2026-02-23T13:06:02.754918+0000","last_peered":"2026-02-23T13:06:02.754918+0000","last_clean":"2026-02-23T13:06:02.754918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:06:02.754918+0000","last_undegraded":"2026-02-23T13:06:02.754918+0000","last_fullsized":"2026-02-23T13:06:02.754918+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:06:02.754918+0000","last_change":"2026-02-23T13:06:02.754918+0000","last_active":"2026-02-23T13:06:02.754918+0000","last_peered":"2026-02-23T13:06:02.754918+0000","last_clean":"2026-02-23T13:06:02.754918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:06:02.754918+0000","last_undegraded":"2026-02-23T13:06:02.754918+0000","last_fullsized":"2026-02-23T13:06:02.754918+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:06:02.754918+0000","last_change":"2026-02-23T13:06:02.754918+0000","last_active":"2026-02-23T13:06:02.754918+0000","last_peered":"2026-02-23T13:06:02.754918+0000","last_clean":"2026-02-23T13:06:02.754918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:06:02.754918+0000","last_undegraded":"2026-02-23T13:06:02.754918+0000","last_fullsized":"2026-02-23T13:06:02.754918+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:06:02.754918+0000","last_change":"2026-02-23T13:06:02.754918+0000","last_active":"2026-02-23T13:06:02.754918+0000","last_peered":"2026-02-23T13:06:02.754918+0000","last_clean":"2026-02-23T13:06:02.754918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:06:02.754918+0000","last_undegraded":"2026-02-23T13:06:02.754918+0000","last_fullsized":"2026-02-23T13:06:02.754918+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:06:02.754918+0000","last_change":"2026-02-23T13:06:02.754918+0000","last_active":"2026-02-23T13:06:02.754918+0000","last_peered":"2026-02-23T13:06:02.754918+0000","last_clean":"2026-02-23T13:06:02.754918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:06:02.754918+0000","last_undegraded":"2026-02-23T13:06:02.754918+0000","last_fullsized":"2026-02-23T13:06:02.754918+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:06:02.754918+0000","last_change":"2026-02-23T13:06:02.754918+0000","last_active":"2026-02-23T13:06:02.754918+0000","last_peered":"2026-02-23T13:06:02.754918+0000","last_clean":"2026-02-23T13:06:02.754918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:06:02.754918+0000","last_undegraded":"2026-02-23T13:06:02.754918+0000","last_fullsized":"2026-02-23T13:06:02.754918+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:06:02.754918+0000","last_change":"2026-02-23T13:06:02.754918+0000","last_active":"2026-02-23T13:06:02.754918+0000","last_peered":"2026-02-23T13:06:02.754918+0000","last_clean":"2026-02-23T13:06:02.754918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:06:02.754918+0000","last_undegraded":"2026-02-23T13:06:02.754918+0000","last_fullsized":"2026-02-23T13:06:02.754918+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:06:02.754918+0000","last_change":"2026-02-23T13:06:02.754918+0000","last_active":"2026-02-23T13:06:02.754918+0000","last_peered":"2026-02-23T13:06:02.754918+0000","last_clean":"2026-02-23T13:06:02.754918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:06:02.754918+0000","last_undegraded":"2026-02-23T13:06:02.754918+0000","last_fullsized":"2026-02-23T13:06:02.754918+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:06:02.754918+0000","last_change":"2026-02-23T13:06:02.754918+0000","last_active":"2026-02-23T13:06:02.754918+0000","last_peered":"2026-02-23T13:06:02.754918+0000","last_clean":"2026-02-23T13:06:02.754918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:06:02.754918+0000","last_undegraded":"2026-02-23T13:06:02.754918+0000","last_fullsized":"2026-02-23T13:06:02.754918+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:06:02.754918+0000","last_change":"2026-02-23T13:06:02.754918+0000","last_active":"2026-02-23T13:06:02.754918+0000","last_peered":"2026-02-23T13:06:02.754918+0000","last_clean":"2026-02-23T13:06:02.754918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:06:02.754918+0000","last_undegraded":"2026-02-23T13:06:02.754918+0000","last_fullsized":"2026-02-23T13:06:02.754918+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:06:02.754918+0000","last_change":"2026-02-23T13:06:02.754918+0000","last_active":"2026-02-23T13:06:02.754918+0000","last_peered":"2026-02-23T13:06:02.754918+0000","last_clean":"2026-02-23T13:06:02.754918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:06:02.754918+0000","last_undegraded":"2026-02-23T13:06:02.754918+0000","last_fullsized":"2026-02-23T13:06:02.754918+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:06:02.754918+0000","last_change":"2026-02-23T13:06:02.754918+0000","last_active":"2026-02-23T13:06:02.754918+0000","last_peered":"2026-02-23T13:06:02.754918+0000","last_clean":"2026-02-23T13:06:02.754918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:06:02.754918+0000","last_undegraded":"2026-02-23T13:06:02.754918+0000","last_fullsized":"2026-02-23T13:06:02.754918+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:06:02.754918+0000","last_change":"2026-02-23T13:06:02.754918+0000","last_active":"2026-02-23T13:06:02.754918+0000","last_peered":"2026-02-23T13:06:02.754918+0000","last_clean":"2026-02-23T13:06:02.754918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:06:02.754918+0000","last_undegraded":"2026-02-23T13:06:02.754918+0000","last_fullsized":"2026-02-23T13:06:02.754918+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:06:02.754918+0000","last_change":"2026-02-23T13:06:02.754918+0000","last_active":"2026-02-23T13:06:02.754918+0000","last_peered":"2026-02-23T13:06:02.754918+0000","last_clean":"2026-02-23T13:06:02.754918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:06:02.754918+0000","last_undegraded":"2026-02-23T13:06:02.754918+0000","last_fullsized":"2026-02-23T13:06:02.754918+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:06:02.754918+0000","last_change":"2026-02-23T13:06:02.754918+0000","last_active":"2026-02-23T13:06:02.754918+0000","last_peered":"2026-02-23T13:06:02.754918+0000","last_clean":"2026-02-23T13:06:02.754918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:06:02.754918+0000","last_undegraded":"2026-02-23T13:06:02.754918+0000","last_fullsized":"2026-02-23T13:06:02.754918+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":237,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-23T13:05:29.192008+0000","last_change":"2026-02-23T13:05:29.192008+0000","last_active":"2026-02-23T13:05:29.192008+0000","last_peered":"2026-02-23T13:05:29.192008+0000","last_clean":"2026-02-23T13:05:29.192008+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:05:29.192008+0000","last_undegraded":"2026-02-23T13:05:29.192008+0000","last_fullsized":"2026-02-23T13:05:29.192008+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:05:29.191972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:05:29.191972+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:50.435825+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":852,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247847,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":936412,"kb_used_data":1032,"kb_used_omap":7,"kb_used_meta":935352,"kb_avail":733066788,"statfs":{"total":751619276800,"available":750660390912,"internally_reserved":0,"allocated":1056768,"data_stored":755199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8043,"internal_metadata":957800597},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444074,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":476188,"kb_used_data":1032,"kb_used_omap":6,"kb_used_meta":475129,"kb_avail":733527012,"statfs":{"total":751619276800,"available":751131660288,"internally_reserved":0,"allocated":1056768,"data_stored":755199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7148,"internal_metadata":486532116},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":632088,"kb_used_data":452,"kb_used_omap":7,"kb_used_meta":631608,"kb_avail":733371112,"statfs":{"total":751619276800,"available":750972018688,"internally_reserved":0,"allocated":462848,"data_stored":164831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7704,"internal_metadata":646767080},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705709,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":478044,"kb_used_data":1032,"kb_used_omap":6,"kb_used_meta":476985,"kb_avail":733525156,"statfs":{"total":751619276800,"available":751129759744,"internally_reserved":0,"allocated":1056768,"data_stored":755199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7058,"internal_metadata":488432750},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":852,"internal_metadata":0}]}} 2026-02-23T13:06:05.273 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_1 pgp_num 16 2026-02-23T13:06:05.419 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:05.548 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:05.545+0000 7fe403036640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:05.548 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:05.545+0000 7fe403036640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:05.771 INFO:teuthology.orchestra.run.trial046.stderr:set pool 3 pgp_num to 16 2026-02-23T13:06:05.852 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 1 16 8206 8190 511.834 511.875 0.00135816 0.00195099 2026-02-23T13:06:05.919 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:06:06.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:05 trial046 ceph-mon[38575]: pgmap v117: 17 pgs: 16 unknown, 1 active+clean; 577 KiB data, 2.4 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-23T13:06:06.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:05 trial046 ceph-mon[38575]: osdmap e50: 4 total, 4 up, 4 in 2026-02-23T13:06:06.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:05 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2336990527' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_1", "var": "pgp_num", "val": "16"} : dispatch 2026-02-23T13:06:06.078 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:06.214 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:06.212+0000 7f0625f90640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:06.215 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:06.212+0000 7f0625f90640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:06.230 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:06:06.230 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:06:06.244 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:06:06.244 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:06:06.260 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:06:06.260 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:06:06.273 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:06:06.273 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:06:06.539 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:06:06 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:06:06] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-23T13:06:06.561 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:06:06 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:06:06.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:06:06.852 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 2 16 16763 16747 523.301 534.812 0.00181759 0.00190867 2026-02-23T13:06:07.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:06 trial046 ceph-mon[38575]: from='client.14635 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:06:07.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:06 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2336990527' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "unique_pool_1", "var": "pgp_num", "val": "16"}]': finished 2026-02-23T13:06:07.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:06 trial046 ceph-mon[38575]: osdmap e51: 4 total, 4 up, 4 in 2026-02-23T13:06:07.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:06 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1456199523' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:06:07.853 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 3 16 25287 25271 526.437 532.75 0.00215948 0.00189735 2026-02-23T13:06:08.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:07 trial046 ceph-mon[38575]: pgmap v120: 17 pgs: 10 unknown, 7 active+clean; 341 MiB data, 3.4 GiB used, 2.7 TiB / 2.7 TiB avail; 85 MiB/s wr, 1.36k op/s 2026-02-23T13:06:08.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:07 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-23T13:06:08.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:07 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:06:08.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:07 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-23T13:06:08.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:07 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:06:08.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:07 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-23T13:06:08.322 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:06:08.471 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:08.607 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:08.604+0000 7fd74925c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:08.607 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:08.604+0000 7fd74925c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:08.623 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:06:08.624 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:06:08.639 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:06:08.640 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:06:08.655 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:06:08.655 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:06:08.671 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:06:08.671 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:06:08.853 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 4 16 33901 33885 529.411 538.375 0.00284019 0.00188719 2026-02-23T13:06:09.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:08 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2295207380' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:06:09.853 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 5 15 42585 42570 532.083 542.812 0.00117042 0.00187789 2026-02-23T13:06:10.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:09 trial046 ceph-mon[38575]: pgmap v121: 17 pgs: 17 active+clean; 921 MiB data, 4.3 GiB used, 2.7 TiB / 2.7 TiB avail; 157 MiB/s wr, 2.52k op/s 2026-02-23T13:06:10.716 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:06:10.824 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:06:10.825 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:06:10.825 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_1 2026-02-23T13:06:10.825 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:06:10.853 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 6 16 51192 51176 533.042 537.875 0.00170315 0.00187448 2026-02-23T13:06:10.874 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:10.982 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:10.993 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:10 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:06:10.993 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:10 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:06:10.998 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:10.996+0000 7f6f46080640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:10.999 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:10.996+0000 7f6f46080640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:11.018 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:06:11.018 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:06:11.032 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:06:11.032 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:06:11.046 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:06:11.046 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:06:11.060 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:06:11.060 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:06:11.117 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:11.114+0000 7f1d08c0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:11.117 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:11.115+0000 7f1d08c0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:11.281 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:06:11.282 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:06:11.332 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2026-02-23T13:06:10.614902+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":966197792,"num_objects":14736,"num_object_clones":0,"num_object_copies":44208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14736,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":14869,"num_write_kb":945126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":4491984,"kb_used_data":1864512,"kb_used_omap":40,"kb_used_meta":2627351,"kb_avail":2931520816,"statfs":{"total":3006477107200,"available":3001877315584,"internally_reserved":0,"allocated":1909260288,"data_stored":1907913092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41561,"internal_metadata":2690407847},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":965607424,"num_objects":14734,"num_object_clones":0,"num_object_copies":44202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14734,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14734,"num_write_kb":942976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.853186"},"pg_stats":[{"pgid":"3.f","version":"51'884","reported_seq":901,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-23T13:06:06.603457+0000","last_change":"2026-02-23T13:06:03.767923+0000","last_active":"2026-02-23T13:06:06.603457+0000","last_peered":"2026-02-23T13:06:06.603457+0000","last_clean":"2026-02-23T13:06:06.603457+0000","last_became_active":"2026-02-23T13:06:03.767261+0000","last_became_peered":"2026-02-23T13:06:03.767261+0000","last_unstale":"2026-02-23T13:06:06.603457+0000","last_undegraded":"2026-02-23T13:06:06.603457+0000","last_fullsized":"2026-02-23T13:06:06.603457+0000","mapping_epoch":48,"log_start":"51'881","ondisk_log_start":"51'881","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":881,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:03.601624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57933824,"num_objects":884,"num_object_clones":0,"num_object_copies":2652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":884,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":884,"num_write_kb":56576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"51'893","reported_seq":909,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-23T13:06:06.606032+0000","last_change":"2026-02-23T13:06:03.768354+0000","last_active":"2026-02-23T13:06:06.606032+0000","last_peered":"2026-02-23T13:06:06.606032+0000","last_clean":"2026-02-23T13:06:06.606032+0000","last_became_active":"2026-02-23T13:06:03.767822+0000","last_became_peered":"2026-02-23T13:06:03.767822+0000","last_unstale":"2026-02-23T13:06:06.606032+0000","last_undegraded":"2026-02-23T13:06:06.606032+0000","last_fullsized":"2026-02-23T13:06:06.606032+0000","mapping_epoch":48,"log_start":"51'890","ondisk_log_start":"51'890","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":890,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:08.333552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58523648,"num_objects":893,"num_object_clones":0,"num_object_copies":2679,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":893,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":893,"num_write_kb":57152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"51'959","reported_seq":976,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-23T13:06:06.612797+0000","last_change":"2026-02-23T13:06:03.769230+0000","last_active":"2026-02-23T13:06:06.612797+0000","last_peered":"2026-02-23T13:06:06.612797+0000","last_clean":"2026-02-23T13:06:06.612797+0000","last_became_active":"2026-02-23T13:06:03.768946+0000","last_became_peered":"2026-02-23T13:06:03.768946+0000","last_unstale":"2026-02-23T13:06:06.612797+0000","last_undegraded":"2026-02-23T13:06:06.612797+0000","last_fullsized":"2026-02-23T13:06:06.612797+0000","mapping_epoch":48,"log_start":"51'956","ondisk_log_start":"51'956","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":956,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:12.085194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62849024,"num_objects":959,"num_object_clones":0,"num_object_copies":2877,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":959,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":959,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"51'908","reported_seq":924,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-23T13:06:06.611806+0000","last_change":"2026-02-23T13:06:03.767398+0000","last_active":"2026-02-23T13:06:06.611806+0000","last_peered":"2026-02-23T13:06:06.611806+0000","last_clean":"2026-02-23T13:06:06.611806+0000","last_became_active":"2026-02-23T13:06:03.767083+0000","last_became_peered":"2026-02-23T13:06:03.767083+0000","last_unstale":"2026-02-23T13:06:06.611806+0000","last_undegraded":"2026-02-23T13:06:06.611806+0000","last_fullsized":"2026-02-23T13:06:06.611806+0000","mapping_epoch":48,"log_start":"51'905","ondisk_log_start":"51'905","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":905,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:04.281461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59506688,"num_objects":908,"num_object_clones":0,"num_object_copies":2724,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":908,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":908,"num_write_kb":58112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"51'912","reported_seq":929,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-23T13:06:06.649660+0000","last_change":"2026-02-23T13:06:03.767015+0000","last_active":"2026-02-23T13:06:06.649660+0000","last_peered":"2026-02-23T13:06:06.649660+0000","last_clean":"2026-02-23T13:06:06.649660+0000","last_became_active":"2026-02-23T13:06:03.766614+0000","last_became_peered":"2026-02-23T13:06:03.766614+0000","last_unstale":"2026-02-23T13:06:06.649660+0000","last_undegraded":"2026-02-23T13:06:06.649660+0000","last_fullsized":"2026-02-23T13:06:06.649660+0000","mapping_epoch":48,"log_start":"51'909","ondisk_log_start":"51'909","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":909,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:18.726818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59768832,"num_objects":912,"num_object_clones":0,"num_object_copies":2736,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":912,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":912,"num_write_kb":58368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"51'892","reported_seq":909,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-23T13:06:06.616529+0000","last_change":"2026-02-23T13:06:03.768603+0000","last_active":"2026-02-23T13:06:06.616529+0000","last_peered":"2026-02-23T13:06:06.616529+0000","last_clean":"2026-02-23T13:06:06.616529+0000","last_became_active":"2026-02-23T13:06:03.768238+0000","last_became_peered":"2026-02-23T13:06:03.768238+0000","last_unstale":"2026-02-23T13:06:06.616529+0000","last_undegraded":"2026-02-23T13:06:06.616529+0000","last_fullsized":"2026-02-23T13:06:06.616529+0000","mapping_epoch":48,"log_start":"51'889","ondisk_log_start":"51'889","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":889,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:31.494952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58458112,"num_objects":892,"num_object_clones":0,"num_object_copies":2676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":892,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":892,"num_write_kb":57088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"51'878","reported_seq":894,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-23T13:06:06.614223+0000","last_change":"2026-02-23T13:06:03.768373+0000","last_active":"2026-02-23T13:06:06.614223+0000","last_peered":"2026-02-23T13:06:06.614223+0000","last_clean":"2026-02-23T13:06:06.614223+0000","last_became_active":"2026-02-23T13:06:03.767947+0000","last_became_peered":"2026-02-23T13:06:03.767947+0000","last_unstale":"2026-02-23T13:06:06.614223+0000","last_undegraded":"2026-02-23T13:06:06.614223+0000","last_fullsized":"2026-02-23T13:06:06.614223+0000","mapping_epoch":48,"log_start":"51'875","ondisk_log_start":"51'875","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":875,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:11.458466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57540608,"num_objects":878,"num_object_clones":0,"num_object_copies":2634,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":878,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":878,"num_write_kb":56192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"51'932","reported_seq":949,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-23T13:06:06.649697+0000","last_change":"2026-02-23T13:06:03.767140+0000","last_active":"2026-02-23T13:06:06.649697+0000","last_peered":"2026-02-23T13:06:06.649697+0000","last_clean":"2026-02-23T13:06:06.649697+0000","last_became_active":"2026-02-23T13:06:03.766859+0000","last_became_peered":"2026-02-23T13:06:03.766859+0000","last_unstale":"2026-02-23T13:06:06.649697+0000","last_undegraded":"2026-02-23T13:06:06.649697+0000","last_fullsized":"2026-02-23T13:06:06.649697+0000","mapping_epoch":48,"log_start":"51'929","ondisk_log_start":"51'929","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":929,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:31.961962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61079552,"num_objects":932,"num_object_clones":0,"num_object_copies":2796,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":932,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":932,"num_write_kb":59648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"51'911","reported_seq":927,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-23T13:06:06.650603+0000","last_change":"2026-02-23T13:06:03.765755+0000","last_active":"2026-02-23T13:06:06.650603+0000","last_peered":"2026-02-23T13:06:06.650603+0000","last_clean":"2026-02-23T13:06:06.650603+0000","last_became_active":"2026-02-23T13:06:03.765502+0000","last_became_peered":"2026-02-23T13:06:03.765502+0000","last_unstale":"2026-02-23T13:06:06.650603+0000","last_undegraded":"2026-02-23T13:06:06.650603+0000","last_fullsized":"2026-02-23T13:06:06.650603+0000","mapping_epoch":48,"log_start":"51'908","ondisk_log_start":"51'908","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":908,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:22.753593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59703296,"num_objects":911,"num_object_clones":0,"num_object_copies":2733,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":911,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":911,"num_write_kb":58304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"51'927","reported_seq":944,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-23T13:06:06.602212+0000","last_change":"2026-02-23T13:06:03.767303+0000","last_active":"2026-02-23T13:06:06.602212+0000","last_peered":"2026-02-23T13:06:06.602212+0000","last_clean":"2026-02-23T13:06:06.602212+0000","last_became_active":"2026-02-23T13:06:03.767012+0000","last_became_peered":"2026-02-23T13:06:03.767012+0000","last_unstale":"2026-02-23T13:06:06.602212+0000","last_undegraded":"2026-02-23T13:06:06.602212+0000","last_fullsized":"2026-02-23T13:06:06.602212+0000","mapping_epoch":48,"log_start":"51'924","ondisk_log_start":"51'924","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":924,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:17.178309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60751872,"num_objects":927,"num_object_clones":0,"num_object_copies":2781,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":927,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":927,"num_write_kb":59328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"51'916","reported_seq":931,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-23T13:06:06.603496+0000","last_change":"2026-02-23T13:06:03.767897+0000","last_active":"2026-02-23T13:06:06.603496+0000","last_peered":"2026-02-23T13:06:06.603496+0000","last_clean":"2026-02-23T13:06:06.603496+0000","last_became_active":"2026-02-23T13:06:03.767200+0000","last_became_peered":"2026-02-23T13:06:03.767200+0000","last_unstale":"2026-02-23T13:06:06.603496+0000","last_undegraded":"2026-02-23T13:06:06.603496+0000","last_fullsized":"2026-02-23T13:06:06.603496+0000","mapping_epoch":48,"log_start":"51'913","ondisk_log_start":"51'913","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":913,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:25.974637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60030976,"num_objects":916,"num_object_clones":0,"num_object_copies":2748,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":916,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":916,"num_write_kb":58624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"51'976","reported_seq":992,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-23T13:06:06.649786+0000","last_change":"2026-02-23T13:06:03.766820+0000","last_active":"2026-02-23T13:06:06.649786+0000","last_peered":"2026-02-23T13:06:06.649786+0000","last_clean":"2026-02-23T13:06:06.649786+0000","last_became_active":"2026-02-23T13:06:03.766415+0000","last_became_peered":"2026-02-23T13:06:03.766415+0000","last_unstale":"2026-02-23T13:06:06.649786+0000","last_undegraded":"2026-02-23T13:06:06.649786+0000","last_fullsized":"2026-02-23T13:06:06.649786+0000","mapping_epoch":48,"log_start":"51'973","ondisk_log_start":"51'973","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":973,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:13.527005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63963136,"num_objects":976,"num_object_clones":0,"num_object_copies":2928,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":976,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":976,"num_write_kb":62464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"51'877","reported_seq":894,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-23T13:06:06.606532+0000","last_change":"2026-02-23T13:06:03.768871+0000","last_active":"2026-02-23T13:06:06.606532+0000","last_peered":"2026-02-23T13:06:06.606532+0000","last_clean":"2026-02-23T13:06:06.606532+0000","last_became_active":"2026-02-23T13:06:03.768541+0000","last_became_peered":"2026-02-23T13:06:03.768541+0000","last_unstale":"2026-02-23T13:06:06.606532+0000","last_undegraded":"2026-02-23T13:06:06.606532+0000","last_fullsized":"2026-02-23T13:06:06.606532+0000","mapping_epoch":48,"log_start":"51'874","ondisk_log_start":"51'874","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":874,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:31.580504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57475072,"num_objects":877,"num_object_clones":0,"num_object_copies":2631,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":877,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":877,"num_write_kb":56128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"51'956","reported_seq":972,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-23T13:06:06.598083+0000","last_change":"2026-02-23T13:06:03.767275+0000","last_active":"2026-02-23T13:06:06.598083+0000","last_peered":"2026-02-23T13:06:06.598083+0000","last_clean":"2026-02-23T13:06:06.598083+0000","last_became_active":"2026-02-23T13:06:03.767001+0000","last_became_peered":"2026-02-23T13:06:03.767001+0000","last_unstale":"2026-02-23T13:06:06.598083+0000","last_undegraded":"2026-02-23T13:06:06.598083+0000","last_fullsized":"2026-02-23T13:06:06.598083+0000","mapping_epoch":48,"log_start":"51'953","ondisk_log_start":"51'953","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":953,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:26.398327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62652416,"num_objects":956,"num_object_clones":0,"num_object_copies":2868,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":956,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":956,"num_write_kb":61184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"51'969","reported_seq":986,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-23T13:06:06.649513+0000","last_change":"2026-02-23T13:06:03.767357+0000","last_active":"2026-02-23T13:06:06.649513+0000","last_peered":"2026-02-23T13:06:06.649513+0000","last_clean":"2026-02-23T13:06:06.649513+0000","last_became_active":"2026-02-23T13:06:03.766997+0000","last_became_peered":"2026-02-23T13:06:03.766997+0000","last_unstale":"2026-02-23T13:06:06.649513+0000","last_undegraded":"2026-02-23T13:06:06.649513+0000","last_fullsized":"2026-02-23T13:06:06.649513+0000","mapping_epoch":48,"log_start":"51'966","ondisk_log_start":"51'966","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":966,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:12.767525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63504384,"num_objects":969,"num_object_clones":0,"num_object_copies":2907,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":969,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":969,"num_write_kb":62016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"51'944","reported_seq":960,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-23T13:06:06.649268+0000","last_change":"2026-02-23T13:06:03.767298+0000","last_active":"2026-02-23T13:06:06.649268+0000","last_peered":"2026-02-23T13:06:06.649268+0000","last_clean":"2026-02-23T13:06:06.649268+0000","last_became_active":"2026-02-23T13:06:03.767015+0000","last_became_peered":"2026-02-23T13:06:03.767015+0000","last_unstale":"2026-02-23T13:06:06.649268+0000","last_undegraded":"2026-02-23T13:06:06.649268+0000","last_fullsized":"2026-02-23T13:06:06.649268+0000","mapping_epoch":48,"log_start":"51'941","ondisk_log_start":"51'941","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":941,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:24.748738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61865984,"num_objects":944,"num_object_clones":0,"num_object_copies":2832,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":944,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":944,"num_write_kb":60416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":247,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-23T13:06:05.772965+0000","last_change":"2026-02-23T13:05:29.192008+0000","last_active":"2026-02-23T13:06:05.772965+0000","last_peered":"2026-02-23T13:06:05.772965+0000","last_clean":"2026-02-23T13:06:05.772965+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:06:05.772965+0000","last_undegraded":"2026-02-23T13:06:05.772965+0000","last_fullsized":"2026-02-23T13:06:05.772965+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:05:29.191972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:05:29.191972+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:50.435825+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":965607424,"num_objects":14734,"num_object_clones":0,"num_object_copies":44202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14734,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14734,"num_write_kb":942976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2883321856,"data_stored":2883321856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1116,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247848,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1454488,"kb_used_data":446916,"kb_used_omap":10,"kb_used_meta":1007541,"kb_avail":732548712,"statfs":{"total":751619276800,"available":750129881088,"internally_reserved":0,"allocated":457641984,"data_stored":457302411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10277,"internal_metadata":1031722971},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444075,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1153752,"kb_used_data":660548,"kb_used_omap":10,"kb_used_meta":493173,"kb_avail":732849448,"statfs":{"total":751619276800,"available":750437834752,"internally_reserved":0,"allocated":676401152,"data_stored":676061579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10439,"internal_metadata":505009977},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1022932,"kb_used_data":391296,"kb_used_omap":10,"kb_used_meta":631605,"kb_avail":732980268,"statfs":{"total":751619276800,"available":750571794432,"internally_reserved":0,"allocated":400687104,"data_stored":400351083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11179,"internal_metadata":646763605},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705710,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":860812,"kb_used_data":365752,"kb_used_omap":9,"kb_used_meta":495030,"kb_avail":733142388,"statfs":{"total":751619276800,"available":750737805312,"internally_reserved":0,"allocated":374530048,"data_stored":374198019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9666,"internal_metadata":506911294},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1116,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":777125888,"data_stored":777125888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":676003840,"data_stored":676003840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":837419008,"data_stored":837419008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":592773120,"data_stored":592773120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:06:11.334 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_1 pgp_num 16 2026-02-23T13:06:11.527 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:11.661 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:11.658+0000 7f2b216bc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:11.661 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:11.658+0000 7f2b216bc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:11.853 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 7 16 59734 59718 533.156 533.875 0.00136622 0.00187412 2026-02-23T13:06:12.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:11 trial046 ceph-mon[38575]: pgmap v122: 17 pgs: 17 active+clean; 921 MiB data, 4.3 GiB used, 2.7 TiB / 2.7 TiB avail; 134 MiB/s wr, 2.15k op/s 2026-02-23T13:06:12.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:11 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3811808491' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:06:12.782 INFO:teuthology.orchestra.run.trial046.stderr:set pool 3 pgp_num to 16 2026-02-23T13:06:12.853 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 8 15 68553 68538 535.412 551.25 0.00175217 0.00186617 2026-02-23T13:06:13.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:12 trial046 ceph-mon[38575]: from='client.14645 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:06:13.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:12 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1284245217' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_1", "var": "pgp_num", "val": "16"} : dispatch 2026-02-23T13:06:13.106 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:06:13.258 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:13.387 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:13.385+0000 7f75a2b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:13.387 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:13.385+0000 7f75a2b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:13.403 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:06:13.404 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:06:13.419 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:06:13.419 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:06:13.433 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:06:13.433 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:06:13.447 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:06:13.447 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:06:13.853 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 9 16 77036 77020 534.82 530.125 0.00284723 0.00186819 2026-02-23T13:06:14.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:13 trial046 ceph-mon[38575]: pgmap v123: 17 pgs: 17 active+clean; 3.5 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 451 MiB/s wr, 7.22k op/s 2026-02-23T13:06:14.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:13 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1284245217' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "unique_pool_1", "var": "pgp_num", "val": "16"}]': finished 2026-02-23T13:06:14.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:13 trial046 ceph-mon[38575]: osdmap e52: 4 total, 4 up, 4 in 2026-02-23T13:06:14.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:13 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3787020464' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:06:14.854 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 10 16 85624 85608 535.009 536.75 0.00127111 0.00186766 2026-02-23T13:06:15.492 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:06:15.640 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:15.854 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 11 16 93876 93860 533.232 515.75 0.000790112 0.00187246 2026-02-23T13:06:15.967 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:15.920+0000 7fe248646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:15.967 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:15.920+0000 7fe248646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:15.967 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:06:15.967 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:06:15.967 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:06:15.967 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:06:15.967 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:06:15.967 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:06:15.980 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:06:15.981 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:06:16.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:15 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:06:16.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:15 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:06:16.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:15 trial046 ceph-mon[38575]: pgmap v125: 17 pgs: 17 active+clean; 3.5 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 408 MiB/s wr, 6.53k op/s 2026-02-23T13:06:16.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:15 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:06:16.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:15 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:06:16.470 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:06:16 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:06:16.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:06:16.539 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:06:16 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:06:16] "GET /metrics HTTP/1.1" 200 4221 "" "Prometheus/3.6.0" 2026-02-23T13:06:16.854 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 12 15 100535 100520 523.481 416.25 0.00132209 0.00190892 2026-02-23T13:06:17.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:16 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:06:17.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:16 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3051694047' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:06:17.831 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:06:17.832 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:06:17.832 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:06:17.832 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:06:17.854 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 13 16 108918 108902 523.508 523.875 0.00180921 0.00190883 2026-02-23T13:06:17.981 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:18.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:17 trial046 ceph-mon[38575]: pgmap v126: 17 pgs: 17 active+clean; 4.5 GiB data, 17 GiB used, 2.7 TiB / 2.7 TiB avail; 423 MiB/s wr, 6.77k op/s 2026-02-23T13:06:18.111 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:18.109+0000 7fc535d52640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:18.111 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:18.109+0000 7fc535d52640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:18.256 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:06:18.257 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:06:18.580 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:06:18.729 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:18.805 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":126,"stamp":"2026-02-23T13:06:16.615683+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4797825568,"num_objects":73202,"num_object_clones":0,"num_object_copies":219606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73202,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":73335,"num_write_kb":4686950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":18049460,"kb_used_data":14682020,"kb_used_omap":43,"kb_used_meta":3367316,"kb_avail":2917963340,"statfs":{"total":3006477107200,"available":2987994460160,"internally_reserved":0,"allocated":15034388480,"data_stored":15033018652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44818,"internal_metadata":3448131822},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4439867392,"num_objects":67747,"num_object_clones":0,"num_object_copies":203241,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67747,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67747,"num_write_kb":4335808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001336"},"pg_stats":[{"pgid":"3.f","version":"52'6149","reported_seq":6168,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:16.608233+0000","last_change":"2026-02-23T13:06:03.767923+0000","last_active":"2026-02-23T13:06:16.608233+0000","last_peered":"2026-02-23T13:06:16.608233+0000","last_clean":"2026-02-23T13:06:16.608233+0000","last_became_active":"2026-02-23T13:06:03.767261+0000","last_became_peered":"2026-02-23T13:06:03.767261+0000","last_unstale":"2026-02-23T13:06:16.608233+0000","last_undegraded":"2026-02-23T13:06:16.608233+0000","last_fullsized":"2026-02-23T13:06:16.608233+0000","mapping_epoch":48,"log_start":"52'6146","ondisk_log_start":"52'6146","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:04.399152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402980864,"num_objects":6149,"num_object_clones":0,"num_object_copies":18447,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6149,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6149,"num_write_kb":393536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"52'6228","reported_seq":6247,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:16.606464+0000","last_change":"2026-02-23T13:06:03.768354+0000","last_active":"2026-02-23T13:06:16.606464+0000","last_peered":"2026-02-23T13:06:16.606464+0000","last_clean":"2026-02-23T13:06:16.606464+0000","last_became_active":"2026-02-23T13:06:03.767822+0000","last_became_peered":"2026-02-23T13:06:03.767822+0000","last_unstale":"2026-02-23T13:06:16.606464+0000","last_undegraded":"2026-02-23T13:06:16.606464+0000","last_fullsized":"2026-02-23T13:06:16.606464+0000","mapping_epoch":48,"log_start":"52'6225","ondisk_log_start":"52'6225","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:24.671155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408158208,"num_objects":6228,"num_object_clones":0,"num_object_copies":18684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6228,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6228,"num_write_kb":398592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"51'3656","reported_seq":3673,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-23T13:06:11.610475+0000","last_change":"2026-02-23T13:06:03.769230+0000","last_active":"2026-02-23T13:06:11.610475+0000","last_peered":"2026-02-23T13:06:11.610475+0000","last_clean":"2026-02-23T13:06:11.610475+0000","last_became_active":"2026-02-23T13:06:03.768946+0000","last_became_peered":"2026-02-23T13:06:03.768946+0000","last_unstale":"2026-02-23T13:06:11.610475+0000","last_undegraded":"2026-02-23T13:06:11.610475+0000","last_fullsized":"2026-02-23T13:06:11.610475+0000","mapping_epoch":48,"log_start":"51'3653","ondisk_log_start":"51'3653","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:12.085194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239599616,"num_objects":3656,"num_object_clones":0,"num_object_copies":10968,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3656,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3656,"num_write_kb":233984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"51'3628","reported_seq":3645,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-23T13:06:11.610529+0000","last_change":"2026-02-23T13:06:03.767398+0000","last_active":"2026-02-23T13:06:11.610529+0000","last_peered":"2026-02-23T13:06:11.610529+0000","last_clean":"2026-02-23T13:06:11.610529+0000","last_became_active":"2026-02-23T13:06:03.767083+0000","last_became_peered":"2026-02-23T13:06:03.767083+0000","last_unstale":"2026-02-23T13:06:11.610529+0000","last_undegraded":"2026-02-23T13:06:11.610529+0000","last_fullsized":"2026-02-23T13:06:11.610529+0000","mapping_epoch":48,"log_start":"51'3625","ondisk_log_start":"51'3625","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:04.281461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":237764608,"num_objects":3628,"num_object_clones":0,"num_object_copies":10884,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3628,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3628,"num_write_kb":232192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"51'3692","reported_seq":3709,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-23T13:06:11.647617+0000","last_change":"2026-02-23T13:06:03.767015+0000","last_active":"2026-02-23T13:06:11.647617+0000","last_peered":"2026-02-23T13:06:11.647617+0000","last_clean":"2026-02-23T13:06:11.647617+0000","last_became_active":"2026-02-23T13:06:03.766614+0000","last_became_peered":"2026-02-23T13:06:03.766614+0000","last_unstale":"2026-02-23T13:06:11.647617+0000","last_undegraded":"2026-02-23T13:06:11.647617+0000","last_fullsized":"2026-02-23T13:06:11.647617+0000","mapping_epoch":48,"log_start":"51'3689","ondisk_log_start":"51'3689","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:18.726818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":241958912,"num_objects":3692,"num_object_clones":0,"num_object_copies":11076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3692,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3692,"num_write_kb":236288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"51'3568","reported_seq":3585,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-23T13:06:11.616327+0000","last_change":"2026-02-23T13:06:03.768603+0000","last_active":"2026-02-23T13:06:11.616327+0000","last_peered":"2026-02-23T13:06:11.616327+0000","last_clean":"2026-02-23T13:06:11.616327+0000","last_became_active":"2026-02-23T13:06:03.768238+0000","last_became_peered":"2026-02-23T13:06:03.768238+0000","last_unstale":"2026-02-23T13:06:11.616327+0000","last_undegraded":"2026-02-23T13:06:11.616327+0000","last_fullsized":"2026-02-23T13:06:11.616327+0000","mapping_epoch":48,"log_start":"51'3565","ondisk_log_start":"51'3565","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:31.494952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":233832448,"num_objects":3568,"num_object_clones":0,"num_object_copies":10704,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3568,"num_write_kb":228352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"51'3531","reported_seq":3547,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-23T13:06:11.615099+0000","last_change":"2026-02-23T13:06:03.768373+0000","last_active":"2026-02-23T13:06:11.615099+0000","last_peered":"2026-02-23T13:06:11.615099+0000","last_clean":"2026-02-23T13:06:11.615099+0000","last_became_active":"2026-02-23T13:06:03.767947+0000","last_became_peered":"2026-02-23T13:06:03.767947+0000","last_unstale":"2026-02-23T13:06:11.615099+0000","last_undegraded":"2026-02-23T13:06:11.615099+0000","last_fullsized":"2026-02-23T13:06:11.615099+0000","mapping_epoch":48,"log_start":"51'3528","ondisk_log_start":"51'3528","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:11.458466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231407616,"num_objects":3531,"num_object_clones":0,"num_object_copies":10593,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3531,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3531,"num_write_kb":225984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"51'3608","reported_seq":3625,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-23T13:06:11.648995+0000","last_change":"2026-02-23T13:06:03.767140+0000","last_active":"2026-02-23T13:06:11.648995+0000","last_peered":"2026-02-23T13:06:11.648995+0000","last_clean":"2026-02-23T13:06:11.648995+0000","last_became_active":"2026-02-23T13:06:03.766859+0000","last_became_peered":"2026-02-23T13:06:03.766859+0000","last_unstale":"2026-02-23T13:06:11.648995+0000","last_undegraded":"2026-02-23T13:06:11.648995+0000","last_fullsized":"2026-02-23T13:06:11.648995+0000","mapping_epoch":48,"log_start":"51'3605","ondisk_log_start":"51'3605","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:31.961962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":236453888,"num_objects":3608,"num_object_clones":0,"num_object_copies":10824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3608,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3608,"num_write_kb":230912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"51'3583","reported_seq":3600,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-23T13:06:11.643750+0000","last_change":"2026-02-23T13:06:03.765755+0000","last_active":"2026-02-23T13:06:11.643750+0000","last_peered":"2026-02-23T13:06:11.643750+0000","last_clean":"2026-02-23T13:06:11.643750+0000","last_became_active":"2026-02-23T13:06:03.765502+0000","last_became_peered":"2026-02-23T13:06:03.765502+0000","last_unstale":"2026-02-23T13:06:11.643750+0000","last_undegraded":"2026-02-23T13:06:11.643750+0000","last_fullsized":"2026-02-23T13:06:11.643750+0000","mapping_epoch":48,"log_start":"51'3580","ondisk_log_start":"51'3580","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:22.753593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234815488,"num_objects":3583,"num_object_clones":0,"num_object_copies":10749,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3583,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3583,"num_write_kb":229312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"52'6224","reported_seq":6244,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:16.603692+0000","last_change":"2026-02-23T13:06:03.767303+0000","last_active":"2026-02-23T13:06:16.603692+0000","last_peered":"2026-02-23T13:06:16.603692+0000","last_clean":"2026-02-23T13:06:16.603692+0000","last_became_active":"2026-02-23T13:06:03.767012+0000","last_became_peered":"2026-02-23T13:06:03.767012+0000","last_unstale":"2026-02-23T13:06:16.603692+0000","last_undegraded":"2026-02-23T13:06:16.603692+0000","last_fullsized":"2026-02-23T13:06:16.603692+0000","mapping_epoch":48,"log_start":"52'6221","ondisk_log_start":"52'6221","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:22.659298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407896064,"num_objects":6224,"num_object_clones":0,"num_object_copies":18672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6224,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6224,"num_write_kb":398336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"52'6143","reported_seq":6163,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:16.605341+0000","last_change":"2026-02-23T13:06:03.767897+0000","last_active":"2026-02-23T13:06:16.605341+0000","last_peered":"2026-02-23T13:06:16.605341+0000","last_clean":"2026-02-23T13:06:16.605341+0000","last_became_active":"2026-02-23T13:06:03.767200+0000","last_became_peered":"2026-02-23T13:06:03.767200+0000","last_unstale":"2026-02-23T13:06:16.605341+0000","last_undegraded":"2026-02-23T13:06:16.605341+0000","last_fullsized":"2026-02-23T13:06:16.605341+0000","mapping_epoch":48,"log_start":"52'6140","ondisk_log_start":"52'6140","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:14.434473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402587648,"num_objects":6143,"num_object_clones":0,"num_object_copies":18429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6143,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6143,"num_write_kb":393152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"51'3577","reported_seq":3594,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-23T13:06:11.648560+0000","last_change":"2026-02-23T13:06:03.766820+0000","last_active":"2026-02-23T13:06:11.648560+0000","last_peered":"2026-02-23T13:06:11.648560+0000","last_clean":"2026-02-23T13:06:11.648560+0000","last_became_active":"2026-02-23T13:06:03.766415+0000","last_became_peered":"2026-02-23T13:06:03.766415+0000","last_unstale":"2026-02-23T13:06:11.648560+0000","last_undegraded":"2026-02-23T13:06:11.648560+0000","last_fullsized":"2026-02-23T13:06:11.648560+0000","mapping_epoch":48,"log_start":"51'3574","ondisk_log_start":"51'3574","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:13.527005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234422272,"num_objects":3577,"num_object_clones":0,"num_object_copies":10731,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3577,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3577,"num_write_kb":228928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"52'6116","reported_seq":6136,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:16.604257+0000","last_change":"2026-02-23T13:06:03.768871+0000","last_active":"2026-02-23T13:06:16.604257+0000","last_peered":"2026-02-23T13:06:16.604257+0000","last_clean":"2026-02-23T13:06:16.604257+0000","last_became_active":"2026-02-23T13:06:03.768541+0000","last_became_peered":"2026-02-23T13:06:03.768541+0000","last_unstale":"2026-02-23T13:06:16.604257+0000","last_undegraded":"2026-02-23T13:06:16.604257+0000","last_fullsized":"2026-02-23T13:06:16.604257+0000","mapping_epoch":48,"log_start":"52'6113","ondisk_log_start":"52'6113","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:31.119570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":400818176,"num_objects":6116,"num_object_clones":0,"num_object_copies":18348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6116,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6116,"num_write_kb":391424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"52'6125","reported_seq":6145,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:16.599333+0000","last_change":"2026-02-23T13:06:03.767275+0000","last_active":"2026-02-23T13:06:16.599333+0000","last_peered":"2026-02-23T13:06:16.599333+0000","last_clean":"2026-02-23T13:06:16.599333+0000","last_became_active":"2026-02-23T13:06:03.767001+0000","last_became_peered":"2026-02-23T13:06:03.767001+0000","last_unstale":"2026-02-23T13:06:16.599333+0000","last_undegraded":"2026-02-23T13:06:16.599333+0000","last_fullsized":"2026-02-23T13:06:16.599333+0000","mapping_epoch":48,"log_start":"52'6122","ondisk_log_start":"52'6122","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:12.872474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401408000,"num_objects":6125,"num_object_clones":0,"num_object_copies":18375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6125,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6125,"num_write_kb":392000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"51'3696","reported_seq":3713,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-23T13:06:11.645427+0000","last_change":"2026-02-23T13:06:03.767357+0000","last_active":"2026-02-23T13:06:11.645427+0000","last_peered":"2026-02-23T13:06:11.645427+0000","last_clean":"2026-02-23T13:06:11.645427+0000","last_became_active":"2026-02-23T13:06:03.766997+0000","last_became_peered":"2026-02-23T13:06:03.766997+0000","last_unstale":"2026-02-23T13:06:11.645427+0000","last_undegraded":"2026-02-23T13:06:11.645427+0000","last_fullsized":"2026-02-23T13:06:11.645427+0000","mapping_epoch":48,"log_start":"51'3693","ondisk_log_start":"51'3693","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:12.767525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":242221056,"num_objects":3696,"num_object_clones":0,"num_object_copies":11088,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3696,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3696,"num_write_kb":236544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"51'3676","reported_seq":3693,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-23T13:06:11.643777+0000","last_change":"2026-02-23T13:06:03.767298+0000","last_active":"2026-02-23T13:06:11.643777+0000","last_peered":"2026-02-23T13:06:11.643777+0000","last_clean":"2026-02-23T13:06:11.643777+0000","last_became_active":"2026-02-23T13:06:03.767015+0000","last_became_peered":"2026-02-23T13:06:03.767015+0000","last_unstale":"2026-02-23T13:06:11.643777+0000","last_undegraded":"2026-02-23T13:06:11.643777+0000","last_fullsized":"2026-02-23T13:06:11.643777+0000","mapping_epoch":48,"log_start":"51'3673","ondisk_log_start":"51'3673","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:24.748738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":240910336,"num_objects":3676,"num_object_clones":0,"num_object_copies":11028,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3676,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3676,"num_write_kb":235264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":247,"reported_epoch":51,"state":"active+clean","last_fresh":"2026-02-23T13:06:05.772965+0000","last_change":"2026-02-23T13:05:29.192008+0000","last_active":"2026-02-23T13:06:05.772965+0000","last_peered":"2026-02-23T13:06:05.772965+0000","last_clean":"2026-02-23T13:06:05.772965+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:06:05.772965+0000","last_undegraded":"2026-02-23T13:06:05.772965+0000","last_fullsized":"2026-02-23T13:06:05.772965+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:05:29.191972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:05:29.191972+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:50.435825+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":4797235200,"num_objects":73200,"num_object_clones":0,"num_object_copies":219600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73200,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73200,"num_write_kb":4684800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15883960320,"data_stored":15883960320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1116,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247849,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3256280,"kb_used_data":2176516,"kb_used_omap":10,"kb_used_meta":1079733,"kb_avail":730746920,"statfs":{"total":751619276800,"available":748284846080,"internally_reserved":0,"allocated":2228752384,"data_stored":2228412811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10277,"internal_metadata":1105647579},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444077,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6192740,"kb_used_data":5392720,"kb_used_omap":11,"kb_used_meta":799988,"kb_avail":727810460,"statfs":{"total":751619276800,"available":745277911040,"internally_reserved":0,"allocated":5522145280,"data_stored":5521798163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11743,"internal_metadata":819188257},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3034580,"kb_used_data":2294656,"kb_used_omap":11,"kb_used_meta":739892,"kb_avail":730968620,"statfs":{"total":751619276800,"available":748511866880,"internally_reserved":0,"allocated":2349727744,"data_stored":2349391723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11828,"internal_metadata":757649868},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705712,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5565860,"kb_used_data":4818128,"kb_used_omap":10,"kb_used_meta":747701,"kb_avail":728437340,"statfs":{"total":751619276800,"available":745919836160,"internally_reserved":0,"allocated":4933763072,"data_stored":4933415955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10970,"internal_metadata":765646118},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1116,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5256577024,"data_stored":5256577024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2615672832,"data_stored":2615672832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5653004288,"data_stored":5653004288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2358706176,"data_stored":2358706176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:06:18.806 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:06:18.806 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 61 2026-02-23T13:06:18.854 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 14 16 115767 115751 516.689 428.062 0.00196355 0.00193396 2026-02-23T13:06:18.906 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:18.904+0000 7f9f6b707640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:18.906 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:18.905+0000 7f9f6b707640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:18.924 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:06:18.924 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:06:18.940 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:06:18.940 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:06:18.953 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:06:18.953 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:06:18.966 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:06:18.966 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:06:18.970 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:19.095 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:19.093+0000 7fe088a47640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:19.095 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:19.093+0000 7fe088a47640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:19.247 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:06:19.288 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:06:19.854 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 15 16 124114 124098 517.019 521.688 0.00266373 0.00193279 2026-02-23T13:06:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:19 trial046 ceph-mon[38575]: from='client.14653 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:06:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:19 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:06:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:19 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:06:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:19 trial046 ceph-mon[38575]: pgmap v127: 17 pgs: 17 active+clean; 6.0 GiB data, 21 GiB used, 2.7 TiB / 2.7 TiB avail; 526 MiB/s wr, 8.41k op/s 2026-02-23T13:06:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:19 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4175137582' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:06:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:19 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2341168098' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "61"} : dispatch 2026-02-23T13:06:20.854 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 16 16 132551 132535 517.66 527.312 0.00185618 0.00193034 2026-02-23T13:06:21.017 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:06:21.166 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:21.288 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:21.286+0000 7f1a037f3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:21.288 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:21.286+0000 7f1a037f3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:21.302 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:06:21.303 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:06:21.317 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:06:21.318 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:06:21.333 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:06:21.333 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:06:21.348 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:06:21.349 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:06:21.854 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 17 16 140712 140696 517.211 510.062 0.00206321 0.00193208 2026-02-23T13:06:22.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:21 trial046 ceph-mon[38575]: pgmap v128: 17 pgs: 17 active+clean; 6.0 GiB data, 21 GiB used, 2.7 TiB / 2.7 TiB avail; 526 MiB/s wr, 8.41k op/s 2026-02-23T13:06:22.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:21 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3842921450' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:06:22.854 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 18 16 149068 149052 517.489 522.25 0.00173984 0.00193105 2026-02-23T13:06:23.399 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:06:23.550 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:23.675 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:23.673+0000 7f19f2bed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:23.675 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:23.673+0000 7f19f2bed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:23.690 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:06:23.690 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:06:23.706 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:06:23.707 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:06:23.720 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:06:23.720 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:06:23.736 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:06:23.736 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:06:23.854 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 19 16 157515 157499 518.036 527.938 0.0011005 0.00192896 2026-02-23T13:06:24.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:23 trial046 ceph-mon[38575]: pgmap v129: 17 pgs: 17 active+clean; 8.5 GiB data, 28 GiB used, 2.7 TiB / 2.7 TiB avail; 508 MiB/s wr, 8.12k op/s 2026-02-23T13:06:24.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:23 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1195465880' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:06:24.289 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:06:24.290 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:06:24.290 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_1 2026-02-23T13:06:24.290 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:06:24.434 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:24.832 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:24.822+0000 7fa4cdc85640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:24.832 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:24.822+0000 7fa4cdc85640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:24.854 INFO:tasks.radosbench.radosbench.0.trial046.stdout:2026-02-23T13:06:24.854212+0000 min lat: 0.00073045 max lat: 0.0367133 avg lat: 0.00193817 2026-02-23T13:06:24.854 INFO:tasks.radosbench.radosbench.0.trial046.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-23T13:06:24.854 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 20 15 165022 165007 515.595 469.25 0.00175622 0.00193817 2026-02-23T13:06:24.963 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:06:24.964 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:06:25.568 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":130,"stamp":"2026-02-23T13:06:24.616809+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":9110815264,"num_objects":139013,"num_object_clones":0,"num_object_copies":417039,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139013,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":139146,"num_write_kb":8898854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":29813068,"kb_used_data":25782652,"kb_used_omap":45,"kb_used_meta":4030290,"kb_avail":2906199732,"statfs":{"total":3006477107200,"available":2975948525568,"internally_reserved":0,"allocated":26401435648,"data_stored":26400050732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46688,"internal_metadata":4127017376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5324472320,"num_objects":81245,"num_object_clones":0,"num_object_copies":243735,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81245,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81245,"num_write_kb":5199680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.835413"},"pg_stats":[{"pgid":"3.f","version":"52'8668","reported_seq":8688,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:21.603969+0000","last_change":"2026-02-23T13:06:03.767923+0000","last_active":"2026-02-23T13:06:21.603969+0000","last_peered":"2026-02-23T13:06:21.603969+0000","last_clean":"2026-02-23T13:06:21.603969+0000","last_became_active":"2026-02-23T13:06:03.767261+0000","last_became_peered":"2026-02-23T13:06:03.767261+0000","last_unstale":"2026-02-23T13:06:21.603969+0000","last_undegraded":"2026-02-23T13:06:21.603969+0000","last_fullsized":"2026-02-23T13:06:21.603969+0000","mapping_epoch":48,"log_start":"52'8665","ondisk_log_start":"52'8665","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:04.399152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568066048,"num_objects":8668,"num_object_clones":0,"num_object_copies":26004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8668,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8668,"num_write_kb":554752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"52'8763","reported_seq":8782,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:21.606486+0000","last_change":"2026-02-23T13:06:03.768354+0000","last_active":"2026-02-23T13:06:21.606486+0000","last_peered":"2026-02-23T13:06:21.606486+0000","last_clean":"2026-02-23T13:06:21.606486+0000","last_became_active":"2026-02-23T13:06:03.767822+0000","last_became_peered":"2026-02-23T13:06:03.767822+0000","last_unstale":"2026-02-23T13:06:21.606486+0000","last_undegraded":"2026-02-23T13:06:21.606486+0000","last_fullsized":"2026-02-23T13:06:21.606486+0000","mapping_epoch":48,"log_start":"52'8760","ondisk_log_start":"52'8760","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:24.671155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574291968,"num_objects":8763,"num_object_clones":0,"num_object_copies":26289,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8763,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8763,"num_write_kb":560832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"52'8640","reported_seq":8660,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:21.603414+0000","last_change":"2026-02-23T13:06:03.769230+0000","last_active":"2026-02-23T13:06:21.603414+0000","last_peered":"2026-02-23T13:06:21.603414+0000","last_clean":"2026-02-23T13:06:21.603414+0000","last_became_active":"2026-02-23T13:06:03.768946+0000","last_became_peered":"2026-02-23T13:06:03.768946+0000","last_unstale":"2026-02-23T13:06:21.603414+0000","last_undegraded":"2026-02-23T13:06:21.603414+0000","last_fullsized":"2026-02-23T13:06:21.603414+0000","mapping_epoch":48,"log_start":"52'8637","ondisk_log_start":"52'8637","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:26.718468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566231040,"num_objects":8640,"num_object_clones":0,"num_object_copies":25920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8640,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8640,"num_write_kb":552960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"52'8769","reported_seq":8788,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:21.616783+0000","last_change":"2026-02-23T13:06:03.767398+0000","last_active":"2026-02-23T13:06:21.616783+0000","last_peered":"2026-02-23T13:06:21.616783+0000","last_clean":"2026-02-23T13:06:21.616783+0000","last_became_active":"2026-02-23T13:06:03.767083+0000","last_became_peered":"2026-02-23T13:06:03.767083+0000","last_unstale":"2026-02-23T13:06:21.616783+0000","last_undegraded":"2026-02-23T13:06:21.616783+0000","last_fullsized":"2026-02-23T13:06:21.616783+0000","mapping_epoch":48,"log_start":"52'8766","ondisk_log_start":"52'8766","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:32.716724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574685184,"num_objects":8769,"num_object_clones":0,"num_object_copies":26307,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8769,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8769,"num_write_kb":561216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"52'8624","reported_seq":8644,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:21.648344+0000","last_change":"2026-02-23T13:06:03.767015+0000","last_active":"2026-02-23T13:06:21.648344+0000","last_peered":"2026-02-23T13:06:21.648344+0000","last_clean":"2026-02-23T13:06:21.648344+0000","last_became_active":"2026-02-23T13:06:03.766614+0000","last_became_peered":"2026-02-23T13:06:03.766614+0000","last_unstale":"2026-02-23T13:06:21.648344+0000","last_undegraded":"2026-02-23T13:06:21.648344+0000","last_fullsized":"2026-02-23T13:06:21.648344+0000","mapping_epoch":48,"log_start":"52'8621","ondisk_log_start":"52'8621","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:15.375425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":565182464,"num_objects":8624,"num_object_clones":0,"num_object_copies":25872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8624,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8624,"num_write_kb":551936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"52'8502","reported_seq":8522,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:21.603874+0000","last_change":"2026-02-23T13:06:03.768603+0000","last_active":"2026-02-23T13:06:21.603874+0000","last_peered":"2026-02-23T13:06:21.603874+0000","last_clean":"2026-02-23T13:06:21.603874+0000","last_became_active":"2026-02-23T13:06:03.768238+0000","last_became_peered":"2026-02-23T13:06:03.768238+0000","last_unstale":"2026-02-23T13:06:21.603874+0000","last_undegraded":"2026-02-23T13:06:21.603874+0000","last_fullsized":"2026-02-23T13:06:21.603874+0000","mapping_epoch":48,"log_start":"52'8499","ondisk_log_start":"52'8499","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:11.493313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":557187072,"num_objects":8502,"num_object_clones":0,"num_object_copies":25506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8502,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8502,"num_write_kb":544128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"52'8581","reported_seq":8601,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:21.611246+0000","last_change":"2026-02-23T13:06:03.768373+0000","last_active":"2026-02-23T13:06:21.611246+0000","last_peered":"2026-02-23T13:06:21.611246+0000","last_clean":"2026-02-23T13:06:21.611246+0000","last_became_active":"2026-02-23T13:06:03.767947+0000","last_became_peered":"2026-02-23T13:06:03.767947+0000","last_unstale":"2026-02-23T13:06:21.611246+0000","last_undegraded":"2026-02-23T13:06:21.611246+0000","last_fullsized":"2026-02-23T13:06:21.611246+0000","mapping_epoch":48,"log_start":"52'8578","ondisk_log_start":"52'8578","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:05.474616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":562364416,"num_objects":8581,"num_object_clones":0,"num_object_copies":25743,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8581,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8581,"num_write_kb":549184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"52'8755","reported_seq":8775,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:21.650706+0000","last_change":"2026-02-23T13:06:03.767140+0000","last_active":"2026-02-23T13:06:21.650706+0000","last_peered":"2026-02-23T13:06:21.650706+0000","last_clean":"2026-02-23T13:06:21.650706+0000","last_became_active":"2026-02-23T13:06:03.766859+0000","last_became_peered":"2026-02-23T13:06:03.766859+0000","last_unstale":"2026-02-23T13:06:21.650706+0000","last_undegraded":"2026-02-23T13:06:21.650706+0000","last_fullsized":"2026-02-23T13:06:21.650706+0000","mapping_epoch":48,"log_start":"52'8752","ondisk_log_start":"52'8752","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:26.334481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":573767680,"num_objects":8755,"num_object_clones":0,"num_object_copies":26265,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8755,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8755,"num_write_kb":560320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"52'8717","reported_seq":8736,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:21.650595+0000","last_change":"2026-02-23T13:06:03.765755+0000","last_active":"2026-02-23T13:06:21.650595+0000","last_peered":"2026-02-23T13:06:21.650595+0000","last_clean":"2026-02-23T13:06:21.650595+0000","last_became_active":"2026-02-23T13:06:03.765502+0000","last_became_peered":"2026-02-23T13:06:03.765502+0000","last_unstale":"2026-02-23T13:06:21.650595+0000","last_undegraded":"2026-02-23T13:06:21.650595+0000","last_fullsized":"2026-02-23T13:06:21.650595+0000","mapping_epoch":48,"log_start":"52'8714","ondisk_log_start":"52'8714","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:14.075905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":571277312,"num_objects":8717,"num_object_clones":0,"num_object_copies":26151,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8717,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8717,"num_write_kb":557888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"52'8789","reported_seq":8809,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:21.599267+0000","last_change":"2026-02-23T13:06:03.767303+0000","last_active":"2026-02-23T13:06:21.599267+0000","last_peered":"2026-02-23T13:06:21.599267+0000","last_clean":"2026-02-23T13:06:21.599267+0000","last_became_active":"2026-02-23T13:06:03.767012+0000","last_became_peered":"2026-02-23T13:06:03.767012+0000","last_unstale":"2026-02-23T13:06:21.599267+0000","last_undegraded":"2026-02-23T13:06:21.599267+0000","last_fullsized":"2026-02-23T13:06:21.599267+0000","mapping_epoch":48,"log_start":"52'8786","ondisk_log_start":"52'8786","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:22.659298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575995904,"num_objects":8789,"num_object_clones":0,"num_object_copies":26367,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8789,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8789,"num_write_kb":562496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"52'8588","reported_seq":8608,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:21.605638+0000","last_change":"2026-02-23T13:06:03.767897+0000","last_active":"2026-02-23T13:06:21.605638+0000","last_peered":"2026-02-23T13:06:21.605638+0000","last_clean":"2026-02-23T13:06:21.605638+0000","last_became_active":"2026-02-23T13:06:03.767200+0000","last_became_peered":"2026-02-23T13:06:03.767200+0000","last_unstale":"2026-02-23T13:06:21.605638+0000","last_undegraded":"2026-02-23T13:06:21.605638+0000","last_fullsized":"2026-02-23T13:06:21.605638+0000","mapping_epoch":48,"log_start":"52'8585","ondisk_log_start":"52'8585","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:14.434473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":562823168,"num_objects":8588,"num_object_clones":0,"num_object_copies":25764,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8588,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8588,"num_write_kb":549632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"52'8726","reported_seq":8746,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:21.648150+0000","last_change":"2026-02-23T13:06:03.766820+0000","last_active":"2026-02-23T13:06:21.648150+0000","last_peered":"2026-02-23T13:06:21.648150+0000","last_clean":"2026-02-23T13:06:21.648150+0000","last_became_active":"2026-02-23T13:06:03.766415+0000","last_became_peered":"2026-02-23T13:06:03.766415+0000","last_unstale":"2026-02-23T13:06:21.648150+0000","last_undegraded":"2026-02-23T13:06:21.648150+0000","last_fullsized":"2026-02-23T13:06:21.648150+0000","mapping_epoch":48,"log_start":"52'8723","ondisk_log_start":"52'8723","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:09.766385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":571867136,"num_objects":8726,"num_object_clones":0,"num_object_copies":26178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8726,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8726,"num_write_kb":558464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"52'8587","reported_seq":8607,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:21.604851+0000","last_change":"2026-02-23T13:06:03.768871+0000","last_active":"2026-02-23T13:06:21.604851+0000","last_peered":"2026-02-23T13:06:21.604851+0000","last_clean":"2026-02-23T13:06:21.604851+0000","last_became_active":"2026-02-23T13:06:03.768541+0000","last_became_peered":"2026-02-23T13:06:03.768541+0000","last_unstale":"2026-02-23T13:06:21.604851+0000","last_undegraded":"2026-02-23T13:06:21.604851+0000","last_fullsized":"2026-02-23T13:06:21.604851+0000","mapping_epoch":48,"log_start":"52'8584","ondisk_log_start":"52'8584","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:31.119570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":562757632,"num_objects":8587,"num_object_clones":0,"num_object_copies":25761,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8587,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8587,"num_write_kb":549568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"52'8643","reported_seq":8663,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:21.598627+0000","last_change":"2026-02-23T13:06:03.767275+0000","last_active":"2026-02-23T13:06:21.598627+0000","last_peered":"2026-02-23T13:06:21.598627+0000","last_clean":"2026-02-23T13:06:21.598627+0000","last_became_active":"2026-02-23T13:06:03.767001+0000","last_became_peered":"2026-02-23T13:06:03.767001+0000","last_unstale":"2026-02-23T13:06:21.598627+0000","last_undegraded":"2026-02-23T13:06:21.598627+0000","last_fullsized":"2026-02-23T13:06:21.598627+0000","mapping_epoch":48,"log_start":"52'8640","ondisk_log_start":"52'8640","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:12.872474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566427648,"num_objects":8643,"num_object_clones":0,"num_object_copies":25929,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8643,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8643,"num_write_kb":553152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"52'8788","reported_seq":8807,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:21.652407+0000","last_change":"2026-02-23T13:06:03.767357+0000","last_active":"2026-02-23T13:06:21.652407+0000","last_peered":"2026-02-23T13:06:21.652407+0000","last_clean":"2026-02-23T13:06:21.652407+0000","last_became_active":"2026-02-23T13:06:03.766997+0000","last_became_peered":"2026-02-23T13:06:03.766997+0000","last_unstale":"2026-02-23T13:06:21.652407+0000","last_undegraded":"2026-02-23T13:06:21.652407+0000","last_fullsized":"2026-02-23T13:06:21.652407+0000","mapping_epoch":48,"log_start":"52'8785","ondisk_log_start":"52'8785","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:08.982263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575930368,"num_objects":8788,"num_object_clones":0,"num_object_copies":26364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8788,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8788,"num_write_kb":562432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"52'8871","reported_seq":8891,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:21.649824+0000","last_change":"2026-02-23T13:06:03.767298+0000","last_active":"2026-02-23T13:06:21.649824+0000","last_peered":"2026-02-23T13:06:21.649824+0000","last_clean":"2026-02-23T13:06:21.649824+0000","last_became_active":"2026-02-23T13:06:03.767015+0000","last_became_peered":"2026-02-23T13:06:03.767015+0000","last_unstale":"2026-02-23T13:06:21.649824+0000","last_undegraded":"2026-02-23T13:06:21.649824+0000","last_fullsized":"2026-02-23T13:06:21.649824+0000","mapping_epoch":48,"log_start":"52'8868","ondisk_log_start":"52'8868","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:29.610437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":581369856,"num_objects":8871,"num_object_clones":0,"num_object_copies":26613,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8871,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8871,"num_write_kb":567744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":249,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:12.781791+0000","last_change":"2026-02-23T13:05:29.192008+0000","last_active":"2026-02-23T13:06:12.781791+0000","last_peered":"2026-02-23T13:06:12.781791+0000","last_clean":"2026-02-23T13:06:12.781791+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:06:12.781791+0000","last_undegraded":"2026-02-23T13:06:12.781791+0000","last_fullsized":"2026-02-23T13:06:12.781791+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:05:29.191972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:05:29.191972+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:50.435825+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":9110224896,"num_objects":139011,"num_object_clones":0,"num_object_copies":417033,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139011,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139011,"num_write_kb":8896704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":27321171968,"data_stored":27321171968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1228,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247851,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6665636,"kb_used_data":5405392,"kb_used_omap":10,"kb_used_meta":1260213,"kb_avail":727337564,"statfs":{"total":751619276800,"available":744793665536,"internally_reserved":0,"allocated":5535121408,"data_stored":5534774291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10837,"internal_metadata":1290458539},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444078,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":8542692,"kb_used_data":7621136,"kb_used_omap":11,"kb_used_meta":921524,"kb_avail":725460508,"statfs":{"total":751619276800,"available":742871560192,"internally_reserved":0,"allocated":7804043264,"data_stored":7803696147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11743,"internal_metadata":943641121},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6915360,"kb_used_data":5922764,"kb_used_omap":12,"kb_used_meta":992563,"kb_avail":727087840,"statfs":{"total":751619276800,"available":744537948160,"internally_reserved":0,"allocated":6064910336,"data_stored":6064566771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12486,"internal_metadata":1016385338},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705713,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":7689380,"kb_used_data":6833360,"kb_used_omap":11,"kb_used_meta":855988,"kb_avail":726313820,"statfs":{"total":751619276800,"available":743745351680,"internally_reserved":0,"allocated":6997360640,"data_stored":6997013523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11622,"internal_metadata":876532378},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1228,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7388200960,"data_stored":7388200960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6295781376,"data_stored":6295781376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7957184512,"data_stored":7957184512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5680005120,"data_stored":5680005120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:06:25.570 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:06:25.570 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_1 pg_num 26 2026-02-23T13:06:25.728 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:25.781 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:06:25.848 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:25 trial046 ceph-mon[38575]: pgmap v130: 17 pgs: 17 active+clean; 8.5 GiB data, 28 GiB used, 2.7 TiB / 2.7 TiB avail; 429 MiB/s wr, 6.86k op/s 2026-02-23T13:06:25.854 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 21 16 172191 172175 512.374 448 0.00169718 0.00194811 2026-02-23T13:06:25.953 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:26.103 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:06:26 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:06:26] "GET /metrics HTTP/1.1" 200 4221 "" "Prometheus/3.6.0" 2026-02-23T13:06:26.217 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:26.100+0000 7f618dfc4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:26.217 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:26.101+0000 7f618dfc4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:26.234 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:06:26.451 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:06:26.451 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:26.422+0000 7f2153ea5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:26.451 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:26.422+0000 7f2153ea5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:26.452 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:06:26.460 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:06:26.460 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:06:26.475 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:06:26.475 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:06:26.490 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:06:26.491 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:06:26.561 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:06:26 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:06:26.085Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:06:26.854 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 22 15 177369 177354 503.797 323.688 0.00194257 0.00198356 2026-02-23T13:06:27.099 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:26 trial046 ceph-mon[38575]: from='client.14663 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:06:27.100 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:26 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/640850034' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_1", "var": "pg_num", "val": "26"} : dispatch 2026-02-23T13:06:27.100 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:26 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1547020328' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:06:27.334 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:06:27.854 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 23 15 183892 183877 499.617 407.688 0.000941994 0.00200016 2026-02-23T13:06:28.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:27 trial046 ceph-mon[38575]: pgmap v131: 17 pgs: 17 active+clean; 9.3 GiB data, 33 GiB used, 2.7 TiB / 2.7 TiB avail; 496 MiB/s wr, 7.93k op/s 2026-02-23T13:06:28.855 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 24 16 192466 192450 501.123 535.812 0.00155215 0.00199413 2026-02-23T13:06:29.508 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:06:29.657 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:29.780 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:29.778+0000 7f836470d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:29.780 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:29.778+0000 7f836470d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:29.796 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:06:29.796 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:06:29.810 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:06:29.811 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:06:29.825 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:06:29.825 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:06:29.839 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:06:29.839 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:06:29.855 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 25 16 200857 200841 502.054 524.438 0.00155377 0.00199043 2026-02-23T13:06:30.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:29 trial046 ceph-mon[38575]: pgmap v132: 17 pgs: 17 active+clean; 11 GiB data, 36 GiB used, 2.7 TiB / 2.7 TiB avail; 536 MiB/s wr, 8.58k op/s 2026-02-23T13:06:30.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:29 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/590805165' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:06:30.855 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 26 16 209259 209243 502.94 525.125 0.00167828 0.00198697 2026-02-23T13:06:31.855 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 27 16 217828 217812 504.147 535.562 0.00139779 0.00198219 2026-02-23T13:06:31.885 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:06:32.041 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:32.067 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:31 trial046 ceph-mon[38575]: pgmap v133: 17 pgs: 17 active+clean; 11 GiB data, 36 GiB used, 2.7 TiB / 2.7 TiB avail; 402 MiB/s wr, 6.44k op/s 2026-02-23T13:06:32.067 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:31 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:06:32.175 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:32.172+0000 7f7fc89df640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:32.175 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:32.173+0000 7f7fc89df640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:32.190 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:06:32.190 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:06:32.204 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:06:32.205 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:06:32.220 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:06:32.220 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:06:32.234 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:06:32.234 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:06:32.335 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:06:32.336 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:06:32.336 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_1 2026-02-23T13:06:32.336 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:06:32.488 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:32.616 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:32.615+0000 7fb332b77640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:32.617 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:32.615+0000 7fb332b77640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:32.762 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:06:32.763 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:06:32.813 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2026-02-23T13:06:32.617878+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":14149485088,"num_objects":215897,"num_object_clones":0,"num_object_copies":647691,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215897,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":216030,"num_write_kb":13819430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":45413260,"kb_used_data":40451260,"kb_used_omap":45,"kb_used_meta":4961874,"kb_avail":2890599540,"statfs":{"total":3006477107200,"available":2959973928960,"internally_reserved":0,"allocated":41422090240,"data_stored":41420705324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46688,"internal_metadata":5080959392},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7668170752,"num_objects":117007,"num_object_clones":0,"num_object_copies":351021,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117007,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117007,"num_write_kb":7488448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001636"},"pg_stats":[{"pgid":"3.f","version":"52'13530","reported_seq":13550,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:31.602225+0000","last_change":"2026-02-23T13:06:03.767923+0000","last_active":"2026-02-23T13:06:31.602225+0000","last_peered":"2026-02-23T13:06:31.602225+0000","last_clean":"2026-02-23T13:06:31.602225+0000","last_became_active":"2026-02-23T13:06:03.767261+0000","last_became_peered":"2026-02-23T13:06:03.767261+0000","last_unstale":"2026-02-23T13:06:31.602225+0000","last_undegraded":"2026-02-23T13:06:31.602225+0000","last_fullsized":"2026-02-23T13:06:31.602225+0000","mapping_epoch":48,"log_start":"52'13527","ondisk_log_start":"52'13527","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:04.399152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":886702080,"num_objects":13530,"num_object_clones":0,"num_object_copies":40590,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13530,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13530,"num_write_kb":865920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"52'13566","reported_seq":13586,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:31.609581+0000","last_change":"2026-02-23T13:06:03.768354+0000","last_active":"2026-02-23T13:06:31.609581+0000","last_peered":"2026-02-23T13:06:31.609581+0000","last_clean":"2026-02-23T13:06:31.609581+0000","last_became_active":"2026-02-23T13:06:03.767822+0000","last_became_peered":"2026-02-23T13:06:03.767822+0000","last_unstale":"2026-02-23T13:06:31.609581+0000","last_undegraded":"2026-02-23T13:06:31.609581+0000","last_fullsized":"2026-02-23T13:06:31.609581+0000","mapping_epoch":48,"log_start":"52'13563","ondisk_log_start":"52'13563","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:24.671155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":889061376,"num_objects":13566,"num_object_clones":0,"num_object_copies":40698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13566,"num_write_kb":868224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"52'13448","reported_seq":13468,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:31.615261+0000","last_change":"2026-02-23T13:06:03.769230+0000","last_active":"2026-02-23T13:06:31.615261+0000","last_peered":"2026-02-23T13:06:31.615261+0000","last_clean":"2026-02-23T13:06:31.615261+0000","last_became_active":"2026-02-23T13:06:03.768946+0000","last_became_peered":"2026-02-23T13:06:03.768946+0000","last_unstale":"2026-02-23T13:06:31.615261+0000","last_undegraded":"2026-02-23T13:06:31.615261+0000","last_fullsized":"2026-02-23T13:06:31.615261+0000","mapping_epoch":48,"log_start":"52'13445","ondisk_log_start":"52'13445","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:26.718468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":881328128,"num_objects":13448,"num_object_clones":0,"num_object_copies":40344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13448,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13448,"num_write_kb":860672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"52'13550","reported_seq":13570,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:31.616805+0000","last_change":"2026-02-23T13:06:03.767398+0000","last_active":"2026-02-23T13:06:31.616805+0000","last_peered":"2026-02-23T13:06:31.616805+0000","last_clean":"2026-02-23T13:06:31.616805+0000","last_became_active":"2026-02-23T13:06:03.767083+0000","last_became_peered":"2026-02-23T13:06:03.767083+0000","last_unstale":"2026-02-23T13:06:31.616805+0000","last_undegraded":"2026-02-23T13:06:31.616805+0000","last_fullsized":"2026-02-23T13:06:31.616805+0000","mapping_epoch":48,"log_start":"52'13547","ondisk_log_start":"52'13547","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:32.716724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":888012800,"num_objects":13550,"num_object_clones":0,"num_object_copies":40650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13550,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13550,"num_write_kb":867200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"52'13445","reported_seq":13465,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:31.667100+0000","last_change":"2026-02-23T13:06:03.767015+0000","last_active":"2026-02-23T13:06:31.667100+0000","last_peered":"2026-02-23T13:06:31.667100+0000","last_clean":"2026-02-23T13:06:31.667100+0000","last_became_active":"2026-02-23T13:06:03.766614+0000","last_became_peered":"2026-02-23T13:06:03.766614+0000","last_unstale":"2026-02-23T13:06:31.667100+0000","last_undegraded":"2026-02-23T13:06:31.667100+0000","last_fullsized":"2026-02-23T13:06:31.667100+0000","mapping_epoch":48,"log_start":"52'13442","ondisk_log_start":"52'13442","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:15.375425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":881131520,"num_objects":13445,"num_object_clones":0,"num_object_copies":40335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13445,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13445,"num_write_kb":860480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"52'13397","reported_seq":13417,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:31.613156+0000","last_change":"2026-02-23T13:06:03.768603+0000","last_active":"2026-02-23T13:06:31.613156+0000","last_peered":"2026-02-23T13:06:31.613156+0000","last_clean":"2026-02-23T13:06:31.613156+0000","last_became_active":"2026-02-23T13:06:03.768238+0000","last_became_peered":"2026-02-23T13:06:03.768238+0000","last_unstale":"2026-02-23T13:06:31.613156+0000","last_undegraded":"2026-02-23T13:06:31.613156+0000","last_fullsized":"2026-02-23T13:06:31.613156+0000","mapping_epoch":48,"log_start":"52'13394","ondisk_log_start":"52'13394","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:11.493313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":877985792,"num_objects":13397,"num_object_clones":0,"num_object_copies":40191,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13397,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13397,"num_write_kb":857408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"52'13399","reported_seq":13419,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:31.613043+0000","last_change":"2026-02-23T13:06:03.768373+0000","last_active":"2026-02-23T13:06:31.613043+0000","last_peered":"2026-02-23T13:06:31.613043+0000","last_clean":"2026-02-23T13:06:31.613043+0000","last_became_active":"2026-02-23T13:06:03.767947+0000","last_became_peered":"2026-02-23T13:06:03.767947+0000","last_unstale":"2026-02-23T13:06:31.613043+0000","last_undegraded":"2026-02-23T13:06:31.613043+0000","last_fullsized":"2026-02-23T13:06:31.613043+0000","mapping_epoch":48,"log_start":"52'13396","ondisk_log_start":"52'13396","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:05.474616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":878116864,"num_objects":13399,"num_object_clones":0,"num_object_copies":40197,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13399,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13399,"num_write_kb":857536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"52'13470","reported_seq":13490,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:31.664233+0000","last_change":"2026-02-23T13:06:03.767140+0000","last_active":"2026-02-23T13:06:31.664233+0000","last_peered":"2026-02-23T13:06:31.664233+0000","last_clean":"2026-02-23T13:06:31.664233+0000","last_became_active":"2026-02-23T13:06:03.766859+0000","last_became_peered":"2026-02-23T13:06:03.766859+0000","last_unstale":"2026-02-23T13:06:31.664233+0000","last_undegraded":"2026-02-23T13:06:31.664233+0000","last_fullsized":"2026-02-23T13:06:31.664233+0000","mapping_epoch":48,"log_start":"52'13467","ondisk_log_start":"52'13467","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:26.334481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":882769920,"num_objects":13470,"num_object_clones":0,"num_object_copies":40410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13470,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13470,"num_write_kb":862080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"52'13539","reported_seq":13558,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:31.668121+0000","last_change":"2026-02-23T13:06:03.765755+0000","last_active":"2026-02-23T13:06:31.668121+0000","last_peered":"2026-02-23T13:06:31.668121+0000","last_clean":"2026-02-23T13:06:31.668121+0000","last_became_active":"2026-02-23T13:06:03.765502+0000","last_became_peered":"2026-02-23T13:06:03.765502+0000","last_unstale":"2026-02-23T13:06:31.668121+0000","last_undegraded":"2026-02-23T13:06:31.668121+0000","last_fullsized":"2026-02-23T13:06:31.668121+0000","mapping_epoch":48,"log_start":"52'13536","ondisk_log_start":"52'13536","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:14.075905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":887291904,"num_objects":13539,"num_object_clones":0,"num_object_copies":40617,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13539,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13539,"num_write_kb":866496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"52'13559","reported_seq":13579,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:31.603447+0000","last_change":"2026-02-23T13:06:03.767303+0000","last_active":"2026-02-23T13:06:31.603447+0000","last_peered":"2026-02-23T13:06:31.603447+0000","last_clean":"2026-02-23T13:06:31.603447+0000","last_became_active":"2026-02-23T13:06:03.767012+0000","last_became_peered":"2026-02-23T13:06:03.767012+0000","last_unstale":"2026-02-23T13:06:31.603447+0000","last_undegraded":"2026-02-23T13:06:31.603447+0000","last_fullsized":"2026-02-23T13:06:31.603447+0000","mapping_epoch":48,"log_start":"52'13556","ondisk_log_start":"52'13556","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:22.659298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":888602624,"num_objects":13559,"num_object_clones":0,"num_object_copies":40677,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13559,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13559,"num_write_kb":867776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"52'13342","reported_seq":13362,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:31.602103+0000","last_change":"2026-02-23T13:06:03.767897+0000","last_active":"2026-02-23T13:06:31.602103+0000","last_peered":"2026-02-23T13:06:31.602103+0000","last_clean":"2026-02-23T13:06:31.602103+0000","last_became_active":"2026-02-23T13:06:03.767200+0000","last_became_peered":"2026-02-23T13:06:03.767200+0000","last_unstale":"2026-02-23T13:06:31.602103+0000","last_undegraded":"2026-02-23T13:06:31.602103+0000","last_fullsized":"2026-02-23T13:06:31.602103+0000","mapping_epoch":48,"log_start":"52'13339","ondisk_log_start":"52'13339","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:14.434473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":874381312,"num_objects":13342,"num_object_clones":0,"num_object_copies":40026,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13342,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13342,"num_write_kb":853888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"52'13626","reported_seq":13646,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:31.666140+0000","last_change":"2026-02-23T13:06:03.766820+0000","last_active":"2026-02-23T13:06:31.666140+0000","last_peered":"2026-02-23T13:06:31.666140+0000","last_clean":"2026-02-23T13:06:31.666140+0000","last_became_active":"2026-02-23T13:06:03.766415+0000","last_became_peered":"2026-02-23T13:06:03.766415+0000","last_unstale":"2026-02-23T13:06:31.666140+0000","last_undegraded":"2026-02-23T13:06:31.666140+0000","last_fullsized":"2026-02-23T13:06:31.666140+0000","mapping_epoch":48,"log_start":"52'13623","ondisk_log_start":"52'13623","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:09.766385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":892993536,"num_objects":13626,"num_object_clones":0,"num_object_copies":40878,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13626,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13626,"num_write_kb":872064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"52'13320","reported_seq":13340,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:31.607673+0000","last_change":"2026-02-23T13:06:03.768871+0000","last_active":"2026-02-23T13:06:31.607673+0000","last_peered":"2026-02-23T13:06:31.607673+0000","last_clean":"2026-02-23T13:06:31.607673+0000","last_became_active":"2026-02-23T13:06:03.768541+0000","last_became_peered":"2026-02-23T13:06:03.768541+0000","last_unstale":"2026-02-23T13:06:31.607673+0000","last_undegraded":"2026-02-23T13:06:31.607673+0000","last_fullsized":"2026-02-23T13:06:31.607673+0000","mapping_epoch":48,"log_start":"52'13317","ondisk_log_start":"52'13317","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:31.119570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":872939520,"num_objects":13320,"num_object_clones":0,"num_object_copies":39960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13320,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13320,"num_write_kb":852480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"52'13367","reported_seq":13387,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:31.604251+0000","last_change":"2026-02-23T13:06:03.767275+0000","last_active":"2026-02-23T13:06:31.604251+0000","last_peered":"2026-02-23T13:06:31.604251+0000","last_clean":"2026-02-23T13:06:31.604251+0000","last_became_active":"2026-02-23T13:06:03.767001+0000","last_became_peered":"2026-02-23T13:06:03.767001+0000","last_unstale":"2026-02-23T13:06:31.604251+0000","last_undegraded":"2026-02-23T13:06:31.604251+0000","last_fullsized":"2026-02-23T13:06:31.604251+0000","mapping_epoch":48,"log_start":"52'13364","ondisk_log_start":"52'13364","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:12.872474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":876019712,"num_objects":13367,"num_object_clones":0,"num_object_copies":40101,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13367,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13367,"num_write_kb":855488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"52'13711","reported_seq":13731,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:31.667572+0000","last_change":"2026-02-23T13:06:03.767357+0000","last_active":"2026-02-23T13:06:31.667572+0000","last_peered":"2026-02-23T13:06:31.667572+0000","last_clean":"2026-02-23T13:06:31.667572+0000","last_became_active":"2026-02-23T13:06:03.766997+0000","last_became_peered":"2026-02-23T13:06:03.766997+0000","last_unstale":"2026-02-23T13:06:31.667572+0000","last_undegraded":"2026-02-23T13:06:31.667572+0000","last_fullsized":"2026-02-23T13:06:31.667572+0000","mapping_epoch":48,"log_start":"52'13708","ondisk_log_start":"52'13708","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:08.982263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":898564096,"num_objects":13711,"num_object_clones":0,"num_object_copies":41133,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13711,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13711,"num_write_kb":877504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"52'13626","reported_seq":13646,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:31.666941+0000","last_change":"2026-02-23T13:06:03.767298+0000","last_active":"2026-02-23T13:06:31.666941+0000","last_peered":"2026-02-23T13:06:31.666941+0000","last_clean":"2026-02-23T13:06:31.666941+0000","last_became_active":"2026-02-23T13:06:03.767015+0000","last_became_peered":"2026-02-23T13:06:03.767015+0000","last_unstale":"2026-02-23T13:06:31.666941+0000","last_undegraded":"2026-02-23T13:06:31.666941+0000","last_fullsized":"2026-02-23T13:06:31.666941+0000","mapping_epoch":48,"log_start":"52'13623","ondisk_log_start":"52'13623","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:29.610437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":892993536,"num_objects":13626,"num_object_clones":0,"num_object_copies":40878,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13626,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13626,"num_write_kb":872064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":249,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:12.781791+0000","last_change":"2026-02-23T13:05:29.192008+0000","last_active":"2026-02-23T13:06:12.781791+0000","last_peered":"2026-02-23T13:06:12.781791+0000","last_clean":"2026-02-23T13:06:12.781791+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:06:12.781791+0000","last_undegraded":"2026-02-23T13:06:12.781791+0000","last_fullsized":"2026-02-23T13:06:12.781791+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:05:29.191972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:05:29.191972+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:50.435825+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":14148894720,"num_objects":215895,"num_object_clones":0,"num_object_copies":647685,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215895,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215895,"num_write_kb":13817280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":42432200704,"data_stored":42432200704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1228,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247853,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":9955620,"kb_used_data":8478800,"kb_used_omap":10,"kb_used_meta":1476789,"kb_avail":724047580,"statfs":{"total":751619276800,"available":741424721920,"internally_reserved":0,"allocated":8682291200,"data_stored":8681944083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10837,"internal_metadata":1512232363},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444080,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":13032164,"kb_used_data":11857936,"kb_used_omap":11,"kb_used_meta":1174196,"kb_avail":720971036,"statfs":{"total":751619276800,"available":738274340864,"internally_reserved":0,"allocated":12142526464,"data_stored":12142179347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11743,"internal_metadata":1202377249},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":10523680,"kb_used_data":9321420,"kb_used_omap":12,"kb_used_meta":1202227,"kb_avail":723479520,"statfs":{"total":751619276800,"available":740843028480,"internally_reserved":0,"allocated":9545134080,"data_stored":9544790515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12486,"internal_metadata":1231081274},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":11901796,"kb_used_data":10793104,"kb_used_omap":11,"kb_used_meta":1108660,"kb_avail":722101404,"statfs":{"total":751619276800,"available":739431837696,"internally_reserved":0,"allocated":11052138496,"data_stored":11051791379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11622,"internal_metadata":1135268506},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1228,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11476467712,"data_stored":11476467712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9765584896,"data_stored":9765584896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12363366400,"data_stored":12363366400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8826781696,"data_stored":8826781696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:06:32.814 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:06:32.814 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_1 pg_num 36 2026-02-23T13:06:32.855 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 28 15 226381 226366 505.234 534.625 0.00332517 0.00197795 2026-02-23T13:06:32.964 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:32.990 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:32 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4259441066' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:06:33.104 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:33.101+0000 7f6d8d735640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:33.104 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:33.102+0000 7f6d8d735640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:33.251 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:06:33.291 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:06:33.855 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 29 15 235390 235375 507.226 563.062 0.0017215 0.00197016 2026-02-23T13:06:34.279 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:06:34.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:33 trial046 ceph-mon[38575]: pgmap v134: 17 pgs: 17 active+clean; 13 GiB data, 43 GiB used, 2.7 TiB / 2.7 TiB avail; 609 MiB/s wr, 9.75k op/s 2026-02-23T13:06:34.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:33 trial046 ceph-mon[38575]: from='client.14673 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:06:34.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:33 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3358384997' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_1", "var": "pg_num", "val": "36"} : dispatch 2026-02-23T13:06:34.434 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:34.805 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:34.747+0000 7f24c77e8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:34.805 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:34.747+0000 7f24c77e8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:34.805 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:06:34.805 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:06:34.805 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:06:34.806 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:06:34.806 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:06:34.806 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:06:34.809 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:06:34.810 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:06:34.855 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 30 16 242975 242959 506.117 474 0.0014203 0.00197449 2026-02-23T13:06:35.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:34 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2412811187' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:06:35.855 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 31 16 249955 249939 503.863 436.25 0.00169496 0.00198332 2026-02-23T13:06:36.088 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:35 trial046 ceph-mon[38575]: pgmap v135: 17 pgs: 17 active+clean; 13 GiB data, 43 GiB used, 2.7 TiB / 2.7 TiB avail; 400 MiB/s wr, 6.41k op/s 2026-02-23T13:06:36.539 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:06:36 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:06:36] "GET /metrics HTTP/1.1" 200 4213 "" "Prometheus/3.6.0" 2026-02-23T13:06:36.561 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:06:36 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:06:36.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:06:36.855 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 32 15 258146 258131 504.116 512 0.00175153 0.00198233 2026-02-23T13:06:37.383 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:06:37.525 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:37.657 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:37.656+0000 7f2f01e8f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:37.657 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:37.656+0000 7f2f01e8f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:37.674 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:06:37.674 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:06:37.689 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:06:37.689 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:06:37.703 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:06:37.704 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:06:37.716 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:06:37.716 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:06:37.855 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 33 16 266537 266521 504.728 524.375 0.001733 0.00197992 2026-02-23T13:06:38.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:37 trial046 ceph-mon[38575]: pgmap v136: 17 pgs: 17 active+clean; 14 GiB data, 48 GiB used, 2.7 TiB / 2.7 TiB avail; 480 MiB/s wr, 7.68k op/s 2026-02-23T13:06:38.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:37 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3730410671' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:06:38.292 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:06:38.292 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:06:38.293 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:06:38.293 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:06:38.440 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:38.563 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:38.562+0000 7fd8e1496640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:38.563 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:38.562+0000 7fd8e1496640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:38.711 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:06:38.711 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:06:38.761 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2026-02-23T13:06:38.618716+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16810770976,"num_objects":256505,"num_object_clones":0,"num_object_copies":769515,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":256505,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":256638,"num_write_kb":16418342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":53667916,"kb_used_data":48243388,"kb_used_omap":45,"kb_used_meta":5424402,"kb_avail":2882344884,"statfs":{"total":3006477107200,"available":2951521161216,"internally_reserved":0,"allocated":49401229312,"data_stored":49399844396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46688,"internal_metadata":5554588064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6784679936,"num_objects":103526,"num_object_clones":0,"num_object_copies":310578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103526,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103526,"num_write_kb":6625664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001647"},"pg_stats":[{"pgid":"3.f","version":"52'16136","reported_seq":16156,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:36.608137+0000","last_change":"2026-02-23T13:06:03.767923+0000","last_active":"2026-02-23T13:06:36.608137+0000","last_peered":"2026-02-23T13:06:36.608137+0000","last_clean":"2026-02-23T13:06:36.608137+0000","last_became_active":"2026-02-23T13:06:03.767261+0000","last_became_peered":"2026-02-23T13:06:03.767261+0000","last_unstale":"2026-02-23T13:06:36.608137+0000","last_undegraded":"2026-02-23T13:06:36.608137+0000","last_fullsized":"2026-02-23T13:06:36.608137+0000","mapping_epoch":48,"log_start":"52'16133","ondisk_log_start":"52'16133","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:04.399152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1057488896,"num_objects":16136,"num_object_clones":0,"num_object_copies":48408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16136,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16136,"num_write_kb":1032704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"52'16069","reported_seq":16089,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:36.602759+0000","last_change":"2026-02-23T13:06:03.768354+0000","last_active":"2026-02-23T13:06:36.602759+0000","last_peered":"2026-02-23T13:06:36.602759+0000","last_clean":"2026-02-23T13:06:36.602759+0000","last_became_active":"2026-02-23T13:06:03.767822+0000","last_became_peered":"2026-02-23T13:06:03.767822+0000","last_unstale":"2026-02-23T13:06:36.602759+0000","last_undegraded":"2026-02-23T13:06:36.602759+0000","last_fullsized":"2026-02-23T13:06:36.602759+0000","mapping_epoch":48,"log_start":"52'16066","ondisk_log_start":"52'16066","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:24.671155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1053097984,"num_objects":16069,"num_object_clones":0,"num_object_copies":48207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16069,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16069,"num_write_kb":1028416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"52'15994","reported_seq":16014,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:36.611587+0000","last_change":"2026-02-23T13:06:03.769230+0000","last_active":"2026-02-23T13:06:36.611587+0000","last_peered":"2026-02-23T13:06:36.611587+0000","last_clean":"2026-02-23T13:06:36.611587+0000","last_became_active":"2026-02-23T13:06:03.768946+0000","last_became_peered":"2026-02-23T13:06:03.768946+0000","last_unstale":"2026-02-23T13:06:36.611587+0000","last_undegraded":"2026-02-23T13:06:36.611587+0000","last_fullsized":"2026-02-23T13:06:36.611587+0000","mapping_epoch":48,"log_start":"52'15991","ondisk_log_start":"52'15991","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:26.718468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048182784,"num_objects":15994,"num_object_clones":0,"num_object_copies":47982,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15994,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15994,"num_write_kb":1023616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"52'16089","reported_seq":16109,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:36.607790+0000","last_change":"2026-02-23T13:06:03.767398+0000","last_active":"2026-02-23T13:06:36.607790+0000","last_peered":"2026-02-23T13:06:36.607790+0000","last_clean":"2026-02-23T13:06:36.607790+0000","last_became_active":"2026-02-23T13:06:03.767083+0000","last_became_peered":"2026-02-23T13:06:03.767083+0000","last_unstale":"2026-02-23T13:06:36.607790+0000","last_undegraded":"2026-02-23T13:06:36.607790+0000","last_fullsized":"2026-02-23T13:06:36.607790+0000","mapping_epoch":48,"log_start":"52'16086","ondisk_log_start":"52'16086","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:32.716724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1054408704,"num_objects":16089,"num_object_clones":0,"num_object_copies":48267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16089,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16089,"num_write_kb":1029696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"52'15891","reported_seq":15911,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:36.662344+0000","last_change":"2026-02-23T13:06:03.767015+0000","last_active":"2026-02-23T13:06:36.662344+0000","last_peered":"2026-02-23T13:06:36.662344+0000","last_clean":"2026-02-23T13:06:36.662344+0000","last_became_active":"2026-02-23T13:06:03.766614+0000","last_became_peered":"2026-02-23T13:06:03.766614+0000","last_unstale":"2026-02-23T13:06:36.662344+0000","last_undegraded":"2026-02-23T13:06:36.662344+0000","last_fullsized":"2026-02-23T13:06:36.662344+0000","mapping_epoch":48,"log_start":"52'15888","ondisk_log_start":"52'15888","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:15.375425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1041432576,"num_objects":15891,"num_object_clones":0,"num_object_copies":47673,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15891,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15891,"num_write_kb":1017024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"52'15925","reported_seq":15945,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:36.616940+0000","last_change":"2026-02-23T13:06:03.768603+0000","last_active":"2026-02-23T13:06:36.616940+0000","last_peered":"2026-02-23T13:06:36.616940+0000","last_clean":"2026-02-23T13:06:36.616940+0000","last_became_active":"2026-02-23T13:06:03.768238+0000","last_became_peered":"2026-02-23T13:06:03.768238+0000","last_unstale":"2026-02-23T13:06:36.616940+0000","last_undegraded":"2026-02-23T13:06:36.616940+0000","last_fullsized":"2026-02-23T13:06:36.616940+0000","mapping_epoch":48,"log_start":"52'15921","ondisk_log_start":"52'15921","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:11.493313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1043660800,"num_objects":15925,"num_object_clones":0,"num_object_copies":47775,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15925,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15925,"num_write_kb":1019200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"52'15928","reported_seq":15948,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:36.618521+0000","last_change":"2026-02-23T13:06:03.768373+0000","last_active":"2026-02-23T13:06:36.618521+0000","last_peered":"2026-02-23T13:06:36.618521+0000","last_clean":"2026-02-23T13:06:36.618521+0000","last_became_active":"2026-02-23T13:06:03.767947+0000","last_became_peered":"2026-02-23T13:06:03.767947+0000","last_unstale":"2026-02-23T13:06:36.618521+0000","last_undegraded":"2026-02-23T13:06:36.618521+0000","last_fullsized":"2026-02-23T13:06:36.618521+0000","mapping_epoch":48,"log_start":"52'15925","ondisk_log_start":"52'15925","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:05.474616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1043857408,"num_objects":15928,"num_object_clones":0,"num_object_copies":47784,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15928,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15928,"num_write_kb":1019392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"52'16051","reported_seq":16071,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:36.665860+0000","last_change":"2026-02-23T13:06:03.767140+0000","last_active":"2026-02-23T13:06:36.665860+0000","last_peered":"2026-02-23T13:06:36.665860+0000","last_clean":"2026-02-23T13:06:36.665860+0000","last_became_active":"2026-02-23T13:06:03.766859+0000","last_became_peered":"2026-02-23T13:06:03.766859+0000","last_unstale":"2026-02-23T13:06:36.665860+0000","last_undegraded":"2026-02-23T13:06:36.665860+0000","last_fullsized":"2026-02-23T13:06:36.665860+0000","mapping_epoch":48,"log_start":"52'16048","ondisk_log_start":"52'16048","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:26.334481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1051918336,"num_objects":16051,"num_object_clones":0,"num_object_copies":48153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16051,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16051,"num_write_kb":1027264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"52'16074","reported_seq":16094,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:36.668171+0000","last_change":"2026-02-23T13:06:03.765755+0000","last_active":"2026-02-23T13:06:36.668171+0000","last_peered":"2026-02-23T13:06:36.668171+0000","last_clean":"2026-02-23T13:06:36.668171+0000","last_became_active":"2026-02-23T13:06:03.765502+0000","last_became_peered":"2026-02-23T13:06:03.765502+0000","last_unstale":"2026-02-23T13:06:36.668171+0000","last_undegraded":"2026-02-23T13:06:36.668171+0000","last_fullsized":"2026-02-23T13:06:36.668171+0000","mapping_epoch":48,"log_start":"52'16071","ondisk_log_start":"52'16071","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:14.075905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1053425664,"num_objects":16074,"num_object_clones":0,"num_object_copies":48222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16074,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16074,"num_write_kb":1028736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"52'16159","reported_seq":16179,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:36.600669+0000","last_change":"2026-02-23T13:06:03.767303+0000","last_active":"2026-02-23T13:06:36.600669+0000","last_peered":"2026-02-23T13:06:36.600669+0000","last_clean":"2026-02-23T13:06:36.600669+0000","last_became_active":"2026-02-23T13:06:03.767012+0000","last_became_peered":"2026-02-23T13:06:03.767012+0000","last_unstale":"2026-02-23T13:06:36.600669+0000","last_undegraded":"2026-02-23T13:06:36.600669+0000","last_fullsized":"2026-02-23T13:06:36.600669+0000","mapping_epoch":48,"log_start":"52'16156","ondisk_log_start":"52'16156","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:22.659298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1058996224,"num_objects":16159,"num_object_clones":0,"num_object_copies":48477,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16159,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16159,"num_write_kb":1034176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"52'15875","reported_seq":15895,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:36.606602+0000","last_change":"2026-02-23T13:06:03.767897+0000","last_active":"2026-02-23T13:06:36.606602+0000","last_peered":"2026-02-23T13:06:36.606602+0000","last_clean":"2026-02-23T13:06:36.606602+0000","last_became_active":"2026-02-23T13:06:03.767200+0000","last_became_peered":"2026-02-23T13:06:03.767200+0000","last_unstale":"2026-02-23T13:06:36.606602+0000","last_undegraded":"2026-02-23T13:06:36.606602+0000","last_fullsized":"2026-02-23T13:06:36.606602+0000","mapping_epoch":48,"log_start":"52'15872","ondisk_log_start":"52'15872","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:14.434473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1040384000,"num_objects":15875,"num_object_clones":0,"num_object_copies":47625,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15875,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15875,"num_write_kb":1016000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"52'16185","reported_seq":16205,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:36.669557+0000","last_change":"2026-02-23T13:06:03.766820+0000","last_active":"2026-02-23T13:06:36.669557+0000","last_peered":"2026-02-23T13:06:36.669557+0000","last_clean":"2026-02-23T13:06:36.669557+0000","last_became_active":"2026-02-23T13:06:03.766415+0000","last_became_peered":"2026-02-23T13:06:03.766415+0000","last_unstale":"2026-02-23T13:06:36.669557+0000","last_undegraded":"2026-02-23T13:06:36.669557+0000","last_fullsized":"2026-02-23T13:06:36.669557+0000","mapping_epoch":48,"log_start":"52'16182","ondisk_log_start":"52'16182","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:09.766385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1060700160,"num_objects":16185,"num_object_clones":0,"num_object_copies":48555,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16185,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16185,"num_write_kb":1035840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"52'15801","reported_seq":15821,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:36.602345+0000","last_change":"2026-02-23T13:06:03.768871+0000","last_active":"2026-02-23T13:06:36.602345+0000","last_peered":"2026-02-23T13:06:36.602345+0000","last_clean":"2026-02-23T13:06:36.602345+0000","last_became_active":"2026-02-23T13:06:03.768541+0000","last_became_peered":"2026-02-23T13:06:03.768541+0000","last_unstale":"2026-02-23T13:06:36.602345+0000","last_undegraded":"2026-02-23T13:06:36.602345+0000","last_fullsized":"2026-02-23T13:06:36.602345+0000","mapping_epoch":48,"log_start":"52'15798","ondisk_log_start":"52'15798","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:31.119570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1035534336,"num_objects":15801,"num_object_clones":0,"num_object_copies":47403,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15801,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15801,"num_write_kb":1011264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"52'15902","reported_seq":15922,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:36.605885+0000","last_change":"2026-02-23T13:06:03.767275+0000","last_active":"2026-02-23T13:06:36.605885+0000","last_peered":"2026-02-23T13:06:36.605885+0000","last_clean":"2026-02-23T13:06:36.605885+0000","last_became_active":"2026-02-23T13:06:03.767001+0000","last_became_peered":"2026-02-23T13:06:03.767001+0000","last_unstale":"2026-02-23T13:06:36.605885+0000","last_undegraded":"2026-02-23T13:06:36.605885+0000","last_fullsized":"2026-02-23T13:06:36.605885+0000","mapping_epoch":48,"log_start":"52'15899","ondisk_log_start":"52'15899","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:12.872474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1042153472,"num_objects":15902,"num_object_clones":0,"num_object_copies":47706,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15902,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15902,"num_write_kb":1017728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"52'16234","reported_seq":16254,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:36.667984+0000","last_change":"2026-02-23T13:06:03.767357+0000","last_active":"2026-02-23T13:06:36.667984+0000","last_peered":"2026-02-23T13:06:36.667984+0000","last_clean":"2026-02-23T13:06:36.667984+0000","last_became_active":"2026-02-23T13:06:03.766997+0000","last_became_peered":"2026-02-23T13:06:03.766997+0000","last_unstale":"2026-02-23T13:06:36.667984+0000","last_undegraded":"2026-02-23T13:06:36.667984+0000","last_fullsized":"2026-02-23T13:06:36.667984+0000","mapping_epoch":48,"log_start":"52'16231","ondisk_log_start":"52'16231","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:08.982263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1063911424,"num_objects":16234,"num_object_clones":0,"num_object_copies":48702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16234,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16234,"num_write_kb":1038976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"52'16190","reported_seq":16210,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:36.667765+0000","last_change":"2026-02-23T13:06:03.767298+0000","last_active":"2026-02-23T13:06:36.667765+0000","last_peered":"2026-02-23T13:06:36.667765+0000","last_clean":"2026-02-23T13:06:36.667765+0000","last_became_active":"2026-02-23T13:06:03.767015+0000","last_became_peered":"2026-02-23T13:06:03.767015+0000","last_unstale":"2026-02-23T13:06:36.667765+0000","last_undegraded":"2026-02-23T13:06:36.667765+0000","last_fullsized":"2026-02-23T13:06:36.667765+0000","mapping_epoch":48,"log_start":"52'16187","ondisk_log_start":"52'16187","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:29.610437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1061027840,"num_objects":16190,"num_object_clones":0,"num_object_copies":48570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16190,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16190,"num_write_kb":1036160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":249,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:12.781791+0000","last_change":"2026-02-23T13:05:29.192008+0000","last_active":"2026-02-23T13:06:12.781791+0000","last_peered":"2026-02-23T13:06:12.781791+0000","last_clean":"2026-02-23T13:06:12.781791+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:06:12.781791+0000","last_undegraded":"2026-02-23T13:06:12.781791+0000","last_fullsized":"2026-02-23T13:06:12.781791+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:05:29.191972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:05:29.191972+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:50.435825+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":16810180608,"num_objects":256503,"num_object_clones":0,"num_object_copies":769509,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":256503,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":256503,"num_write_kb":16416192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":50419073024,"data_stored":50419073024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1228,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247854,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":11626852,"kb_used_data":10077840,"kb_used_omap":10,"kb_used_meta":1548981,"kb_avail":722376348,"statfs":{"total":751619276800,"available":739713380352,"internally_reserved":0,"allocated":10319708160,"data_stored":10319361043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10837,"internal_metadata":1586156971},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444081,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":15442532,"kb_used_data":14123920,"kb_used_omap":11,"kb_used_meta":1318580,"kb_avail":718560668,"statfs":{"total":751619276800,"available":735806124032,"internally_reserved":0,"allocated":14462894080,"data_stored":14462546963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11743,"internal_metadata":1350226465},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":12422112,"kb_used_data":11111564,"kb_used_omap":12,"kb_used_meta":1310515,"kb_avail":721581088,"statfs":{"total":751619276800,"available":738899034112,"internally_reserved":0,"allocated":11378241536,"data_stored":11377897971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12486,"internal_metadata":1341968186},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705716,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":14176420,"kb_used_data":12930064,"kb_used_omap":11,"kb_used_meta":1246324,"kb_avail":719826780,"statfs":{"total":751619276800,"available":737102622720,"internally_reserved":0,"allocated":13240385536,"data_stored":13240038419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11622,"internal_metadata":1276236442},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1228,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13641842688,"data_stored":13641842688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11594891264,"data_stored":11594891264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14693498880,"data_stored":14693498880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10488840192,"data_stored":10488840192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:06:38.763 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:06:38.763 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 71 2026-02-23T13:06:38.855 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 34 15 274949 274934 505.347 525.812 0.00183337 0.00197751 2026-02-23T13:06:38.920 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:39.056 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:39.056+0000 7f9bbc943640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:39.056 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:39.056+0000 7f9bbc943640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:39.214 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:06:39.358 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:06:39.769 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:06:39.855 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 35 16 282893 282877 505.091 496.438 0.00152586 0.00197853 2026-02-23T13:06:39.917 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:40.046 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:40.045+0000 7ffb58758640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:40.046 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:40.045+0000 7ffb58758640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:40.046 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:39 trial046 ceph-mon[38575]: pgmap v137: 17 pgs: 17 active+clean; 16 GiB data, 51 GiB used, 2.7 TiB / 2.7 TiB avail; 539 MiB/s wr, 8.62k op/s 2026-02-23T13:06:40.046 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:39 trial046 ceph-mon[38575]: from='client.14681 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:06:40.046 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:39 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/952795280' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "71"} : dispatch 2026-02-23T13:06:40.061 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:06:40.062 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:06:40.075 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:06:40.076 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:06:40.088 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:06:40.089 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:06:40.101 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:06:40.102 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:06:40.855 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 36 16 291752 291736 506.44 553.688 0.00204123 0.00197321 2026-02-23T13:06:41.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:40 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/497819868' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:06:41.856 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 37 16 300270 300254 507.14 532.375 0.0016153 0.00197051 2026-02-23T13:06:42.146 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:06:42.171 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:41 trial046 ceph-mon[38575]: pgmap v138: 17 pgs: 17 active+clean; 16 GiB data, 51 GiB used, 2.7 TiB / 2.7 TiB avail; 418 MiB/s wr, 6.69k op/s 2026-02-23T13:06:42.301 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:42.675 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:42.674+0000 7fe76184b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:42.676 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:42.675+0000 7fe76184b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:42.692 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:06:42.692 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:06:42.708 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:06:42.708 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:06:42.723 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:06:42.723 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:06:42.736 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:06:42.736 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:06:42.856 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 38 16 308350 308334 507.082 505 0.00205558 0.00197075 2026-02-23T13:06:43.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:42 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/248551551' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:06:43.856 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 39 16 316915 316899 507.805 535.312 0.00171273 0.00196794 2026-02-23T13:06:44.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:43 trial046 ceph-mon[38575]: pgmap v139: 17 pgs: 17 active+clean; 18 GiB data, 59 GiB used, 2.7 TiB / 2.7 TiB avail; 638 MiB/s wr, 10.21k op/s 2026-02-23T13:06:44.359 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:06:44.360 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:06:44.360 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_1 2026-02-23T13:06:44.360 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:06:44.507 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:44.640 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:44.638+0000 7fcdca019640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:44.640 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:44.638+0000 7fcdca019640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:44.781 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:06:44.790 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:06:44.791 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:06:44.856 INFO:tasks.radosbench.radosbench.0.trial046.stdout:2026-02-23T13:06:44.855784+0000 min lat: 0.000713511 max lat: 0.0544095 avg lat: 0.00196605 2026-02-23T13:06:44.856 INFO:tasks.radosbench.radosbench.0.trial046.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-23T13:06:44.856 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 40 16 325119 325103 507.928 512.75 0.00161031 0.00196605 2026-02-23T13:06:45.364 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:45.444 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2026-02-23T13:06:44.619587+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19573441056,"num_objects":298660,"num_object_clones":0,"num_object_copies":895980,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":298660,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":298793,"num_write_kb":19116262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":62088524,"kb_used_data":56275516,"kb_used_omap":45,"kb_used_meta":5812882,"kb_avail":2873924276,"statfs":{"total":3006477107200,"available":2942898458624,"internally_reserved":0,"allocated":57626128384,"data_stored":57624743468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46688,"internal_metadata":5952391584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5423955968,"num_objects":82763,"num_object_clones":0,"num_object_copies":248289,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82763,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82763,"num_write_kb":5296832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001709"},"pg_stats":[{"pgid":"3.f","version":"52'18757","reported_seq":18777,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:41.609176+0000","last_change":"2026-02-23T13:06:03.767923+0000","last_active":"2026-02-23T13:06:41.609176+0000","last_peered":"2026-02-23T13:06:41.609176+0000","last_clean":"2026-02-23T13:06:41.609176+0000","last_became_active":"2026-02-23T13:06:03.767261+0000","last_became_peered":"2026-02-23T13:06:03.767261+0000","last_unstale":"2026-02-23T13:06:41.609176+0000","last_undegraded":"2026-02-23T13:06:41.609176+0000","last_fullsized":"2026-02-23T13:06:41.609176+0000","mapping_epoch":48,"log_start":"52'18754","ondisk_log_start":"52'18754","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:04.399152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1229258752,"num_objects":18757,"num_object_clones":0,"num_object_copies":56271,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18757,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18757,"num_write_kb":1200448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"52'18738","reported_seq":18758,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:41.610650+0000","last_change":"2026-02-23T13:06:03.768354+0000","last_active":"2026-02-23T13:06:41.610650+0000","last_peered":"2026-02-23T13:06:41.610650+0000","last_clean":"2026-02-23T13:06:41.610650+0000","last_became_active":"2026-02-23T13:06:03.767822+0000","last_became_peered":"2026-02-23T13:06:03.767822+0000","last_unstale":"2026-02-23T13:06:41.610650+0000","last_undegraded":"2026-02-23T13:06:41.610650+0000","last_fullsized":"2026-02-23T13:06:41.610650+0000","mapping_epoch":48,"log_start":"52'18735","ondisk_log_start":"52'18735","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:24.671155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1228013568,"num_objects":18738,"num_object_clones":0,"num_object_copies":56214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18738,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18738,"num_write_kb":1199232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"52'18741","reported_seq":18761,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:41.617141+0000","last_change":"2026-02-23T13:06:03.769230+0000","last_active":"2026-02-23T13:06:41.617141+0000","last_peered":"2026-02-23T13:06:41.617141+0000","last_clean":"2026-02-23T13:06:41.617141+0000","last_became_active":"2026-02-23T13:06:03.768946+0000","last_became_peered":"2026-02-23T13:06:03.768946+0000","last_unstale":"2026-02-23T13:06:41.617141+0000","last_undegraded":"2026-02-23T13:06:41.617141+0000","last_fullsized":"2026-02-23T13:06:41.617141+0000","mapping_epoch":48,"log_start":"52'18738","ondisk_log_start":"52'18738","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:26.718468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1228210176,"num_objects":18741,"num_object_clones":0,"num_object_copies":56223,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18741,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18741,"num_write_kb":1199424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"52'18689","reported_seq":18709,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:41.612393+0000","last_change":"2026-02-23T13:06:03.767398+0000","last_active":"2026-02-23T13:06:41.612393+0000","last_peered":"2026-02-23T13:06:41.612393+0000","last_clean":"2026-02-23T13:06:41.612393+0000","last_became_active":"2026-02-23T13:06:03.767083+0000","last_became_peered":"2026-02-23T13:06:03.767083+0000","last_unstale":"2026-02-23T13:06:41.612393+0000","last_undegraded":"2026-02-23T13:06:41.612393+0000","last_fullsized":"2026-02-23T13:06:41.612393+0000","mapping_epoch":48,"log_start":"52'18686","ondisk_log_start":"52'18686","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:32.716724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1224802304,"num_objects":18689,"num_object_clones":0,"num_object_copies":56067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18689,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18689,"num_write_kb":1196096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"52'18605","reported_seq":18624,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:41.669635+0000","last_change":"2026-02-23T13:06:03.767015+0000","last_active":"2026-02-23T13:06:41.669635+0000","last_peered":"2026-02-23T13:06:41.669635+0000","last_clean":"2026-02-23T13:06:41.669635+0000","last_became_active":"2026-02-23T13:06:03.766614+0000","last_became_peered":"2026-02-23T13:06:03.766614+0000","last_unstale":"2026-02-23T13:06:41.669635+0000","last_undegraded":"2026-02-23T13:06:41.669635+0000","last_fullsized":"2026-02-23T13:06:41.669635+0000","mapping_epoch":48,"log_start":"52'18602","ondisk_log_start":"52'18602","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:15.375425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1219297280,"num_objects":18605,"num_object_clones":0,"num_object_copies":55815,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18605,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18605,"num_write_kb":1190720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"52'18444","reported_seq":18463,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:41.618422+0000","last_change":"2026-02-23T13:06:03.768603+0000","last_active":"2026-02-23T13:06:41.618422+0000","last_peered":"2026-02-23T13:06:41.618422+0000","last_clean":"2026-02-23T13:06:41.618422+0000","last_became_active":"2026-02-23T13:06:03.768238+0000","last_became_peered":"2026-02-23T13:06:03.768238+0000","last_unstale":"2026-02-23T13:06:41.618422+0000","last_undegraded":"2026-02-23T13:06:41.618422+0000","last_fullsized":"2026-02-23T13:06:41.618422+0000","mapping_epoch":48,"log_start":"52'18441","ondisk_log_start":"52'18441","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:11.493313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1208745984,"num_objects":18444,"num_object_clones":0,"num_object_copies":55332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18444,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18444,"num_write_kb":1180416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"52'18625","reported_seq":18645,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:41.616963+0000","last_change":"2026-02-23T13:06:03.768373+0000","last_active":"2026-02-23T13:06:41.616963+0000","last_peered":"2026-02-23T13:06:41.616963+0000","last_clean":"2026-02-23T13:06:41.616963+0000","last_became_active":"2026-02-23T13:06:03.767947+0000","last_became_peered":"2026-02-23T13:06:03.767947+0000","last_unstale":"2026-02-23T13:06:41.616963+0000","last_undegraded":"2026-02-23T13:06:41.616963+0000","last_fullsized":"2026-02-23T13:06:41.616963+0000","mapping_epoch":48,"log_start":"52'18622","ondisk_log_start":"52'18622","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:05.474616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1220608000,"num_objects":18625,"num_object_clones":0,"num_object_copies":55875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18625,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18625,"num_write_kb":1192000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"52'18658","reported_seq":18676,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:41.670426+0000","last_change":"2026-02-23T13:06:03.767140+0000","last_active":"2026-02-23T13:06:41.670426+0000","last_peered":"2026-02-23T13:06:41.670426+0000","last_clean":"2026-02-23T13:06:41.670426+0000","last_became_active":"2026-02-23T13:06:03.766859+0000","last_became_peered":"2026-02-23T13:06:03.766859+0000","last_unstale":"2026-02-23T13:06:41.670426+0000","last_undegraded":"2026-02-23T13:06:41.670426+0000","last_fullsized":"2026-02-23T13:06:41.670426+0000","mapping_epoch":48,"log_start":"52'18655","ondisk_log_start":"52'18655","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:26.334481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1222770688,"num_objects":18658,"num_object_clones":0,"num_object_copies":55974,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18658,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18658,"num_write_kb":1194112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"52'18672","reported_seq":18692,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:41.664004+0000","last_change":"2026-02-23T13:06:03.765755+0000","last_active":"2026-02-23T13:06:41.664004+0000","last_peered":"2026-02-23T13:06:41.664004+0000","last_clean":"2026-02-23T13:06:41.664004+0000","last_became_active":"2026-02-23T13:06:03.765502+0000","last_became_peered":"2026-02-23T13:06:03.765502+0000","last_unstale":"2026-02-23T13:06:41.664004+0000","last_undegraded":"2026-02-23T13:06:41.664004+0000","last_fullsized":"2026-02-23T13:06:41.664004+0000","mapping_epoch":48,"log_start":"52'18669","ondisk_log_start":"52'18669","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:14.075905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1223688192,"num_objects":18672,"num_object_clones":0,"num_object_copies":56016,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18672,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18672,"num_write_kb":1195008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"52'18771","reported_seq":18790,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:41.605293+0000","last_change":"2026-02-23T13:06:03.767303+0000","last_active":"2026-02-23T13:06:41.605293+0000","last_peered":"2026-02-23T13:06:41.605293+0000","last_clean":"2026-02-23T13:06:41.605293+0000","last_became_active":"2026-02-23T13:06:03.767012+0000","last_became_peered":"2026-02-23T13:06:03.767012+0000","last_unstale":"2026-02-23T13:06:41.605293+0000","last_undegraded":"2026-02-23T13:06:41.605293+0000","last_fullsized":"2026-02-23T13:06:41.605293+0000","mapping_epoch":48,"log_start":"52'18768","ondisk_log_start":"52'18768","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:22.659298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1230176256,"num_objects":18771,"num_object_clones":0,"num_object_copies":56313,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18771,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18771,"num_write_kb":1201344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"52'18511","reported_seq":18530,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:41.610572+0000","last_change":"2026-02-23T13:06:03.767897+0000","last_active":"2026-02-23T13:06:41.610572+0000","last_peered":"2026-02-23T13:06:41.610572+0000","last_clean":"2026-02-23T13:06:41.610572+0000","last_became_active":"2026-02-23T13:06:03.767200+0000","last_became_peered":"2026-02-23T13:06:03.767200+0000","last_unstale":"2026-02-23T13:06:41.610572+0000","last_undegraded":"2026-02-23T13:06:41.610572+0000","last_fullsized":"2026-02-23T13:06:41.610572+0000","mapping_epoch":48,"log_start":"52'18508","ondisk_log_start":"52'18508","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:14.434473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1213136896,"num_objects":18511,"num_object_clones":0,"num_object_copies":55533,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18511,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18511,"num_write_kb":1184704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"52'18952","reported_seq":18972,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:41.667884+0000","last_change":"2026-02-23T13:06:03.766820+0000","last_active":"2026-02-23T13:06:41.667884+0000","last_peered":"2026-02-23T13:06:41.667884+0000","last_clean":"2026-02-23T13:06:41.667884+0000","last_became_active":"2026-02-23T13:06:03.766415+0000","last_became_peered":"2026-02-23T13:06:03.766415+0000","last_unstale":"2026-02-23T13:06:41.667884+0000","last_undegraded":"2026-02-23T13:06:41.667884+0000","last_fullsized":"2026-02-23T13:06:41.667884+0000","mapping_epoch":48,"log_start":"52'18949","ondisk_log_start":"52'18949","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:09.766385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1242038272,"num_objects":18952,"num_object_clones":0,"num_object_copies":56856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18952,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18952,"num_write_kb":1212928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"52'18419","reported_seq":18439,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:41.607127+0000","last_change":"2026-02-23T13:06:03.768871+0000","last_active":"2026-02-23T13:06:41.607127+0000","last_peered":"2026-02-23T13:06:41.607127+0000","last_clean":"2026-02-23T13:06:41.607127+0000","last_became_active":"2026-02-23T13:06:03.768541+0000","last_became_peered":"2026-02-23T13:06:03.768541+0000","last_unstale":"2026-02-23T13:06:41.607127+0000","last_undegraded":"2026-02-23T13:06:41.607127+0000","last_fullsized":"2026-02-23T13:06:41.607127+0000","mapping_epoch":48,"log_start":"52'18416","ondisk_log_start":"52'18416","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:31.119570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1207107584,"num_objects":18419,"num_object_clones":0,"num_object_copies":55257,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18419,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18419,"num_write_kb":1178816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"52'18488","reported_seq":18507,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:41.606510+0000","last_change":"2026-02-23T13:06:03.767275+0000","last_active":"2026-02-23T13:06:41.606510+0000","last_peered":"2026-02-23T13:06:41.606510+0000","last_clean":"2026-02-23T13:06:41.606510+0000","last_became_active":"2026-02-23T13:06:03.767001+0000","last_became_peered":"2026-02-23T13:06:03.767001+0000","last_unstale":"2026-02-23T13:06:41.606510+0000","last_undegraded":"2026-02-23T13:06:41.606510+0000","last_fullsized":"2026-02-23T13:06:41.606510+0000","mapping_epoch":48,"log_start":"52'18485","ondisk_log_start":"52'18485","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:12.872474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1211629568,"num_objects":18488,"num_object_clones":0,"num_object_copies":55464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18488,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18488,"num_write_kb":1183232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"52'18817","reported_seq":18837,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:41.660945+0000","last_change":"2026-02-23T13:06:03.767357+0000","last_active":"2026-02-23T13:06:41.660945+0000","last_peered":"2026-02-23T13:06:41.660945+0000","last_clean":"2026-02-23T13:06:41.660945+0000","last_became_active":"2026-02-23T13:06:03.766997+0000","last_became_peered":"2026-02-23T13:06:03.766997+0000","last_unstale":"2026-02-23T13:06:41.660945+0000","last_undegraded":"2026-02-23T13:06:41.660945+0000","last_fullsized":"2026-02-23T13:06:41.660945+0000","mapping_epoch":48,"log_start":"52'18814","ondisk_log_start":"52'18814","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:08.982263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1233190912,"num_objects":18817,"num_object_clones":0,"num_object_copies":56451,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18817,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18817,"num_write_kb":1204288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"52'18771","reported_seq":18790,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:41.670442+0000","last_change":"2026-02-23T13:06:03.767298+0000","last_active":"2026-02-23T13:06:41.670442+0000","last_peered":"2026-02-23T13:06:41.670442+0000","last_clean":"2026-02-23T13:06:41.670442+0000","last_became_active":"2026-02-23T13:06:03.767015+0000","last_became_peered":"2026-02-23T13:06:03.767015+0000","last_unstale":"2026-02-23T13:06:41.670442+0000","last_undegraded":"2026-02-23T13:06:41.670442+0000","last_fullsized":"2026-02-23T13:06:41.670442+0000","mapping_epoch":48,"log_start":"52'18768","ondisk_log_start":"52'18768","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:29.610437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1230176256,"num_objects":18771,"num_object_clones":0,"num_object_copies":56313,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18771,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18771,"num_write_kb":1201344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":249,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:12.781791+0000","last_change":"2026-02-23T13:05:29.192008+0000","last_active":"2026-02-23T13:06:12.781791+0000","last_peered":"2026-02-23T13:06:12.781791+0000","last_clean":"2026-02-23T13:06:12.781791+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:06:12.781791+0000","last_undegraded":"2026-02-23T13:06:12.781791+0000","last_fullsized":"2026-02-23T13:06:12.781791+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:05:29.191972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:05:29.191972+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:06:50.435825+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":19572850688,"num_objects":298658,"num_object_clones":0,"num_object_copies":895974,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":298658,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":298658,"num_write_kb":19114112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":58703085568,"data_stored":58703085568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1228,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247855,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":13350564,"kb_used_data":11774032,"kb_used_omap":10,"kb_used_meta":1576501,"kb_avail":720652636,"statfs":{"total":751619276800,"available":737948299264,"internally_reserved":0,"allocated":12056608768,"data_stored":12056261651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10837,"internal_metadata":1614337451},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444082,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":17900388,"kb_used_data":16437392,"kb_used_omap":11,"kb_used_meta":1462964,"kb_avail":716102812,"statfs":{"total":751619276800,"available":733289279488,"internally_reserved":0,"allocated":16831889408,"data_stored":16831542291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11743,"internal_metadata":1498075681},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":14353184,"kb_used_data":12934348,"kb_used_omap":12,"kb_used_meta":1418803,"kb_avail":719650016,"statfs":{"total":751619276800,"available":736921616384,"internally_reserved":0,"allocated":13244772352,"data_stored":13244428787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12486,"internal_metadata":1452855098},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705717,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":16484388,"kb_used_data":15129744,"kb_used_omap":11,"kb_used_meta":1354612,"kb_avail":717518812,"statfs":{"total":751619276800,"available":734739263488,"internally_reserved":0,"allocated":15492857856,"data_stored":15492510739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11622,"internal_metadata":1387123354},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1228,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15892676608,"data_stored":15892676608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13485277184,"data_stored":13485277184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17113153536,"data_stored":17113153536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12211978240,"data_stored":12211978240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:06:45.446 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:06:45.446 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_1 pg_num 46 2026-02-23T13:06:45.703 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:45.856 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 41 15 331115 331100 504.681 374.812 0.00210939 0.00198015 2026-02-23T13:06:45.883 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:45.849+0000 7f90e92a5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:45.883 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:45.849+0000 7f90e92a5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:45.883 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:06:45.883 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:06:45.884 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:06:45.884 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:06:45.894 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:06:45.894 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:06:45.908 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:06:45.908 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:06:46.000 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:45 trial046 ceph-mon[38575]: pgmap v140: 17 pgs: 17 active+clean; 18 GiB data, 59 GiB used, 2.7 TiB / 2.7 TiB avail; 431 MiB/s wr, 6.89k op/s 2026-02-23T13:06:46.000 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:45 trial046 ceph-mon[38575]: from='client.14689 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:06:46.000 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:45 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:06:46.290 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:06:46 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:06:46] "GET /metrics HTTP/1.1" 200 4211 "" "Prometheus/3.6.0" 2026-02-23T13:06:46.470 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:06:46 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:06:46.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:06:46.836 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:46.790+0000 7f0314813640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:46.837 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:46.790+0000 7f0314813640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:46.856 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 42 16 337263 337247 501.811 384.188 0.00174252 0.00199147 2026-02-23T13:06:46.938 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:06:46.938 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:46 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3252362368' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:06:47.653 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:06:47.856 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 43 15 344010 343995 499.948 421.75 0.00160437 0.00199887 2026-02-23T13:06:48.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:47 trial046 ceph-mon[38575]: pgmap v141: 17 pgs: 17 active+clean; 19 GiB data, 64 GiB used, 2.7 TiB / 2.7 TiB avail; 503 MiB/s wr, 8.05k op/s 2026-02-23T13:06:48.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:47 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2451808405' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_1", "var": "pg_num", "val": "46"} : dispatch 2026-02-23T13:06:48.590 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:06:48.739 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:48.856 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 44 16 352255 352239 500.295 515.25 0.00151377 0.00199674 2026-02-23T13:06:49.266 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:49.199+0000 7fb8e27ab640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:49.266 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:49.200+0000 7fb8e27ab640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:49.266 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:06:49.266 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:06:49.267 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:06:49.267 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:06:49.267 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:06:49.267 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:06:49.276 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:06:49.277 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:06:49.856 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 45 16 359356 359340 499.039 443.812 0.00161418 0.00200255 2026-02-23T13:06:50.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:49 trial046 ceph-mon[38575]: pgmap v142: 17 pgs: 17 active+clean; 21 GiB data, 67 GiB used, 2.7 TiB / 2.7 TiB avail; 545 MiB/s wr, 8.72k op/s 2026-02-23T13:06:50.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:49 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2907613874' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:06:50.856 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 46 16 367615 367599 499.411 516.188 0.00122481 0.00200104 2026-02-23T13:06:51.507 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:06:51.658 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:51.785 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:51.784+0000 7f2983944640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:51.786 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:51.784+0000 7f2983944640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:51.801 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:06:51.802 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:06:51.818 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:06:51.818 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:06:51.830 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:06:51.831 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:06:51.845 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:06:51.845 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:06:51.856 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 47 15 376130 376115 500.109 532.25 0.00211188 0.00199825 2026-02-23T13:06:52.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:51 trial046 ceph-mon[38575]: pgmap v143: 17 pgs: 17 active+clean; 21 GiB data, 67 GiB used, 2.7 TiB / 2.7 TiB avail; 413 MiB/s wr, 6.61k op/s 2026-02-23T13:06:52.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:51 trial046 ceph-mon[38575]: 1.0 scrub starts 2026-02-23T13:06:52.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:51 trial046 ceph-mon[38575]: 1.0 scrub ok 2026-02-23T13:06:52.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:51 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3489024528' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:06:52.654 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:06:52.654 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:06:52.655 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:06:52.655 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:06:52.810 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:52.857 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 48 16 384831 384815 501.018 543.75 0.00165686 0.00199463 2026-02-23T13:06:52.942 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:52.940+0000 7f4fef8e1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:52.942 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:52.940+0000 7f4fef8e1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:53.095 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:06:53.096 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:06:53.143 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":144,"stamp":"2026-02-23T13:06:52.620603+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":24534712864,"num_objects":374363,"num_object_clones":0,"num_object_copies":1123089,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":374363,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":374496,"num_write_kb":23961254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":77009932,"kb_used_data":70709564,"kb_used_omap":41,"kb_used_meta":6300246,"kb_avail":2859002868,"statfs":{"total":3006477107200,"available":2927618936832,"internally_reserved":0,"allocated":72406593536,"data_stored":72405208620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42325,"internal_metadata":6451452587},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7723941888,"num_objects":117858,"num_object_clones":0,"num_object_copies":353574,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117858,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117858,"num_write_kb":7542912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001602"},"pg_stats":[{"pgid":"3.f","version":"52'23467","reported_seq":23487,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:51.609095+0000","last_change":"2026-02-23T13:06:03.767923+0000","last_active":"2026-02-23T13:06:51.609095+0000","last_peered":"2026-02-23T13:06:51.609095+0000","last_clean":"2026-02-23T13:06:51.609095+0000","last_became_active":"2026-02-23T13:06:03.767261+0000","last_became_peered":"2026-02-23T13:06:03.767261+0000","last_unstale":"2026-02-23T13:06:51.609095+0000","last_undegraded":"2026-02-23T13:06:51.609095+0000","last_fullsized":"2026-02-23T13:06:51.609095+0000","mapping_epoch":48,"log_start":"52'23464","ondisk_log_start":"52'23464","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:04.399152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1537933312,"num_objects":23467,"num_object_clones":0,"num_object_copies":70401,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23467,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23467,"num_write_kb":1501888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"52'23404","reported_seq":23424,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:51.608698+0000","last_change":"2026-02-23T13:06:03.768354+0000","last_active":"2026-02-23T13:06:51.608698+0000","last_peered":"2026-02-23T13:06:51.608698+0000","last_clean":"2026-02-23T13:06:51.608698+0000","last_became_active":"2026-02-23T13:06:03.767822+0000","last_became_peered":"2026-02-23T13:06:03.767822+0000","last_unstale":"2026-02-23T13:06:51.608698+0000","last_undegraded":"2026-02-23T13:06:51.608698+0000","last_fullsized":"2026-02-23T13:06:51.608698+0000","mapping_epoch":48,"log_start":"52'23401","ondisk_log_start":"52'23401","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:24.671155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1533804544,"num_objects":23404,"num_object_clones":0,"num_object_copies":70212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23404,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23404,"num_write_kb":1497856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"52'23530","reported_seq":23550,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:51.613248+0000","last_change":"2026-02-23T13:06:03.769230+0000","last_active":"2026-02-23T13:06:51.613248+0000","last_peered":"2026-02-23T13:06:51.613248+0000","last_clean":"2026-02-23T13:06:51.613248+0000","last_became_active":"2026-02-23T13:06:03.768946+0000","last_became_peered":"2026-02-23T13:06:03.768946+0000","last_unstale":"2026-02-23T13:06:51.613248+0000","last_undegraded":"2026-02-23T13:06:51.613248+0000","last_fullsized":"2026-02-23T13:06:51.613248+0000","mapping_epoch":48,"log_start":"52'23527","ondisk_log_start":"52'23527","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:26.718468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1542062080,"num_objects":23530,"num_object_clones":0,"num_object_copies":70590,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23530,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23530,"num_write_kb":1505920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"52'23416","reported_seq":23436,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:51.619639+0000","last_change":"2026-02-23T13:06:03.767398+0000","last_active":"2026-02-23T13:06:51.619639+0000","last_peered":"2026-02-23T13:06:51.619639+0000","last_clean":"2026-02-23T13:06:51.619639+0000","last_became_active":"2026-02-23T13:06:03.767083+0000","last_became_peered":"2026-02-23T13:06:03.767083+0000","last_unstale":"2026-02-23T13:06:51.619639+0000","last_undegraded":"2026-02-23T13:06:51.619639+0000","last_fullsized":"2026-02-23T13:06:51.619639+0000","mapping_epoch":48,"log_start":"52'23413","ondisk_log_start":"52'23413","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:32.716724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1534590976,"num_objects":23416,"num_object_clones":0,"num_object_copies":70248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23416,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23416,"num_write_kb":1498624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"52'23424","reported_seq":23444,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:51.689730+0000","last_change":"2026-02-23T13:06:03.767015+0000","last_active":"2026-02-23T13:06:51.689730+0000","last_peered":"2026-02-23T13:06:51.689730+0000","last_clean":"2026-02-23T13:06:51.689730+0000","last_became_active":"2026-02-23T13:06:03.766614+0000","last_became_peered":"2026-02-23T13:06:03.766614+0000","last_unstale":"2026-02-23T13:06:51.689730+0000","last_undegraded":"2026-02-23T13:06:51.689730+0000","last_fullsized":"2026-02-23T13:06:51.689730+0000","mapping_epoch":48,"log_start":"52'23421","ondisk_log_start":"52'23421","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:15.375425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1535115264,"num_objects":23424,"num_object_clones":0,"num_object_copies":70272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23424,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23424,"num_write_kb":1499136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"52'23229","reported_seq":23249,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:51.617922+0000","last_change":"2026-02-23T13:06:03.768603+0000","last_active":"2026-02-23T13:06:51.617922+0000","last_peered":"2026-02-23T13:06:51.617922+0000","last_clean":"2026-02-23T13:06:51.617922+0000","last_became_active":"2026-02-23T13:06:03.768238+0000","last_became_peered":"2026-02-23T13:06:03.768238+0000","last_unstale":"2026-02-23T13:06:51.617922+0000","last_undegraded":"2026-02-23T13:06:51.617922+0000","last_fullsized":"2026-02-23T13:06:51.617922+0000","mapping_epoch":48,"log_start":"52'23226","ondisk_log_start":"52'23226","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:11.493313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1522335744,"num_objects":23229,"num_object_clones":0,"num_object_copies":69687,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23229,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23229,"num_write_kb":1486656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"52'23389","reported_seq":23409,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:51.619254+0000","last_change":"2026-02-23T13:06:03.768373+0000","last_active":"2026-02-23T13:06:51.619254+0000","last_peered":"2026-02-23T13:06:51.619254+0000","last_clean":"2026-02-23T13:06:51.619254+0000","last_became_active":"2026-02-23T13:06:03.767947+0000","last_became_peered":"2026-02-23T13:06:03.767947+0000","last_unstale":"2026-02-23T13:06:51.619254+0000","last_undegraded":"2026-02-23T13:06:51.619254+0000","last_fullsized":"2026-02-23T13:06:51.619254+0000","mapping_epoch":48,"log_start":"52'23386","ondisk_log_start":"52'23386","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:05.474616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1532821504,"num_objects":23389,"num_object_clones":0,"num_object_copies":70167,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23389,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23389,"num_write_kb":1496896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"52'23341","reported_seq":23360,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:51.691920+0000","last_change":"2026-02-23T13:06:03.767140+0000","last_active":"2026-02-23T13:06:51.691920+0000","last_peered":"2026-02-23T13:06:51.691920+0000","last_clean":"2026-02-23T13:06:51.691920+0000","last_became_active":"2026-02-23T13:06:03.766859+0000","last_became_peered":"2026-02-23T13:06:03.766859+0000","last_unstale":"2026-02-23T13:06:51.691920+0000","last_undegraded":"2026-02-23T13:06:51.691920+0000","last_fullsized":"2026-02-23T13:06:51.691920+0000","mapping_epoch":48,"log_start":"52'23338","ondisk_log_start":"52'23338","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:26.334481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1529675776,"num_objects":23341,"num_object_clones":0,"num_object_copies":70023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23341,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23341,"num_write_kb":1493824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"52'23332","reported_seq":23352,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:51.689946+0000","last_change":"2026-02-23T13:06:03.765755+0000","last_active":"2026-02-23T13:06:51.689946+0000","last_peered":"2026-02-23T13:06:51.689946+0000","last_clean":"2026-02-23T13:06:51.689946+0000","last_became_active":"2026-02-23T13:06:03.765502+0000","last_became_peered":"2026-02-23T13:06:03.765502+0000","last_unstale":"2026-02-23T13:06:51.689946+0000","last_undegraded":"2026-02-23T13:06:51.689946+0000","last_fullsized":"2026-02-23T13:06:51.689946+0000","mapping_epoch":48,"log_start":"52'23329","ondisk_log_start":"52'23329","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:14.075905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1529085952,"num_objects":23332,"num_object_clones":0,"num_object_copies":69996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23332,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23332,"num_write_kb":1493248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"52'23518","reported_seq":23538,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:51.601786+0000","last_change":"2026-02-23T13:06:03.767303+0000","last_active":"2026-02-23T13:06:51.601786+0000","last_peered":"2026-02-23T13:06:51.601786+0000","last_clean":"2026-02-23T13:06:51.601786+0000","last_became_active":"2026-02-23T13:06:03.767012+0000","last_became_peered":"2026-02-23T13:06:03.767012+0000","last_unstale":"2026-02-23T13:06:51.601786+0000","last_undegraded":"2026-02-23T13:06:51.601786+0000","last_fullsized":"2026-02-23T13:06:51.601786+0000","mapping_epoch":48,"log_start":"52'23515","ondisk_log_start":"52'23515","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:22.659298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1541275648,"num_objects":23518,"num_object_clones":0,"num_object_copies":70554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23518,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23518,"num_write_kb":1505152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"52'23203","reported_seq":23223,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:51.610473+0000","last_change":"2026-02-23T13:06:03.767897+0000","last_active":"2026-02-23T13:06:51.610473+0000","last_peered":"2026-02-23T13:06:51.610473+0000","last_clean":"2026-02-23T13:06:51.610473+0000","last_became_active":"2026-02-23T13:06:03.767200+0000","last_became_peered":"2026-02-23T13:06:03.767200+0000","last_unstale":"2026-02-23T13:06:51.610473+0000","last_undegraded":"2026-02-23T13:06:51.610473+0000","last_fullsized":"2026-02-23T13:06:51.610473+0000","mapping_epoch":48,"log_start":"52'23200","ondisk_log_start":"52'23200","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:14.434473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1520631808,"num_objects":23203,"num_object_clones":0,"num_object_copies":69609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23203,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23203,"num_write_kb":1484992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"52'23785","reported_seq":23804,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:51.689829+0000","last_change":"2026-02-23T13:06:03.766820+0000","last_active":"2026-02-23T13:06:51.689829+0000","last_peered":"2026-02-23T13:06:51.689829+0000","last_clean":"2026-02-23T13:06:51.689829+0000","last_became_active":"2026-02-23T13:06:03.766415+0000","last_became_peered":"2026-02-23T13:06:03.766415+0000","last_unstale":"2026-02-23T13:06:51.689829+0000","last_undegraded":"2026-02-23T13:06:51.689829+0000","last_fullsized":"2026-02-23T13:06:51.689829+0000","mapping_epoch":48,"log_start":"52'23782","ondisk_log_start":"52'23782","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:09.766385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1558773760,"num_objects":23785,"num_object_clones":0,"num_object_copies":71355,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23785,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23785,"num_write_kb":1522240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"52'23220","reported_seq":23240,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:51.610752+0000","last_change":"2026-02-23T13:06:03.768871+0000","last_active":"2026-02-23T13:06:51.610752+0000","last_peered":"2026-02-23T13:06:51.610752+0000","last_clean":"2026-02-23T13:06:51.610752+0000","last_became_active":"2026-02-23T13:06:03.768541+0000","last_became_peered":"2026-02-23T13:06:03.768541+0000","last_unstale":"2026-02-23T13:06:51.610752+0000","last_undegraded":"2026-02-23T13:06:51.610752+0000","last_fullsized":"2026-02-23T13:06:51.610752+0000","mapping_epoch":48,"log_start":"52'23217","ondisk_log_start":"52'23217","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:31.119570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1521745920,"num_objects":23220,"num_object_clones":0,"num_object_copies":69660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23220,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23220,"num_write_kb":1486080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"52'23099","reported_seq":23119,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:51.608244+0000","last_change":"2026-02-23T13:06:03.767275+0000","last_active":"2026-02-23T13:06:51.608244+0000","last_peered":"2026-02-23T13:06:51.608244+0000","last_clean":"2026-02-23T13:06:51.608244+0000","last_became_active":"2026-02-23T13:06:03.767001+0000","last_became_peered":"2026-02-23T13:06:03.767001+0000","last_unstale":"2026-02-23T13:06:51.608244+0000","last_undegraded":"2026-02-23T13:06:51.608244+0000","last_fullsized":"2026-02-23T13:06:51.608244+0000","mapping_epoch":48,"log_start":"52'23096","ondisk_log_start":"52'23096","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:12.872474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1513816064,"num_objects":23099,"num_object_clones":0,"num_object_copies":69297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23099,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23099,"num_write_kb":1478336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"52'23596","reported_seq":23616,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:51.682410+0000","last_change":"2026-02-23T13:06:03.767357+0000","last_active":"2026-02-23T13:06:51.682410+0000","last_peered":"2026-02-23T13:06:51.682410+0000","last_clean":"2026-02-23T13:06:51.682410+0000","last_became_active":"2026-02-23T13:06:03.766997+0000","last_became_peered":"2026-02-23T13:06:03.766997+0000","last_unstale":"2026-02-23T13:06:51.682410+0000","last_undegraded":"2026-02-23T13:06:51.682410+0000","last_fullsized":"2026-02-23T13:06:51.682410+0000","mapping_epoch":48,"log_start":"52'23593","ondisk_log_start":"52'23593","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:08.982263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1546387456,"num_objects":23596,"num_object_clones":0,"num_object_copies":70788,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23596,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23596,"num_write_kb":1510144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"52'23408","reported_seq":23428,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:51.684213+0000","last_change":"2026-02-23T13:06:03.767298+0000","last_active":"2026-02-23T13:06:51.684213+0000","last_peered":"2026-02-23T13:06:51.684213+0000","last_clean":"2026-02-23T13:06:51.684213+0000","last_became_active":"2026-02-23T13:06:03.767015+0000","last_became_peered":"2026-02-23T13:06:03.767015+0000","last_unstale":"2026-02-23T13:06:51.684213+0000","last_undegraded":"2026-02-23T13:06:51.684213+0000","last_fullsized":"2026-02-23T13:06:51.684213+0000","mapping_epoch":48,"log_start":"52'23405","ondisk_log_start":"52'23405","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:29.610437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1534066688,"num_objects":23408,"num_object_clones":0,"num_object_copies":70224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23408,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23408,"num_write_kb":1498112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":257,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:51.141808+0000","last_change":"2026-02-23T13:06:51.141808+0000","last_active":"2026-02-23T13:06:51.141808+0000","last_peered":"2026-02-23T13:06:51.141808+0000","last_clean":"2026-02-23T13:06:51.141808+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:06:51.141808+0000","last_undegraded":"2026-02-23T13:06:51.141808+0000","last_fullsized":"2026-02-23T13:06:51.141808+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:06:51.141759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:06:51.141759+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:55.931020+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":24534122496,"num_objects":374361,"num_object_clones":0,"num_object_copies":1123083,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":374361,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":374361,"num_write_kb":23959104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73584345088,"data_stored":73584345088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247857,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":16126884,"kb_used_data":14784912,"kb_used_omap":6,"kb_used_meta":1341945,"kb_avail":717876316,"statfs":{"total":751619276800,"available":735105347584,"internally_reserved":0,"allocated":15139749888,"data_stored":15139402771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6474,"internal_metadata":1374152374},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444084,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":22345380,"kb_used_data":20629712,"kb_used_omap":11,"kb_used_meta":1715636,"kb_avail":711657820,"statfs":{"total":751619276800,"available":728737607680,"internally_reserved":0,"allocated":21124825088,"data_stored":21124477971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11743,"internal_metadata":1756811809},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":17864160,"kb_used_data":16228748,"kb_used_omap":12,"kb_used_meta":1635379,"kb_avail":716139040,"statfs":{"total":751619276800,"available":733326376960,"internally_reserved":0,"allocated":16618237952,"data_stored":16617894387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12486,"internal_metadata":1674628922},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705719,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":20673508,"kb_used_data":19066192,"kb_used_omap":11,"kb_used_meta":1607284,"kb_avail":713329692,"statfs":{"total":751619276800,"available":730449604608,"internally_reserved":0,"allocated":19523780608,"data_stored":19523433491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11622,"internal_metadata":1645859482},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":19929169920,"data_stored":19929169920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16892297216,"data_stored":16892297216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21457469440,"data_stored":21457469440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15305408512,"data_stored":15305408512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:06:53.145 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:06:53.145 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 81 2026-02-23T13:06:53.293 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:53.422 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:53.419+0000 7fc9ea312640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:53.422 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:53.420+0000 7fc9ea312640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:53.572 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:06:53.616 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:06:53.857 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 49 16 393051 393035 501.273 513.75 0.00243768 0.0019936 2026-02-23T13:06:53.892 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:06:53.918 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:53 trial046 ceph-mon[38575]: pgmap v144: 17 pgs: 17 active+clean; 23 GiB data, 73 GiB used, 2.7 TiB / 2.7 TiB avail; 614 MiB/s wr, 9.82k op/s 2026-02-23T13:06:53.918 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:53 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1193638760' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "81"} : dispatch 2026-02-23T13:06:54.042 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:54.177 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:54.174+0000 7f5ff11a2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:54.177 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:54.175+0000 7f5ff11a2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:54.193 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:06:54.193 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:06:54.208 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:06:54.208 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:06:54.221 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:06:54.221 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:06:54.236 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:06:54.237 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:06:54.857 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 50 16 401330 401314 501.596 517.438 0.00185239 0.00199232 2026-02-23T13:06:55.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:54 trial046 ceph-mon[38575]: from='client.14699 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:06:55.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:54 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2917740121' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:06:55.857 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 51 16 409733 409717 502.058 525.188 0.00177467 0.00199049 2026-02-23T13:06:56.088 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:55 trial046 ceph-mon[38575]: pgmap v145: 17 pgs: 17 active+clean; 23 GiB data, 73 GiB used, 2.7 TiB / 2.7 TiB avail; 394 MiB/s wr, 6.31k op/s 2026-02-23T13:06:56.282 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:06:56.427 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:56.539 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:06:56 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:06:56] "GET /metrics HTTP/1.1" 200 4211 "" "Prometheus/3.6.0" 2026-02-23T13:06:56.561 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:06:56 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:06:56.087Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:06:56.858 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 52 16 416925 416909 501.046 449.5 0.0310159 0.0019939 2026-02-23T13:06:56.935 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:56.904+0000 7f7f99e84640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:56.935 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:56.905+0000 7f7f99e84640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:56.935 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:06:56.936 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:06:56.936 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:06:56.936 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:06:56.948 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:06:56.948 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:06:56.965 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:06:56.965 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:06:57.857 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 53 16 424695 424679 500.75 485.625 0.00191148 0.00199568 2026-02-23T13:06:58.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:57 trial046 ceph-mon[38575]: pgmap v146: 17 pgs: 17 active+clean; 24 GiB data, 78 GiB used, 2.7 TiB / 2.7 TiB avail; 475 MiB/s wr, 7.60k op/s 2026-02-23T13:06:58.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:57 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/833940450' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:06:58.618 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:06:58.618 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:06:58.618 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2026-02-23T13:06:58.618 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph tell osd.0 'trim stale osdmaps' 2026-02-23T13:06:58.764 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:58.857 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 54 16 433274 433258 501.406 536.188 0.00248571 0.00199308 2026-02-23T13:06:58.898 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:58.896+0000 7f5f56285640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:58.898 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:58.896+0000 7f5f56285640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:58.920 INFO:teuthology.orchestra.run.trial046.stderr:no valid command found; 10 closest matches: 2026-02-23T13:06:58.920 INFO:teuthology.orchestra.run.trial046.stderr:0 2026-02-23T13:06:58.921 INFO:teuthology.orchestra.run.trial046.stderr:1 2026-02-23T13:06:58.921 INFO:teuthology.orchestra.run.trial046.stderr:2 2026-02-23T13:06:58.921 INFO:teuthology.orchestra.run.trial046.stderr:abort 2026-02-23T13:06:58.921 INFO:teuthology.orchestra.run.trial046.stderr:assert 2026-02-23T13:06:58.921 INFO:teuthology.orchestra.run.trial046.stderr:bench [] [] [] [] 2026-02-23T13:06:58.921 INFO:teuthology.orchestra.run.trial046.stderr:bluefs debug_inject_read_zeros 2026-02-23T13:06:58.921 INFO:teuthology.orchestra.run.trial046.stderr:bluefs files list 2026-02-23T13:06:58.921 INFO:teuthology.orchestra.run.trial046.stderr:bluefs stats 2026-02-23T13:06:58.922 INFO:teuthology.orchestra.run.trial046.stderr:bluestore allocator dump block 2026-02-23T13:06:58.922 INFO:teuthology.orchestra.run.trial046.stderr:Error EINVAL: invalid command 2026-02-23T13:06:58.957 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-23T13:06:58.958 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-23T13:06:58.958 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph tell osd.1 'trim stale osdmaps' 2026-02-23T13:06:59.107 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:59.241 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:59.238+0000 7fb82870f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:59.241 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:59.238+0000 7fb82870f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:59.258 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:06:59.263 INFO:teuthology.orchestra.run.trial046.stderr:no valid command found; 10 closest matches: 2026-02-23T13:06:59.263 INFO:teuthology.orchestra.run.trial046.stderr:0 2026-02-23T13:06:59.263 INFO:teuthology.orchestra.run.trial046.stderr:1 2026-02-23T13:06:59.263 INFO:teuthology.orchestra.run.trial046.stderr:2 2026-02-23T13:06:59.263 INFO:teuthology.orchestra.run.trial046.stderr:abort 2026-02-23T13:06:59.263 INFO:teuthology.orchestra.run.trial046.stderr:assert 2026-02-23T13:06:59.263 INFO:teuthology.orchestra.run.trial046.stderr:bench [] [] [] [] 2026-02-23T13:06:59.263 INFO:teuthology.orchestra.run.trial046.stderr:bluefs debug_inject_read_zeros 2026-02-23T13:06:59.263 INFO:teuthology.orchestra.run.trial046.stderr:bluefs files list 2026-02-23T13:06:59.263 INFO:teuthology.orchestra.run.trial046.stderr:bluefs stats 2026-02-23T13:06:59.263 INFO:teuthology.orchestra.run.trial046.stderr:bluestore allocator dump block 2026-02-23T13:06:59.263 INFO:teuthology.orchestra.run.trial046.stderr:Error EINVAL: invalid command 2026-02-23T13:06:59.306 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-23T13:06:59.306 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-23T13:06:59.307 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph tell osd.2 'trim stale osdmaps' 2026-02-23T13:06:59.410 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:59.501 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:59.529 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:59.527+0000 7fca7efe2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:59.529 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:59.527+0000 7fca7efe2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:59.545 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:06:59.546 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:06:59.563 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:06:59.563 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:06:59.576 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:06:59.576 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:06:59.592 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:06:59.592 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:06:59.633 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:59.631+0000 7fd4d67b6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:59.633 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:06:59.631+0000 7fd4d67b6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:06:59.658 INFO:teuthology.orchestra.run.trial046.stderr:no valid command found; 10 closest matches: 2026-02-23T13:06:59.658 INFO:teuthology.orchestra.run.trial046.stderr:0 2026-02-23T13:06:59.658 INFO:teuthology.orchestra.run.trial046.stderr:1 2026-02-23T13:06:59.658 INFO:teuthology.orchestra.run.trial046.stderr:2 2026-02-23T13:06:59.658 INFO:teuthology.orchestra.run.trial046.stderr:abort 2026-02-23T13:06:59.658 INFO:teuthology.orchestra.run.trial046.stderr:assert 2026-02-23T13:06:59.658 INFO:teuthology.orchestra.run.trial046.stderr:bench [] [] [] [] 2026-02-23T13:06:59.659 INFO:teuthology.orchestra.run.trial046.stderr:bluefs debug_inject_read_zeros 2026-02-23T13:06:59.659 INFO:teuthology.orchestra.run.trial046.stderr:bluefs files list 2026-02-23T13:06:59.659 INFO:teuthology.orchestra.run.trial046.stderr:bluefs stats 2026-02-23T13:06:59.659 INFO:teuthology.orchestra.run.trial046.stderr:bluestore allocator dump block 2026-02-23T13:06:59.659 INFO:teuthology.orchestra.run.trial046.stderr:Error EINVAL: invalid command 2026-02-23T13:06:59.701 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-23T13:06:59.702 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-23T13:06:59.702 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph tell osd.3 'trim stale osdmaps' 2026-02-23T13:06:59.858 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 55 16 441243 441227 501.344 498.062 0.00144216 0.00199332 2026-02-23T13:06:59.891 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:06:59.953 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:59 trial046 ceph-mon[38575]: pgmap v147: 17 pgs: 17 active+clean; 25 GiB data, 82 GiB used, 2.7 TiB / 2.7 TiB avail; 537 MiB/s wr, 8.59k op/s 2026-02-23T13:06:59.953 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:06:59 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1993656000' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:07:00.022 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:00.020+0000 7f983a66f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:00.022 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:00.020+0000 7f983a66f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:00.043 INFO:teuthology.orchestra.run.trial046.stderr:no valid command found; 10 closest matches: 2026-02-23T13:07:00.044 INFO:teuthology.orchestra.run.trial046.stderr:0 2026-02-23T13:07:00.044 INFO:teuthology.orchestra.run.trial046.stderr:1 2026-02-23T13:07:00.044 INFO:teuthology.orchestra.run.trial046.stderr:2 2026-02-23T13:07:00.044 INFO:teuthology.orchestra.run.trial046.stderr:abort 2026-02-23T13:07:00.044 INFO:teuthology.orchestra.run.trial046.stderr:assert 2026-02-23T13:07:00.044 INFO:teuthology.orchestra.run.trial046.stderr:bench [] [] [] [] 2026-02-23T13:07:00.044 INFO:teuthology.orchestra.run.trial046.stderr:bluefs debug_inject_read_zeros 2026-02-23T13:07:00.044 INFO:teuthology.orchestra.run.trial046.stderr:bluefs files list 2026-02-23T13:07:00.044 INFO:teuthology.orchestra.run.trial046.stderr:bluefs stats 2026-02-23T13:07:00.044 INFO:teuthology.orchestra.run.trial046.stderr:bluestore allocator dump block 2026-02-23T13:07:00.045 INFO:teuthology.orchestra.run.trial046.stderr:Error EINVAL: invalid command 2026-02-23T13:07:00.081 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-23T13:07:00.082 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-23T13:07:00.858 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 56 16 449825 449809 501.969 536.375 0.00196824 0.00199084 2026-02-23T13:07:01.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:00 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:07:01.638 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:07:01.790 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:01.858 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 57 16 457929 457913 502.048 506.5 0.00235362 0.00199054 2026-02-23T13:07:01.921 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:01.919+0000 7f3af2255640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:01.921 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:01.919+0000 7f3af2255640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:01.922 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:01 trial046 ceph-mon[38575]: pgmap v148: 17 pgs: 17 active+clean; 25 GiB data, 82 GiB used, 2.7 TiB / 2.7 TiB avail; 415 MiB/s wr, 6.64k op/s 2026-02-23T13:07:01.936 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:07:01.937 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:07:01.952 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:07:01.953 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:07:01.968 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:07:01.968 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:07:01.982 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:07:01.983 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:07:02.858 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 58 16 466679 466663 502.82 546.875 0.00173058 0.00198747 2026-02-23T13:07:03.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:02 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/324762898' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:07:03.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:02 trial046 ceph-mon[38575]: pgmap v149: 17 pgs: 17 active+clean; 28 GiB data, 89 GiB used, 2.6 TiB / 2.7 TiB avail; 628 MiB/s wr, 10.05k op/s 2026-02-23T13:07:03.858 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 59 16 475018 475002 503.131 521.188 0.00173142 0.00198625 2026-02-23T13:07:04.035 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:07:04.180 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:04.564 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:04.490+0000 7f0096fdb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:04.564 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:04.490+0000 7f0096fdb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:04.564 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:07:04.565 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:07:04.565 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:07:04.565 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:07:04.565 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:07:04.566 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:07:04.566 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:07:04.566 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:07:04.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:04 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1355439906' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:07:04.858 INFO:tasks.radosbench.radosbench.0.trial046.stdout:2026-02-23T13:07:04.858055+0000 min lat: 0.00064303 max lat: 0.0544095 avg lat: 0.00199177 2026-02-23T13:07:04.858 INFO:tasks.radosbench.radosbench.0.trial046.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-23T13:07:04.858 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 60 15 481728 481713 501.735 419.438 0.00172133 0.00199177 2026-02-23T13:07:05.082 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:07:05.083 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:07:05.083 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:07:05.085 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:07:05.239 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:05.353 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:05.351+0000 7fd281abc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:05.353 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:05.351+0000 7fd281abc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:05.502 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:07:05.503 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:07:05.556 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2026-02-23T13:07:04.622395+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29915546144,"num_objects":456468,"num_object_clones":0,"num_object_copies":1369404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":456468,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":456601,"num_write_kb":29215974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":93570636,"kb_used_data":86556732,"kb_used_omap":36,"kb_used_meta":7013723,"kb_avail":2842442164,"statfs":{"total":3006477107200,"available":2910660775936,"internally_reserved":0,"allocated":88634093568,"data_stored":88632708652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36888,"internal_metadata":7182053352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,5],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5380833280,"num_objects":82105,"num_object_clones":0,"num_object_copies":246315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82105,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82105,"num_write_kb":5254720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001791"},"pg_stats":[{"pgid":"3.f","version":"52'28636","reported_seq":28656,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:01.612372+0000","last_change":"2026-02-23T13:06:03.767923+0000","last_active":"2026-02-23T13:07:01.612372+0000","last_peered":"2026-02-23T13:07:01.612372+0000","last_clean":"2026-02-23T13:07:01.612372+0000","last_became_active":"2026-02-23T13:06:03.767261+0000","last_became_peered":"2026-02-23T13:06:03.767261+0000","last_unstale":"2026-02-23T13:07:01.612372+0000","last_undegraded":"2026-02-23T13:07:01.612372+0000","last_fullsized":"2026-02-23T13:07:01.612372+0000","mapping_epoch":48,"log_start":"52'28633","ondisk_log_start":"52'28633","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:04.399152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1876688896,"num_objects":28636,"num_object_clones":0,"num_object_copies":85908,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28636,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28636,"num_write_kb":1832704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"52'28409","reported_seq":28429,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:01.613538+0000","last_change":"2026-02-23T13:06:03.768354+0000","last_active":"2026-02-23T13:07:01.613538+0000","last_peered":"2026-02-23T13:07:01.613538+0000","last_clean":"2026-02-23T13:07:01.613538+0000","last_became_active":"2026-02-23T13:06:03.767822+0000","last_became_peered":"2026-02-23T13:06:03.767822+0000","last_unstale":"2026-02-23T13:07:01.613538+0000","last_undegraded":"2026-02-23T13:07:01.613538+0000","last_fullsized":"2026-02-23T13:07:01.613538+0000","mapping_epoch":48,"log_start":"52'28406","ondisk_log_start":"52'28406","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:24.671155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1861812224,"num_objects":28409,"num_object_clones":0,"num_object_copies":85227,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28409,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28409,"num_write_kb":1818176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"52'28573","reported_seq":28593,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:01.618986+0000","last_change":"2026-02-23T13:06:03.769230+0000","last_active":"2026-02-23T13:07:01.618986+0000","last_peered":"2026-02-23T13:07:01.618986+0000","last_clean":"2026-02-23T13:07:01.618986+0000","last_became_active":"2026-02-23T13:06:03.768946+0000","last_became_peered":"2026-02-23T13:06:03.768946+0000","last_unstale":"2026-02-23T13:07:01.618986+0000","last_undegraded":"2026-02-23T13:07:01.618986+0000","last_fullsized":"2026-02-23T13:07:01.618986+0000","mapping_epoch":48,"log_start":"52'28570","ondisk_log_start":"52'28570","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:26.718468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1872560128,"num_objects":28573,"num_object_clones":0,"num_object_copies":85719,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28573,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28573,"num_write_kb":1828672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"52'28558","reported_seq":28578,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:01.619532+0000","last_change":"2026-02-23T13:06:03.767398+0000","last_active":"2026-02-23T13:07:01.619532+0000","last_peered":"2026-02-23T13:07:01.619532+0000","last_clean":"2026-02-23T13:07:01.619532+0000","last_became_active":"2026-02-23T13:06:03.767083+0000","last_became_peered":"2026-02-23T13:06:03.767083+0000","last_unstale":"2026-02-23T13:07:01.619532+0000","last_undegraded":"2026-02-23T13:07:01.619532+0000","last_fullsized":"2026-02-23T13:07:01.619532+0000","mapping_epoch":48,"log_start":"52'28555","ondisk_log_start":"52'28555","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:32.716724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1871577088,"num_objects":28558,"num_object_clones":0,"num_object_copies":85674,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28558,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28558,"num_write_kb":1827712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"52'28486","reported_seq":28506,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:01.692047+0000","last_change":"2026-02-23T13:06:03.767015+0000","last_active":"2026-02-23T13:07:01.692047+0000","last_peered":"2026-02-23T13:07:01.692047+0000","last_clean":"2026-02-23T13:07:01.692047+0000","last_became_active":"2026-02-23T13:06:03.766614+0000","last_became_peered":"2026-02-23T13:06:03.766614+0000","last_unstale":"2026-02-23T13:07:01.692047+0000","last_undegraded":"2026-02-23T13:07:01.692047+0000","last_fullsized":"2026-02-23T13:07:01.692047+0000","mapping_epoch":48,"log_start":"52'28483","ondisk_log_start":"52'28483","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:15.375425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1866858496,"num_objects":28486,"num_object_clones":0,"num_object_copies":85458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28486,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28486,"num_write_kb":1823104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"52'28377","reported_seq":28397,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:01.618809+0000","last_change":"2026-02-23T13:06:03.768603+0000","last_active":"2026-02-23T13:07:01.618809+0000","last_peered":"2026-02-23T13:07:01.618809+0000","last_clean":"2026-02-23T13:07:01.618809+0000","last_became_active":"2026-02-23T13:06:03.768238+0000","last_became_peered":"2026-02-23T13:06:03.768238+0000","last_unstale":"2026-02-23T13:07:01.618809+0000","last_undegraded":"2026-02-23T13:07:01.618809+0000","last_fullsized":"2026-02-23T13:07:01.618809+0000","mapping_epoch":48,"log_start":"52'28374","ondisk_log_start":"52'28374","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:11.493313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1859715072,"num_objects":28377,"num_object_clones":0,"num_object_copies":85131,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28377,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28377,"num_write_kb":1816128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"52'28567","reported_seq":28587,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:01.618901+0000","last_change":"2026-02-23T13:06:03.768373+0000","last_active":"2026-02-23T13:07:01.618901+0000","last_peered":"2026-02-23T13:07:01.618901+0000","last_clean":"2026-02-23T13:07:01.618901+0000","last_became_active":"2026-02-23T13:06:03.767947+0000","last_became_peered":"2026-02-23T13:06:03.767947+0000","last_unstale":"2026-02-23T13:07:01.618901+0000","last_undegraded":"2026-02-23T13:07:01.618901+0000","last_fullsized":"2026-02-23T13:07:01.618901+0000","mapping_epoch":48,"log_start":"52'28564","ondisk_log_start":"52'28564","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:05.474616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1872166912,"num_objects":28567,"num_object_clones":0,"num_object_copies":85701,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28567,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28567,"num_write_kb":1828288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"52'28366","reported_seq":28386,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:01.685463+0000","last_change":"2026-02-23T13:06:03.767140+0000","last_active":"2026-02-23T13:07:01.685463+0000","last_peered":"2026-02-23T13:07:01.685463+0000","last_clean":"2026-02-23T13:07:01.685463+0000","last_became_active":"2026-02-23T13:06:03.766859+0000","last_became_peered":"2026-02-23T13:06:03.766859+0000","last_unstale":"2026-02-23T13:07:01.685463+0000","last_undegraded":"2026-02-23T13:07:01.685463+0000","last_fullsized":"2026-02-23T13:07:01.685463+0000","mapping_epoch":48,"log_start":"52'28363","ondisk_log_start":"52'28363","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:26.334481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1858994176,"num_objects":28366,"num_object_clones":0,"num_object_copies":85098,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28366,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28366,"num_write_kb":1815424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"52'28515","reported_seq":28535,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:01.688883+0000","last_change":"2026-02-23T13:06:03.765755+0000","last_active":"2026-02-23T13:07:01.688883+0000","last_peered":"2026-02-23T13:07:01.688883+0000","last_clean":"2026-02-23T13:07:01.688883+0000","last_became_active":"2026-02-23T13:06:03.765502+0000","last_became_peered":"2026-02-23T13:06:03.765502+0000","last_unstale":"2026-02-23T13:07:01.688883+0000","last_undegraded":"2026-02-23T13:07:01.688883+0000","last_fullsized":"2026-02-23T13:07:01.688883+0000","mapping_epoch":48,"log_start":"52'28512","ondisk_log_start":"52'28512","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:14.075905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1868759040,"num_objects":28515,"num_object_clones":0,"num_object_copies":85545,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28515,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28515,"num_write_kb":1824960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"52'28691","reported_seq":28711,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:01.610039+0000","last_change":"2026-02-23T13:06:03.767303+0000","last_active":"2026-02-23T13:07:01.610039+0000","last_peered":"2026-02-23T13:07:01.610039+0000","last_clean":"2026-02-23T13:07:01.610039+0000","last_became_active":"2026-02-23T13:06:03.767012+0000","last_became_peered":"2026-02-23T13:06:03.767012+0000","last_unstale":"2026-02-23T13:07:01.610039+0000","last_undegraded":"2026-02-23T13:07:01.610039+0000","last_fullsized":"2026-02-23T13:07:01.610039+0000","mapping_epoch":48,"log_start":"52'28688","ondisk_log_start":"52'28688","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:22.659298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1880293376,"num_objects":28691,"num_object_clones":0,"num_object_copies":86073,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28691,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28691,"num_write_kb":1836224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"52'28425","reported_seq":28444,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:01.613456+0000","last_change":"2026-02-23T13:06:03.767897+0000","last_active":"2026-02-23T13:07:01.613456+0000","last_peered":"2026-02-23T13:07:01.613456+0000","last_clean":"2026-02-23T13:07:01.613456+0000","last_became_active":"2026-02-23T13:06:03.767200+0000","last_became_peered":"2026-02-23T13:06:03.767200+0000","last_unstale":"2026-02-23T13:07:01.613456+0000","last_undegraded":"2026-02-23T13:07:01.613456+0000","last_fullsized":"2026-02-23T13:07:01.613456+0000","mapping_epoch":48,"log_start":"52'28422","ondisk_log_start":"52'28422","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:14.434473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1862860800,"num_objects":28425,"num_object_clones":0,"num_object_copies":85275,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28425,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28425,"num_write_kb":1819200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"52'28934","reported_seq":28954,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:01.692099+0000","last_change":"2026-02-23T13:06:03.766820+0000","last_active":"2026-02-23T13:07:01.692099+0000","last_peered":"2026-02-23T13:07:01.692099+0000","last_clean":"2026-02-23T13:07:01.692099+0000","last_became_active":"2026-02-23T13:06:03.766415+0000","last_became_peered":"2026-02-23T13:06:03.766415+0000","last_unstale":"2026-02-23T13:07:01.692099+0000","last_undegraded":"2026-02-23T13:07:01.692099+0000","last_fullsized":"2026-02-23T13:07:01.692099+0000","mapping_epoch":48,"log_start":"52'28931","ondisk_log_start":"52'28931","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:09.766385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1896218624,"num_objects":28934,"num_object_clones":0,"num_object_copies":86802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28934,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28934,"num_write_kb":1851776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"52'28325","reported_seq":28345,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:01.614306+0000","last_change":"2026-02-23T13:06:03.768871+0000","last_active":"2026-02-23T13:07:01.614306+0000","last_peered":"2026-02-23T13:07:01.614306+0000","last_clean":"2026-02-23T13:07:01.614306+0000","last_became_active":"2026-02-23T13:06:03.768541+0000","last_became_peered":"2026-02-23T13:06:03.768541+0000","last_unstale":"2026-02-23T13:07:01.614306+0000","last_undegraded":"2026-02-23T13:07:01.614306+0000","last_fullsized":"2026-02-23T13:07:01.614306+0000","mapping_epoch":48,"log_start":"52'28322","ondisk_log_start":"52'28322","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:31.119570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1856307200,"num_objects":28325,"num_object_clones":0,"num_object_copies":84975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28325,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28325,"num_write_kb":1812800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"52'28258","reported_seq":28278,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:01.600837+0000","last_change":"2026-02-23T13:06:03.767275+0000","last_active":"2026-02-23T13:07:01.600837+0000","last_peered":"2026-02-23T13:07:01.600837+0000","last_clean":"2026-02-23T13:07:01.600837+0000","last_became_active":"2026-02-23T13:06:03.767001+0000","last_became_peered":"2026-02-23T13:06:03.767001+0000","last_unstale":"2026-02-23T13:07:01.600837+0000","last_undegraded":"2026-02-23T13:07:01.600837+0000","last_fullsized":"2026-02-23T13:07:01.600837+0000","mapping_epoch":48,"log_start":"52'28255","ondisk_log_start":"52'28255","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:12.872474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1851916288,"num_objects":28258,"num_object_clones":0,"num_object_copies":84774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28258,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28258,"num_write_kb":1808512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"52'28754","reported_seq":28774,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:01.692535+0000","last_change":"2026-02-23T13:06:03.767357+0000","last_active":"2026-02-23T13:07:01.692535+0000","last_peered":"2026-02-23T13:07:01.692535+0000","last_clean":"2026-02-23T13:07:01.692535+0000","last_became_active":"2026-02-23T13:06:03.766997+0000","last_became_peered":"2026-02-23T13:06:03.766997+0000","last_unstale":"2026-02-23T13:07:01.692535+0000","last_undegraded":"2026-02-23T13:07:01.692535+0000","last_fullsized":"2026-02-23T13:07:01.692535+0000","mapping_epoch":48,"log_start":"52'28751","ondisk_log_start":"52'28751","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:08.982263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1884422144,"num_objects":28754,"num_object_clones":0,"num_object_copies":86262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28754,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28754,"num_write_kb":1840256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"52'28592","reported_seq":28612,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:01.694010+0000","last_change":"2026-02-23T13:06:03.767298+0000","last_active":"2026-02-23T13:07:01.694010+0000","last_peered":"2026-02-23T13:07:01.694010+0000","last_clean":"2026-02-23T13:07:01.694010+0000","last_became_active":"2026-02-23T13:06:03.767015+0000","last_became_peered":"2026-02-23T13:06:03.767015+0000","last_unstale":"2026-02-23T13:07:01.694010+0000","last_undegraded":"2026-02-23T13:07:01.694010+0000","last_fullsized":"2026-02-23T13:07:01.694010+0000","mapping_epoch":48,"log_start":"52'28589","ondisk_log_start":"52'28589","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:29.610437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1873805312,"num_objects":28592,"num_object_clones":0,"num_object_copies":85776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28592,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28592,"num_write_kb":1829888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":258,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:51.141839+0000","last_change":"2026-02-23T13:06:51.141808+0000","last_active":"2026-02-23T13:06:51.141839+0000","last_peered":"2026-02-23T13:06:51.141839+0000","last_clean":"2026-02-23T13:06:51.141839+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:06:51.141839+0000","last_undegraded":"2026-02-23T13:06:51.141839+0000","last_fullsized":"2026-02-23T13:06:51.141839+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:06:51.141759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:06:51.141759+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:55.931020+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":29914955776,"num_objects":456466,"num_object_clones":0,"num_object_copies":1369398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":456466,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":456466,"num_write_kb":29213824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":89724616704,"data_stored":89724616704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247859,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":19699684,"kb_used_data":18123088,"kb_used_omap":6,"kb_used_meta":1576569,"kb_avail":714303516,"statfs":{"total":751619276800,"available":731446800384,"internally_reserved":0,"allocated":18558042112,"data_stored":18557694995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6536,"internal_metadata":1614407288},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444086,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27030564,"kb_used_data":25195024,"kb_used_omap":6,"kb_used_meta":1835513,"kb_avail":706972636,"statfs":{"total":751619276800,"available":723939979264,"internally_reserved":0,"allocated":25799704576,"data_stored":25799357459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6244,"internal_metadata":1879566236},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":21543200,"kb_used_data":19848844,"kb_used_omap":12,"kb_used_meta":1694259,"kb_avail":712460000,"statfs":{"total":751619276800,"available":729559040000,"internally_reserved":0,"allocated":20325216256,"data_stored":20324872691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12486,"internal_metadata":1734922042},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705721,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":25297188,"kb_used_data":23389776,"kb_used_omap":11,"kb_used_meta":1907380,"kb_avail":708706012,"statfs":{"total":751619276800,"available":725714956288,"internally_reserved":0,"allocated":23951130624,"data_stored":23950783507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11622,"internal_metadata":1953157786},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,3],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24304091136,"data_stored":24304091136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20587610112,"data_stored":20587610112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":26160136192,"data_stored":26160136192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18672779264,"data_stored":18672779264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:07:05.558 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:07:05.559 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 91 2026-02-23T13:07:05.705 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:05.758 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:05 trial046 ceph-mon[38575]: pgmap v150: 17 pgs: 17 active+clean; 28 GiB data, 89 GiB used, 2.6 TiB / 2.7 TiB avail; 428 MiB/s wr, 6.84k op/s 2026-02-23T13:07:05.833 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:05.831+0000 7f278ec5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:05.834 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:05.831+0000 7f278ec5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:05.858 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 61 15 489414 489399 501.385 480.375 0.00109648 0.00199317 2026-02-23T13:07:05.976 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:07:06.018 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:07:06.289 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:07:06 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:07:06] "GET /metrics HTTP/1.1" 200 4214 "" "Prometheus/3.6.0" 2026-02-23T13:07:06.561 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:07:06 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:07:06.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:07:06.845 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:07:06.858 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 62 16 496782 496766 500.724 460.438 0.00194684 0.00199578 2026-02-23T13:07:06.870 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:06 trial046 ceph-mon[38575]: 3.f scrub starts 2026-02-23T13:07:06.871 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:06 trial046 ceph-mon[38575]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:07:06.871 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:06 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1860937849' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "91"} : dispatch 2026-02-23T13:07:06.995 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:07.126 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:07.124+0000 7fd519e7b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:07.126 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:07.124+0000 7fd519e7b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:07.143 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:07:07.143 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:07:07.158 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:07:07.158 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:07:07.172 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:07:07.172 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:07:07.185 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:07:07.185 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:07:07.858 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 63 16 504292 504276 500.226 469.375 0.00113968 0.00199778 2026-02-23T13:07:08.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:07 trial046 ceph-mon[38575]: pgmap v151: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 29 GiB data, 93 GiB used, 2.6 TiB / 2.7 TiB avail; 504 MiB/s wr, 8.06k op/s 2026-02-23T13:07:08.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:07 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3869442139' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:07:08.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:07 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-23T13:07:08.858 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 64 15 512373 512358 500.301 505.125 0.00217402 0.00199749 2026-02-23T13:07:09.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:08 trial046 ceph-mon[38575]: 3.9 scrub starts 2026-02-23T13:07:09.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:08 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:07:09.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:08 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-23T13:07:09.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:08 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:07:09.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:08 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-23T13:07:09.228 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:07:09.378 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:09.714 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:09.711+0000 7f892f357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:09.714 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:09.712+0000 7f892f357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:09.728 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:07:09.729 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:07:09.741 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:07:09.741 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:07:09.754 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:07:09.755 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:07:09.768 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:07:09.768 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:07:09.798 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:09 trial046 ceph-mon[38575]: 3.f scrub ok 2026-02-23T13:07:09.798 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:09 trial046 ceph-mon[38575]: pgmap v152: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 30 GiB data, 96 GiB used, 2.6 TiB / 2.7 TiB avail; 548 MiB/s wr, 8.77k op/s 2026-02-23T13:07:09.859 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 65 16 518949 518933 498.926 410.938 0.00193824 0.00200299 2026-02-23T13:07:10.858 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 66 15 526208 526193 498.241 453.75 0.000904565 0.00200571 2026-02-23T13:07:11.020 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:07:11.021 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:07:11.021 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:07:11.021 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:07:11.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:10 trial046 ceph-mon[38575]: 3.0 scrub starts 2026-02-23T13:07:11.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:10 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2056314551' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:07:11.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:10 trial046 ceph-mon[38575]: 3.9 scrub ok 2026-02-23T13:07:11.199 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:11.327 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:11.325+0000 7fe3f8f07640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:11.327 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:11.325+0000 7fe3f8f07640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:11.478 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:07:11.479 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:07:11.527 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2026-02-23T13:07:10.623173+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":32454672928,"num_objects":495212,"num_object_clones":0,"num_object_copies":1485636,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495212,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":495345,"num_write_kb":31695590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":100560972,"kb_used_data":94179004,"kb_used_omap":30,"kb_used_meta":6381857,"kb_avail":2835451828,"statfs":{"total":3006477107200,"available":2903502671872,"internally_reserved":0,"allocated":96439300096,"data_stored":96437915180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31392,"internal_metadata":6535021920},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[13,2,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5217189888,"num_objects":79608,"num_object_clones":0,"num_object_copies":238824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79608,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79608,"num_write_kb":5094912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001623"},"pg_stats":[{"pgid":"3.f","version":"52'31096","reported_seq":31288,"reported_epoch":52,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:07:06.609128+0000","last_change":"2026-02-23T13:07:04.827117+0000","last_active":"2026-02-23T13:07:06.609128+0000","last_peered":"2026-02-23T13:07:06.609128+0000","last_clean":"2026-02-23T13:07:06.609128+0000","last_became_active":"2026-02-23T13:06:03.767261+0000","last_became_peered":"2026-02-23T13:06:03.767261+0000","last_unstale":"2026-02-23T13:07:06.609128+0000","last_undegraded":"2026-02-23T13:07:06.609128+0000","last_fullsized":"2026-02-23T13:07:06.609128+0000","mapping_epoch":48,"log_start":"52'31093","ondisk_log_start":"52'31093","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":16949,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2037907456,"num_objects":31096,"num_object_clones":0,"num_object_copies":93288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31096,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31096,"num_write_kb":1990144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"52'30915","reported_seq":30935,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:06.602058+0000","last_change":"2026-02-23T13:06:03.768354+0000","last_active":"2026-02-23T13:07:06.602058+0000","last_peered":"2026-02-23T13:07:06.602058+0000","last_clean":"2026-02-23T13:07:06.602058+0000","last_became_active":"2026-02-23T13:06:03.767822+0000","last_became_peered":"2026-02-23T13:06:03.767822+0000","last_unstale":"2026-02-23T13:07:06.602058+0000","last_undegraded":"2026-02-23T13:07:06.602058+0000","last_fullsized":"2026-02-23T13:07:06.602058+0000","mapping_epoch":48,"log_start":"52'30912","ondisk_log_start":"52'30912","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:24.671155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2026045440,"num_objects":30915,"num_object_clones":0,"num_object_copies":92745,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30915,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30915,"num_write_kb":1978560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"52'31019","reported_seq":31039,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:06.616806+0000","last_change":"2026-02-23T13:06:03.769230+0000","last_active":"2026-02-23T13:07:06.616806+0000","last_peered":"2026-02-23T13:07:06.616806+0000","last_clean":"2026-02-23T13:07:06.616806+0000","last_became_active":"2026-02-23T13:06:03.768946+0000","last_became_peered":"2026-02-23T13:06:03.768946+0000","last_unstale":"2026-02-23T13:07:06.616806+0000","last_undegraded":"2026-02-23T13:07:06.616806+0000","last_fullsized":"2026-02-23T13:07:06.616806+0000","mapping_epoch":48,"log_start":"52'31016","ondisk_log_start":"52'31016","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:26.718468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2032861184,"num_objects":31019,"num_object_clones":0,"num_object_copies":93057,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31019,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31019,"num_write_kb":1985216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"52'30965","reported_seq":30985,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:06.611219+0000","last_change":"2026-02-23T13:06:03.767398+0000","last_active":"2026-02-23T13:07:06.611219+0000","last_peered":"2026-02-23T13:07:06.611219+0000","last_clean":"2026-02-23T13:07:06.611219+0000","last_became_active":"2026-02-23T13:06:03.767083+0000","last_became_peered":"2026-02-23T13:06:03.767083+0000","last_unstale":"2026-02-23T13:07:06.611219+0000","last_undegraded":"2026-02-23T13:07:06.611219+0000","last_fullsized":"2026-02-23T13:07:06.611219+0000","mapping_epoch":48,"log_start":"52'30962","ondisk_log_start":"52'30962","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:32.716724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2029322240,"num_objects":30965,"num_object_clones":0,"num_object_copies":92895,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30965,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30965,"num_write_kb":1981760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"52'30864","reported_seq":30884,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:06.695660+0000","last_change":"2026-02-23T13:06:03.767015+0000","last_active":"2026-02-23T13:07:06.695660+0000","last_peered":"2026-02-23T13:07:06.695660+0000","last_clean":"2026-02-23T13:07:06.695660+0000","last_became_active":"2026-02-23T13:06:03.766614+0000","last_became_peered":"2026-02-23T13:06:03.766614+0000","last_unstale":"2026-02-23T13:07:06.695660+0000","last_undegraded":"2026-02-23T13:07:06.695660+0000","last_fullsized":"2026-02-23T13:07:06.695660+0000","mapping_epoch":48,"log_start":"52'30861","ondisk_log_start":"52'30861","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:15.375425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2022703104,"num_objects":30864,"num_object_clones":0,"num_object_copies":92592,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30864,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30864,"num_write_kb":1975296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"52'30748","reported_seq":30768,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:06.619773+0000","last_change":"2026-02-23T13:06:03.768603+0000","last_active":"2026-02-23T13:07:06.619773+0000","last_peered":"2026-02-23T13:07:06.619773+0000","last_clean":"2026-02-23T13:07:06.619773+0000","last_became_active":"2026-02-23T13:06:03.768238+0000","last_became_peered":"2026-02-23T13:06:03.768238+0000","last_unstale":"2026-02-23T13:07:06.619773+0000","last_undegraded":"2026-02-23T13:07:06.619773+0000","last_fullsized":"2026-02-23T13:07:06.619773+0000","mapping_epoch":48,"log_start":"52'30745","ondisk_log_start":"52'30745","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:11.493313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2015100928,"num_objects":30748,"num_object_clones":0,"num_object_copies":92244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30748,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30748,"num_write_kb":1967872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"52'31041","reported_seq":31061,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:06.616410+0000","last_change":"2026-02-23T13:06:03.768373+0000","last_active":"2026-02-23T13:07:06.616410+0000","last_peered":"2026-02-23T13:07:06.616410+0000","last_clean":"2026-02-23T13:07:06.616410+0000","last_became_active":"2026-02-23T13:06:03.767947+0000","last_became_peered":"2026-02-23T13:06:03.767947+0000","last_unstale":"2026-02-23T13:07:06.616410+0000","last_undegraded":"2026-02-23T13:07:06.616410+0000","last_fullsized":"2026-02-23T13:07:06.616410+0000","mapping_epoch":48,"log_start":"52'31038","ondisk_log_start":"52'31038","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2034302976,"num_objects":31041,"num_object_clones":0,"num_object_copies":93123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31041,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31041,"num_write_kb":1986624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"52'30765","reported_seq":30784,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:06.692850+0000","last_change":"2026-02-23T13:06:03.767140+0000","last_active":"2026-02-23T13:07:06.692850+0000","last_peered":"2026-02-23T13:07:06.692850+0000","last_clean":"2026-02-23T13:07:06.692850+0000","last_became_active":"2026-02-23T13:06:03.766859+0000","last_became_peered":"2026-02-23T13:06:03.766859+0000","last_unstale":"2026-02-23T13:07:06.692850+0000","last_undegraded":"2026-02-23T13:07:06.692850+0000","last_fullsized":"2026-02-23T13:07:06.692850+0000","mapping_epoch":48,"log_start":"52'30762","ondisk_log_start":"52'30762","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:26.334481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2016215040,"num_objects":30765,"num_object_clones":0,"num_object_copies":92295,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30765,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30765,"num_write_kb":1968960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"52'30942","reported_seq":30961,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:06.691324+0000","last_change":"2026-02-23T13:06:03.765755+0000","last_active":"2026-02-23T13:07:06.691324+0000","last_peered":"2026-02-23T13:07:06.691324+0000","last_clean":"2026-02-23T13:07:06.691324+0000","last_became_active":"2026-02-23T13:06:03.765502+0000","last_became_peered":"2026-02-23T13:06:03.765502+0000","last_unstale":"2026-02-23T13:07:06.691324+0000","last_undegraded":"2026-02-23T13:07:06.691324+0000","last_fullsized":"2026-02-23T13:07:06.691324+0000","mapping_epoch":48,"log_start":"52'30939","ondisk_log_start":"52'30939","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:14.075905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2027814912,"num_objects":30942,"num_object_clones":0,"num_object_copies":92826,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30942,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30942,"num_write_kb":1980288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"52'31157","reported_seq":31176,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:06.608333+0000","last_change":"2026-02-23T13:06:03.767303+0000","last_active":"2026-02-23T13:07:06.608333+0000","last_peered":"2026-02-23T13:07:06.608333+0000","last_clean":"2026-02-23T13:07:06.608333+0000","last_became_active":"2026-02-23T13:06:03.767012+0000","last_became_peered":"2026-02-23T13:06:03.767012+0000","last_unstale":"2026-02-23T13:07:06.608333+0000","last_undegraded":"2026-02-23T13:07:06.608333+0000","last_fullsized":"2026-02-23T13:07:06.608333+0000","mapping_epoch":48,"log_start":"52'31154","ondisk_log_start":"52'31154","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:22.659298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2041905152,"num_objects":31157,"num_object_clones":0,"num_object_copies":93471,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31157,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31157,"num_write_kb":1994048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"52'30829","reported_seq":30849,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:06.614812+0000","last_change":"2026-02-23T13:06:03.767897+0000","last_active":"2026-02-23T13:07:06.614812+0000","last_peered":"2026-02-23T13:07:06.614812+0000","last_clean":"2026-02-23T13:07:06.614812+0000","last_became_active":"2026-02-23T13:06:03.767200+0000","last_became_peered":"2026-02-23T13:06:03.767200+0000","last_unstale":"2026-02-23T13:07:06.614812+0000","last_undegraded":"2026-02-23T13:07:06.614812+0000","last_fullsized":"2026-02-23T13:07:06.614812+0000","mapping_epoch":48,"log_start":"52'30826","ondisk_log_start":"52'30826","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:14.434473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2020409344,"num_objects":30829,"num_object_clones":0,"num_object_copies":92487,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30829,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30829,"num_write_kb":1973056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"52'31302","reported_seq":31320,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:06.692618+0000","last_change":"2026-02-23T13:06:03.766820+0000","last_active":"2026-02-23T13:07:06.692618+0000","last_peered":"2026-02-23T13:07:06.692618+0000","last_clean":"2026-02-23T13:07:06.692618+0000","last_became_active":"2026-02-23T13:06:03.766415+0000","last_became_peered":"2026-02-23T13:06:03.766415+0000","last_unstale":"2026-02-23T13:07:06.692618+0000","last_undegraded":"2026-02-23T13:07:06.692618+0000","last_fullsized":"2026-02-23T13:07:06.692618+0000","mapping_epoch":48,"log_start":"52'31299","ondisk_log_start":"52'31299","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:09.766385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2051407872,"num_objects":31302,"num_object_clones":0,"num_object_copies":93906,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31302,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31302,"num_write_kb":2003328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"52'30687","reported_seq":30707,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:06.611855+0000","last_change":"2026-02-23T13:06:03.768871+0000","last_active":"2026-02-23T13:07:06.611855+0000","last_peered":"2026-02-23T13:07:06.611855+0000","last_clean":"2026-02-23T13:07:06.611855+0000","last_became_active":"2026-02-23T13:06:03.768541+0000","last_became_peered":"2026-02-23T13:06:03.768541+0000","last_unstale":"2026-02-23T13:07:06.611855+0000","last_undegraded":"2026-02-23T13:07:06.611855+0000","last_fullsized":"2026-02-23T13:07:06.611855+0000","mapping_epoch":48,"log_start":"52'30684","ondisk_log_start":"52'30684","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:31.119570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2011103232,"num_objects":30687,"num_object_clones":0,"num_object_copies":92061,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30687,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30687,"num_write_kb":1963968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"52'30683","reported_seq":30703,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:06.611271+0000","last_change":"2026-02-23T13:06:03.767275+0000","last_active":"2026-02-23T13:07:06.611271+0000","last_peered":"2026-02-23T13:07:06.611271+0000","last_clean":"2026-02-23T13:07:06.611271+0000","last_became_active":"2026-02-23T13:06:03.767001+0000","last_became_peered":"2026-02-23T13:06:03.767001+0000","last_unstale":"2026-02-23T13:07:06.611271+0000","last_undegraded":"2026-02-23T13:07:06.611271+0000","last_fullsized":"2026-02-23T13:07:06.611271+0000","mapping_epoch":48,"log_start":"52'30679","ondisk_log_start":"52'30679","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:12.872474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2010841088,"num_objects":30683,"num_object_clones":0,"num_object_copies":92049,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30683,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30683,"num_write_kb":1963712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"52'31151","reported_seq":31171,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:06.693664+0000","last_change":"2026-02-23T13:06:03.767357+0000","last_active":"2026-02-23T13:07:06.693664+0000","last_peered":"2026-02-23T13:07:06.693664+0000","last_clean":"2026-02-23T13:07:06.693664+0000","last_became_active":"2026-02-23T13:06:03.766997+0000","last_became_peered":"2026-02-23T13:06:03.766997+0000","last_unstale":"2026-02-23T13:07:06.693664+0000","last_undegraded":"2026-02-23T13:07:06.693664+0000","last_fullsized":"2026-02-23T13:07:06.693664+0000","mapping_epoch":48,"log_start":"52'31148","ondisk_log_start":"52'31148","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:08.982263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2041511936,"num_objects":31151,"num_object_clones":0,"num_object_copies":93453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31151,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31151,"num_write_kb":1993664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"52'31046","reported_seq":31065,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:06.694859+0000","last_change":"2026-02-23T13:06:03.767298+0000","last_active":"2026-02-23T13:07:06.694859+0000","last_peered":"2026-02-23T13:07:06.694859+0000","last_clean":"2026-02-23T13:07:06.694859+0000","last_became_active":"2026-02-23T13:06:03.767015+0000","last_became_peered":"2026-02-23T13:06:03.767015+0000","last_unstale":"2026-02-23T13:07:06.694859+0000","last_undegraded":"2026-02-23T13:07:06.694859+0000","last_fullsized":"2026-02-23T13:07:06.694859+0000","mapping_epoch":48,"log_start":"52'31043","ondisk_log_start":"52'31043","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:29.610437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2034630656,"num_objects":31046,"num_object_clones":0,"num_object_copies":93138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31046,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31046,"num_write_kb":1986944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":258,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:51.141839+0000","last_change":"2026-02-23T13:06:51.141808+0000","last_active":"2026-02-23T13:06:51.141839+0000","last_peered":"2026-02-23T13:06:51.141839+0000","last_clean":"2026-02-23T13:06:51.141839+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:06:51.141839+0000","last_undegraded":"2026-02-23T13:06:51.141839+0000","last_fullsized":"2026-02-23T13:06:51.141839+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:06:51.141759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:06:51.141759+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:55.931020+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":32454082560,"num_objects":495210,"num_object_clones":0,"num_object_copies":1485630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495210,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":495210,"num_write_kb":31693440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97343963136,"data_stored":97343963136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247860,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":21363684,"kb_used_data":19697168,"kb_used_omap":6,"kb_used_meta":1666489,"kb_avail":712639516,"statfs":{"total":751619276800,"available":729742864384,"internally_reserved":0,"allocated":20169900032,"data_stored":20169552915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6536,"internal_metadata":1706485368},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444087,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":29348516,"kb_used_data":27404688,"kb_used_omap":6,"kb_used_meta":1943801,"kb_avail":704654684,"statfs":{"total":751619276800,"available":721566396416,"internally_reserved":0,"allocated":28062400512,"data_stored":28062053395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6244,"internal_metadata":1990453148},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574905,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":23412128,"kb_used_data":21609548,"kb_used_omap":12,"kb_used_meta":1802547,"kb_avail":710591072,"statfs":{"total":751619276800,"available":727645257728,"internally_reserved":0,"allocated":22128177152,"data_stored":22127833587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12486,"internal_metadata":1845808954},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705722,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":26436644,"kb_used_data":25467600,"kb_used_omap":5,"kb_used_meta":969018,"kb_avail":707566556,"statfs":{"total":751619276800,"available":724548153344,"internally_reserved":0,"allocated":26078822400,"data_stored":26078475283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6126,"internal_metadata":992274450},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26363756544,"data_stored":26363756544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22330277888,"data_stored":22330277888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28384100352,"data_stored":28384100352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20265828352,"data_stored":20265828352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:07:11.529 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:07:11.530 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 101 2026-02-23T13:07:11.593 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:11 trial046 ceph-mon[38575]: pgmap v153: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 30 GiB data, 96 GiB used, 2.6 TiB / 2.7 TiB avail; 415 MiB/s wr, 6.63k op/s 2026-02-23T13:07:11.720 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:11.815 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:07:11.859 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 67 15 532875 532860 497.023 416.688 0.00226477 0.00201067 2026-02-23T13:07:11.866 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:11.864+0000 7f34d7036640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:11.867 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:11.865+0000 7f34d7036640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:11.979 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:12.015 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:07:12.062 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:07:12.102 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:12.100+0000 7f067f79b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:12.102 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:12.101+0000 7f067f79b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:12.117 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:07:12.117 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:07:12.131 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:07:12.131 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:07:12.143 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:07:12.143 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:07:12.155 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:07:12.156 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:07:12.859 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 68 16 539724 539708 496.008 428 0.00159554 0.00201478 2026-02-23T13:07:13.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:12 trial046 ceph-mon[38575]: from='client.14729 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:07:13.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:12 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/920493919' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "101"} : dispatch 2026-02-23T13:07:13.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:12 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/704103298' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:07:13.859 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 69 16 547472 547456 495.835 484.25 0.00126076 0.00201549 2026-02-23T13:07:14.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:13 trial046 ceph-mon[38575]: pgmap v154: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 32 GiB data, 103 GiB used, 2.6 TiB / 2.7 TiB avail; 604 MiB/s wr, 9.67k op/s 2026-02-23T13:07:14.203 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:07:14.358 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:14.480 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:14.478+0000 7fd38e211640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:14.480 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:14.478+0000 7fd38e211640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:14.495 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:07:14.495 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:07:14.510 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:07:14.511 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:07:14.523 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:07:14.523 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:07:14.538 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:07:14.539 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:07:14.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:14 trial046 ceph-mon[38575]: 3.0 scrub ok 2026-02-23T13:07:14.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:14 trial046 ceph-mon[38575]: 3.4 scrub starts 2026-02-23T13:07:14.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:14 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3192869738' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:07:14.859 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 70 16 554645 554629 495.155 448.312 0.00131416 0.00201823 2026-02-23T13:07:15.859 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 71 15 560689 560674 493.502 377.812 0.00876833 0.00202497 2026-02-23T13:07:16.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:15 trial046 ceph-mon[38575]: 3.7 scrub starts 2026-02-23T13:07:16.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:15 trial046 ceph-mon[38575]: pgmap v155: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 32 GiB data, 103 GiB used, 2.6 TiB / 2.7 TiB avail; 392 MiB/s wr, 6.26k op/s 2026-02-23T13:07:16.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:15 trial046 ceph-mon[38575]: 3.1 scrub starts 2026-02-23T13:07:16.516 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:07:16 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:07:16.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:07:16.539 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:07:16 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:07:16] "GET /metrics HTTP/1.1" 200 4216 "" "Prometheus/3.6.0" 2026-02-23T13:07:16.589 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:07:16.743 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:16.816 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:16 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:07:16.859 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 72 15 566578 566563 491.76 368.062 0.00239763 0.00203218 2026-02-23T13:07:16.881 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:16.879+0000 7fe1ae8d5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:16.881 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:16.879+0000 7fe1ae8d5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:16.898 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:07:16.898 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:07:16.911 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:07:16.911 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:07:16.927 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:07:16.927 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:07:16.940 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:07:16.940 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:07:17.063 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:07:17.064 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:07:17.064 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_1 2026-02-23T13:07:17.064 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:07:17.215 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:17.342 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:17.339+0000 7f7482c5b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:17.342 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:17.340+0000 7f7482c5b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:17.493 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:07:17.494 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:07:17.547 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2026-02-23T13:07:16.624012+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":36217946656,"num_objects":552635,"num_object_clones":0,"num_object_copies":1657905,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":552635,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":552768,"num_write_kb":35370662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":113238796,"kb_used_data":106296892,"kb_used_omap":31,"kb_used_meta":6941792,"kb_avail":2822774004,"statfs":{"total":3006477107200,"available":2890520580096,"internally_reserved":0,"allocated":108848017408,"data_stored":108846632492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32472,"internal_metadata":7108395304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9,7,3,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6302400512,"num_objects":96167,"num_object_clones":0,"num_object_copies":288501,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96167,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96167,"num_write_kb":6154688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001616"},"pg_stats":[{"pgid":"3.f","version":"52'35524","reported_seq":35863,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:16.619131+0000","last_change":"2026-02-23T13:07:08.188933+0000","last_active":"2026-02-23T13:07:16.619131+0000","last_peered":"2026-02-23T13:07:16.619131+0000","last_clean":"2026-02-23T13:07:16.619131+0000","last_became_active":"2026-02-23T13:06:03.767261+0000","last_became_peered":"2026-02-23T13:06:03.767261+0000","last_unstale":"2026-02-23T13:07:16.619131+0000","last_undegraded":"2026-02-23T13:07:16.619131+0000","last_fullsized":"2026-02-23T13:07:16.619131+0000","mapping_epoch":48,"log_start":"52'35521","ondisk_log_start":"52'35521","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'31889","last_scrub_stamp":"2026-02-23T13:07:08.188897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:08.188897+0000","objects_scrubbed":31058,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:29.284171+0000","scrub_duration":3362,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2328100864,"num_objects":35524,"num_object_clones":0,"num_object_copies":106572,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35524,"num_write_kb":2273536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"52'35331","reported_seq":35351,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:16.614928+0000","last_change":"2026-02-23T13:06:03.768354+0000","last_active":"2026-02-23T13:07:16.614928+0000","last_peered":"2026-02-23T13:07:16.614928+0000","last_clean":"2026-02-23T13:07:16.614928+0000","last_became_active":"2026-02-23T13:06:03.767822+0000","last_became_peered":"2026-02-23T13:06:03.767822+0000","last_unstale":"2026-02-23T13:07:16.614928+0000","last_undegraded":"2026-02-23T13:07:16.614928+0000","last_fullsized":"2026-02-23T13:07:16.614928+0000","mapping_epoch":48,"log_start":"52'35328","ondisk_log_start":"52'35328","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:24.671155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2315452416,"num_objects":35331,"num_object_clones":0,"num_object_copies":105993,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35331,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35331,"num_write_kb":2261184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"52'35331","reported_seq":35351,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:16.620957+0000","last_change":"2026-02-23T13:06:03.769230+0000","last_active":"2026-02-23T13:07:16.620957+0000","last_peered":"2026-02-23T13:07:16.620957+0000","last_clean":"2026-02-23T13:07:16.620957+0000","last_became_active":"2026-02-23T13:06:03.768946+0000","last_became_peered":"2026-02-23T13:06:03.768946+0000","last_unstale":"2026-02-23T13:07:16.620957+0000","last_undegraded":"2026-02-23T13:07:16.620957+0000","last_fullsized":"2026-02-23T13:07:16.620957+0000","mapping_epoch":48,"log_start":"52'35328","ondisk_log_start":"52'35328","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:26.718468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2315452416,"num_objects":35331,"num_object_clones":0,"num_object_copies":105993,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35331,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35331,"num_write_kb":2261184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"52'35270","reported_seq":35290,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:16.619291+0000","last_change":"2026-02-23T13:06:03.767398+0000","last_active":"2026-02-23T13:07:16.619291+0000","last_peered":"2026-02-23T13:07:16.619291+0000","last_clean":"2026-02-23T13:07:16.619291+0000","last_became_active":"2026-02-23T13:06:03.767083+0000","last_became_peered":"2026-02-23T13:06:03.767083+0000","last_unstale":"2026-02-23T13:07:16.619291+0000","last_undegraded":"2026-02-23T13:07:16.619291+0000","last_fullsized":"2026-02-23T13:07:16.619291+0000","mapping_epoch":48,"log_start":"52'35266","ondisk_log_start":"52'35266","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:32.716724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2311454720,"num_objects":35270,"num_object_clones":0,"num_object_copies":105810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35270,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35270,"num_write_kb":2257280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"52'33179","reported_seq":33199,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:11.696387+0000","last_change":"2026-02-23T13:06:03.767015+0000","last_active":"2026-02-23T13:07:11.696387+0000","last_peered":"2026-02-23T13:07:11.696387+0000","last_clean":"2026-02-23T13:07:11.696387+0000","last_became_active":"2026-02-23T13:06:03.766614+0000","last_became_peered":"2026-02-23T13:06:03.766614+0000","last_unstale":"2026-02-23T13:07:11.696387+0000","last_undegraded":"2026-02-23T13:07:11.696387+0000","last_fullsized":"2026-02-23T13:07:11.696387+0000","mapping_epoch":48,"log_start":"52'33176","ondisk_log_start":"52'33176","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:15.375425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2174418944,"num_objects":33179,"num_object_clones":0,"num_object_copies":99537,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33179,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33179,"num_write_kb":2123456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"52'35231","reported_seq":35251,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:16.616158+0000","last_change":"2026-02-23T13:06:03.768603+0000","last_active":"2026-02-23T13:07:16.616158+0000","last_peered":"2026-02-23T13:07:16.616158+0000","last_clean":"2026-02-23T13:07:16.616158+0000","last_became_active":"2026-02-23T13:06:03.768238+0000","last_became_peered":"2026-02-23T13:06:03.768238+0000","last_unstale":"2026-02-23T13:07:16.616158+0000","last_undegraded":"2026-02-23T13:07:16.616158+0000","last_fullsized":"2026-02-23T13:07:16.616158+0000","mapping_epoch":48,"log_start":"52'35228","ondisk_log_start":"52'35228","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2308898816,"num_objects":35231,"num_object_clones":0,"num_object_copies":105693,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35231,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35231,"num_write_kb":2254784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"52'35457","reported_seq":35805,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:16.617032+0000","last_change":"2026-02-23T13:07:09.835508+0000","last_active":"2026-02-23T13:07:16.617032+0000","last_peered":"2026-02-23T13:07:16.617032+0000","last_clean":"2026-02-23T13:07:16.617032+0000","last_became_active":"2026-02-23T13:06:03.767947+0000","last_became_peered":"2026-02-23T13:06:03.767947+0000","last_unstale":"2026-02-23T13:07:16.617032+0000","last_undegraded":"2026-02-23T13:07:16.617032+0000","last_fullsized":"2026-02-23T13:07:16.617032+0000","mapping_epoch":48,"log_start":"52'35454","ondisk_log_start":"52'35454","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'32488","last_scrub_stamp":"2026-02-23T13:07:09.835476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:09.835476+0000","objects_scrubbed":31955,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:24.178560+0000","scrub_duration":2500,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2323709952,"num_objects":35457,"num_object_clones":0,"num_object_copies":106371,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35457,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35457,"num_write_kb":2269248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"52'33068","reported_seq":33088,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:11.692203+0000","last_change":"2026-02-23T13:06:03.767140+0000","last_active":"2026-02-23T13:07:11.692203+0000","last_peered":"2026-02-23T13:07:11.692203+0000","last_clean":"2026-02-23T13:07:11.692203+0000","last_became_active":"2026-02-23T13:06:03.766859+0000","last_became_peered":"2026-02-23T13:06:03.766859+0000","last_unstale":"2026-02-23T13:07:11.692203+0000","last_undegraded":"2026-02-23T13:07:11.692203+0000","last_fullsized":"2026-02-23T13:07:11.692203+0000","mapping_epoch":48,"log_start":"52'33065","ondisk_log_start":"52'33065","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:26.334481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2167144448,"num_objects":33068,"num_object_clones":0,"num_object_copies":99204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33068,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33068,"num_write_kb":2116352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"52'33209","reported_seq":33229,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:11.696567+0000","last_change":"2026-02-23T13:06:03.765755+0000","last_active":"2026-02-23T13:07:11.696567+0000","last_peered":"2026-02-23T13:07:11.696567+0000","last_clean":"2026-02-23T13:07:11.696567+0000","last_became_active":"2026-02-23T13:06:03.765502+0000","last_became_peered":"2026-02-23T13:06:03.765502+0000","last_unstale":"2026-02-23T13:07:11.696567+0000","last_undegraded":"2026-02-23T13:07:11.696567+0000","last_fullsized":"2026-02-23T13:07:11.696567+0000","mapping_epoch":48,"log_start":"52'33206","ondisk_log_start":"52'33206","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:14.075905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2176385024,"num_objects":33209,"num_object_clones":0,"num_object_copies":99627,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33209,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33209,"num_write_kb":2125376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"52'35459","reported_seq":35479,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:16.606170+0000","last_change":"2026-02-23T13:06:03.767303+0000","last_active":"2026-02-23T13:07:16.606170+0000","last_peered":"2026-02-23T13:07:16.606170+0000","last_clean":"2026-02-23T13:07:16.606170+0000","last_became_active":"2026-02-23T13:06:03.767012+0000","last_became_peered":"2026-02-23T13:06:03.767012+0000","last_unstale":"2026-02-23T13:07:16.606170+0000","last_undegraded":"2026-02-23T13:07:16.606170+0000","last_fullsized":"2026-02-23T13:07:16.606170+0000","mapping_epoch":48,"log_start":"52'35456","ondisk_log_start":"52'35456","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:22.659298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2323841024,"num_objects":35459,"num_object_clones":0,"num_object_copies":106377,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35459,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35459,"num_write_kb":2269376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"52'35265","reported_seq":35285,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:16.615753+0000","last_change":"2026-02-23T13:06:03.767897+0000","last_active":"2026-02-23T13:07:16.615753+0000","last_peered":"2026-02-23T13:07:16.615753+0000","last_clean":"2026-02-23T13:07:16.615753+0000","last_became_active":"2026-02-23T13:06:03.767200+0000","last_became_peered":"2026-02-23T13:06:03.767200+0000","last_unstale":"2026-02-23T13:07:16.615753+0000","last_undegraded":"2026-02-23T13:07:16.615753+0000","last_fullsized":"2026-02-23T13:07:16.615753+0000","mapping_epoch":48,"log_start":"52'35262","ondisk_log_start":"52'35262","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2311127040,"num_objects":35265,"num_object_clones":0,"num_object_copies":105795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35265,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35265,"num_write_kb":2256960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"52'33546","reported_seq":33566,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:11.692817+0000","last_change":"2026-02-23T13:06:03.766820+0000","last_active":"2026-02-23T13:07:11.692817+0000","last_peered":"2026-02-23T13:07:11.692817+0000","last_clean":"2026-02-23T13:07:11.692817+0000","last_became_active":"2026-02-23T13:06:03.766415+0000","last_became_peered":"2026-02-23T13:06:03.766415+0000","last_unstale":"2026-02-23T13:07:11.692817+0000","last_undegraded":"2026-02-23T13:07:11.692817+0000","last_fullsized":"2026-02-23T13:07:11.692817+0000","mapping_epoch":48,"log_start":"52'33543","ondisk_log_start":"52'33543","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2198470656,"num_objects":33546,"num_object_clones":0,"num_object_copies":100638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33546,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33546,"num_write_kb":2146944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"52'35017","reported_seq":35037,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:16.613864+0000","last_change":"2026-02-23T13:06:03.768871+0000","last_active":"2026-02-23T13:07:16.613864+0000","last_peered":"2026-02-23T13:07:16.613864+0000","last_clean":"2026-02-23T13:07:16.613864+0000","last_became_active":"2026-02-23T13:06:03.768541+0000","last_became_peered":"2026-02-23T13:06:03.768541+0000","last_unstale":"2026-02-23T13:07:16.613864+0000","last_undegraded":"2026-02-23T13:07:16.613864+0000","last_fullsized":"2026-02-23T13:07:16.613864+0000","mapping_epoch":48,"log_start":"52'35014","ondisk_log_start":"52'35014","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:31.119570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2294874112,"num_objects":35017,"num_object_clones":0,"num_object_copies":105051,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35017,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35017,"num_write_kb":2241088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"52'35099","reported_seq":35327,"reported_epoch":52,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:07:16.613644+0000","last_change":"2026-02-23T13:07:14.911627+0000","last_active":"2026-02-23T13:07:16.613644+0000","last_peered":"2026-02-23T13:07:16.613644+0000","last_clean":"2026-02-23T13:07:16.613644+0000","last_became_active":"2026-02-23T13:06:03.767001+0000","last_became_peered":"2026-02-23T13:06:03.767001+0000","last_unstale":"2026-02-23T13:07:16.613644+0000","last_undegraded":"2026-02-23T13:07:16.613644+0000","last_fullsized":"2026-02-23T13:07:16.613644+0000","mapping_epoch":48,"log_start":"52'35096","ondisk_log_start":"52'35096","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":20349,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2300248064,"num_objects":35099,"num_object_clones":0,"num_object_copies":105297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35099,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35099,"num_write_kb":2246336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"52'33358","reported_seq":33603,"reported_epoch":52,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:07:11.695531+0000","last_change":"2026-02-23T13:07:09.114575+0000","last_active":"2026-02-23T13:07:11.695531+0000","last_peered":"2026-02-23T13:07:11.695531+0000","last_clean":"2026-02-23T13:07:11.695531+0000","last_became_active":"2026-02-23T13:06:03.766997+0000","last_became_peered":"2026-02-23T13:06:03.766997+0000","last_unstale":"2026-02-23T13:07:11.695531+0000","last_undegraded":"2026-02-23T13:07:11.695531+0000","last_fullsized":"2026-02-23T13:07:11.695531+0000","mapping_epoch":48,"log_start":"52'33355","ondisk_log_start":"52'33355","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":22099,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 3s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2186149888,"num_objects":33358,"num_object_clones":0,"num_object_copies":100074,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33358,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33358,"num_write_kb":2134912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"52'33289","reported_seq":33309,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:11.700142+0000","last_change":"2026-02-23T13:06:03.767298+0000","last_active":"2026-02-23T13:07:11.700142+0000","last_peered":"2026-02-23T13:07:11.700142+0000","last_clean":"2026-02-23T13:07:11.700142+0000","last_became_active":"2026-02-23T13:06:03.767015+0000","last_became_peered":"2026-02-23T13:06:03.767015+0000","last_unstale":"2026-02-23T13:07:11.700142+0000","last_undegraded":"2026-02-23T13:07:11.700142+0000","last_fullsized":"2026-02-23T13:07:11.700142+0000","mapping_epoch":48,"log_start":"52'33286","ondisk_log_start":"52'33286","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:29.610437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2181627904,"num_objects":33289,"num_object_clones":0,"num_object_copies":99867,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33289,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33289,"num_write_kb":2130496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":258,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:51.141839+0000","last_change":"2026-02-23T13:06:51.141808+0000","last_active":"2026-02-23T13:06:51.141839+0000","last_peered":"2026-02-23T13:06:51.141839+0000","last_clean":"2026-02-23T13:06:51.141839+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:06:51.141839+0000","last_undegraded":"2026-02-23T13:06:51.141839+0000","last_fullsized":"2026-02-23T13:06:51.141839+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:06:51.141759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:06:51.141759+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:55.931020+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":36217356288,"num_objects":552633,"num_object_clones":0,"num_object_copies":1657899,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":552633,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552633,"num_write_kb":35368512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":109629603840,"data_stored":109629603840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247862,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":24344292,"kb_used_data":22533392,"kb_used_omap":6,"kb_used_meta":1810873,"kb_avail":709658908,"statfs":{"total":751619276800,"available":726690721792,"internally_reserved":0,"allocated":23074193408,"data_stored":23073846291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6536,"internal_metadata":1854334584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,4,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444089,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":33429028,"kb_used_data":31376464,"kb_used_omap":7,"kb_used_meta":2052536,"kb_avail":700574172,"statfs":{"total":751619276800,"available":717387952128,"internally_reserved":0,"allocated":32129499136,"data_stored":32129152019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7324,"internal_metadata":2101797732},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":25082400,"kb_used_data":23207628,"kb_used_omap":12,"kb_used_meta":1874739,"kb_avail":708920800,"statfs":{"total":751619276800,"available":725934899200,"internally_reserved":0,"allocated":23764611072,"data_stored":23764267507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12486,"internal_metadata":1919733562},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,3,2,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705724,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":30383076,"kb_used_data":29179408,"kb_used_omap":5,"kb_used_meta":1203642,"kb_avail":703620124,"statfs":{"total":751619276800,"available":720507006976,"internally_reserved":0,"allocated":29879713792,"data_stored":29879366675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6126,"internal_metadata":1232529426},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":30095966208,"data_stored":30095966208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23970447360,"data_stored":23970447360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32418168832,"data_stored":32418168832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":23145021440,"data_stored":23145021440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:07:17.549 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:07:17.550 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_1 pg_num 56 2026-02-23T13:07:17.696 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:17.725 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:17 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:07:17.725 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:17 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:07:17.725 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:17 trial046 ceph-mon[38575]: pgmap v156: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 34 GiB data, 108 GiB used, 2.6 TiB / 2.7 TiB avail; 501 MiB/s wr, 8.01k op/s 2026-02-23T13:07:17.725 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:17 trial046 ceph-mon[38575]: 3.5 scrub starts 2026-02-23T13:07:17.725 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:17 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/177823625' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:07:17.829 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:17.828+0000 7f7224f78640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:17.829 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:17.828+0000 7f7224f78640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:17.859 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 73 15 572036 572021 489.696 341.125 0.00588139 0.00204073 2026-02-23T13:07:17.975 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:07:18.015 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:07:18.860 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 74 16 578315 578299 488.38 392.375 0.0011267 0.00204622 2026-02-23T13:07:18.987 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:07:19.010 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:18 trial046 ceph-mon[38575]: 3.4 scrub ok 2026-02-23T13:07:19.011 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:18 trial046 ceph-mon[38575]: 3.b scrub starts 2026-02-23T13:07:19.011 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:18 trial046 ceph-mon[38575]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:07:19.011 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:18 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1965520425' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_1", "var": "pg_num", "val": "56"} : dispatch 2026-02-23T13:07:19.125 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:19.252 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:19.251+0000 7f5b0a66b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:19.252 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:19.251+0000 7f5b0a66b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:19.267 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:07:19.268 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:07:19.282 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:07:19.283 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:07:19.297 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:07:19.297 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:07:19.313 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:07:19.314 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:07:19.860 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 75 16 584393 584377 486.933 379.875 0.00182216 0.00205236 2026-02-23T13:07:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:19 trial046 ceph-mon[38575]: 3.1 scrub ok 2026-02-23T13:07:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:19 trial046 ceph-mon[38575]: 3.7 scrub ok 2026-02-23T13:07:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:19 trial046 ceph-mon[38575]: 3.a scrub starts 2026-02-23T13:07:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:19 trial046 ceph-mon[38575]: pgmap v157: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 35 GiB data, 109 GiB used, 2.6 TiB / 2.7 TiB avail; 491 MiB/s wr, 7.86k op/s 2026-02-23T13:07:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:19 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/349602589' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:07:20.859 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 76 16 591292 591276 486.199 431.188 0.00146662 0.00205545 2026-02-23T13:07:21.357 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:07:21.502 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:21.631 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:21.630+0000 7f7d45d44640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:21.632 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:21.630+0000 7f7d45d44640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:21.647 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:07:21.647 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:07:21.659 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:07:21.660 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:07:21.675 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:07:21.675 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:07:21.687 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:07:21.687 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:07:21.859 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 77 16 598380 598364 485.638 443 0.00211328 0.00205784 2026-02-23T13:07:22.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:21 trial046 ceph-mon[38575]: 3.5 scrub ok 2026-02-23T13:07:22.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:21 trial046 ceph-mon[38575]: pgmap v158: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 35 GiB data, 109 GiB used, 2.6 TiB / 2.7 TiB avail; 366 MiB/s wr, 5.85k op/s 2026-02-23T13:07:22.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:21 trial046 ceph-mon[38575]: 3.b scrub ok 2026-02-23T13:07:22.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:21 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/410361455' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:07:22.860 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 78 16 606990 606974 486.31 538.125 0.00134907 0.00205499 2026-02-23T13:07:23.016 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:07:23.017 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:07:23.017 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:07:23.017 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:07:23.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:22 trial046 ceph-mon[38575]: 3.a scrub ok 2026-02-23T13:07:23.171 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:23.305 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:23.304+0000 7f219313c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:23.305 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:23.304+0000 7f219313c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:23.472 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:07:23.472 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:07:23.524 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2026-02-23T13:07:22.624840+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":39130694176,"num_objects":597080,"num_object_clones":0,"num_object_copies":1791240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":597080,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":597213,"num_write_kb":38215142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":120818380,"kb_used_data":113713852,"kb_used_omap":28,"kb_used_meta":7104419,"kb_avail":2815194420,"statfs":{"total":3006477107200,"available":2882759086080,"internally_reserved":0,"allocated":116442984448,"data_stored":116441599532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29290,"internal_metadata":7274925462},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,2,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6676021248,"num_objects":101868,"num_object_clones":0,"num_object_copies":305604,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101868,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101868,"num_write_kb":6519552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001667"},"pg_stats":[{"pgid":"3.f","version":"52'37543","reported_seq":37883,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:21.616245+0000","last_change":"2026-02-23T13:07:08.188933+0000","last_active":"2026-02-23T13:07:21.616245+0000","last_peered":"2026-02-23T13:07:21.616245+0000","last_clean":"2026-02-23T13:07:21.616245+0000","last_became_active":"2026-02-23T13:06:03.767261+0000","last_became_peered":"2026-02-23T13:06:03.767261+0000","last_unstale":"2026-02-23T13:07:21.616245+0000","last_undegraded":"2026-02-23T13:07:21.616245+0000","last_fullsized":"2026-02-23T13:07:21.616245+0000","mapping_epoch":48,"log_start":"52'37540","ondisk_log_start":"52'37540","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'31889","last_scrub_stamp":"2026-02-23T13:07:08.188897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:08.188897+0000","objects_scrubbed":31058,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:29.284171+0000","scrub_duration":3362,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2460418048,"num_objects":37543,"num_object_clones":0,"num_object_copies":112629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37543,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37543,"num_write_kb":2402752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"52'37320","reported_seq":37340,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:21.616916+0000","last_change":"2026-02-23T13:06:03.768354+0000","last_active":"2026-02-23T13:07:21.616916+0000","last_peered":"2026-02-23T13:07:21.616916+0000","last_clean":"2026-02-23T13:07:21.616916+0000","last_became_active":"2026-02-23T13:06:03.767822+0000","last_became_peered":"2026-02-23T13:06:03.767822+0000","last_unstale":"2026-02-23T13:07:21.616916+0000","last_undegraded":"2026-02-23T13:07:21.616916+0000","last_fullsized":"2026-02-23T13:07:21.616916+0000","mapping_epoch":48,"log_start":"52'37317","ondisk_log_start":"52'37317","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:24.671155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2445803520,"num_objects":37320,"num_object_clones":0,"num_object_copies":111960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37320,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37320,"num_write_kb":2388480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"52'37299","reported_seq":37319,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:21.619235+0000","last_change":"2026-02-23T13:06:03.769230+0000","last_active":"2026-02-23T13:07:21.619235+0000","last_peered":"2026-02-23T13:07:21.619235+0000","last_clean":"2026-02-23T13:07:21.619235+0000","last_became_active":"2026-02-23T13:06:03.768946+0000","last_became_peered":"2026-02-23T13:06:03.768946+0000","last_unstale":"2026-02-23T13:07:21.619235+0000","last_undegraded":"2026-02-23T13:07:21.619235+0000","last_fullsized":"2026-02-23T13:07:21.619235+0000","mapping_epoch":48,"log_start":"52'37296","ondisk_log_start":"52'37296","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:26.718468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2444427264,"num_objects":37299,"num_object_clones":0,"num_object_copies":111897,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37299,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37299,"num_write_kb":2387136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"52'37277","reported_seq":37297,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:21.615518+0000","last_change":"2026-02-23T13:06:03.767398+0000","last_active":"2026-02-23T13:07:21.615518+0000","last_peered":"2026-02-23T13:07:21.615518+0000","last_clean":"2026-02-23T13:07:21.615518+0000","last_became_active":"2026-02-23T13:06:03.767083+0000","last_became_peered":"2026-02-23T13:06:03.767083+0000","last_unstale":"2026-02-23T13:07:21.615518+0000","last_undegraded":"2026-02-23T13:07:21.615518+0000","last_fullsized":"2026-02-23T13:07:21.615518+0000","mapping_epoch":48,"log_start":"52'37274","ondisk_log_start":"52'37274","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:32.716724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2442985472,"num_objects":37277,"num_object_clones":0,"num_object_copies":111831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37277,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37277,"num_write_kb":2385728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"52'37241","reported_seq":37630,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:21.704809+0000","last_change":"2026-02-23T13:07:20.897120+0000","last_active":"2026-02-23T13:07:21.704809+0000","last_peered":"2026-02-23T13:07:21.704809+0000","last_clean":"2026-02-23T13:07:21.704809+0000","last_became_active":"2026-02-23T13:06:03.766614+0000","last_became_peered":"2026-02-23T13:06:03.766614+0000","last_unstale":"2026-02-23T13:07:21.704809+0000","last_undegraded":"2026-02-23T13:07:21.704809+0000","last_fullsized":"2026-02-23T13:07:21.704809+0000","mapping_epoch":48,"log_start":"52'37238","ondisk_log_start":"52'37238","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'36893","last_scrub_stamp":"2026-02-23T13:07:20.897051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:20.897051+0000","objects_scrubbed":36116,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:37.187224+0000","scrub_duration":3824,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2440626176,"num_objects":37241,"num_object_clones":0,"num_object_copies":111723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37241,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37241,"num_write_kb":2383424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"52'37221","reported_seq":37589,"reported_epoch":52,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:07:21.623714+0000","last_change":"2026-02-23T13:07:18.315816+0000","last_active":"2026-02-23T13:07:21.623714+0000","last_peered":"2026-02-23T13:07:21.623714+0000","last_clean":"2026-02-23T13:07:21.623714+0000","last_became_active":"2026-02-23T13:06:03.768238+0000","last_became_peered":"2026-02-23T13:06:03.768238+0000","last_unstale":"2026-02-23T13:07:21.623714+0000","last_undegraded":"2026-02-23T13:07:21.623714+0000","last_fullsized":"2026-02-23T13:07:21.623714+0000","mapping_epoch":48,"log_start":"52'37218","ondisk_log_start":"52'37218","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":34399,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 4s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2439315456,"num_objects":37221,"num_object_clones":0,"num_object_copies":111663,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37221,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37221,"num_write_kb":2382144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"52'37462","reported_seq":37810,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:21.621704+0000","last_change":"2026-02-23T13:07:09.835508+0000","last_active":"2026-02-23T13:07:21.621704+0000","last_peered":"2026-02-23T13:07:21.621704+0000","last_clean":"2026-02-23T13:07:21.621704+0000","last_became_active":"2026-02-23T13:06:03.767947+0000","last_became_peered":"2026-02-23T13:06:03.767947+0000","last_unstale":"2026-02-23T13:07:21.621704+0000","last_undegraded":"2026-02-23T13:07:21.621704+0000","last_fullsized":"2026-02-23T13:07:21.621704+0000","mapping_epoch":48,"log_start":"52'37459","ondisk_log_start":"52'37459","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'32488","last_scrub_stamp":"2026-02-23T13:07:09.835476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:09.835476+0000","objects_scrubbed":31955,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:24.178560+0000","scrub_duration":2500,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2455109632,"num_objects":37462,"num_object_clones":0,"num_object_copies":112386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37462,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37462,"num_write_kb":2397568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"52'37200","reported_seq":37219,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:21.708340+0000","last_change":"2026-02-23T13:06:03.767140+0000","last_active":"2026-02-23T13:07:21.708340+0000","last_peered":"2026-02-23T13:07:21.708340+0000","last_clean":"2026-02-23T13:07:21.708340+0000","last_became_active":"2026-02-23T13:06:03.766859+0000","last_became_peered":"2026-02-23T13:06:03.766859+0000","last_unstale":"2026-02-23T13:07:21.708340+0000","last_undegraded":"2026-02-23T13:07:21.708340+0000","last_fullsized":"2026-02-23T13:07:21.708340+0000","mapping_epoch":48,"log_start":"52'37197","ondisk_log_start":"52'37197","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:26.334481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2437939200,"num_objects":37200,"num_object_clones":0,"num_object_copies":111600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37200,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37200,"num_write_kb":2380800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"52'37297","reported_seq":37677,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:21.706068+0000","last_change":"2026-02-23T13:07:18.015015+0000","last_active":"2026-02-23T13:07:21.706068+0000","last_peered":"2026-02-23T13:07:21.706068+0000","last_clean":"2026-02-23T13:07:21.706068+0000","last_became_active":"2026-02-23T13:06:03.765502+0000","last_became_peered":"2026-02-23T13:06:03.765502+0000","last_unstale":"2026-02-23T13:07:21.706068+0000","last_undegraded":"2026-02-23T13:07:21.706068+0000","last_fullsized":"2026-02-23T13:07:21.706068+0000","mapping_epoch":48,"log_start":"52'37294","ondisk_log_start":"52'37294","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'35769","last_scrub_stamp":"2026-02-23T13:07:18.014937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:18.014937+0000","objects_scrubbed":35059,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:23.289493+0000","scrub_duration":3913,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2444296192,"num_objects":37297,"num_object_clones":0,"num_object_copies":111891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37297,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37297,"num_write_kb":2387008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"52'37469","reported_seq":37489,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:21.612324+0000","last_change":"2026-02-23T13:06:03.767303+0000","last_active":"2026-02-23T13:07:21.612324+0000","last_peered":"2026-02-23T13:07:21.612324+0000","last_clean":"2026-02-23T13:07:21.612324+0000","last_became_active":"2026-02-23T13:06:03.767012+0000","last_became_peered":"2026-02-23T13:06:03.767012+0000","last_unstale":"2026-02-23T13:07:21.612324+0000","last_undegraded":"2026-02-23T13:07:21.612324+0000","last_fullsized":"2026-02-23T13:07:21.612324+0000","mapping_epoch":48,"log_start":"52'37466","ondisk_log_start":"52'37466","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:22.659298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2455568384,"num_objects":37469,"num_object_clones":0,"num_object_copies":112407,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37469,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37469,"num_write_kb":2398016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"52'37241","reported_seq":37630,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:21.618420+0000","last_change":"2026-02-23T13:07:20.033733+0000","last_active":"2026-02-23T13:07:21.618420+0000","last_peered":"2026-02-23T13:07:21.618420+0000","last_clean":"2026-02-23T13:07:21.618420+0000","last_became_active":"2026-02-23T13:06:03.767200+0000","last_became_peered":"2026-02-23T13:06:03.767200+0000","last_unstale":"2026-02-23T13:07:21.618420+0000","last_undegraded":"2026-02-23T13:07:21.618420+0000","last_fullsized":"2026-02-23T13:07:21.618420+0000","mapping_epoch":48,"log_start":"52'37238","ondisk_log_start":"52'37238","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'36561","last_scrub_stamp":"2026-02-23T13:07:20.033700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:20.033700+0000","objects_scrubbed":35947,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:44.960748+0000","scrub_duration":3247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2440626176,"num_objects":37241,"num_object_clones":0,"num_object_copies":111723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37241,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37241,"num_write_kb":2383424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"52'37622","reported_seq":38001,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:21.706422+0000","last_change":"2026-02-23T13:07:17.060455+0000","last_active":"2026-02-23T13:07:21.706422+0000","last_peered":"2026-02-23T13:07:21.706422+0000","last_clean":"2026-02-23T13:07:21.706422+0000","last_became_active":"2026-02-23T13:06:03.766415+0000","last_became_peered":"2026-02-23T13:06:03.766415+0000","last_unstale":"2026-02-23T13:07:21.706422+0000","last_undegraded":"2026-02-23T13:07:21.706422+0000","last_fullsized":"2026-02-23T13:07:21.706422+0000","mapping_epoch":48,"log_start":"52'37619","ondisk_log_start":"52'37619","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'35773","last_scrub_stamp":"2026-02-23T13:07:17.060384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:17.060384+0000","objects_scrubbed":34982,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:39.770993+0000","scrub_duration":3962,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2465595392,"num_objects":37622,"num_object_clones":0,"num_object_copies":112866,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37622,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37622,"num_write_kb":2407808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"52'36986","reported_seq":37006,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:21.609360+0000","last_change":"2026-02-23T13:06:03.768871+0000","last_active":"2026-02-23T13:07:21.609360+0000","last_peered":"2026-02-23T13:07:21.609360+0000","last_clean":"2026-02-23T13:07:21.609360+0000","last_became_active":"2026-02-23T13:06:03.768541+0000","last_became_peered":"2026-02-23T13:06:03.768541+0000","last_unstale":"2026-02-23T13:07:21.609360+0000","last_undegraded":"2026-02-23T13:07:21.609360+0000","last_fullsized":"2026-02-23T13:07:21.609360+0000","mapping_epoch":48,"log_start":"52'36983","ondisk_log_start":"52'36983","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:31.119570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2423914496,"num_objects":36986,"num_object_clones":0,"num_object_copies":110958,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36986,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36986,"num_write_kb":2367104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"52'37072","reported_seq":37452,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:21.609378+0000","last_change":"2026-02-23T13:07:18.000008+0000","last_active":"2026-02-23T13:07:21.609378+0000","last_peered":"2026-02-23T13:07:21.609378+0000","last_clean":"2026-02-23T13:07:21.609378+0000","last_became_active":"2026-02-23T13:06:03.767001+0000","last_became_peered":"2026-02-23T13:06:03.767001+0000","last_unstale":"2026-02-23T13:07:21.609378+0000","last_undegraded":"2026-02-23T13:07:21.609378+0000","last_fullsized":"2026-02-23T13:07:21.609378+0000","mapping_epoch":48,"log_start":"52'37069","ondisk_log_start":"52'37069","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'35564","last_scrub_stamp":"2026-02-23T13:07:17.999970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:17.999970+0000","objects_scrubbed":35002,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:36.421460+0000","scrub_duration":3089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2429550592,"num_objects":37072,"num_object_clones":0,"num_object_copies":111216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37072,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37072,"num_write_kb":2372608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"52'37412","reported_seq":37773,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:21.706558+0000","last_change":"2026-02-23T13:07:13.026486+0000","last_active":"2026-02-23T13:07:21.706558+0000","last_peered":"2026-02-23T13:07:21.706558+0000","last_clean":"2026-02-23T13:07:21.706558+0000","last_became_active":"2026-02-23T13:06:03.766997+0000","last_became_peered":"2026-02-23T13:06:03.766997+0000","last_unstale":"2026-02-23T13:07:21.706558+0000","last_undegraded":"2026-02-23T13:07:21.706558+0000","last_fullsized":"2026-02-23T13:07:21.706558+0000","mapping_epoch":48,"log_start":"52'37409","ondisk_log_start":"52'37409","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'33950","last_scrub_stamp":"2026-02-23T13:07:13.026390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:13.026390+0000","objects_scrubbed":33091,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:30.336827+0000","scrub_duration":3912,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2451832832,"num_objects":37412,"num_object_clones":0,"num_object_copies":112236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37412,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37412,"num_write_kb":2394368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"52'37416","reported_seq":37435,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:21.707371+0000","last_change":"2026-02-23T13:06:03.767298+0000","last_active":"2026-02-23T13:07:21.707371+0000","last_peered":"2026-02-23T13:07:21.707371+0000","last_clean":"2026-02-23T13:07:21.707371+0000","last_became_active":"2026-02-23T13:06:03.767015+0000","last_became_peered":"2026-02-23T13:06:03.767015+0000","last_unstale":"2026-02-23T13:07:21.707371+0000","last_undegraded":"2026-02-23T13:07:21.707371+0000","last_fullsized":"2026-02-23T13:07:21.707371+0000","mapping_epoch":48,"log_start":"52'37413","ondisk_log_start":"52'37413","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:29.610437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2452094976,"num_objects":37416,"num_object_clones":0,"num_object_copies":112248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37416,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37416,"num_write_kb":2394624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":258,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:51.141839+0000","last_change":"2026-02-23T13:06:51.141808+0000","last_active":"2026-02-23T13:06:51.141839+0000","last_peered":"2026-02-23T13:06:51.141839+0000","last_clean":"2026-02-23T13:06:51.141839+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:06:51.141839+0000","last_undegraded":"2026-02-23T13:06:51.141839+0000","last_fullsized":"2026-02-23T13:06:51.141839+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:06:51.141759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:06:51.141759+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:55.931020+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":39130103808,"num_objects":597078,"num_object_clones":0,"num_object_copies":1791234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":597078,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":597078,"num_write_kb":38212992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":117369274368,"data_stored":117369274368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247863,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":25684324,"kb_used_data":23783184,"kb_used_omap":6,"kb_used_meta":1901113,"kb_avail":708318876,"statfs":{"total":751619276800,"available":725318529024,"internally_reserved":0,"allocated":24353980416,"data_stored":24353633299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6536,"internal_metadata":1946740344},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444090,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":35231844,"kb_used_data":33070992,"kb_used_omap":7,"kb_used_meta":2160824,"kb_avail":698771356,"statfs":{"total":751619276800,"available":715541868544,"internally_reserved":0,"allocated":33864695808,"data_stored":33864348691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7324,"internal_metadata":2212684644},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574908,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27860128,"kb_used_data":26111500,"kb_used_omap":9,"kb_used_meta":1748598,"kb_avail":706143072,"statfs":{"total":751619276800,"available":723090505728,"internally_reserved":0,"allocated":26738176000,"data_stored":26737832435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9304,"internal_metadata":1790565288},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,2,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705725,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32042084,"kb_used_data":30748176,"kb_used_omap":5,"kb_used_meta":1293882,"kb_avail":701961116,"statfs":{"total":751619276800,"available":718808182784,"internally_reserved":0,"allocated":31486132224,"data_stored":31485785107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6126,"internal_metadata":1324935186},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31776178176,"data_stored":31776178176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26919960576,"data_stored":26919960576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":34228469760,"data_stored":34228469760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24444665856,"data_stored":24444665856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:07:23.526 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:07:23.526 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 111 2026-02-23T13:07:23.718 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:23.731 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:07:23.860 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 79 16 615572 615556 486.943 536.375 0.00148707 0.00205232 2026-02-23T13:07:23.864 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:23 trial046 ceph-mon[38575]: pgmap v159: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 36 GiB data, 115 GiB used, 2.6 TiB / 2.7 TiB avail; 530 MiB/s wr, 8.49k op/s 2026-02-23T13:07:23.865 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:23.863+0000 7f4d0bd35640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:23.865 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:23.863+0000 7f4d0bd35640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:23.917 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:24.023 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:07:24.051 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:24.050+0000 7f83598a6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:24.052 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:24.051+0000 7f83598a6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:24.066 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:07:24.068 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:07:24.068 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:07:24.081 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:07:24.082 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:07:24.094 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:07:24.095 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:07:24.109 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:07:24.109 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:07:24.860 INFO:tasks.radosbench.radosbench.0.trial046.stdout:2026-02-23T13:07:24.859925+0000 min lat: 0.00064303 max lat: 0.0544095 avg lat: 0.00205017 2026-02-23T13:07:24.860 INFO:tasks.radosbench.radosbench.0.trial046.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-23T13:07:24.860 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 80 16 624017 624001 487.454 527.812 0.00228313 0.00205017 2026-02-23T13:07:25.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:24 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:07:25.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:24 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:07:25.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:24 trial046 ceph-mon[38575]: from='client.14747 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:07:25.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:24 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/128812298' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "111"} : dispatch 2026-02-23T13:07:25.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:24 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2040454019' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:07:25.860 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 81 16 631860 631844 487.487 490.188 0.00117095 0.00205 2026-02-23T13:07:26.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:25 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:07:26.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:25 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:07:26.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:25 trial046 ceph-mon[38575]: pgmap v160: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 36 GiB data, 115 GiB used, 2.6 TiB / 2.7 TiB avail; 341 MiB/s wr, 5.45k op/s 2026-02-23T13:07:26.154 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:07:26.303 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:26.354 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:07:26 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:07:26] "GET /metrics HTTP/1.1" 200 4216 "" "Prometheus/3.6.0" 2026-02-23T13:07:26.425 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:26.423+0000 7f4ab5f8b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:26.425 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:26.424+0000 7f4ab5f8b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:26.440 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:07:26.441 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:07:26.455 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:07:26.455 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:07:26.470 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:07:26.470 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:07:26.483 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:07:26.483 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:07:26.561 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:07:26 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:07:26.087Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:07:26.860 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 82 15 639302 639287 487.215 465.188 0.00278791 0.00205117 2026-02-23T13:07:27.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:26 trial046 ceph-mon[38575]: 3.6 scrub starts 2026-02-23T13:07:27.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:26 trial046 ceph-mon[38575]: 3.e scrub starts 2026-02-23T13:07:27.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:26 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3530292909' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:07:27.860 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 83 16 645304 645288 485.863 375.062 0.00535572 0.00205685 2026-02-23T13:07:28.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:27 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:07:28.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:27 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:07:28.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:27 trial046 ceph-mon[38575]: pgmap v161: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 38 GiB data, 119 GiB used, 2.6 TiB / 2.7 TiB avail; 473 MiB/s wr, 7.56k op/s 2026-02-23T13:07:28.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:27 trial046 ceph-mon[38575]: 3.8 scrub starts 2026-02-23T13:07:28.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:27 trial046 ceph-mon[38575]: 3.d scrub starts 2026-02-23T13:07:28.527 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:07:28.670 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:28.860 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 84 16 650672 650656 484.073 335.5 0.00766163 0.00206445 2026-02-23T13:07:29.054 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:28.995+0000 7f117fc32640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:29.054 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:28.996+0000 7f117fc32640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:29.055 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:07:29.055 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:07:29.055 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:07:29.055 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:07:29.055 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:07:29.056 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:07:29.068 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:07:29.068 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:07:29.068 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-23T13:07:29.068 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:07:29.068 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:07:29.068 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:07:29.840 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:29.860 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 85 16 654800 654784 481.413 258 0.00103449 0.00207586 2026-02-23T13:07:29.959 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:29 trial046 ceph-mon[38575]: pgmap v162: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 39 GiB data, 121 GiB used, 2.6 TiB / 2.7 TiB avail; 444 MiB/s wr, 7.10k op/s 2026-02-23T13:07:29.959 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:29 trial046 ceph-mon[38575]: osdmap e53: 4 total, 4 up, 4 in 2026-02-23T13:07:29.959 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:29 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2750798920' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:07:30.259 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:30.251+0000 7f06ea539640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:30.259 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:30.251+0000 7f06ea539640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:30.397 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:07:30.398 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:07:30.861 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 86 16 659447 659431 479.192 290.438 0.000833695 0.00208551 2026-02-23T13:07:30.946 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:30 trial046 ceph-mon[38575]: 3.6 scrub ok 2026-02-23T13:07:30.970 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2026-02-23T13:07:28.685465+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":41800827424,"num_objects":637823,"num_object_clones":0,"num_object_copies":1913469,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":637823,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":637956,"num_write_kb":40822694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53,"ondisk_log_size":53,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":127120716,"kb_used_data":121558716,"kb_used_omap":30,"kb_used_meta":5561889,"kb_avail":2808892084,"statfs":{"total":3006477107200,"available":2876305494016,"internally_reserved":0,"allocated":124476125184,"data_stored":124474740268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31580,"internal_metadata":5695374500},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4744544256,"num_objects":72396,"num_object_clones":0,"num_object_copies":217188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72396,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72396,"num_write_kb":4633344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.061145"},"pg_stats":[{"pgid":"3.f","version":"52'40071","reported_seq":40411,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:26.617822+0000","last_change":"2026-02-23T13:07:08.188933+0000","last_active":"2026-02-23T13:07:26.617822+0000","last_peered":"2026-02-23T13:07:26.617822+0000","last_clean":"2026-02-23T13:07:26.617822+0000","last_became_active":"2026-02-23T13:06:03.767261+0000","last_became_peered":"2026-02-23T13:06:03.767261+0000","last_unstale":"2026-02-23T13:07:26.617822+0000","last_undegraded":"2026-02-23T13:07:26.617822+0000","last_fullsized":"2026-02-23T13:07:26.617822+0000","mapping_epoch":48,"log_start":"52'40068","ondisk_log_start":"52'40068","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'31889","last_scrub_stamp":"2026-02-23T13:07:08.188897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:08.188897+0000","objects_scrubbed":31058,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:29.284171+0000","scrub_duration":3362,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2626093056,"num_objects":40071,"num_object_clones":0,"num_object_copies":120213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40071,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40071,"num_write_kb":2564544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"52'39849","reported_seq":39948,"reported_epoch":52,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:07:26.612518+0000","last_change":"2026-02-23T13:07:25.697087+0000","last_active":"2026-02-23T13:07:26.612518+0000","last_peered":"2026-02-23T13:07:26.612518+0000","last_clean":"2026-02-23T13:07:26.612518+0000","last_became_active":"2026-02-23T13:06:03.767822+0000","last_became_peered":"2026-02-23T13:06:03.767822+0000","last_unstale":"2026-02-23T13:07:26.612518+0000","last_undegraded":"2026-02-23T13:07:26.612518+0000","last_fullsized":"2026-02-23T13:07:26.612518+0000","mapping_epoch":48,"log_start":"52'39845","ondisk_log_start":"52'39845","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":7899,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2611544064,"num_objects":39849,"num_object_clones":0,"num_object_copies":119547,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39849,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39849,"num_write_kb":2550336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"52'39904","reported_seq":39923,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:26.616079+0000","last_change":"2026-02-23T13:06:03.769230+0000","last_active":"2026-02-23T13:07:26.616079+0000","last_peered":"2026-02-23T13:07:26.616079+0000","last_clean":"2026-02-23T13:07:26.616079+0000","last_became_active":"2026-02-23T13:06:03.768946+0000","last_became_peered":"2026-02-23T13:06:03.768946+0000","last_unstale":"2026-02-23T13:07:26.616079+0000","last_undegraded":"2026-02-23T13:07:26.616079+0000","last_fullsized":"2026-02-23T13:07:26.616079+0000","mapping_epoch":48,"log_start":"52'39901","ondisk_log_start":"52'39901","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:26.718468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2615148544,"num_objects":39904,"num_object_clones":0,"num_object_copies":119712,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39904,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39904,"num_write_kb":2553856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"52'39795","reported_seq":39815,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:26.622950+0000","last_change":"2026-02-23T13:06:03.767398+0000","last_active":"2026-02-23T13:07:26.622950+0000","last_peered":"2026-02-23T13:07:26.622950+0000","last_clean":"2026-02-23T13:07:26.622950+0000","last_became_active":"2026-02-23T13:06:03.767083+0000","last_became_peered":"2026-02-23T13:06:03.767083+0000","last_unstale":"2026-02-23T13:07:26.622950+0000","last_undegraded":"2026-02-23T13:07:26.622950+0000","last_fullsized":"2026-02-23T13:07:26.622950+0000","mapping_epoch":48,"log_start":"52'39792","ondisk_log_start":"52'39792","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:32.716724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2608005120,"num_objects":39795,"num_object_clones":0,"num_object_copies":119385,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39795,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39795,"num_write_kb":2546880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"52'39857","reported_seq":40247,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:26.709116+0000","last_change":"2026-02-23T13:07:20.897120+0000","last_active":"2026-02-23T13:07:26.709116+0000","last_peered":"2026-02-23T13:07:26.709116+0000","last_clean":"2026-02-23T13:07:26.709116+0000","last_became_active":"2026-02-23T13:06:03.766614+0000","last_became_peered":"2026-02-23T13:06:03.766614+0000","last_unstale":"2026-02-23T13:07:26.709116+0000","last_undegraded":"2026-02-23T13:07:26.709116+0000","last_fullsized":"2026-02-23T13:07:26.709116+0000","mapping_epoch":48,"log_start":"52'39854","ondisk_log_start":"52'39854","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'36893","last_scrub_stamp":"2026-02-23T13:07:20.897051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:20.897051+0000","objects_scrubbed":36116,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:37.187224+0000","scrub_duration":3824,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2612068352,"num_objects":39857,"num_object_clones":0,"num_object_copies":119571,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39857,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39857,"num_write_kb":2550848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"52'39759","reported_seq":40155,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:26.621455+0000","last_change":"2026-02-23T13:07:21.878287+0000","last_active":"2026-02-23T13:07:26.621455+0000","last_peered":"2026-02-23T13:07:26.621455+0000","last_clean":"2026-02-23T13:07:26.621455+0000","last_became_active":"2026-02-23T13:06:03.768238+0000","last_became_peered":"2026-02-23T13:06:03.768238+0000","last_unstale":"2026-02-23T13:07:26.621455+0000","last_undegraded":"2026-02-23T13:07:26.621455+0000","last_fullsized":"2026-02-23T13:07:26.621455+0000","mapping_epoch":48,"log_start":"52'39756","ondisk_log_start":"52'39756","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'37319","last_scrub_stamp":"2026-02-23T13:07:21.878230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:21.878230+0000","objects_scrubbed":36520,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:48.355026+0000","scrub_duration":3562,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2605645824,"num_objects":39759,"num_object_clones":0,"num_object_copies":119277,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39759,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39759,"num_write_kb":2544576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"52'39935","reported_seq":40283,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:26.621490+0000","last_change":"2026-02-23T13:07:09.835508+0000","last_active":"2026-02-23T13:07:26.621490+0000","last_peered":"2026-02-23T13:07:26.621490+0000","last_clean":"2026-02-23T13:07:26.621490+0000","last_became_active":"2026-02-23T13:06:03.767947+0000","last_became_peered":"2026-02-23T13:06:03.767947+0000","last_unstale":"2026-02-23T13:07:26.621490+0000","last_undegraded":"2026-02-23T13:07:26.621490+0000","last_fullsized":"2026-02-23T13:07:26.621490+0000","mapping_epoch":48,"log_start":"52'39932","ondisk_log_start":"52'39932","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'32488","last_scrub_stamp":"2026-02-23T13:07:09.835476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:09.835476+0000","objects_scrubbed":31955,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:24.178560+0000","scrub_duration":2500,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2617180160,"num_objects":39935,"num_object_clones":0,"num_object_copies":119805,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39935,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39935,"num_write_kb":2555840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"52'39763","reported_seq":39783,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:26.705515+0000","last_change":"2026-02-23T13:06:03.767140+0000","last_active":"2026-02-23T13:07:26.705515+0000","last_peered":"2026-02-23T13:07:26.705515+0000","last_clean":"2026-02-23T13:07:26.705515+0000","last_became_active":"2026-02-23T13:06:03.766859+0000","last_became_peered":"2026-02-23T13:06:03.766859+0000","last_unstale":"2026-02-23T13:07:26.705515+0000","last_undegraded":"2026-02-23T13:07:26.705515+0000","last_fullsized":"2026-02-23T13:07:26.705515+0000","mapping_epoch":48,"log_start":"52'39760","ondisk_log_start":"52'39760","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2605907968,"num_objects":39763,"num_object_clones":0,"num_object_copies":119289,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39763,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39763,"num_write_kb":2544832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"52'39795","reported_seq":40175,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:26.706700+0000","last_change":"2026-02-23T13:07:18.015015+0000","last_active":"2026-02-23T13:07:26.706700+0000","last_peered":"2026-02-23T13:07:26.706700+0000","last_clean":"2026-02-23T13:07:26.706700+0000","last_became_active":"2026-02-23T13:06:03.765502+0000","last_became_peered":"2026-02-23T13:06:03.765502+0000","last_unstale":"2026-02-23T13:07:26.706700+0000","last_undegraded":"2026-02-23T13:07:26.706700+0000","last_fullsized":"2026-02-23T13:07:26.706700+0000","mapping_epoch":48,"log_start":"52'39792","ondisk_log_start":"52'39792","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'35769","last_scrub_stamp":"2026-02-23T13:07:18.014937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:18.014937+0000","objects_scrubbed":35059,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:23.289493+0000","scrub_duration":3913,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2608005120,"num_objects":39795,"num_object_clones":0,"num_object_copies":119385,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39795,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39795,"num_write_kb":2546880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"52'39998","reported_seq":40171,"reported_epoch":52,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:07:26.615713+0000","last_change":"2026-02-23T13:07:24.969607+0000","last_active":"2026-02-23T13:07:26.615713+0000","last_peered":"2026-02-23T13:07:26.615713+0000","last_clean":"2026-02-23T13:07:26.615713+0000","last_became_active":"2026-02-23T13:06:03.767012+0000","last_became_peered":"2026-02-23T13:06:03.767012+0000","last_unstale":"2026-02-23T13:07:26.615713+0000","last_undegraded":"2026-02-23T13:07:26.615713+0000","last_fullsized":"2026-02-23T13:07:26.615713+0000","mapping_epoch":48,"log_start":"52'39995","ondisk_log_start":"52'39995","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":14799,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621308928,"num_objects":39998,"num_object_clones":0,"num_object_copies":119994,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39998,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39998,"num_write_kb":2559872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"52'39724","reported_seq":40113,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:26.618783+0000","last_change":"2026-02-23T13:07:20.033733+0000","last_active":"2026-02-23T13:07:26.618783+0000","last_peered":"2026-02-23T13:07:26.618783+0000","last_clean":"2026-02-23T13:07:26.618783+0000","last_became_active":"2026-02-23T13:06:03.767200+0000","last_became_peered":"2026-02-23T13:06:03.767200+0000","last_unstale":"2026-02-23T13:07:26.618783+0000","last_undegraded":"2026-02-23T13:07:26.618783+0000","last_fullsized":"2026-02-23T13:07:26.618783+0000","mapping_epoch":48,"log_start":"52'39720","ondisk_log_start":"52'39720","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'36561","last_scrub_stamp":"2026-02-23T13:07:20.033700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:20.033700+0000","objects_scrubbed":35947,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:44.960748+0000","scrub_duration":3247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2603352064,"num_objects":39724,"num_object_clones":0,"num_object_copies":119172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39724,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39724,"num_write_kb":2542336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"52'40206","reported_seq":40585,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:26.709430+0000","last_change":"2026-02-23T13:07:17.060455+0000","last_active":"2026-02-23T13:07:26.709430+0000","last_peered":"2026-02-23T13:07:26.709430+0000","last_clean":"2026-02-23T13:07:26.709430+0000","last_became_active":"2026-02-23T13:06:03.766415+0000","last_became_peered":"2026-02-23T13:06:03.766415+0000","last_unstale":"2026-02-23T13:07:26.709430+0000","last_undegraded":"2026-02-23T13:07:26.709430+0000","last_fullsized":"2026-02-23T13:07:26.709430+0000","mapping_epoch":48,"log_start":"52'40203","ondisk_log_start":"52'40203","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'35773","last_scrub_stamp":"2026-02-23T13:07:17.060384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:17.060384+0000","objects_scrubbed":34982,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:39.770993+0000","scrub_duration":3962,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2634940416,"num_objects":40206,"num_object_clones":0,"num_object_copies":120618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40206,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40206,"num_write_kb":2573184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"52'39646","reported_seq":39666,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:26.615915+0000","last_change":"2026-02-23T13:06:03.768871+0000","last_active":"2026-02-23T13:07:26.615915+0000","last_peered":"2026-02-23T13:07:26.615915+0000","last_clean":"2026-02-23T13:07:26.615915+0000","last_became_active":"2026-02-23T13:06:03.768541+0000","last_became_peered":"2026-02-23T13:06:03.768541+0000","last_unstale":"2026-02-23T13:07:26.615915+0000","last_undegraded":"2026-02-23T13:07:26.615915+0000","last_fullsized":"2026-02-23T13:07:26.615915+0000","mapping_epoch":48,"log_start":"52'39643","ondisk_log_start":"52'39643","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:31.119570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2598240256,"num_objects":39646,"num_object_clones":0,"num_object_copies":118938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39646,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39646,"num_write_kb":2537344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"52'39537","reported_seq":39917,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:26.613079+0000","last_change":"2026-02-23T13:07:18.000008+0000","last_active":"2026-02-23T13:07:26.613079+0000","last_peered":"2026-02-23T13:07:26.613079+0000","last_clean":"2026-02-23T13:07:26.613079+0000","last_became_active":"2026-02-23T13:06:03.767001+0000","last_became_peered":"2026-02-23T13:06:03.767001+0000","last_unstale":"2026-02-23T13:07:26.613079+0000","last_undegraded":"2026-02-23T13:07:26.613079+0000","last_fullsized":"2026-02-23T13:07:26.613079+0000","mapping_epoch":48,"log_start":"52'39534","ondisk_log_start":"52'39534","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'35564","last_scrub_stamp":"2026-02-23T13:07:17.999970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:17.999970+0000","objects_scrubbed":35002,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:36.421460+0000","scrub_duration":3089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2591096832,"num_objects":39537,"num_object_clones":0,"num_object_copies":118611,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39537,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39537,"num_write_kb":2530368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"52'39972","reported_seq":40333,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:26.703219+0000","last_change":"2026-02-23T13:07:13.026486+0000","last_active":"2026-02-23T13:07:26.703219+0000","last_peered":"2026-02-23T13:07:26.703219+0000","last_clean":"2026-02-23T13:07:26.703219+0000","last_became_active":"2026-02-23T13:06:03.766997+0000","last_became_peered":"2026-02-23T13:06:03.766997+0000","last_unstale":"2026-02-23T13:07:26.703219+0000","last_undegraded":"2026-02-23T13:07:26.703219+0000","last_fullsized":"2026-02-23T13:07:26.703219+0000","mapping_epoch":48,"log_start":"52'39969","ondisk_log_start":"52'39969","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'33950","last_scrub_stamp":"2026-02-23T13:07:13.026390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:13.026390+0000","objects_scrubbed":33091,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:30.336827+0000","scrub_duration":3912,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2619604992,"num_objects":39972,"num_object_clones":0,"num_object_copies":119916,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39972,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39972,"num_write_kb":2558208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"52'40010","reported_seq":40030,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:07:26.704545+0000","last_change":"2026-02-23T13:06:03.767298+0000","last_active":"2026-02-23T13:07:26.704545+0000","last_peered":"2026-02-23T13:07:26.704545+0000","last_clean":"2026-02-23T13:07:26.704545+0000","last_became_active":"2026-02-23T13:06:03.767015+0000","last_became_peered":"2026-02-23T13:06:03.767015+0000","last_unstale":"2026-02-23T13:07:26.704545+0000","last_undegraded":"2026-02-23T13:07:26.704545+0000","last_fullsized":"2026-02-23T13:07:26.704545+0000","mapping_epoch":48,"log_start":"52'40007","ondisk_log_start":"52'40007","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:29.610437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2622095360,"num_objects":40010,"num_object_clones":0,"num_object_copies":120030,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40010,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40010,"num_write_kb":2560640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":258,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-23T13:06:51.141839+0000","last_change":"2026-02-23T13:06:51.141808+0000","last_active":"2026-02-23T13:06:51.141839+0000","last_peered":"2026-02-23T13:06:51.141839+0000","last_clean":"2026-02-23T13:06:51.141839+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:06:51.141839+0000","last_undegraded":"2026-02-23T13:06:51.141839+0000","last_fullsized":"2026-02-23T13:06:51.141839+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:06:51.141759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:06:51.141759+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:55.931020+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":41800237056,"num_objects":637821,"num_object_clones":0,"num_object_copies":1913463,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":637821,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":637821,"num_write_kb":40820544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":125379280896,"data_stored":125379280896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":50,"ondisk_log_size":50,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":476,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247864,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27069220,"kb_used_data":25384592,"kb_used_omap":7,"kb_used_meta":1684600,"kb_avail":706933980,"statfs":{"total":751619276800,"available":723900395520,"internally_reserved":0,"allocated":25993822208,"data_stored":25993475091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8174,"internal_metadata":1725030418},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444091,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":35967524,"kb_used_data":35331216,"kb_used_omap":7,"kb_used_meta":636280,"kb_avail":698035676,"statfs":{"total":751619276800,"available":714788532224,"internally_reserved":0,"allocated":36179165184,"data_stored":36178818067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7976,"internal_metadata":651550936},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":29764256,"kb_used_data":27925388,"kb_used_omap":9,"kb_used_meta":1838838,"kb_avail":704238944,"statfs":{"total":751619276800,"available":721140678656,"internally_reserved":0,"allocated":28595597312,"data_stored":28595253747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9304,"internal_metadata":1882971048},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705726,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":34319716,"kb_used_data":32917520,"kb_used_omap":5,"kb_used_meta":1402170,"kb_avail":699683484,"statfs":{"total":751619276800,"available":716475887616,"internally_reserved":0,"allocated":33707540480,"data_stored":33707193363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6126,"internal_metadata":1435822098},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":476,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33945157632,"data_stored":33945157632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28753133568,"data_stored":28753133568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36570136576,"data_stored":36570136576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26110853120,"data_stored":26110853120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:07:30.970 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 111 2026-02-23T13:07:31.109 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:31.246 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:31.244+0000 7fa414d38640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:31.246 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:31.244+0000 7fa414d38640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:31.386 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-23T13:07:31.782 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:07:31.860 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 87 15 664971 664956 477.653 345.312 0.00192378 0.00209225 2026-02-23T13:07:31.915 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:31 trial046 ceph-mon[38575]: 3.e scrub ok 2026-02-23T13:07:31.915 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:31 trial046 ceph-mon[38575]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:07:31.915 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:31 trial046 ceph-mon[38575]: 3.d scrub ok 2026-02-23T13:07:31.915 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:31 trial046 ceph-mon[38575]: pgmap v164: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 39 GiB data, 121 GiB used, 2.6 TiB / 2.7 TiB avail; 452 MiB/s wr, 7.24k op/s 2026-02-23T13:07:31.915 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:31 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:07:31.915 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:31 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2882435734' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "111"} : dispatch 2026-02-23T13:07:31.923 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:31.938 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:07:32.051 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:32.049+0000 7f90ef86e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:32.051 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:32.049+0000 7f90ef86e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:32.068 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:07:32.068 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:07:32.084 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:07:32.084 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:07:32.098 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:07:32.098 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:07:32.111 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:07:32.111 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:07:32.861 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 88 16 672531 672515 477.593 472.438 0.00209743 0.00209252 2026-02-23T13:07:33.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:32 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/856267570' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:07:33.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:32 trial046 ceph-mon[38575]: 3.8 scrub ok 2026-02-23T13:07:33.861 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 89 15 680019 680004 477.486 468.062 0.00168032 0.00209297 2026-02-23T13:07:34.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:33 trial046 ceph-mon[38575]: pgmap v165: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 41 GiB data, 126 GiB used, 2.6 TiB / 2.7 TiB avail; 419 MiB/s wr, 6.70k op/s 2026-02-23T13:07:34.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:33 trial046 ceph-mon[38575]: 3.2 scrub starts 2026-02-23T13:07:34.155 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:07:34.302 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:34.436 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:34.434+0000 7fd5abcd4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:34.437 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:34.434+0000 7fd5abcd4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:34.452 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:07:34.452 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:07:34.469 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:07:34.469 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:07:34.482 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:07:34.483 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:07:34.496 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:07:34.496 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:07:34.861 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Total time run: 90.0063 2026-02-23T13:07:34.861 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Total writes made: 687112 2026-02-23T13:07:34.861 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Write size: 65536 2026-02-23T13:07:34.862 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Object size: 65536 2026-02-23T13:07:34.862 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Bandwidth (MB/sec): 477.128 2026-02-23T13:07:34.862 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Stddev Bandwidth: 67.4564 2026-02-23T13:07:34.862 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Max bandwidth (MB/sec): 563.062 2026-02-23T13:07:34.862 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Min bandwidth (MB/sec): 258 2026-02-23T13:07:34.862 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Average IOPS: 7634 2026-02-23T13:07:34.862 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Stddev IOPS: 1079.3 2026-02-23T13:07:34.862 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Max IOPS: 9009 2026-02-23T13:07:34.862 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Min IOPS: 4128 2026-02-23T13:07:34.862 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Average Latency(s): 0.00209447 2026-02-23T13:07:34.862 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Stddev Latency(s): 0.00197101 2026-02-23T13:07:34.862 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Max latency(s): 0.0599161 2026-02-23T13:07:34.863 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Min latency(s): 0.00064303 2026-02-23T13:07:34.863 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Cleaning up (deleting benchmark objects) 2026-02-23T13:07:35.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:34 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/330199664' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:07:36.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:35 trial046 ceph-mon[38575]: 3.c scrub starts 2026-02-23T13:07:36.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:35 trial046 ceph-mon[38575]: pgmap v166: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 41 GiB data, 126 GiB used, 2.6 TiB / 2.7 TiB avail; 419 MiB/s wr, 6.70k op/s 2026-02-23T13:07:36.539 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:07:36 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:07:36] "GET /metrics HTTP/1.1" 200 4231 "" "Prometheus/3.6.0" 2026-02-23T13:07:36.543 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:07:36.561 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:07:36 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:07:36.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:07:36.684 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:36.806 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:36.804+0000 7f2fcca0f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:36.807 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:36.804+0000 7f2fcca0f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:36.822 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:07:36.822 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:07:36.835 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:07:36.835 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:07:36.847 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:07:36.848 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:07:36.861 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:07:36.861 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:07:36.939 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:07:36.939 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:07:36.939 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-23T13:07:36.940 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:07:37.075 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:37.484 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:37.461+0000 7fe18a718640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:37.484 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:37.462+0000 7fe18a718640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:37.607 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:07:37.608 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:07:37.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:37 trial046 ceph-mon[38575]: pgmap v167: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 41 GiB data, 128 GiB used, 2.6 TiB / 2.7 TiB avail; 314 MiB/s wr, 5.52k op/s 2026-02-23T13:07:37.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:37 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3155661410' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:07:38.125 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":167,"stamp":"2026-02-23T13:07:36.626827+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":43756159520,"num_objects":667659,"num_object_clones":0,"num_object_copies":2002977,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":667659,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":677728,"num_write_kb":43050150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53,"ondisk_log_size":53,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":134367108,"kb_used_data":128945140,"kb_used_omap":34,"kb_used_meta":5421789,"kb_avail":2801645692,"statfs":{"total":3006477107200,"available":2868885188608,"internally_reserved":0,"allocated":132039823360,"data_stored":132038398952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34838,"internal_metadata":5551912938},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,1,6,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2965569536,"num_objects":45251,"num_object_clones":0,"num_object_copies":135753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45251,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55187,"num_write_kb":3214016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001412"},"pg_stats":[{"pgid":"3.f","version":"53'44067","reported_seq":44409,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-23T13:07:36.617296+0000","last_change":"2026-02-23T13:07:08.188933+0000","last_active":"2026-02-23T13:07:36.617296+0000","last_peered":"2026-02-23T13:07:36.617296+0000","last_clean":"2026-02-23T13:07:36.617296+0000","last_became_active":"2026-02-23T13:06:03.767261+0000","last_became_peered":"2026-02-23T13:06:03.767261+0000","last_unstale":"2026-02-23T13:07:36.617296+0000","last_undegraded":"2026-02-23T13:07:36.617296+0000","last_fullsized":"2026-02-23T13:07:36.617296+0000","mapping_epoch":48,"log_start":"53'44064","ondisk_log_start":"53'44064","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'31889","last_scrub_stamp":"2026-02-23T13:07:08.188897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:08.188897+0000","objects_scrubbed":31058,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:29.284171+0000","scrub_duration":3362,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2780889088,"num_objects":42433,"num_object_clones":0,"num_object_copies":127299,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42433,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44067,"num_write_kb":2768000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"53'43817","reported_seq":44250,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-23T13:07:36.618145+0000","last_change":"2026-02-23T13:07:30.198745+0000","last_active":"2026-02-23T13:07:36.618145+0000","last_peered":"2026-02-23T13:07:36.618145+0000","last_clean":"2026-02-23T13:07:36.618145+0000","last_became_active":"2026-02-23T13:06:03.767822+0000","last_became_peered":"2026-02-23T13:06:03.767822+0000","last_unstale":"2026-02-23T13:07:36.618145+0000","last_undegraded":"2026-02-23T13:07:36.618145+0000","last_fullsized":"2026-02-23T13:07:36.618145+0000","mapping_epoch":48,"log_start":"53'43814","ondisk_log_start":"53'43814","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41040","last_scrub_stamp":"2026-02-23T13:07:30.198713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:30.198713+0000","objects_scrubbed":40305,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:38.570153+0000","scrub_duration":4501,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2763456512,"num_objects":42167,"num_object_clones":0,"num_object_copies":126501,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42167,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43817,"num_write_kb":2751488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"53'41562","reported_seq":42000,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-23T13:07:31.618737+0000","last_change":"2026-02-23T13:07:30.466390+0000","last_active":"2026-02-23T13:07:31.618737+0000","last_peered":"2026-02-23T13:07:31.618737+0000","last_clean":"2026-02-23T13:07:31.618737+0000","last_became_active":"2026-02-23T13:06:03.768946+0000","last_became_peered":"2026-02-23T13:06:03.768946+0000","last_unstale":"2026-02-23T13:07:31.618737+0000","last_undegraded":"2026-02-23T13:07:31.618737+0000","last_fullsized":"2026-02-23T13:07:31.618737+0000","mapping_epoch":48,"log_start":"53'41559","ondisk_log_start":"53'41559","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41169","last_scrub_stamp":"2026-02-23T13:07:30.466346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:30.466346+0000","objects_scrubbed":40719,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:35.646690+0000","scrub_duration":3195,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2723807232,"num_objects":41562,"num_object_clones":0,"num_object_copies":124686,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41562,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41562,"num_write_kb":2659968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"53'41371","reported_seq":41390,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-23T13:07:31.624868+0000","last_change":"2026-02-23T13:06:03.767398+0000","last_active":"2026-02-23T13:07:31.624868+0000","last_peered":"2026-02-23T13:07:31.624868+0000","last_clean":"2026-02-23T13:07:31.624868+0000","last_became_active":"2026-02-23T13:06:03.767083+0000","last_became_peered":"2026-02-23T13:06:03.767083+0000","last_unstale":"2026-02-23T13:07:31.624868+0000","last_undegraded":"2026-02-23T13:07:31.624868+0000","last_fullsized":"2026-02-23T13:07:31.624868+0000","mapping_epoch":48,"log_start":"53'41366","ondisk_log_start":"53'41366","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:32.716724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2711289856,"num_objects":41371,"num_object_clones":0,"num_object_copies":124113,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41371,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41371,"num_write_kb":2647744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"53'41428","reported_seq":41820,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-23T13:07:31.683977+0000","last_change":"2026-02-23T13:07:20.897120+0000","last_active":"2026-02-23T13:07:31.683977+0000","last_peered":"2026-02-23T13:07:31.683977+0000","last_clean":"2026-02-23T13:07:31.683977+0000","last_became_active":"2026-02-23T13:06:03.766614+0000","last_became_peered":"2026-02-23T13:06:03.766614+0000","last_unstale":"2026-02-23T13:07:31.683977+0000","last_undegraded":"2026-02-23T13:07:31.683977+0000","last_fullsized":"2026-02-23T13:07:31.683977+0000","mapping_epoch":48,"log_start":"53'41425","ondisk_log_start":"53'41425","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'36893","last_scrub_stamp":"2026-02-23T13:07:20.897051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:20.897051+0000","objects_scrubbed":36116,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:37.187224+0000","scrub_duration":3824,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2715025408,"num_objects":41428,"num_object_clones":0,"num_object_copies":124284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41428,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41428,"num_write_kb":2651392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"53'41349","reported_seq":41747,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-23T13:07:31.621907+0000","last_change":"2026-02-23T13:07:21.878287+0000","last_active":"2026-02-23T13:07:31.621907+0000","last_peered":"2026-02-23T13:07:31.621907+0000","last_clean":"2026-02-23T13:07:31.621907+0000","last_became_active":"2026-02-23T13:06:03.768238+0000","last_became_peered":"2026-02-23T13:06:03.768238+0000","last_unstale":"2026-02-23T13:07:31.621907+0000","last_undegraded":"2026-02-23T13:07:31.621907+0000","last_fullsized":"2026-02-23T13:07:31.621907+0000","mapping_epoch":48,"log_start":"53'41346","ondisk_log_start":"53'41346","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'37319","last_scrub_stamp":"2026-02-23T13:07:21.878230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:21.878230+0000","objects_scrubbed":36520,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:48.355026+0000","scrub_duration":3562,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2709848064,"num_objects":41349,"num_object_clones":0,"num_object_copies":124047,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41349,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41349,"num_write_kb":2646336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"53'41508","reported_seq":41858,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-23T13:07:31.622369+0000","last_change":"2026-02-23T13:07:09.835508+0000","last_active":"2026-02-23T13:07:31.622369+0000","last_peered":"2026-02-23T13:07:31.622369+0000","last_clean":"2026-02-23T13:07:31.622369+0000","last_became_active":"2026-02-23T13:06:03.767947+0000","last_became_peered":"2026-02-23T13:06:03.767947+0000","last_unstale":"2026-02-23T13:07:31.622369+0000","last_undegraded":"2026-02-23T13:07:31.622369+0000","last_fullsized":"2026-02-23T13:07:31.622369+0000","mapping_epoch":48,"log_start":"53'41505","ondisk_log_start":"53'41505","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'32488","last_scrub_stamp":"2026-02-23T13:07:09.835476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:09.835476+0000","objects_scrubbed":31955,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:24.178560+0000","scrub_duration":2500,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2720268288,"num_objects":41508,"num_object_clones":0,"num_object_copies":124524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41508,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41508,"num_write_kb":2656512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"53'41403","reported_seq":41810,"reported_epoch":53,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:07:31.686447+0000","last_change":"2026-02-23T13:07:27.232325+0000","last_active":"2026-02-23T13:07:31.686447+0000","last_peered":"2026-02-23T13:07:31.686447+0000","last_clean":"2026-02-23T13:07:31.686447+0000","last_became_active":"2026-02-23T13:06:03.766859+0000","last_became_peered":"2026-02-23T13:06:03.766859+0000","last_unstale":"2026-02-23T13:07:31.686447+0000","last_undegraded":"2026-02-23T13:07:31.686447+0000","last_fullsized":"2026-02-23T13:07:31.686447+0000","mapping_epoch":48,"log_start":"53'41400","ondisk_log_start":"53'41400","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":37949,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 5s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2713387008,"num_objects":41403,"num_object_clones":0,"num_object_copies":124209,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41403,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41403,"num_write_kb":2649792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"53'41502","reported_seq":41882,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-23T13:07:31.721338+0000","last_change":"2026-02-23T13:07:18.015015+0000","last_active":"2026-02-23T13:07:31.721338+0000","last_peered":"2026-02-23T13:07:31.721338+0000","last_clean":"2026-02-23T13:07:31.721338+0000","last_became_active":"2026-02-23T13:06:03.765502+0000","last_became_peered":"2026-02-23T13:06:03.765502+0000","last_unstale":"2026-02-23T13:07:31.721338+0000","last_undegraded":"2026-02-23T13:07:31.721338+0000","last_fullsized":"2026-02-23T13:07:31.721338+0000","mapping_epoch":48,"log_start":"53'41499","ondisk_log_start":"53'41499","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'35769","last_scrub_stamp":"2026-02-23T13:07:18.014937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:18.014937+0000","objects_scrubbed":35059,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:23.289493+0000","scrub_duration":3913,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2719875072,"num_objects":41502,"num_object_clones":0,"num_object_copies":124506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41502,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41502,"num_write_kb":2656128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"53'43892","reported_seq":44326,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-23T13:07:36.614994+0000","last_change":"2026-02-23T13:07:29.741974+0000","last_active":"2026-02-23T13:07:36.614994+0000","last_peered":"2026-02-23T13:07:36.614994+0000","last_clean":"2026-02-23T13:07:36.614994+0000","last_became_active":"2026-02-23T13:06:03.767012+0000","last_became_peered":"2026-02-23T13:06:03.767012+0000","last_unstale":"2026-02-23T13:07:36.614994+0000","last_undegraded":"2026-02-23T13:07:36.614994+0000","last_fullsized":"2026-02-23T13:07:36.614994+0000","mapping_epoch":48,"log_start":"53'43889","ondisk_log_start":"53'43889","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41030","last_scrub_stamp":"2026-02-23T13:07:29.741913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:29.741913+0000","objects_scrubbed":40165,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:39.928525+0000","scrub_duration":4772,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2766667776,"num_objects":42216,"num_object_clones":0,"num_object_copies":126648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42216,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43892,"num_write_kb":2755456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"53'43656","reported_seq":44047,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-23T13:07:36.619286+0000","last_change":"2026-02-23T13:07:20.033733+0000","last_active":"2026-02-23T13:07:36.619286+0000","last_peered":"2026-02-23T13:07:36.619286+0000","last_clean":"2026-02-23T13:07:36.619286+0000","last_became_active":"2026-02-23T13:06:03.767200+0000","last_became_peered":"2026-02-23T13:06:03.767200+0000","last_unstale":"2026-02-23T13:07:36.619286+0000","last_undegraded":"2026-02-23T13:07:36.619286+0000","last_fullsized":"2026-02-23T13:07:36.619286+0000","mapping_epoch":48,"log_start":"53'43653","ondisk_log_start":"53'43653","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'36561","last_scrub_stamp":"2026-02-23T13:07:20.033700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:20.033700+0000","objects_scrubbed":35947,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:44.960748+0000","scrub_duration":3247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2753036288,"num_objects":42008,"num_object_clones":0,"num_object_copies":126024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42008,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43656,"num_write_kb":2741248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"53'41853","reported_seq":42234,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-23T13:07:31.685514+0000","last_change":"2026-02-23T13:07:17.060455+0000","last_active":"2026-02-23T13:07:31.685514+0000","last_peered":"2026-02-23T13:07:31.685514+0000","last_clean":"2026-02-23T13:07:31.685514+0000","last_became_active":"2026-02-23T13:06:03.766415+0000","last_became_peered":"2026-02-23T13:06:03.766415+0000","last_unstale":"2026-02-23T13:07:31.685514+0000","last_undegraded":"2026-02-23T13:07:31.685514+0000","last_fullsized":"2026-02-23T13:07:31.685514+0000","mapping_epoch":48,"log_start":"53'41850","ondisk_log_start":"53'41850","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'35773","last_scrub_stamp":"2026-02-23T13:07:17.060384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:17.060384+0000","objects_scrubbed":34982,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:39.770993+0000","scrub_duration":3962,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2742878208,"num_objects":41853,"num_object_clones":0,"num_object_copies":125559,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41853,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41853,"num_write_kb":2678592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"53'43500","reported_seq":43522,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-23T13:07:36.616302+0000","last_change":"2026-02-23T13:06:03.768871+0000","last_active":"2026-02-23T13:07:36.616302+0000","last_peered":"2026-02-23T13:07:36.616302+0000","last_clean":"2026-02-23T13:07:36.616302+0000","last_became_active":"2026-02-23T13:06:03.768541+0000","last_became_peered":"2026-02-23T13:06:03.768541+0000","last_unstale":"2026-02-23T13:07:36.616302+0000","last_undegraded":"2026-02-23T13:07:36.616302+0000","last_fullsized":"2026-02-23T13:07:36.616302+0000","mapping_epoch":48,"log_start":"53'43497","ondisk_log_start":"53'43497","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2748055552,"num_objects":41932,"num_object_clones":0,"num_object_copies":125796,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41932,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43500,"num_write_kb":2733824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"53'43481","reported_seq":43863,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-23T13:07:36.615134+0000","last_change":"2026-02-23T13:07:18.000008+0000","last_active":"2026-02-23T13:07:36.615134+0000","last_peered":"2026-02-23T13:07:36.615134+0000","last_clean":"2026-02-23T13:07:36.615134+0000","last_became_active":"2026-02-23T13:06:03.767001+0000","last_became_peered":"2026-02-23T13:06:03.767001+0000","last_unstale":"2026-02-23T13:07:36.615134+0000","last_undegraded":"2026-02-23T13:07:36.615134+0000","last_fullsized":"2026-02-23T13:07:36.615134+0000","mapping_epoch":48,"log_start":"53'43478","ondisk_log_start":"53'43478","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'35564","last_scrub_stamp":"2026-02-23T13:07:17.999970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:17.999970+0000","objects_scrubbed":35002,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:36.421460+0000","scrub_duration":3089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2734227456,"num_objects":41721,"num_object_clones":0,"num_object_copies":125163,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41721,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43481,"num_write_kb":2726464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"53'41592","reported_seq":41955,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-23T13:07:31.679787+0000","last_change":"2026-02-23T13:07:13.026486+0000","last_active":"2026-02-23T13:07:31.679787+0000","last_peered":"2026-02-23T13:07:31.679787+0000","last_clean":"2026-02-23T13:07:31.679787+0000","last_became_active":"2026-02-23T13:06:03.766997+0000","last_became_peered":"2026-02-23T13:06:03.766997+0000","last_unstale":"2026-02-23T13:07:31.679787+0000","last_undegraded":"2026-02-23T13:07:31.679787+0000","last_fullsized":"2026-02-23T13:07:31.679787+0000","mapping_epoch":48,"log_start":"53'41589","ondisk_log_start":"53'41589","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'33950","last_scrub_stamp":"2026-02-23T13:07:13.026390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:13.026390+0000","objects_scrubbed":33091,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:30.336827+0000","scrub_duration":3912,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2725773312,"num_objects":41592,"num_object_clones":0,"num_object_copies":124776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41592,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41592,"num_write_kb":2661888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"53'41612","reported_seq":41633,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-23T13:07:31.685023+0000","last_change":"2026-02-23T13:06:03.767298+0000","last_active":"2026-02-23T13:07:31.685023+0000","last_peered":"2026-02-23T13:07:31.685023+0000","last_clean":"2026-02-23T13:07:31.685023+0000","last_became_active":"2026-02-23T13:06:03.767015+0000","last_became_peered":"2026-02-23T13:06:03.767015+0000","last_unstale":"2026-02-23T13:07:31.685023+0000","last_undegraded":"2026-02-23T13:07:31.685023+0000","last_fullsized":"2026-02-23T13:07:31.685023+0000","mapping_epoch":48,"log_start":"53'41609","ondisk_log_start":"53'41609","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:06:02.754918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2727084032,"num_objects":41612,"num_object_clones":0,"num_object_copies":124836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41612,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41612,"num_write_kb":2663168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":260,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-23T13:07:28.685535+0000","last_change":"2026-02-23T13:06:51.141808+0000","last_active":"2026-02-23T13:07:28.685535+0000","last_peered":"2026-02-23T13:07:28.685535+0000","last_clean":"2026-02-23T13:07:28.685535+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:07:28.685535+0000","last_undegraded":"2026-02-23T13:07:28.685535+0000","last_fullsized":"2026-02-23T13:07:28.685535+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:06:51.141759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:06:51.141759+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:55.931020+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":43755569152,"num_objects":667657,"num_object_clones":0,"num_object_copies":2002971,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":667657,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":677593,"num_write_kb":43048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131640270848,"data_stored":131640262704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":50,"ondisk_log_size":50,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":682,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247865,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28218032,"kb_used_data":26497308,"kb_used_omap":8,"kb_used_meta":1720695,"kb_avail":705785168,"statfs":{"total":751619276800,"available":722724012032,"internally_reserved":0,"allocated":27133243392,"data_stored":27132888438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8824,"internal_metadata":1761992072},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444093,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":38945076,"kb_used_data":38092128,"kb_used_omap":8,"kb_used_meta":852855,"kb_avail":695058124,"statfs":{"total":751619276800,"available":711739518976,"internally_reserved":0,"allocated":39006339072,"data_stored":39005980046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8628,"internal_metadata":873324108},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574910,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":31007916,"kb_used_data":29115032,"kb_used_omap":9,"kb_used_meta":1892854,"kb_avail":702995284,"statfs":{"total":751619276800,"available":719867170816,"internally_reserved":0,"allocated":29813792768,"data_stored":29813441366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9956,"internal_metadata":1938282780},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,1,6,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705728,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":36196084,"kb_used_data":35240672,"kb_used_omap":7,"kb_used_meta":955384,"kb_avail":697807116,"statfs":{"total":751619276800,"available":714554486784,"internally_reserved":0,"allocated":36086448128,"data_stored":36086089102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7430,"internal_metadata":978313978},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":682,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":35870674944,"data_stored":35870670872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29929308160,"data_stored":29929308160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":38648942592,"data_stored":38648938520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":27191345152,"data_stored":27191345152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:07:38.127 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 111 2026-02-23T13:07:38.271 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:38.672 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:38.655+0000 7fc3c0c4e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:38.673 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:38.655+0000 7fc3c0c4e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:38.804 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-23T13:07:38.905 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:07:38.932 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:38 trial046 ceph-mon[38575]: from='client.14767 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:07:38.932 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:38 trial046 ceph-mon[38575]: osdmap e54: 4 total, 4 up, 4 in 2026-02-23T13:07:38.933 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:38 trial046 ceph-mon[38575]: 3.2 scrub ok 2026-02-23T13:07:39.049 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:39.304 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:07:39.614 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:07:39.615 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:07:39.615 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:07:39.615 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:39.564+0000 7f8db8515640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:39.615 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:39.565+0000 7f8db8515640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:39.615 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:07:39.615 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:07:39.615 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:07:39.627 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:07:39.627 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:07:40.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:39 trial046 ceph-mon[38575]: 3.c scrub ok 2026-02-23T13:07:40.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:39 trial046 ceph-mon[38575]: pgmap v169: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 41 GiB data, 129 GiB used, 2.6 TiB / 2.7 TiB avail; 103 B/s rd, 310 MiB/s wr, 6.33k op/s 2026-02-23T13:07:40.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:39 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3675420947' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "111"} : dispatch 2026-02-23T13:07:40.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:39 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1359715493' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:07:42.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:41 trial046 ceph-mon[38575]: 3.3 scrub starts 2026-02-23T13:07:42.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:41 trial046 ceph-mon[38575]: pgmap v170: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 41 GiB data, 129 GiB used, 2.6 TiB / 2.7 TiB avail; 102 B/s rd, 308 MiB/s wr, 6.29k op/s 2026-02-23T13:07:42.098 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:07:42.250 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:42.744 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:07:42.744 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:07:42.745 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:07:42.745 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:07:42.745 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:42.666+0000 7f01c46cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:42.745 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:42.666+0000 7f01c46cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:42.745 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:07:42.745 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:07:42.745 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:07:42.746 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:07:43.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:42 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/847713873' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:07:44.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:43 trial046 ceph-mon[38575]: pgmap v171: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 39 GiB data, 123 GiB used, 2.6 TiB / 2.7 TiB avail; 102 B/s rd, 144 MiB/s wr, 7.20k op/s 2026-02-23T13:07:44.306 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:07:44.306 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:07:44.306 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2026-02-23T13:07:44.306 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph tell osd.0 'trim stale osdmaps' 2026-02-23T13:07:44.451 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:44.942 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:44.887+0000 7fbbbdd4e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:44.943 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:44.888+0000 7fbbbdd4e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:44.943 INFO:teuthology.orchestra.run.trial046.stderr:no valid command found; 10 closest matches: 2026-02-23T13:07:44.943 INFO:teuthology.orchestra.run.trial046.stderr:0 2026-02-23T13:07:44.943 INFO:teuthology.orchestra.run.trial046.stderr:1 2026-02-23T13:07:44.943 INFO:teuthology.orchestra.run.trial046.stderr:2 2026-02-23T13:07:44.943 INFO:teuthology.orchestra.run.trial046.stderr:abort 2026-02-23T13:07:44.943 INFO:teuthology.orchestra.run.trial046.stderr:assert 2026-02-23T13:07:44.943 INFO:teuthology.orchestra.run.trial046.stderr:bench [] [] [] [] 2026-02-23T13:07:44.943 INFO:teuthology.orchestra.run.trial046.stderr:bluefs debug_inject_read_zeros 2026-02-23T13:07:44.943 INFO:teuthology.orchestra.run.trial046.stderr:bluefs files list 2026-02-23T13:07:44.944 INFO:teuthology.orchestra.run.trial046.stderr:bluefs stats 2026-02-23T13:07:44.944 INFO:teuthology.orchestra.run.trial046.stderr:bluestore allocator dump block 2026-02-23T13:07:44.944 INFO:teuthology.orchestra.run.trial046.stderr:Error EINVAL: invalid command 2026-02-23T13:07:45.004 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-23T13:07:45.005 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-23T13:07:45.006 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph tell osd.1 'trim stale osdmaps' 2026-02-23T13:07:45.152 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:45.278 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:45.276+0000 7f9f92664640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:45.279 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:45.276+0000 7f9f92664640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:45.303 INFO:teuthology.orchestra.run.trial046.stderr:no valid command found; 10 closest matches: 2026-02-23T13:07:45.303 INFO:teuthology.orchestra.run.trial046.stderr:0 2026-02-23T13:07:45.303 INFO:teuthology.orchestra.run.trial046.stderr:1 2026-02-23T13:07:45.303 INFO:teuthology.orchestra.run.trial046.stderr:2 2026-02-23T13:07:45.304 INFO:teuthology.orchestra.run.trial046.stderr:abort 2026-02-23T13:07:45.304 INFO:teuthology.orchestra.run.trial046.stderr:assert 2026-02-23T13:07:45.304 INFO:teuthology.orchestra.run.trial046.stderr:bench [] [] [] [] 2026-02-23T13:07:45.304 INFO:teuthology.orchestra.run.trial046.stderr:bluefs debug_inject_read_zeros 2026-02-23T13:07:45.304 INFO:teuthology.orchestra.run.trial046.stderr:bluefs files list 2026-02-23T13:07:45.304 INFO:teuthology.orchestra.run.trial046.stderr:bluefs stats 2026-02-23T13:07:45.304 INFO:teuthology.orchestra.run.trial046.stderr:bluestore allocator dump block 2026-02-23T13:07:45.304 INFO:teuthology.orchestra.run.trial046.stderr:Error EINVAL: invalid command 2026-02-23T13:07:45.347 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-23T13:07:45.348 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-23T13:07:45.349 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph tell osd.2 'trim stale osdmaps' 2026-02-23T13:07:45.461 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:07:45.495 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:45.613 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:45.624 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:45.622+0000 7f6765538640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:45.624 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:45.622+0000 7f6765538640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:45.651 INFO:teuthology.orchestra.run.trial046.stderr:no valid command found; 10 closest matches: 2026-02-23T13:07:45.651 INFO:teuthology.orchestra.run.trial046.stderr:0 2026-02-23T13:07:45.651 INFO:teuthology.orchestra.run.trial046.stderr:1 2026-02-23T13:07:45.651 INFO:teuthology.orchestra.run.trial046.stderr:2 2026-02-23T13:07:45.651 INFO:teuthology.orchestra.run.trial046.stderr:abort 2026-02-23T13:07:45.652 INFO:teuthology.orchestra.run.trial046.stderr:assert 2026-02-23T13:07:45.652 INFO:teuthology.orchestra.run.trial046.stderr:bench [] [] [] [] 2026-02-23T13:07:45.652 INFO:teuthology.orchestra.run.trial046.stderr:bluefs debug_inject_read_zeros 2026-02-23T13:07:45.652 INFO:teuthology.orchestra.run.trial046.stderr:bluefs files list 2026-02-23T13:07:45.652 INFO:teuthology.orchestra.run.trial046.stderr:bluefs stats 2026-02-23T13:07:45.652 INFO:teuthology.orchestra.run.trial046.stderr:bluestore allocator dump block 2026-02-23T13:07:45.652 INFO:teuthology.orchestra.run.trial046.stderr:Error EINVAL: invalid command 2026-02-23T13:07:45.692 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-23T13:07:45.693 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-23T13:07:45.694 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph tell osd.3 'trim stale osdmaps' 2026-02-23T13:07:45.738 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:45 trial046 ceph-mon[38575]: 3.3 scrub ok 2026-02-23T13:07:45.738 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:45 trial046 ceph-mon[38575]: pgmap v172: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 39 GiB data, 123 GiB used, 2.6 TiB / 2.7 TiB avail; 102 B/s rd, 144 MiB/s wr, 7.20k op/s 2026-02-23T13:07:45.739 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:45.734+0000 7f18bd8f1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:45.739 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:45.735+0000 7f18bd8f1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:45.753 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:07:45.753 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:07:45.767 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:07:45.768 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:07:45.780 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:07:45.780 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:07:45.795 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:07:45.795 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:07:45.881 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:46.005 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:46.003+0000 7f2a61de7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:46.005 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:46.003+0000 7f2a61de7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:46.025 INFO:teuthology.orchestra.run.trial046.stderr:no valid command found; 10 closest matches: 2026-02-23T13:07:46.025 INFO:teuthology.orchestra.run.trial046.stderr:0 2026-02-23T13:07:46.025 INFO:teuthology.orchestra.run.trial046.stderr:1 2026-02-23T13:07:46.025 INFO:teuthology.orchestra.run.trial046.stderr:2 2026-02-23T13:07:46.025 INFO:teuthology.orchestra.run.trial046.stderr:abort 2026-02-23T13:07:46.026 INFO:teuthology.orchestra.run.trial046.stderr:assert 2026-02-23T13:07:46.026 INFO:teuthology.orchestra.run.trial046.stderr:bench [] [] [] [] 2026-02-23T13:07:46.026 INFO:teuthology.orchestra.run.trial046.stderr:bluefs debug_inject_read_zeros 2026-02-23T13:07:46.026 INFO:teuthology.orchestra.run.trial046.stderr:bluefs files list 2026-02-23T13:07:46.026 INFO:teuthology.orchestra.run.trial046.stderr:bluefs stats 2026-02-23T13:07:46.026 INFO:teuthology.orchestra.run.trial046.stderr:bluestore allocator dump block 2026-02-23T13:07:46.026 INFO:teuthology.orchestra.run.trial046.stderr:Error EINVAL: invalid command 2026-02-23T13:07:46.058 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-23T13:07:46.059 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-23T13:07:46.289 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:07:46 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:07:46] "GET /metrics HTTP/1.1" 200 4230 "" "Prometheus/3.6.0" 2026-02-23T13:07:46.463 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:07:46 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:07:46.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:07:47.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:46 trial046 ceph-mon[38575]: osdmap e55: 4 total, 4 up, 4 in 2026-02-23T13:07:47.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:46 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2112306002' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:07:47.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:46 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:07:47.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:47 trial046 ceph-mon[38575]: pgmap v174: 17 pgs: 17 active+clean; 38 GiB data, 119 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 5.70k op/s 2026-02-23T13:07:47.841 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:07:47.981 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:48.103 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:48.101+0000 7fb1bc893640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:48.103 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:48.101+0000 7fb1bc893640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:48.119 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:07:48.119 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:07:48.133 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:07:48.133 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:07:48.145 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:07:48.146 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:07:48.158 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:07:48.158 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:07:49.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:48 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3407893123' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:07:50.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:49 trial046 ceph-mon[38575]: pgmap v175: 17 pgs: 17 active+clean; 36 GiB data, 116 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 7.67k op/s 2026-02-23T13:07:50.207 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:07:50.352 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:50.692 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:50.637+0000 7fdc7f540640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:50.692 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:50.638+0000 7fdc7f540640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:50.692 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:07:50.692 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:07:50.692 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:07:50.693 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:07:50.693 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:07:50.693 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:07:50.706 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:07:50.706 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:07:50.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:50 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3674482183' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:07:51.060 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:07:51.060 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:07:51.060 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:07:51.061 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:07:51.232 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:51.641 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:51.611+0000 7f23c8e6e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:51.641 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:51.611+0000 7f23c8e6e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:51.769 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:51 trial046 ceph-mon[38575]: pgmap v176: 17 pgs: 17 active+clean; 36 GiB data, 116 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 7.67k op/s 2026-02-23T13:07:51.770 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:07:51.770 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:07:51.820 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2026-02-23T13:07:50.628714+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":39111098936,"num_objects":596782,"num_object_clones":0,"num_object_copies":1790346,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":596782,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":777581,"num_write_kb":43977319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":121662824,"kb_used_data":115627160,"kb_used_omap":39,"kb_used_meta":6035416,"kb_avail":2814349976,"statfs":{"total":3006477107200,"available":2881894375424,"internally_reserved":0,"allocated":118402211840,"data_stored":118400720664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40056,"internal_metadata":6180266888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5027987456,"num_objects":-76721,"num_object_clones":0,"num_object_copies":-230163,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-76721,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76721,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001344"},"pg_stats":[{"pgid":"3.f","version":"55'48862","reported_seq":49208,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-23T13:07:46.621453+0000","last_change":"2026-02-23T13:07:08.188933+0000","last_active":"2026-02-23T13:07:46.621453+0000","last_peered":"2026-02-23T13:07:46.621453+0000","last_clean":"2026-02-23T13:07:46.621453+0000","last_became_active":"2026-02-23T13:06:03.767261+0000","last_became_peered":"2026-02-23T13:06:03.767261+0000","last_unstale":"2026-02-23T13:07:46.621453+0000","last_undegraded":"2026-02-23T13:07:46.621453+0000","last_fullsized":"2026-02-23T13:07:46.621453+0000","mapping_epoch":48,"log_start":"55'48859","ondisk_log_start":"55'48859","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'31889","last_scrub_stamp":"2026-02-23T13:07:08.188897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:08.188897+0000","objects_scrubbed":31058,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:29.284171+0000","scrub_duration":3362,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2466643968,"num_objects":37638,"num_object_clones":0,"num_object_copies":112914,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37638,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48862,"num_write_kb":2768000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"55'48674","reported_seq":49111,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-23T13:07:46.621556+0000","last_change":"2026-02-23T13:07:30.198745+0000","last_active":"2026-02-23T13:07:46.621556+0000","last_peered":"2026-02-23T13:07:46.621556+0000","last_clean":"2026-02-23T13:07:46.621556+0000","last_became_active":"2026-02-23T13:06:03.767822+0000","last_became_peered":"2026-02-23T13:06:03.767822+0000","last_unstale":"2026-02-23T13:07:46.621556+0000","last_undegraded":"2026-02-23T13:07:46.621556+0000","last_fullsized":"2026-02-23T13:07:46.621556+0000","mapping_epoch":48,"log_start":"55'48671","ondisk_log_start":"55'48671","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41040","last_scrub_stamp":"2026-02-23T13:07:30.198713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:30.198713+0000","objects_scrubbed":40305,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:38.570153+0000","scrub_duration":4501,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2445148160,"num_objects":37310,"num_object_clones":0,"num_object_copies":111930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37310,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48674,"num_write_kb":2751488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"55'48748","reported_seq":49191,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-23T13:07:46.626984+0000","last_change":"2026-02-23T13:07:30.466390+0000","last_active":"2026-02-23T13:07:46.626984+0000","last_peered":"2026-02-23T13:07:46.626984+0000","last_clean":"2026-02-23T13:07:46.626984+0000","last_became_active":"2026-02-23T13:06:03.768946+0000","last_became_peered":"2026-02-23T13:06:03.768946+0000","last_unstale":"2026-02-23T13:07:46.626984+0000","last_undegraded":"2026-02-23T13:07:46.626984+0000","last_fullsized":"2026-02-23T13:07:46.626984+0000","mapping_epoch":48,"log_start":"55'48745","ondisk_log_start":"55'48745","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41169","last_scrub_stamp":"2026-02-23T13:07:30.466346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:30.466346+0000","objects_scrubbed":40719,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:35.646690+0000","scrub_duration":3195,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2452815896,"num_objects":37428,"num_object_clones":0,"num_object_copies":112284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37428,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":48748,"num_write_kb":2757569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"55'48537","reported_seq":48995,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-23T13:07:46.628617+0000","last_change":"2026-02-23T13:07:38.374570+0000","last_active":"2026-02-23T13:07:46.628617+0000","last_peered":"2026-02-23T13:07:46.628617+0000","last_clean":"2026-02-23T13:07:46.628617+0000","last_became_active":"2026-02-23T13:06:03.767083+0000","last_became_peered":"2026-02-23T13:06:03.767083+0000","last_unstale":"2026-02-23T13:07:46.628617+0000","last_undegraded":"2026-02-23T13:07:46.628617+0000","last_fullsized":"2026-02-23T13:07:46.628617+0000","mapping_epoch":48,"log_start":"55'48534","ondisk_log_start":"55'48534","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'44374","last_scrub_stamp":"2026-02-23T13:07:38.374512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:38.374512+0000","objects_scrubbed":42187,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:05.652994+0000","scrub_duration":4032,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2432368640,"num_objects":37115,"num_object_clones":0,"num_object_copies":111345,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37115,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48537,"num_write_kb":2740864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"55'48560","reported_seq":48956,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-23T13:07:46.722792+0000","last_change":"2026-02-23T13:07:20.897120+0000","last_active":"2026-02-23T13:07:46.722792+0000","last_peered":"2026-02-23T13:07:46.722792+0000","last_clean":"2026-02-23T13:07:46.722792+0000","last_became_active":"2026-02-23T13:06:03.766614+0000","last_became_peered":"2026-02-23T13:06:03.766614+0000","last_unstale":"2026-02-23T13:07:46.722792+0000","last_undegraded":"2026-02-23T13:07:46.722792+0000","last_fullsized":"2026-02-23T13:07:46.722792+0000","mapping_epoch":48,"log_start":"55'48557","ondisk_log_start":"55'48557","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'36893","last_scrub_stamp":"2026-02-23T13:07:20.897051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:20.897051+0000","objects_scrubbed":36116,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:37.187224+0000","scrub_duration":3824,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2438725632,"num_objects":37212,"num_object_clones":0,"num_object_copies":111636,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37212,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48560,"num_write_kb":2744704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"55'48311","reported_seq":48712,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-23T13:07:46.628380+0000","last_change":"2026-02-23T13:07:21.878287+0000","last_active":"2026-02-23T13:07:46.628380+0000","last_peered":"2026-02-23T13:07:46.628380+0000","last_clean":"2026-02-23T13:07:46.628380+0000","last_became_active":"2026-02-23T13:06:03.768238+0000","last_became_peered":"2026-02-23T13:06:03.768238+0000","last_unstale":"2026-02-23T13:07:46.628380+0000","last_undegraded":"2026-02-23T13:07:46.628380+0000","last_fullsized":"2026-02-23T13:07:46.628380+0000","mapping_epoch":48,"log_start":"55'48308","ondisk_log_start":"55'48308","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'37319","last_scrub_stamp":"2026-02-23T13:07:21.878230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:21.878230+0000","objects_scrubbed":36520,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:48.355026+0000","scrub_duration":3562,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2449145856,"num_objects":37371,"num_object_clones":0,"num_object_copies":112113,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37371,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48311,"num_write_kb":2741824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"55'48408","reported_seq":48760,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-23T13:07:46.629308+0000","last_change":"2026-02-23T13:07:09.835508+0000","last_active":"2026-02-23T13:07:46.629308+0000","last_peered":"2026-02-23T13:07:46.629308+0000","last_clean":"2026-02-23T13:07:46.629308+0000","last_became_active":"2026-02-23T13:06:03.767947+0000","last_became_peered":"2026-02-23T13:06:03.767947+0000","last_unstale":"2026-02-23T13:07:46.629308+0000","last_undegraded":"2026-02-23T13:07:46.629308+0000","last_fullsized":"2026-02-23T13:07:46.629308+0000","mapping_epoch":48,"log_start":"55'48405","ondisk_log_start":"55'48405","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'32488","last_scrub_stamp":"2026-02-23T13:07:09.835476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:09.835476+0000","objects_scrubbed":31955,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:24.178560+0000","scrub_duration":2500,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2453798912,"num_objects":37442,"num_object_clones":0,"num_object_copies":112326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37442,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48408,"num_write_kb":2747200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"55'48582","reported_seq":49026,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-23T13:07:46.721382+0000","last_change":"2026-02-23T13:07:32.151615+0000","last_active":"2026-02-23T13:07:46.721382+0000","last_peered":"2026-02-23T13:07:46.721382+0000","last_clean":"2026-02-23T13:07:46.721382+0000","last_became_active":"2026-02-23T13:06:03.766859+0000","last_became_peered":"2026-02-23T13:06:03.766859+0000","last_unstale":"2026-02-23T13:07:46.721382+0000","last_undegraded":"2026-02-23T13:07:46.721382+0000","last_fullsized":"2026-02-23T13:07:46.721382+0000","mapping_epoch":48,"log_start":"55'48579","ondisk_log_start":"55'48579","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41546","last_scrub_stamp":"2026-02-23T13:07:32.151562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:32.151562+0000","objects_scrubbed":40710,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:35.090003+0000","scrub_duration":4919,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2434531328,"num_objects":37148,"num_object_clones":0,"num_object_copies":111444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37148,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48582,"num_write_kb":2743360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"55'48546","reported_seq":48930,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-23T13:07:46.722430+0000","last_change":"2026-02-23T13:07:18.015015+0000","last_active":"2026-02-23T13:07:46.722430+0000","last_peered":"2026-02-23T13:07:46.722430+0000","last_clean":"2026-02-23T13:07:46.722430+0000","last_became_active":"2026-02-23T13:06:03.765502+0000","last_became_peered":"2026-02-23T13:06:03.765502+0000","last_unstale":"2026-02-23T13:07:46.722430+0000","last_undegraded":"2026-02-23T13:07:46.722430+0000","last_fullsized":"2026-02-23T13:07:46.722430+0000","mapping_epoch":48,"log_start":"55'48543","ondisk_log_start":"55'48543","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'35769","last_scrub_stamp":"2026-02-23T13:07:18.014937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:18.014937+0000","objects_scrubbed":35059,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:23.289493+0000","scrub_duration":3913,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2435579904,"num_objects":37164,"num_object_clones":0,"num_object_copies":111492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37164,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48546,"num_write_kb":2742720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"55'48710","reported_seq":49148,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-23T13:07:46.616416+0000","last_change":"2026-02-23T13:07:29.741974+0000","last_active":"2026-02-23T13:07:46.616416+0000","last_peered":"2026-02-23T13:07:46.616416+0000","last_clean":"2026-02-23T13:07:46.616416+0000","last_became_active":"2026-02-23T13:06:03.767012+0000","last_became_peered":"2026-02-23T13:06:03.767012+0000","last_unstale":"2026-02-23T13:07:46.616416+0000","last_undegraded":"2026-02-23T13:07:46.616416+0000","last_fullsized":"2026-02-23T13:07:46.616416+0000","mapping_epoch":48,"log_start":"55'48707","ondisk_log_start":"55'48707","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41030","last_scrub_stamp":"2026-02-23T13:07:29.741913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:29.741913+0000","objects_scrubbed":40165,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:39.928525+0000","scrub_duration":4772,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2450915328,"num_objects":37398,"num_object_clones":0,"num_object_copies":112194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37398,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48710,"num_write_kb":2755456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"55'48441","reported_seq":48836,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-23T13:07:46.623335+0000","last_change":"2026-02-23T13:07:20.033733+0000","last_active":"2026-02-23T13:07:46.623335+0000","last_peered":"2026-02-23T13:07:46.623335+0000","last_clean":"2026-02-23T13:07:46.623335+0000","last_became_active":"2026-02-23T13:06:03.767200+0000","last_became_peered":"2026-02-23T13:06:03.767200+0000","last_unstale":"2026-02-23T13:07:46.623335+0000","last_undegraded":"2026-02-23T13:07:46.623335+0000","last_fullsized":"2026-02-23T13:07:46.623335+0000","mapping_epoch":48,"log_start":"55'48438","ondisk_log_start":"55'48438","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'36561","last_scrub_stamp":"2026-02-23T13:07:20.033700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:20.033700+0000","objects_scrubbed":35947,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:44.960748+0000","scrub_duration":3247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2439446528,"num_objects":37223,"num_object_clones":0,"num_object_copies":111669,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37223,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48441,"num_write_kb":2741248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"55'48885","reported_seq":49270,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-23T13:07:46.717351+0000","last_change":"2026-02-23T13:07:17.060455+0000","last_active":"2026-02-23T13:07:46.717351+0000","last_peered":"2026-02-23T13:07:46.717351+0000","last_clean":"2026-02-23T13:07:46.717351+0000","last_became_active":"2026-02-23T13:06:03.766415+0000","last_became_peered":"2026-02-23T13:06:03.766415+0000","last_unstale":"2026-02-23T13:07:46.717351+0000","last_undegraded":"2026-02-23T13:07:46.717351+0000","last_fullsized":"2026-02-23T13:07:46.717351+0000","mapping_epoch":48,"log_start":"55'48882","ondisk_log_start":"55'48882","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'35773","last_scrub_stamp":"2026-02-23T13:07:17.060384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:17.060384+0000","objects_scrubbed":34982,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:39.770993+0000","scrub_duration":3962,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2465267712,"num_objects":37617,"num_object_clones":0,"num_object_copies":112851,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37617,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48885,"num_write_kb":2768064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"55'48320","reported_seq":48751,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-23T13:07:46.621771+0000","last_change":"2026-02-23T13:07:44.359896+0000","last_active":"2026-02-23T13:07:46.621771+0000","last_peered":"2026-02-23T13:07:46.621771+0000","last_clean":"2026-02-23T13:07:46.621771+0000","last_became_active":"2026-02-23T13:06:03.768541+0000","last_became_peered":"2026-02-23T13:06:03.768541+0000","last_unstale":"2026-02-23T13:07:46.621771+0000","last_undegraded":"2026-02-23T13:07:46.621771+0000","last_fullsized":"2026-02-23T13:07:46.621771+0000","mapping_epoch":48,"log_start":"55'48317","ondisk_log_start":"55'48317","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'47017","last_scrub_stamp":"2026-02-23T13:07:44.359774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:44.359774+0000","objects_scrubbed":39444,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:00.349146+0000","scrub_duration":4516,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2432172032,"num_objects":37112,"num_object_clones":0,"num_object_copies":111336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48320,"num_write_kb":2733824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"55'48155","reported_seq":48541,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-23T13:07:46.614144+0000","last_change":"2026-02-23T13:07:18.000008+0000","last_active":"2026-02-23T13:07:46.614144+0000","last_peered":"2026-02-23T13:07:46.614144+0000","last_clean":"2026-02-23T13:07:46.614144+0000","last_became_active":"2026-02-23T13:06:03.767001+0000","last_became_peered":"2026-02-23T13:06:03.767001+0000","last_unstale":"2026-02-23T13:07:46.614144+0000","last_undegraded":"2026-02-23T13:07:46.614144+0000","last_fullsized":"2026-02-23T13:07:46.614144+0000","mapping_epoch":48,"log_start":"55'48152","ondisk_log_start":"55'48152","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'35564","last_scrub_stamp":"2026-02-23T13:07:17.999970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:17.999970+0000","objects_scrubbed":35002,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:36.421460+0000","scrub_duration":3089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2427912192,"num_objects":37047,"num_object_clones":0,"num_object_copies":111141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37047,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48155,"num_write_kb":2726464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"55'48819","reported_seq":49186,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-23T13:07:46.723710+0000","last_change":"2026-02-23T13:07:13.026486+0000","last_active":"2026-02-23T13:07:46.723710+0000","last_peered":"2026-02-23T13:07:46.723710+0000","last_clean":"2026-02-23T13:07:46.723710+0000","last_became_active":"2026-02-23T13:06:03.766997+0000","last_became_peered":"2026-02-23T13:06:03.766997+0000","last_unstale":"2026-02-23T13:07:46.723710+0000","last_undegraded":"2026-02-23T13:07:46.723710+0000","last_fullsized":"2026-02-23T13:07:46.723710+0000","mapping_epoch":48,"log_start":"55'48816","ondisk_log_start":"55'48816","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'33950","last_scrub_stamp":"2026-02-23T13:07:13.026390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:13.026390+0000","objects_scrubbed":33091,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:30.336827+0000","scrub_duration":3912,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2438529024,"num_objects":37209,"num_object_clones":0,"num_object_copies":111627,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37209,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48819,"num_write_kb":2752896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"55'48888","reported_seq":49349,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-23T13:07:46.722243+0000","last_change":"2026-02-23T13:07:38.263276+0000","last_active":"2026-02-23T13:07:46.722243+0000","last_peered":"2026-02-23T13:07:46.722243+0000","last_clean":"2026-02-23T13:07:46.722243+0000","last_became_active":"2026-02-23T13:06:03.767015+0000","last_became_peered":"2026-02-23T13:06:03.767015+0000","last_unstale":"2026-02-23T13:07:46.722243+0000","last_undegraded":"2026-02-23T13:07:46.722243+0000","last_fullsized":"2026-02-23T13:07:46.722243+0000","mapping_epoch":48,"log_start":"55'48885","ondisk_log_start":"55'48885","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'44630","last_scrub_stamp":"2026-02-23T13:07:38.263188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:38.263188+0000","objects_scrubbed":42478,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:53.250163+0000","scrub_duration":5027,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2447507456,"num_objects":37346,"num_object_clones":0,"num_object_copies":112038,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37346,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48888,"num_write_kb":2759488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":264,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-23T13:07:45.544301+0000","last_change":"2026-02-23T13:06:51.141808+0000","last_active":"2026-02-23T13:07:45.544301+0000","last_peered":"2026-02-23T13:07:45.544301+0000","last_clean":"2026-02-23T13:07:45.544301+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:07:45.544301+0000","last_undegraded":"2026-02-23T13:07:45.544301+0000","last_fullsized":"2026-02-23T13:07:45.544301+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:06:51.141759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:06:51.141759+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:55.931020+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":39110508568,"num_objects":596780,"num_object_clones":0,"num_object_copies":1790340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":596780,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":777446,"num_write_kb":43975169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":117362405376,"data_stored":117362393160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":890,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247868,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":25882316,"kb_used_data":23999096,"kb_used_omap":9,"kb_used_meta":1883126,"kb_avail":708120884,"statfs":{"total":751619276800,"available":725115785216,"internally_reserved":0,"allocated":24575074304,"data_stored":24574699604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10130,"internal_metadata":1928321134},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444095,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":34865676,"kb_used_data":33904504,"kb_used_omap":9,"kb_used_meta":961142,"kb_avail":699137524,"statfs":{"total":751619276800,"available":715916824576,"internally_reserved":0,"allocated":34718212096,"data_stored":34717837396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9932,"internal_metadata":984209716},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28506500,"kb_used_data":26378992,"kb_used_omap":10,"kb_used_meta":2127477,"kb_avail":705496700,"statfs":{"total":751619276800,"available":722428620800,"internally_reserved":0,"allocated":27012087808,"data_stored":27011720732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11260,"internal_metadata":2178536452},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705730,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32408332,"kb_used_data":31344568,"kb_used_omap":8,"kb_used_meta":1063671,"kb_avail":701594868,"statfs":{"total":751619276800,"available":718433144832,"internally_reserved":0,"allocated":32096837632,"data_stored":32096462932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8734,"internal_metadata":1089199586},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":890,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31791779840,"data_stored":31791775768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26846560256,"data_stored":26846560256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":34262683648,"data_stored":34262679576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24461381632,"data_stored":24461377560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:07:51.822 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:07:51.822 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 121 2026-02-23T13:07:51.972 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:52.107 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:52.105+0000 7f10af9f3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:52.107 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:52.105+0000 7f10af9f3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:52.259 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:07:52.299 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:07:53.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:52 trial046 ceph-mon[38575]: from='client.14789 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:07:53.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:52 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/463921490' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "121"} : dispatch 2026-02-23T13:07:53.243 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:07:53.391 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:53.512 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:53.511+0000 7f799d60b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:53.513 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:53.511+0000 7f799d60b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:53.527 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:07:53.527 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:07:53.540 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:07:53.540 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:07:53.553 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:07:53.553 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:07:53.564 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:07:53.564 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:07:53.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:53 trial046 ceph-mon[38575]: pgmap v177: 17 pgs: 17 active+clean; 34 GiB data, 107 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 8.42k op/s 2026-02-23T13:07:53.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:53 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3929714887' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:07:55.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:54 trial046 ceph-mon[38575]: osdmap e56: 4 total, 4 up, 4 in 2026-02-23T13:07:55.628 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:07:55.774 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:55.907 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:55 trial046 ceph-mon[38575]: pgmap v179: 17 pgs: 17 active+clean; 34 GiB data, 107 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 9.27k op/s 2026-02-23T13:07:55.969 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:55.966+0000 7fd8a313f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:55.969 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:55.967+0000 7fd8a313f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:55.985 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:07:55.986 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:07:56.000 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:07:56.000 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:07:56.013 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:07:56.013 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:07:56.026 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:07:56.027 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:07:56.290 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:07:56 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:07:56] "GET /metrics HTTP/1.1" 200 4230 "" "Prometheus/3.6.0" 2026-02-23T13:07:56.561 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:07:56 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:07:56.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:07:57.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:56 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/594659648' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:07:57.301 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:07:57.301 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:07:57.302 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_1 2026-02-23T13:07:57.302 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:07:57.453 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:57.883 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:57 trial046 ceph-mon[38575]: 1.0 scrub starts 2026-02-23T13:07:57.883 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:57 trial046 ceph-mon[38575]: 1.0 scrub ok 2026-02-23T13:07:57.883 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:57 trial046 ceph-mon[38575]: pgmap v180: 17 pgs: 17 active+clean; 33 GiB data, 103 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 8.67k op/s 2026-02-23T13:07:57.925 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:57.880+0000 7ff505035640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:57.925 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:57.881+0000 7ff505035640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:58.019 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:07:58.019 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:07:58.067 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:07:58.203 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:58.436 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":180,"stamp":"2026-02-23T13:07:56.629464+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":35118776888,"num_objects":535864,"num_object_clones":0,"num_object_copies":1607592,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":535864,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":838499,"num_write_kb":43977319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":107499968,"kb_used_data":102145904,"kb_used_omap":40,"kb_used_meta":5353815,"kb_avail":2828512832,"statfs":{"total":3006477107200,"available":2896397139968,"internally_reserved":0,"allocated":104597405696,"data_stored":104595898846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41360,"internal_metadata":5482307184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[20,6,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5683871744,"num_objects":-86729,"num_object_clones":0,"num_object_copies":-260187,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-86729,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86729,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001299"},"pg_stats":[{"pgid":"3.f","version":"56'54635","reported_seq":54982,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:07:56.623452+0000","last_change":"2026-02-23T13:07:08.188933+0000","last_active":"2026-02-23T13:07:56.623452+0000","last_peered":"2026-02-23T13:07:56.623452+0000","last_clean":"2026-02-23T13:07:56.623452+0000","last_became_active":"2026-02-23T13:06:03.767261+0000","last_became_peered":"2026-02-23T13:06:03.767261+0000","last_unstale":"2026-02-23T13:07:56.623452+0000","last_undegraded":"2026-02-23T13:07:56.623452+0000","last_fullsized":"2026-02-23T13:07:56.623452+0000","mapping_epoch":48,"log_start":"56'54632","ondisk_log_start":"56'54632","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'31889","last_scrub_stamp":"2026-02-23T13:07:08.188897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:08.188897+0000","objects_scrubbed":31058,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:29.284171+0000","scrub_duration":3362,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2088304640,"num_objects":31865,"num_object_clones":0,"num_object_copies":95595,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31865,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54635,"num_write_kb":2768000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"56'54389","reported_seq":54829,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:07:56.622252+0000","last_change":"2026-02-23T13:07:30.198745+0000","last_active":"2026-02-23T13:07:56.622252+0000","last_peered":"2026-02-23T13:07:56.622252+0000","last_clean":"2026-02-23T13:07:56.622252+0000","last_became_active":"2026-02-23T13:06:03.767822+0000","last_became_peered":"2026-02-23T13:06:03.767822+0000","last_unstale":"2026-02-23T13:07:56.622252+0000","last_undegraded":"2026-02-23T13:07:56.622252+0000","last_fullsized":"2026-02-23T13:07:56.622252+0000","mapping_epoch":48,"log_start":"56'54386","ondisk_log_start":"56'54386","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41040","last_scrub_stamp":"2026-02-23T13:07:30.198713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:30.198713+0000","objects_scrubbed":40305,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:38.570153+0000","scrub_duration":4501,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2070609920,"num_objects":31595,"num_object_clones":0,"num_object_copies":94785,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31595,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54389,"num_write_kb":2751488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"55'51367","reported_seq":51810,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-23T13:07:51.629894+0000","last_change":"2026-02-23T13:07:30.466390+0000","last_active":"2026-02-23T13:07:51.629894+0000","last_peered":"2026-02-23T13:07:51.629894+0000","last_clean":"2026-02-23T13:07:51.629894+0000","last_became_active":"2026-02-23T13:06:03.768946+0000","last_became_peered":"2026-02-23T13:06:03.768946+0000","last_unstale":"2026-02-23T13:07:51.629894+0000","last_undegraded":"2026-02-23T13:07:51.629894+0000","last_fullsized":"2026-02-23T13:07:51.629894+0000","mapping_epoch":48,"log_start":"55'51364","ondisk_log_start":"55'51364","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41169","last_scrub_stamp":"2026-02-23T13:07:30.466346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:30.466346+0000","objects_scrubbed":40719,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:35.646690+0000","scrub_duration":3195,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2281177112,"num_objects":34809,"num_object_clones":0,"num_object_copies":104427,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34809,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":51367,"num_write_kb":2757569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"55'51204","reported_seq":51662,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-23T13:07:51.629696+0000","last_change":"2026-02-23T13:07:38.374570+0000","last_active":"2026-02-23T13:07:51.629696+0000","last_peered":"2026-02-23T13:07:51.629696+0000","last_clean":"2026-02-23T13:07:51.629696+0000","last_became_active":"2026-02-23T13:06:03.767083+0000","last_became_peered":"2026-02-23T13:06:03.767083+0000","last_unstale":"2026-02-23T13:07:51.629696+0000","last_undegraded":"2026-02-23T13:07:51.629696+0000","last_fullsized":"2026-02-23T13:07:51.629696+0000","mapping_epoch":48,"log_start":"55'51201","ondisk_log_start":"55'51201","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'44374","last_scrub_stamp":"2026-02-23T13:07:38.374512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:38.374512+0000","objects_scrubbed":42187,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:05.652994+0000","scrub_duration":4032,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2257584128,"num_objects":34448,"num_object_clones":0,"num_object_copies":103344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34448,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51204,"num_write_kb":2740864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"55'51209","reported_seq":51605,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-23T13:07:51.719962+0000","last_change":"2026-02-23T13:07:20.897120+0000","last_active":"2026-02-23T13:07:51.719962+0000","last_peered":"2026-02-23T13:07:51.719962+0000","last_clean":"2026-02-23T13:07:51.719962+0000","last_became_active":"2026-02-23T13:06:03.766614+0000","last_became_peered":"2026-02-23T13:06:03.766614+0000","last_unstale":"2026-02-23T13:07:51.719962+0000","last_undegraded":"2026-02-23T13:07:51.719962+0000","last_fullsized":"2026-02-23T13:07:51.719962+0000","mapping_epoch":48,"log_start":"55'51206","ondisk_log_start":"55'51206","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'36893","last_scrub_stamp":"2026-02-23T13:07:20.897051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:20.897051+0000","objects_scrubbed":36116,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:37.187224+0000","scrub_duration":3824,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2265120768,"num_objects":34563,"num_object_clones":0,"num_object_copies":103689,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34563,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51209,"num_write_kb":2744704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"55'51012","reported_seq":51414,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-23T13:07:51.628471+0000","last_change":"2026-02-23T13:07:21.878287+0000","last_active":"2026-02-23T13:07:51.628471+0000","last_peered":"2026-02-23T13:07:51.628471+0000","last_clean":"2026-02-23T13:07:51.628471+0000","last_became_active":"2026-02-23T13:06:03.768238+0000","last_became_peered":"2026-02-23T13:06:03.768238+0000","last_unstale":"2026-02-23T13:07:51.628471+0000","last_undegraded":"2026-02-23T13:07:51.628471+0000","last_fullsized":"2026-02-23T13:07:51.628471+0000","mapping_epoch":48,"log_start":"55'51009","ondisk_log_start":"55'51009","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'37319","last_scrub_stamp":"2026-02-23T13:07:21.878230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:21.878230+0000","objects_scrubbed":36520,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:48.355026+0000","scrub_duration":3562,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2272133120,"num_objects":34670,"num_object_clones":0,"num_object_copies":104010,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34670,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51012,"num_write_kb":2741824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"55'51126","reported_seq":51480,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-23T13:07:51.630023+0000","last_change":"2026-02-23T13:07:09.835508+0000","last_active":"2026-02-23T13:07:51.630023+0000","last_peered":"2026-02-23T13:07:51.630023+0000","last_clean":"2026-02-23T13:07:51.630023+0000","last_became_active":"2026-02-23T13:06:03.767947+0000","last_became_peered":"2026-02-23T13:06:03.767947+0000","last_unstale":"2026-02-23T13:07:51.630023+0000","last_undegraded":"2026-02-23T13:07:51.630023+0000","last_fullsized":"2026-02-23T13:07:51.630023+0000","mapping_epoch":48,"log_start":"55'51123","ondisk_log_start":"55'51123","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'32488","last_scrub_stamp":"2026-02-23T13:07:09.835476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:09.835476+0000","objects_scrubbed":31955,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:24.178560+0000","scrub_duration":2500,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2275672064,"num_objects":34724,"num_object_clones":0,"num_object_copies":104172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34724,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51126,"num_write_kb":2747200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"55'51236","reported_seq":51680,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-23T13:07:51.724059+0000","last_change":"2026-02-23T13:07:32.151615+0000","last_active":"2026-02-23T13:07:51.724059+0000","last_peered":"2026-02-23T13:07:51.724059+0000","last_clean":"2026-02-23T13:07:51.724059+0000","last_became_active":"2026-02-23T13:06:03.766859+0000","last_became_peered":"2026-02-23T13:06:03.766859+0000","last_unstale":"2026-02-23T13:07:51.724059+0000","last_undegraded":"2026-02-23T13:07:51.724059+0000","last_fullsized":"2026-02-23T13:07:51.724059+0000","mapping_epoch":48,"log_start":"55'51233","ondisk_log_start":"55'51233","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41546","last_scrub_stamp":"2026-02-23T13:07:32.151562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:32.151562+0000","objects_scrubbed":40710,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:35.090003+0000","scrub_duration":4919,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2260598784,"num_objects":34494,"num_object_clones":0,"num_object_copies":103482,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34494,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51236,"num_write_kb":2743360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"55'51230","reported_seq":51616,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-23T13:07:51.718677+0000","last_change":"2026-02-23T13:07:18.015015+0000","last_active":"2026-02-23T13:07:51.718677+0000","last_peered":"2026-02-23T13:07:51.718677+0000","last_clean":"2026-02-23T13:07:51.718677+0000","last_became_active":"2026-02-23T13:06:03.765502+0000","last_became_peered":"2026-02-23T13:06:03.765502+0000","last_unstale":"2026-02-23T13:07:51.718677+0000","last_undegraded":"2026-02-23T13:07:51.718677+0000","last_fullsized":"2026-02-23T13:07:51.718677+0000","mapping_epoch":48,"log_start":"55'51227","ondisk_log_start":"55'51227","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'35769","last_scrub_stamp":"2026-02-23T13:07:18.014937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:18.014937+0000","objects_scrubbed":35059,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:23.289493+0000","scrub_duration":3913,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2259681280,"num_objects":34480,"num_object_clones":0,"num_object_copies":103440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34480,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51230,"num_write_kb":2742720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"56'54451","reported_seq":54890,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:07:56.618733+0000","last_change":"2026-02-23T13:07:29.741974+0000","last_active":"2026-02-23T13:07:56.618733+0000","last_peered":"2026-02-23T13:07:56.618733+0000","last_clean":"2026-02-23T13:07:56.618733+0000","last_became_active":"2026-02-23T13:06:03.767012+0000","last_became_peered":"2026-02-23T13:06:03.767012+0000","last_unstale":"2026-02-23T13:07:56.618733+0000","last_undegraded":"2026-02-23T13:07:56.618733+0000","last_fullsized":"2026-02-23T13:07:56.618733+0000","mapping_epoch":48,"log_start":"56'54448","ondisk_log_start":"56'54448","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41030","last_scrub_stamp":"2026-02-23T13:07:29.741913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:29.741913+0000","objects_scrubbed":40165,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:39.928525+0000","scrub_duration":4772,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2074673152,"num_objects":31657,"num_object_clones":0,"num_object_copies":94971,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31657,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54451,"num_write_kb":2755456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"56'54016","reported_seq":54413,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:07:56.622738+0000","last_change":"2026-02-23T13:07:20.033733+0000","last_active":"2026-02-23T13:07:56.622738+0000","last_peered":"2026-02-23T13:07:56.622738+0000","last_clean":"2026-02-23T13:07:56.622738+0000","last_became_active":"2026-02-23T13:06:03.767200+0000","last_became_peered":"2026-02-23T13:06:03.767200+0000","last_unstale":"2026-02-23T13:07:56.622738+0000","last_undegraded":"2026-02-23T13:07:56.622738+0000","last_fullsized":"2026-02-23T13:07:56.622738+0000","mapping_epoch":48,"log_start":"56'54013","ondisk_log_start":"56'54013","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'36561","last_scrub_stamp":"2026-02-23T13:07:20.033700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:20.033700+0000","objects_scrubbed":35947,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:44.960748+0000","scrub_duration":3247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2074083328,"num_objects":31648,"num_object_clones":0,"num_object_copies":94944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31648,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54016,"num_write_kb":2741248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"55'51616","reported_seq":52001,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-23T13:07:51.721249+0000","last_change":"2026-02-23T13:07:17.060455+0000","last_active":"2026-02-23T13:07:51.721249+0000","last_peered":"2026-02-23T13:07:51.721249+0000","last_clean":"2026-02-23T13:07:51.721249+0000","last_became_active":"2026-02-23T13:06:03.766415+0000","last_became_peered":"2026-02-23T13:06:03.766415+0000","last_unstale":"2026-02-23T13:07:51.721249+0000","last_undegraded":"2026-02-23T13:07:51.721249+0000","last_fullsized":"2026-02-23T13:07:51.721249+0000","mapping_epoch":48,"log_start":"55'51613","ondisk_log_start":"55'51613","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'35773","last_scrub_stamp":"2026-02-23T13:07:17.060384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:17.060384+0000","objects_scrubbed":34982,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:39.770993+0000","scrub_duration":3962,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2286288896,"num_objects":34886,"num_object_clones":0,"num_object_copies":104658,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34886,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51616,"num_write_kb":2768064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"56'53877","reported_seq":54310,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:07:56.623317+0000","last_change":"2026-02-23T13:07:44.359896+0000","last_active":"2026-02-23T13:07:56.623317+0000","last_peered":"2026-02-23T13:07:56.623317+0000","last_clean":"2026-02-23T13:07:56.623317+0000","last_became_active":"2026-02-23T13:06:03.768541+0000","last_became_peered":"2026-02-23T13:06:03.768541+0000","last_unstale":"2026-02-23T13:07:56.623317+0000","last_undegraded":"2026-02-23T13:07:56.623317+0000","last_fullsized":"2026-02-23T13:07:56.623317+0000","mapping_epoch":48,"log_start":"56'53874","ondisk_log_start":"56'53874","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'47017","last_scrub_stamp":"2026-02-23T13:07:44.359774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:44.359774+0000","objects_scrubbed":39444,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:00.349146+0000","scrub_duration":4516,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2067988480,"num_objects":31555,"num_object_clones":0,"num_object_copies":94665,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31555,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53877,"num_write_kb":2733824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"56'53875","reported_seq":54263,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:07:56.614077+0000","last_change":"2026-02-23T13:07:18.000008+0000","last_active":"2026-02-23T13:07:56.614077+0000","last_peered":"2026-02-23T13:07:56.614077+0000","last_clean":"2026-02-23T13:07:56.614077+0000","last_became_active":"2026-02-23T13:06:03.767001+0000","last_became_peered":"2026-02-23T13:06:03.767001+0000","last_unstale":"2026-02-23T13:07:56.614077+0000","last_undegraded":"2026-02-23T13:07:56.614077+0000","last_fullsized":"2026-02-23T13:07:56.614077+0000","mapping_epoch":48,"log_start":"56'53872","ondisk_log_start":"56'53872","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'35564","last_scrub_stamp":"2026-02-23T13:07:17.999970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:17.999970+0000","objects_scrubbed":35002,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:36.421460+0000","scrub_duration":3089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2053046272,"num_objects":31327,"num_object_clones":0,"num_object_copies":93981,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31327,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53875,"num_write_kb":2726464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"55'51494","reported_seq":51861,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-23T13:07:51.721058+0000","last_change":"2026-02-23T13:07:13.026486+0000","last_active":"2026-02-23T13:07:51.721058+0000","last_peered":"2026-02-23T13:07:51.721058+0000","last_clean":"2026-02-23T13:07:51.721058+0000","last_became_active":"2026-02-23T13:06:03.766997+0000","last_became_peered":"2026-02-23T13:06:03.766997+0000","last_unstale":"2026-02-23T13:07:51.721058+0000","last_undegraded":"2026-02-23T13:07:51.721058+0000","last_fullsized":"2026-02-23T13:07:51.721058+0000","mapping_epoch":48,"log_start":"55'51491","ondisk_log_start":"55'51491","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'33950","last_scrub_stamp":"2026-02-23T13:07:13.026390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:13.026390+0000","objects_scrubbed":33091,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:30.336827+0000","scrub_duration":3912,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2263220224,"num_objects":34534,"num_object_clones":0,"num_object_copies":103602,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34534,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51494,"num_write_kb":2752896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"55'51627","reported_seq":52088,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-23T13:07:51.720624+0000","last_change":"2026-02-23T13:07:38.263276+0000","last_active":"2026-02-23T13:07:51.720624+0000","last_peered":"2026-02-23T13:07:51.720624+0000","last_clean":"2026-02-23T13:07:51.720624+0000","last_became_active":"2026-02-23T13:06:03.767015+0000","last_became_peered":"2026-02-23T13:06:03.767015+0000","last_unstale":"2026-02-23T13:07:51.720624+0000","last_undegraded":"2026-02-23T13:07:51.720624+0000","last_fullsized":"2026-02-23T13:07:51.720624+0000","mapping_epoch":48,"log_start":"55'51624","ondisk_log_start":"55'51624","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'44630","last_scrub_stamp":"2026-02-23T13:07:38.263188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:38.263188+0000","objects_scrubbed":42478,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:53.250163+0000","scrub_duration":5027,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2268004352,"num_objects":34607,"num_object_clones":0,"num_object_copies":103821,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34607,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51627,"num_write_kb":2759488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":264,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-23T13:07:45.544301+0000","last_change":"2026-02-23T13:06:51.141808+0000","last_active":"2026-02-23T13:07:45.544301+0000","last_peered":"2026-02-23T13:07:45.544301+0000","last_clean":"2026-02-23T13:07:45.544301+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:07:45.544301+0000","last_undegraded":"2026-02-23T13:07:45.544301+0000","last_fullsized":"2026-02-23T13:07:45.544301+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:06:51.141759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:06:51.141759+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:07:55.931020+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":35118186520,"num_objects":535862,"num_object_clones":0,"num_object_copies":1607586,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":535862,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":838364,"num_write_kb":43975169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":103633924096,"data_stored":103633911880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":890,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247869,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":24186572,"kb_used_data":22249272,"kb_used_omap":9,"kb_used_meta":1937270,"kb_avail":709816628,"statfs":{"total":751619276800,"available":726852227072,"internally_reserved":0,"allocated":22783254528,"data_stored":22782879828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10130,"internal_metadata":1983764590},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444097,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":29971224,"kb_used_data":28811524,"kb_used_omap":10,"kb_used_meta":1159669,"kb_avail":704031976,"statfs":{"total":751619276800,"available":720928743424,"internally_reserved":0,"allocated":29503000576,"data_stored":29502618039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10584,"internal_metadata":1187501736},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":25480388,"kb_used_data":24413424,"kb_used_omap":10,"kb_used_meta":1066869,"kb_avail":708522812,"statfs":{"total":751619276800,"available":725527359488,"internally_reserved":0,"allocated":24999346176,"data_stored":24998979100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11260,"internal_metadata":1092473860},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,2,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705732,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27861784,"kb_used_data":26671684,"kb_used_omap":9,"kb_used_meta":1190006,"kb_avail":706141416,"statfs":{"total":751619276800,"available":723088809984,"internally_reserved":0,"allocated":27311804416,"data_stored":27311421879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9386,"internal_metadata":1218566998},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":890,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26963742720,"data_stored":26963738648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24904597504,"data_stored":24904597504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29056831488,"data_stored":29056827416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":22708752384,"data_stored":22708748312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:07:58.438 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:07:58.439 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_1 pg_num 66 2026-02-23T13:07:58.560 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:58.558+0000 7fcaa3ba1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:58.560 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:58.558+0000 7fcaa3ba1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:58.577 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:07:58.578 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:07:58.590 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:07:58.592 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:07:58.592 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:07:58.606 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:07:58.607 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:07:58.620 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:07:58.620 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:07:58.719 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:58.716+0000 7f0d6714c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:58.719 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:07:58.717+0000 7f0d6714c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:07:58.865 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:07:58.866 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:58 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/759522988' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:07:58.906 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:08:00.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:59 trial046 ceph-mon[38575]: from='client.14797 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:08:00.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:59 trial046 ceph-mon[38575]: pgmap v181: 17 pgs: 17 active+clean; 31 GiB data, 99 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 9.08k op/s 2026-02-23T13:08:00.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:07:59 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2324205094' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_1", "var": "pg_num", "val": "66"} : dispatch 2026-02-23T13:08:00.678 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:08:00.827 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:00.958 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:00.955+0000 7f7cd47d0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:00.958 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:00.956+0000 7f7cd47d0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:00.974 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:08:00.974 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:08:00.988 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:08:00.988 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:08:01.001 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:08:01.001 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:08:01.015 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:08:01.015 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:08:02.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:01 trial046 ceph-mon[38575]: pgmap v182: 17 pgs: 17 active+clean; 31 GiB data, 99 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 9.08k op/s 2026-02-23T13:08:02.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:01 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:08:02.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:01 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2151109604' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:08:03.593 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:08:03.747 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:03.889 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:03 trial046 ceph-mon[38575]: pgmap v183: 17 pgs: 17 active+clean; 28 GiB data, 90 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 9.20k op/s 2026-02-23T13:08:03.907 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:08:03.907 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:08:03.907 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:08:03.908 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:08:04.171 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:04.115+0000 7fa70a64e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:04.171 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:04.115+0000 7fa70a64e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:04.171 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:08:04.171 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:08:04.171 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:08:04.171 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:08:04.171 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:08:04.171 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:08:04.179 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:08:04.179 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:08:04.675 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:04.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:04 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1683510472' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:08:05.050 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:05.049+0000 7f5fd451a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:05.050 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:05.049+0000 7f5fd451a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:05.199 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:08:05.200 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:08:05.245 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2026-02-23T13:08:04.630563+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30270358072,"num_objects":461883,"num_object_clones":0,"num_object_copies":1385649,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":461883,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":912480,"num_write_kb":43977319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":94117976,"kb_used_data":89567112,"kb_used_omap":41,"kb_used_meta":4550678,"kb_avail":2841894824,"statfs":{"total":3006477107200,"available":2910100299776,"internally_reserved":0,"allocated":91716722688,"data_stored":91715200164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42726,"internal_metadata":4659894554},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6031278080,"num_objects":-92030,"num_object_clones":0,"num_object_copies":-276090,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-92030,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92030,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.934970"},"pg_stats":[{"pgid":"3.f","version":"56'57359","reported_seq":57707,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:01.625485+0000","last_change":"2026-02-23T13:07:08.188933+0000","last_active":"2026-02-23T13:08:01.625485+0000","last_peered":"2026-02-23T13:08:01.625485+0000","last_clean":"2026-02-23T13:08:01.625485+0000","last_became_active":"2026-02-23T13:06:03.767261+0000","last_became_peered":"2026-02-23T13:06:03.767261+0000","last_unstale":"2026-02-23T13:08:01.625485+0000","last_undegraded":"2026-02-23T13:08:01.625485+0000","last_fullsized":"2026-02-23T13:08:01.625485+0000","mapping_epoch":48,"log_start":"56'57356","ondisk_log_start":"56'57356","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'31889","last_scrub_stamp":"2026-02-23T13:07:08.188897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:08.188897+0000","objects_scrubbed":31058,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:29.284171+0000","scrub_duration":3362,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1909784576,"num_objects":29141,"num_object_clones":0,"num_object_copies":87423,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29141,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57359,"num_write_kb":2768000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"56'57094","reported_seq":57534,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:01.622551+0000","last_change":"2026-02-23T13:07:30.198745+0000","last_active":"2026-02-23T13:08:01.622551+0000","last_peered":"2026-02-23T13:08:01.622551+0000","last_clean":"2026-02-23T13:08:01.622551+0000","last_became_active":"2026-02-23T13:06:03.767822+0000","last_became_peered":"2026-02-23T13:06:03.767822+0000","last_unstale":"2026-02-23T13:08:01.622551+0000","last_undegraded":"2026-02-23T13:08:01.622551+0000","last_fullsized":"2026-02-23T13:08:01.622551+0000","mapping_epoch":48,"log_start":"56'57091","ondisk_log_start":"56'57091","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41040","last_scrub_stamp":"2026-02-23T13:07:30.198713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:30.198713+0000","objects_scrubbed":40305,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:38.570153+0000","scrub_duration":4501,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1893335040,"num_objects":28890,"num_object_clones":0,"num_object_copies":86670,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28890,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57094,"num_write_kb":2751488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"56'57120","reported_seq":57565,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:01.626331+0000","last_change":"2026-02-23T13:07:30.466390+0000","last_active":"2026-02-23T13:08:01.626331+0000","last_peered":"2026-02-23T13:08:01.626331+0000","last_clean":"2026-02-23T13:08:01.626331+0000","last_became_active":"2026-02-23T13:06:03.768946+0000","last_became_peered":"2026-02-23T13:06:03.768946+0000","last_unstale":"2026-02-23T13:08:01.626331+0000","last_undegraded":"2026-02-23T13:08:01.626331+0000","last_fullsized":"2026-02-23T13:08:01.626331+0000","mapping_epoch":48,"log_start":"56'57117","ondisk_log_start":"56'57117","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41169","last_scrub_stamp":"2026-02-23T13:07:30.466346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:30.466346+0000","objects_scrubbed":40719,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:35.646690+0000","scrub_duration":3195,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1904148504,"num_objects":29056,"num_object_clones":0,"num_object_copies":87168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29056,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":57120,"num_write_kb":2757569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"56'56977","reported_seq":57437,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:01.629680+0000","last_change":"2026-02-23T13:07:38.374570+0000","last_active":"2026-02-23T13:08:01.629680+0000","last_peered":"2026-02-23T13:08:01.629680+0000","last_clean":"2026-02-23T13:08:01.629680+0000","last_became_active":"2026-02-23T13:06:03.767083+0000","last_became_peered":"2026-02-23T13:06:03.767083+0000","last_unstale":"2026-02-23T13:08:01.629680+0000","last_undegraded":"2026-02-23T13:08:01.629680+0000","last_fullsized":"2026-02-23T13:08:01.629680+0000","mapping_epoch":48,"log_start":"56'56974","ondisk_log_start":"56'56974","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'44374","last_scrub_stamp":"2026-02-23T13:07:38.374512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:38.374512+0000","objects_scrubbed":42187,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:05.652994+0000","scrub_duration":4032,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1879244800,"num_objects":28675,"num_object_clones":0,"num_object_copies":86025,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28675,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56977,"num_write_kb":2740864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"56'56935","reported_seq":57333,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:01.725625+0000","last_change":"2026-02-23T13:07:20.897120+0000","last_active":"2026-02-23T13:08:01.725625+0000","last_peered":"2026-02-23T13:08:01.725625+0000","last_clean":"2026-02-23T13:08:01.725625+0000","last_became_active":"2026-02-23T13:06:03.766614+0000","last_became_peered":"2026-02-23T13:06:03.766614+0000","last_unstale":"2026-02-23T13:08:01.725625+0000","last_undegraded":"2026-02-23T13:08:01.725625+0000","last_fullsized":"2026-02-23T13:08:01.725625+0000","mapping_epoch":48,"log_start":"56'56932","ondisk_log_start":"56'56932","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'36893","last_scrub_stamp":"2026-02-23T13:07:20.897051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:20.897051+0000","objects_scrubbed":36116,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:37.187224+0000","scrub_duration":3824,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1889861632,"num_objects":28837,"num_object_clones":0,"num_object_copies":86511,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28837,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56935,"num_write_kb":2744704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"56'56771","reported_seq":57175,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:01.628052+0000","last_change":"2026-02-23T13:07:21.878287+0000","last_active":"2026-02-23T13:08:01.628052+0000","last_peered":"2026-02-23T13:08:01.628052+0000","last_clean":"2026-02-23T13:08:01.628052+0000","last_became_active":"2026-02-23T13:06:03.768238+0000","last_became_peered":"2026-02-23T13:06:03.768238+0000","last_unstale":"2026-02-23T13:08:01.628052+0000","last_undegraded":"2026-02-23T13:08:01.628052+0000","last_fullsized":"2026-02-23T13:08:01.628052+0000","mapping_epoch":48,"log_start":"56'56768","ondisk_log_start":"56'56768","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'37319","last_scrub_stamp":"2026-02-23T13:07:21.878230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:21.878230+0000","objects_scrubbed":36520,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:48.355026+0000","scrub_duration":3562,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1894711296,"num_objects":28911,"num_object_clones":0,"num_object_copies":86733,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28911,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56771,"num_write_kb":2741824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"56'56884","reported_seq":57238,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:01.628822+0000","last_change":"2026-02-23T13:07:09.835508+0000","last_active":"2026-02-23T13:08:01.628822+0000","last_peered":"2026-02-23T13:08:01.628822+0000","last_clean":"2026-02-23T13:08:01.628822+0000","last_became_active":"2026-02-23T13:06:03.767947+0000","last_became_peered":"2026-02-23T13:06:03.767947+0000","last_unstale":"2026-02-23T13:08:01.628822+0000","last_undegraded":"2026-02-23T13:08:01.628822+0000","last_fullsized":"2026-02-23T13:08:01.628822+0000","mapping_epoch":48,"log_start":"56'56881","ondisk_log_start":"56'56881","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'32488","last_scrub_stamp":"2026-02-23T13:07:09.835476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:09.835476+0000","objects_scrubbed":31955,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:24.178560+0000","scrub_duration":2500,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1898315776,"num_objects":28966,"num_object_clones":0,"num_object_copies":86898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28966,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56884,"num_write_kb":2747200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"56'56944","reported_seq":57389,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:01.721758+0000","last_change":"2026-02-23T13:07:32.151615+0000","last_active":"2026-02-23T13:08:01.721758+0000","last_peered":"2026-02-23T13:08:01.721758+0000","last_clean":"2026-02-23T13:08:01.721758+0000","last_became_active":"2026-02-23T13:06:03.766859+0000","last_became_peered":"2026-02-23T13:06:03.766859+0000","last_unstale":"2026-02-23T13:08:01.721758+0000","last_undegraded":"2026-02-23T13:08:01.721758+0000","last_fullsized":"2026-02-23T13:08:01.721758+0000","mapping_epoch":48,"log_start":"56'56941","ondisk_log_start":"56'56941","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41546","last_scrub_stamp":"2026-02-23T13:07:32.151562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:32.151562+0000","objects_scrubbed":40710,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:35.090003+0000","scrub_duration":4919,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1886519296,"num_objects":28786,"num_object_clones":0,"num_object_copies":86358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28786,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56944,"num_write_kb":2743360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"56'57032","reported_seq":57420,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:01.724542+0000","last_change":"2026-02-23T13:07:18.015015+0000","last_active":"2026-02-23T13:08:01.724542+0000","last_peered":"2026-02-23T13:08:01.724542+0000","last_clean":"2026-02-23T13:08:01.724542+0000","last_became_active":"2026-02-23T13:06:03.765502+0000","last_became_peered":"2026-02-23T13:06:03.765502+0000","last_unstale":"2026-02-23T13:08:01.724542+0000","last_undegraded":"2026-02-23T13:08:01.724542+0000","last_fullsized":"2026-02-23T13:08:01.724542+0000","mapping_epoch":48,"log_start":"56'57029","ondisk_log_start":"56'57029","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'35769","last_scrub_stamp":"2026-02-23T13:07:18.014937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:18.014937+0000","objects_scrubbed":35059,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:23.289493+0000","scrub_duration":3913,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1879441408,"num_objects":28678,"num_object_clones":0,"num_object_copies":86034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28678,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57032,"num_write_kb":2742720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"56'57189","reported_seq":57629,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:01.618726+0000","last_change":"2026-02-23T13:07:29.741974+0000","last_active":"2026-02-23T13:08:01.618726+0000","last_peered":"2026-02-23T13:08:01.618726+0000","last_clean":"2026-02-23T13:08:01.618726+0000","last_became_active":"2026-02-23T13:06:03.767012+0000","last_became_peered":"2026-02-23T13:06:03.767012+0000","last_unstale":"2026-02-23T13:08:01.618726+0000","last_undegraded":"2026-02-23T13:08:01.618726+0000","last_fullsized":"2026-02-23T13:08:01.618726+0000","mapping_epoch":48,"log_start":"56'57186","ondisk_log_start":"56'57186","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41030","last_scrub_stamp":"2026-02-23T13:07:29.741913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:29.741913+0000","objects_scrubbed":40165,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:39.928525+0000","scrub_duration":4772,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1895235584,"num_objects":28919,"num_object_clones":0,"num_object_copies":86757,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28919,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57189,"num_write_kb":2755456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"56'56755","reported_seq":57152,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:01.619100+0000","last_change":"2026-02-23T13:07:20.033733+0000","last_active":"2026-02-23T13:08:01.619100+0000","last_peered":"2026-02-23T13:08:01.619100+0000","last_clean":"2026-02-23T13:08:01.619100+0000","last_became_active":"2026-02-23T13:06:03.767200+0000","last_became_peered":"2026-02-23T13:06:03.767200+0000","last_unstale":"2026-02-23T13:08:01.619100+0000","last_undegraded":"2026-02-23T13:08:01.619100+0000","last_fullsized":"2026-02-23T13:08:01.619100+0000","mapping_epoch":48,"log_start":"56'56752","ondisk_log_start":"56'56752","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'36561","last_scrub_stamp":"2026-02-23T13:07:20.033700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:20.033700+0000","objects_scrubbed":35947,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:44.960748+0000","scrub_duration":3247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1894580224,"num_objects":28909,"num_object_clones":0,"num_object_copies":86727,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28909,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56755,"num_write_kb":2741248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"56'57508","reported_seq":57895,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:01.721167+0000","last_change":"2026-02-23T13:07:17.060455+0000","last_active":"2026-02-23T13:08:01.721167+0000","last_peered":"2026-02-23T13:08:01.721167+0000","last_clean":"2026-02-23T13:08:01.721167+0000","last_became_active":"2026-02-23T13:06:03.766415+0000","last_became_peered":"2026-02-23T13:06:03.766415+0000","last_unstale":"2026-02-23T13:08:01.721167+0000","last_undegraded":"2026-02-23T13:08:01.721167+0000","last_fullsized":"2026-02-23T13:08:01.721167+0000","mapping_epoch":48,"log_start":"56'57505","ondisk_log_start":"56'57505","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'35773","last_scrub_stamp":"2026-02-23T13:07:17.060384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:17.060384+0000","objects_scrubbed":34982,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:39.770993+0000","scrub_duration":3962,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900150784,"num_objects":28994,"num_object_clones":0,"num_object_copies":86982,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28994,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57508,"num_write_kb":2768064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"56'56617","reported_seq":57050,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:01.624119+0000","last_change":"2026-02-23T13:07:44.359896+0000","last_active":"2026-02-23T13:08:01.624119+0000","last_peered":"2026-02-23T13:08:01.624119+0000","last_clean":"2026-02-23T13:08:01.624119+0000","last_became_active":"2026-02-23T13:06:03.768541+0000","last_became_peered":"2026-02-23T13:06:03.768541+0000","last_unstale":"2026-02-23T13:08:01.624119+0000","last_undegraded":"2026-02-23T13:08:01.624119+0000","last_fullsized":"2026-02-23T13:08:01.624119+0000","mapping_epoch":48,"log_start":"56'56614","ondisk_log_start":"56'56614","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'47017","last_scrub_stamp":"2026-02-23T13:07:44.359774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:44.359774+0000","objects_scrubbed":39444,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:00.349146+0000","scrub_duration":4516,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1888419840,"num_objects":28815,"num_object_clones":0,"num_object_copies":86445,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28815,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56617,"num_write_kb":2733824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"56'56529","reported_seq":56917,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:01.617018+0000","last_change":"2026-02-23T13:07:18.000008+0000","last_active":"2026-02-23T13:08:01.617018+0000","last_peered":"2026-02-23T13:08:01.617018+0000","last_clean":"2026-02-23T13:08:01.617018+0000","last_became_active":"2026-02-23T13:06:03.767001+0000","last_became_peered":"2026-02-23T13:06:03.767001+0000","last_unstale":"2026-02-23T13:08:01.617018+0000","last_undegraded":"2026-02-23T13:08:01.617018+0000","last_fullsized":"2026-02-23T13:08:01.617018+0000","mapping_epoch":48,"log_start":"56'56526","ondisk_log_start":"56'56526","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'35564","last_scrub_stamp":"2026-02-23T13:07:17.999970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:17.999970+0000","objects_scrubbed":35002,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:36.421460+0000","scrub_duration":3089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1879113728,"num_objects":28673,"num_object_clones":0,"num_object_copies":86019,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28673,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56529,"num_write_kb":2726464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"56'57309","reported_seq":57678,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:01.722167+0000","last_change":"2026-02-23T13:07:13.026486+0000","last_active":"2026-02-23T13:08:01.722167+0000","last_peered":"2026-02-23T13:08:01.722167+0000","last_clean":"2026-02-23T13:08:01.722167+0000","last_became_active":"2026-02-23T13:06:03.766997+0000","last_became_peered":"2026-02-23T13:06:03.766997+0000","last_unstale":"2026-02-23T13:08:01.722167+0000","last_undegraded":"2026-02-23T13:08:01.722167+0000","last_fullsized":"2026-02-23T13:08:01.722167+0000","mapping_epoch":48,"log_start":"56'57306","ondisk_log_start":"56'57306","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'33950","last_scrub_stamp":"2026-02-23T13:07:13.026390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:13.026390+0000","objects_scrubbed":33091,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:30.336827+0000","scrub_duration":3912,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1882128384,"num_objects":28719,"num_object_clones":0,"num_object_copies":86157,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28719,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57309,"num_write_kb":2752896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"56'57322","reported_seq":57785,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:01.719470+0000","last_change":"2026-02-23T13:07:38.263276+0000","last_active":"2026-02-23T13:08:01.719470+0000","last_peered":"2026-02-23T13:08:01.719470+0000","last_clean":"2026-02-23T13:08:01.719470+0000","last_became_active":"2026-02-23T13:06:03.767015+0000","last_became_peered":"2026-02-23T13:06:03.767015+0000","last_unstale":"2026-02-23T13:08:01.719470+0000","last_undegraded":"2026-02-23T13:08:01.719470+0000","last_fullsized":"2026-02-23T13:08:01.719470+0000","mapping_epoch":48,"log_start":"56'57319","ondisk_log_start":"56'57319","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'44630","last_scrub_stamp":"2026-02-23T13:07:38.263188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:38.263188+0000","objects_scrubbed":42478,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:53.250163+0000","scrub_duration":5027,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1894776832,"num_objects":28912,"num_object_clones":0,"num_object_copies":86736,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28912,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57322,"num_write_kb":2759488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":274,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:07:56.312851+0000","last_change":"2026-02-23T13:07:56.312851+0000","last_active":"2026-02-23T13:07:56.312851+0000","last_peered":"2026-02-23T13:07:56.312851+0000","last_clean":"2026-02-23T13:07:56.312851+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:07:56.312851+0000","last_undegraded":"2026-02-23T13:07:56.312851+0000","last_fullsized":"2026-02-23T13:07:56.312851+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:07:56.312801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:07:56.312801+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:14.345117+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":30269767704,"num_objects":461881,"num_object_clones":0,"num_object_copies":1385643,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":461881,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":912345,"num_write_kb":43975169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":90839527424,"data_stored":90839515208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2256,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247871,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":19905240,"kb_used_data":18608580,"kb_used_omap":10,"kb_used_meta":1296565,"kb_avail":714097960,"statfs":{"total":751619276800,"available":731236311040,"internally_reserved":0,"allocated":19055185920,"data_stored":19054803383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10844,"internal_metadata":1327682980},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444098,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27099416,"kb_used_data":26282628,"kb_used_omap":10,"kb_used_meta":816757,"kb_avail":706903784,"statfs":{"total":751619276800,"available":723869474816,"internally_reserved":0,"allocated":26913411072,"data_stored":26913028535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10584,"internal_metadata":836359848},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":21573008,"kb_used_data":20397820,"kb_used_omap":11,"kb_used_meta":1175156,"kb_avail":712430192,"statfs":{"total":751619276800,"available":729528516608,"internally_reserved":0,"allocated":20887367680,"data_stored":20886992767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11912,"internal_metadata":1203360120},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705733,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":25540312,"kb_used_data":24278084,"kb_used_omap":9,"kb_used_meta":1262198,"kb_avail":708462888,"statfs":{"total":751619276800,"available":725465997312,"internally_reserved":0,"allocated":24860758016,"data_stored":24860375479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9386,"internal_metadata":1292491606},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2256,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24610410496,"data_stored":24610406424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20753940480,"data_stored":20753940480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":26531270656,"data_stored":26531266584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18943905792,"data_stored":18943901720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:08:05.246 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:08:05.246 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 131 2026-02-23T13:08:05.424 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:05.563 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:05.561+0000 7f61a76be640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:05.563 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:05.561+0000 7f61a76be640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:05.720 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:08:05.761 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:08:06.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:05 trial046 ceph-mon[38575]: pgmap v184: 17 pgs: 17 active+clean; 28 GiB data, 90 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 8.42k op/s 2026-02-23T13:08:06.539 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:08:06 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:08:06] "GET /metrics HTTP/1.1" 200 4233 "" "Prometheus/3.6.0" 2026-02-23T13:08:06.561 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:08:06 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:08:06.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:08:06.676 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:08:06.816 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:06.940 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:06.939+0000 7f56aee5f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:06.940 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:06.939+0000 7f56aee5f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:06.955 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:08:06.955 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:08:06.955 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:06 trial046 ceph-mon[38575]: from='client.14807 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:08:06.955 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:06 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3432944751' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "131"} : dispatch 2026-02-23T13:08:06.969 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:08:06.969 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:08:06.983 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:08:06.983 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:08:06.996 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:08:06.996 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:08:08.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:07 trial046 ceph-mon[38575]: pgmap v185: 17 pgs: 17 active+clean; 27 GiB data, 85 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 9.08k op/s 2026-02-23T13:08:08.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:07 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/591196884' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:08:08.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:07 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-23T13:08:09.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:08 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:08:09.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:08 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-23T13:08:09.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:08 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:08:09.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:08 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-23T13:08:09.040 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:08:09.180 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:09.297 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:09.297+0000 7fbdb749f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:09.298 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:09.297+0000 7fbdb749f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:09.313 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:08:09.313 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:08:09.326 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:08:09.326 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:08:09.340 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:08:09.340 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:08:09.353 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:08:09.354 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:08:10.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:09 trial046 ceph-mon[38575]: pgmap v186: 17 pgs: 17 active+clean; 25 GiB data, 82 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 9.91k op/s 2026-02-23T13:08:10.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:09 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3851255862' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:08:10.763 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:08:10.763 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:08:10.763 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_1 2026-02-23T13:08:10.764 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:08:10.907 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:11.045 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:11.043+0000 7f022de73640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:11.045 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:11.044+0000 7f022de73640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:11.188 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:08:11.188 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:08:11.234 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":187,"stamp":"2026-02-23T13:08:10.631347+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":27320255032,"num_objects":416868,"num_object_clones":0,"num_object_copies":1250604,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":416868,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":957495,"num_write_kb":43977319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":85955480,"kb_used_data":81187784,"kb_used_omap":41,"kb_used_meta":4767254,"kb_avail":2850057320,"statfs":{"total":3006477107200,"available":2918458695680,"internally_reserved":0,"allocated":83136290816,"data_stored":83134768292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42726,"internal_metadata":4881668378},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5839847424,"num_objects":-89109,"num_object_clones":0,"num_object_copies":-267327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-89109,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89109,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001621"},"pg_stats":[{"pgid":"3.f","version":"56'60209","reported_seq":60557,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:06.623751+0000","last_change":"2026-02-23T13:07:08.188933+0000","last_active":"2026-02-23T13:08:06.623751+0000","last_peered":"2026-02-23T13:08:06.623751+0000","last_clean":"2026-02-23T13:08:06.623751+0000","last_became_active":"2026-02-23T13:06:03.767261+0000","last_became_peered":"2026-02-23T13:06:03.767261+0000","last_unstale":"2026-02-23T13:08:06.623751+0000","last_undegraded":"2026-02-23T13:08:06.623751+0000","last_fullsized":"2026-02-23T13:08:06.623751+0000","mapping_epoch":48,"log_start":"56'60206","ondisk_log_start":"56'60206","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'31889","last_scrub_stamp":"2026-02-23T13:07:08.188897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:08.188897+0000","objects_scrubbed":31058,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:29.284171+0000","scrub_duration":3362,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1723006976,"num_objects":26291,"num_object_clones":0,"num_object_copies":78873,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26291,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60209,"num_write_kb":2768000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"56'59899","reported_seq":60339,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:06.624132+0000","last_change":"2026-02-23T13:07:30.198745+0000","last_active":"2026-02-23T13:08:06.624132+0000","last_peered":"2026-02-23T13:08:06.624132+0000","last_clean":"2026-02-23T13:08:06.624132+0000","last_became_active":"2026-02-23T13:06:03.767822+0000","last_became_peered":"2026-02-23T13:06:03.767822+0000","last_unstale":"2026-02-23T13:08:06.624132+0000","last_undegraded":"2026-02-23T13:08:06.624132+0000","last_fullsized":"2026-02-23T13:08:06.624132+0000","mapping_epoch":48,"log_start":"56'59896","ondisk_log_start":"56'59896","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41040","last_scrub_stamp":"2026-02-23T13:07:30.198713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:30.198713+0000","objects_scrubbed":40305,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:38.570153+0000","scrub_duration":4501,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1709506560,"num_objects":26085,"num_object_clones":0,"num_object_copies":78255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26085,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59899,"num_write_kb":2751488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"56'59942","reported_seq":60386,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:06.622884+0000","last_change":"2026-02-23T13:07:30.466390+0000","last_active":"2026-02-23T13:08:06.622884+0000","last_peered":"2026-02-23T13:08:06.622884+0000","last_clean":"2026-02-23T13:08:06.622884+0000","last_became_active":"2026-02-23T13:06:03.768946+0000","last_became_peered":"2026-02-23T13:06:03.768946+0000","last_unstale":"2026-02-23T13:08:06.622884+0000","last_undegraded":"2026-02-23T13:08:06.622884+0000","last_fullsized":"2026-02-23T13:08:06.622884+0000","mapping_epoch":48,"log_start":"56'59939","ondisk_log_start":"56'59939","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41169","last_scrub_stamp":"2026-02-23T13:07:30.466346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:30.466346+0000","objects_scrubbed":40719,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:35.646690+0000","scrub_duration":3195,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1719205912,"num_objects":26234,"num_object_clones":0,"num_object_copies":78702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26234,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":59942,"num_write_kb":2757569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"56'59769","reported_seq":60229,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:06.627628+0000","last_change":"2026-02-23T13:07:38.374570+0000","last_active":"2026-02-23T13:08:06.627628+0000","last_peered":"2026-02-23T13:08:06.627628+0000","last_clean":"2026-02-23T13:08:06.627628+0000","last_became_active":"2026-02-23T13:06:03.767083+0000","last_became_peered":"2026-02-23T13:06:03.767083+0000","last_unstale":"2026-02-23T13:08:06.627628+0000","last_undegraded":"2026-02-23T13:08:06.627628+0000","last_fullsized":"2026-02-23T13:08:06.627628+0000","mapping_epoch":48,"log_start":"56'59766","ondisk_log_start":"56'59766","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'44374","last_scrub_stamp":"2026-02-23T13:07:38.374512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:38.374512+0000","objects_scrubbed":42187,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:05.652994+0000","scrub_duration":4032,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1696268288,"num_objects":25883,"num_object_clones":0,"num_object_copies":77649,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25883,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59769,"num_write_kb":2740864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"56'59667","reported_seq":60065,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:06.726497+0000","last_change":"2026-02-23T13:07:20.897120+0000","last_active":"2026-02-23T13:08:06.726497+0000","last_peered":"2026-02-23T13:08:06.726497+0000","last_clean":"2026-02-23T13:08:06.726497+0000","last_became_active":"2026-02-23T13:06:03.766614+0000","last_became_peered":"2026-02-23T13:06:03.766614+0000","last_unstale":"2026-02-23T13:08:06.726497+0000","last_undegraded":"2026-02-23T13:08:06.726497+0000","last_fullsized":"2026-02-23T13:08:06.726497+0000","mapping_epoch":48,"log_start":"56'59664","ondisk_log_start":"56'59664","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'36893","last_scrub_stamp":"2026-02-23T13:07:20.897051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:20.897051+0000","objects_scrubbed":36116,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:37.187224+0000","scrub_duration":3824,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1710817280,"num_objects":26105,"num_object_clones":0,"num_object_copies":78315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26105,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59667,"num_write_kb":2744704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"56'59537","reported_seq":59941,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:06.629586+0000","last_change":"2026-02-23T13:07:21.878287+0000","last_active":"2026-02-23T13:08:06.629586+0000","last_peered":"2026-02-23T13:08:06.629586+0000","last_clean":"2026-02-23T13:08:06.629586+0000","last_became_active":"2026-02-23T13:06:03.768238+0000","last_became_peered":"2026-02-23T13:06:03.768238+0000","last_unstale":"2026-02-23T13:08:06.629586+0000","last_undegraded":"2026-02-23T13:08:06.629586+0000","last_fullsized":"2026-02-23T13:08:06.629586+0000","mapping_epoch":48,"log_start":"56'59534","ondisk_log_start":"56'59534","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'37319","last_scrub_stamp":"2026-02-23T13:07:21.878230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:21.878230+0000","objects_scrubbed":36520,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:48.355026+0000","scrub_duration":3562,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1713438720,"num_objects":26145,"num_object_clones":0,"num_object_copies":78435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26145,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59537,"num_write_kb":2741824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"56'59753","reported_seq":60109,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:06.628004+0000","last_change":"2026-02-23T13:07:09.835508+0000","last_active":"2026-02-23T13:08:06.628004+0000","last_peered":"2026-02-23T13:08:06.628004+0000","last_clean":"2026-02-23T13:08:06.628004+0000","last_became_active":"2026-02-23T13:06:03.767947+0000","last_became_peered":"2026-02-23T13:06:03.767947+0000","last_unstale":"2026-02-23T13:08:06.628004+0000","last_undegraded":"2026-02-23T13:08:06.628004+0000","last_fullsized":"2026-02-23T13:08:06.628004+0000","mapping_epoch":48,"log_start":"56'59750","ondisk_log_start":"56'59750","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'32488","last_scrub_stamp":"2026-02-23T13:07:09.835476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:09.835476+0000","objects_scrubbed":31955,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:24.178560+0000","scrub_duration":2500,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1710292992,"num_objects":26097,"num_object_clones":0,"num_object_copies":78291,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26097,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59753,"num_write_kb":2747200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"56'59777","reported_seq":60223,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:06.726390+0000","last_change":"2026-02-23T13:07:32.151615+0000","last_active":"2026-02-23T13:08:06.726390+0000","last_peered":"2026-02-23T13:08:06.726390+0000","last_clean":"2026-02-23T13:08:06.726390+0000","last_became_active":"2026-02-23T13:06:03.766859+0000","last_became_peered":"2026-02-23T13:06:03.766859+0000","last_unstale":"2026-02-23T13:08:06.726390+0000","last_undegraded":"2026-02-23T13:08:06.726390+0000","last_fullsized":"2026-02-23T13:08:06.726390+0000","mapping_epoch":48,"log_start":"56'59774","ondisk_log_start":"56'59774","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41546","last_scrub_stamp":"2026-02-23T13:07:32.151562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:32.151562+0000","objects_scrubbed":40710,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:35.090003+0000","scrub_duration":4919,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1700855808,"num_objects":25953,"num_object_clones":0,"num_object_copies":77859,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25953,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59777,"num_write_kb":2743360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"56'59782","reported_seq":60170,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:06.719987+0000","last_change":"2026-02-23T13:07:18.015015+0000","last_active":"2026-02-23T13:08:06.719987+0000","last_peered":"2026-02-23T13:08:06.719987+0000","last_clean":"2026-02-23T13:08:06.719987+0000","last_became_active":"2026-02-23T13:06:03.765502+0000","last_became_peered":"2026-02-23T13:06:03.765502+0000","last_unstale":"2026-02-23T13:08:06.719987+0000","last_undegraded":"2026-02-23T13:08:06.719987+0000","last_fullsized":"2026-02-23T13:08:06.719987+0000","mapping_epoch":48,"log_start":"56'59779","ondisk_log_start":"56'59779","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'35769","last_scrub_stamp":"2026-02-23T13:07:18.014937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:18.014937+0000","objects_scrubbed":35059,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:23.289493+0000","scrub_duration":3913,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1699217408,"num_objects":25928,"num_object_clones":0,"num_object_copies":77784,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25928,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59782,"num_write_kb":2742720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"56'60097","reported_seq":60537,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:06.608106+0000","last_change":"2026-02-23T13:07:29.741974+0000","last_active":"2026-02-23T13:08:06.608106+0000","last_peered":"2026-02-23T13:08:06.608106+0000","last_clean":"2026-02-23T13:08:06.608106+0000","last_became_active":"2026-02-23T13:06:03.767012+0000","last_became_peered":"2026-02-23T13:06:03.767012+0000","last_unstale":"2026-02-23T13:08:06.608106+0000","last_undegraded":"2026-02-23T13:08:06.608106+0000","last_fullsized":"2026-02-23T13:08:06.608106+0000","mapping_epoch":48,"log_start":"56'60094","ondisk_log_start":"56'60094","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41030","last_scrub_stamp":"2026-02-23T13:07:29.741913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:29.741913+0000","objects_scrubbed":40165,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:39.928525+0000","scrub_duration":4772,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1704656896,"num_objects":26011,"num_object_clones":0,"num_object_copies":78033,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26011,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60097,"num_write_kb":2755456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"56'59550","reported_seq":59947,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:06.620781+0000","last_change":"2026-02-23T13:07:20.033733+0000","last_active":"2026-02-23T13:08:06.620781+0000","last_peered":"2026-02-23T13:08:06.620781+0000","last_clean":"2026-02-23T13:08:06.620781+0000","last_became_active":"2026-02-23T13:06:03.767200+0000","last_became_peered":"2026-02-23T13:06:03.767200+0000","last_unstale":"2026-02-23T13:08:06.620781+0000","last_undegraded":"2026-02-23T13:08:06.620781+0000","last_fullsized":"2026-02-23T13:08:06.620781+0000","mapping_epoch":48,"log_start":"56'59547","ondisk_log_start":"56'59547","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'36561","last_scrub_stamp":"2026-02-23T13:07:20.033700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:20.033700+0000","objects_scrubbed":35947,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:44.960748+0000","scrub_duration":3247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1711407104,"num_objects":26114,"num_object_clones":0,"num_object_copies":78342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59550,"num_write_kb":2741248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"56'60374","reported_seq":60761,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:06.721330+0000","last_change":"2026-02-23T13:07:17.060455+0000","last_active":"2026-02-23T13:08:06.721330+0000","last_peered":"2026-02-23T13:08:06.721330+0000","last_clean":"2026-02-23T13:08:06.721330+0000","last_became_active":"2026-02-23T13:06:03.766415+0000","last_became_peered":"2026-02-23T13:06:03.766415+0000","last_unstale":"2026-02-23T13:08:06.721330+0000","last_undegraded":"2026-02-23T13:08:06.721330+0000","last_fullsized":"2026-02-23T13:08:06.721330+0000","mapping_epoch":48,"log_start":"56'60371","ondisk_log_start":"56'60371","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'35773","last_scrub_stamp":"2026-02-23T13:07:17.060384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:17.060384+0000","objects_scrubbed":34982,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:39.770993+0000","scrub_duration":3962,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1712324608,"num_objects":26128,"num_object_clones":0,"num_object_copies":78384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26128,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60374,"num_write_kb":2768064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"56'59377","reported_seq":59810,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:06.625096+0000","last_change":"2026-02-23T13:07:44.359896+0000","last_active":"2026-02-23T13:08:06.625096+0000","last_peered":"2026-02-23T13:08:06.625096+0000","last_clean":"2026-02-23T13:08:06.625096+0000","last_became_active":"2026-02-23T13:06:03.768541+0000","last_became_peered":"2026-02-23T13:06:03.768541+0000","last_unstale":"2026-02-23T13:08:06.625096+0000","last_undegraded":"2026-02-23T13:08:06.625096+0000","last_fullsized":"2026-02-23T13:08:06.625096+0000","mapping_epoch":48,"log_start":"56'59374","ondisk_log_start":"56'59374","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'47017","last_scrub_stamp":"2026-02-23T13:07:44.359774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:44.359774+0000","objects_scrubbed":39444,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:00.349146+0000","scrub_duration":4516,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1707540480,"num_objects":26055,"num_object_clones":0,"num_object_copies":78165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26055,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59377,"num_write_kb":2733824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"56'59364","reported_seq":59752,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:06.618780+0000","last_change":"2026-02-23T13:07:18.000008+0000","last_active":"2026-02-23T13:08:06.618780+0000","last_peered":"2026-02-23T13:08:06.618780+0000","last_clean":"2026-02-23T13:08:06.618780+0000","last_became_active":"2026-02-23T13:06:03.767001+0000","last_became_peered":"2026-02-23T13:06:03.767001+0000","last_unstale":"2026-02-23T13:08:06.618780+0000","last_undegraded":"2026-02-23T13:08:06.618780+0000","last_fullsized":"2026-02-23T13:08:06.618780+0000","mapping_epoch":48,"log_start":"56'59361","ondisk_log_start":"56'59361","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'35564","last_scrub_stamp":"2026-02-23T13:07:17.999970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:17.999970+0000","objects_scrubbed":35002,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:36.421460+0000","scrub_duration":3089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1693319168,"num_objects":25838,"num_object_clones":0,"num_object_copies":77514,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25838,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59364,"num_write_kb":2726464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"56'60112","reported_seq":60481,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:06.719708+0000","last_change":"2026-02-23T13:07:13.026486+0000","last_active":"2026-02-23T13:08:06.719708+0000","last_peered":"2026-02-23T13:08:06.719708+0000","last_clean":"2026-02-23T13:08:06.719708+0000","last_became_active":"2026-02-23T13:06:03.766997+0000","last_became_peered":"2026-02-23T13:06:03.766997+0000","last_unstale":"2026-02-23T13:08:06.719708+0000","last_undegraded":"2026-02-23T13:08:06.719708+0000","last_fullsized":"2026-02-23T13:08:06.719708+0000","mapping_epoch":48,"log_start":"56'60109","ondisk_log_start":"56'60109","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'33950","last_scrub_stamp":"2026-02-23T13:07:13.026390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:13.026390+0000","objects_scrubbed":33091,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:30.336827+0000","scrub_duration":3912,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1698430976,"num_objects":25916,"num_object_clones":0,"num_object_copies":77748,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25916,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60112,"num_write_kb":2752896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"56'60151","reported_seq":60614,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:06.724646+0000","last_change":"2026-02-23T13:07:38.263276+0000","last_active":"2026-02-23T13:08:06.724646+0000","last_peered":"2026-02-23T13:08:06.724646+0000","last_clean":"2026-02-23T13:08:06.724646+0000","last_became_active":"2026-02-23T13:06:03.767015+0000","last_became_peered":"2026-02-23T13:06:03.767015+0000","last_unstale":"2026-02-23T13:08:06.724646+0000","last_undegraded":"2026-02-23T13:08:06.724646+0000","last_fullsized":"2026-02-23T13:08:06.724646+0000","mapping_epoch":48,"log_start":"56'60148","ondisk_log_start":"56'60148","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'44630","last_scrub_stamp":"2026-02-23T13:07:38.263188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:38.263188+0000","objects_scrubbed":42478,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:53.250163+0000","scrub_duration":5027,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1709375488,"num_objects":26083,"num_object_clones":0,"num_object_copies":78249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26083,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60151,"num_write_kb":2759488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":274,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:07:56.312851+0000","last_change":"2026-02-23T13:07:56.312851+0000","last_active":"2026-02-23T13:07:56.312851+0000","last_peered":"2026-02-23T13:07:56.312851+0000","last_clean":"2026-02-23T13:07:56.312851+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:07:56.312851+0000","last_undegraded":"2026-02-23T13:07:56.312851+0000","last_fullsized":"2026-02-23T13:07:56.312851+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:07:56.312801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:07:56.312801+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:14.345117+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":27319664664,"num_objects":416866,"num_object_clones":0,"num_object_copies":1250598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":416866,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":957360,"num_write_kb":43975169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":81986072576,"data_stored":81986060360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2256,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247872,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":18201560,"kb_used_data":16850756,"kb_used_omap":10,"kb_used_meta":1350709,"kb_avail":715801640,"statfs":{"total":751619276800,"available":732980879360,"internally_reserved":0,"allocated":17255174144,"data_stored":17254791607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10844,"internal_metadata":1383126436},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444099,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":24731800,"kb_used_data":23860740,"kb_used_omap":10,"kb_used_meta":870901,"kb_avail":709271400,"statfs":{"total":751619276800,"available":726293913600,"internally_reserved":0,"allocated":24433397760,"data_stored":24433015223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10584,"internal_metadata":891803304},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":19650384,"kb_used_data":18420988,"kb_used_omap":11,"kb_used_meta":1229300,"kb_avail":714352816,"statfs":{"total":751619276800,"available":731497283584,"internally_reserved":0,"allocated":18863091712,"data_stored":18862716799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11912,"internal_metadata":1258803576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705734,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":23371736,"kb_used_data":22055300,"kb_used_omap":9,"kb_used_meta":1316342,"kb_avail":710631464,"statfs":{"total":751619276800,"available":727686619136,"internally_reserved":0,"allocated":22584627200,"data_stored":22584244663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9386,"internal_metadata":1347935062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2256,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":22209105920,"data_stored":22209101848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":18728550400,"data_stored":18728550400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23943188480,"data_stored":23943184408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17105227776,"data_stored":17105223704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:08:11.236 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:08:11.237 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_1 pg_num 76 2026-02-23T13:08:11.381 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:11.398 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:08:11.505 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:11.504+0000 7f4766a7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:11.505 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:11.504+0000 7f4766a7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:11.554 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:11.651 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:08:11.682 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:11.680+0000 7f8910df7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:11.682 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:11.681+0000 7f8910df7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:11.692 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:08:11.696 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:08:11.696 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:08:11.710 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:08:11.710 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:08:11.723 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:08:11.723 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:08:11.735 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:08:11.736 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:08:11.936 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:11 trial046 ceph-mon[38575]: pgmap v187: 17 pgs: 17 active+clean; 25 GiB data, 82 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 7.42k op/s 2026-02-23T13:08:11.936 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:11 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1264875888' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_1", "var": "pg_num", "val": "76"} : dispatch 2026-02-23T13:08:11.936 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:11 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1799597304' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:08:13.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:12 trial046 ceph-mon[38575]: from='client.14815 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:08:13.784 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:08:13.923 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:14.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:13 trial046 ceph-mon[38575]: pgmap v188: 17 pgs: 17 active+clean; 23 GiB data, 73 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 11.39k op/s 2026-02-23T13:08:14.276 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:14.274+0000 7f06055ba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:14.276 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:14.275+0000 7f06055ba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:14.294 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:08:14.294 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:08:14.311 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:08:14.311 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:08:14.327 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:08:14.328 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:08:14.340 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:08:14.340 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:08:15.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:14 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/320030406' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:08:16.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:15 trial046 ceph-mon[38575]: pgmap v189: 17 pgs: 17 active+clean; 23 GiB data, 73 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 7.72k op/s 2026-02-23T13:08:16.385 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:08:16.411 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:08:16 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:08:16] "GET /metrics HTTP/1.1" 200 4225 "" "Prometheus/3.6.0" 2026-02-23T13:08:16.469 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:08:16 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:08:16.087Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:08:16.529 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:16.662 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:16.659+0000 7f066ae6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:16.662 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:16.660+0000 7f066ae6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:16.676 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:08:16.677 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:08:16.689 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:08:16.689 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:08:16.693 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:08:16.693 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:08:16.694 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:08:16.703 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:08:16.704 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:08:16.718 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:08:16.718 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:08:16.845 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:16.912 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:16 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:08:16.913 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:16 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1897121156' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:08:16.967 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:16.965+0000 7eff2b683640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:16.967 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:16.965+0000 7eff2b683640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:17.115 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:08:17.115 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:08:17.162 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":190,"stamp":"2026-02-23T13:08:16.632092+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23051174456,"num_objects":351727,"num_object_clones":0,"num_object_copies":1055181,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":351727,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":1022636,"num_write_kb":43977319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":72156312,"kb_used_data":66956936,"kb_used_omap":41,"kb_used_meta":5199190,"kb_avail":2863856488,"statfs":{"total":3006477107200,"available":2932589043712,"internally_reserved":0,"allocated":68563902464,"data_stored":68562379940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42726,"internal_metadata":5323970842},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7219183616,"num_objects":-110156,"num_object_clones":0,"num_object_copies":-330468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-110156,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110156,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001529"},"pg_stats":[{"pgid":"3.f","version":"56'66155","reported_seq":66503,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:16.619717+0000","last_change":"2026-02-23T13:07:08.188933+0000","last_active":"2026-02-23T13:08:16.619717+0000","last_peered":"2026-02-23T13:08:16.619717+0000","last_clean":"2026-02-23T13:08:16.619717+0000","last_became_active":"2026-02-23T13:06:03.767261+0000","last_became_peered":"2026-02-23T13:06:03.767261+0000","last_unstale":"2026-02-23T13:08:16.619717+0000","last_undegraded":"2026-02-23T13:08:16.619717+0000","last_fullsized":"2026-02-23T13:08:16.619717+0000","mapping_epoch":48,"log_start":"56'66152","ondisk_log_start":"56'66152","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'31889","last_scrub_stamp":"2026-02-23T13:07:08.188897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:08.188897+0000","objects_scrubbed":31058,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:29.284171+0000","scrub_duration":3362,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1333329920,"num_objects":20345,"num_object_clones":0,"num_object_copies":61035,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20345,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66155,"num_write_kb":2768000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"56'65800","reported_seq":66240,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:16.623106+0000","last_change":"2026-02-23T13:07:30.198745+0000","last_active":"2026-02-23T13:08:16.623106+0000","last_peered":"2026-02-23T13:08:16.623106+0000","last_clean":"2026-02-23T13:08:16.623106+0000","last_became_active":"2026-02-23T13:06:03.767822+0000","last_became_peered":"2026-02-23T13:06:03.767822+0000","last_unstale":"2026-02-23T13:08:16.623106+0000","last_undegraded":"2026-02-23T13:08:16.623106+0000","last_fullsized":"2026-02-23T13:08:16.623106+0000","mapping_epoch":48,"log_start":"56'65797","ondisk_log_start":"56'65797","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41040","last_scrub_stamp":"2026-02-23T13:07:30.198713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:30.198713+0000","objects_scrubbed":40305,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:38.570153+0000","scrub_duration":4501,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1322778624,"num_objects":20184,"num_object_clones":0,"num_object_copies":60552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20184,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65800,"num_write_kb":2751488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"56'63022","reported_seq":63466,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:11.632328+0000","last_change":"2026-02-23T13:07:30.466390+0000","last_active":"2026-02-23T13:08:11.632328+0000","last_peered":"2026-02-23T13:08:11.632328+0000","last_clean":"2026-02-23T13:08:11.632328+0000","last_became_active":"2026-02-23T13:06:03.768946+0000","last_became_peered":"2026-02-23T13:06:03.768946+0000","last_unstale":"2026-02-23T13:08:11.632328+0000","last_undegraded":"2026-02-23T13:08:11.632328+0000","last_fullsized":"2026-02-23T13:08:11.632328+0000","mapping_epoch":48,"log_start":"56'63018","ondisk_log_start":"56'63018","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41169","last_scrub_stamp":"2026-02-23T13:07:30.466346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:30.466346+0000","objects_scrubbed":40719,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:35.646690+0000","scrub_duration":3195,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1517355032,"num_objects":23154,"num_object_clones":0,"num_object_copies":69462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23154,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":63022,"num_write_kb":2757569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"56'62723","reported_seq":63182,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:11.621588+0000","last_change":"2026-02-23T13:07:38.374570+0000","last_active":"2026-02-23T13:08:11.621588+0000","last_peered":"2026-02-23T13:08:11.621588+0000","last_clean":"2026-02-23T13:08:11.621588+0000","last_became_active":"2026-02-23T13:06:03.767083+0000","last_became_peered":"2026-02-23T13:06:03.767083+0000","last_unstale":"2026-02-23T13:08:11.621588+0000","last_undegraded":"2026-02-23T13:08:11.621588+0000","last_fullsized":"2026-02-23T13:08:11.621588+0000","mapping_epoch":48,"log_start":"56'62720","ondisk_log_start":"56'62720","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'44374","last_scrub_stamp":"2026-02-23T13:07:38.374512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:38.374512+0000","objects_scrubbed":42187,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:05.652994+0000","scrub_duration":4032,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1502674944,"num_objects":22929,"num_object_clones":0,"num_object_copies":68787,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22929,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62723,"num_write_kb":2740864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"56'62754","reported_seq":63152,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:11.721061+0000","last_change":"2026-02-23T13:07:20.897120+0000","last_active":"2026-02-23T13:08:11.721061+0000","last_peered":"2026-02-23T13:08:11.721061+0000","last_clean":"2026-02-23T13:08:11.721061+0000","last_became_active":"2026-02-23T13:06:03.766614+0000","last_became_peered":"2026-02-23T13:06:03.766614+0000","last_unstale":"2026-02-23T13:08:11.721061+0000","last_undegraded":"2026-02-23T13:08:11.721061+0000","last_fullsized":"2026-02-23T13:08:11.721061+0000","mapping_epoch":48,"log_start":"56'62751","ondisk_log_start":"56'62751","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'36893","last_scrub_stamp":"2026-02-23T13:07:20.897051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:20.897051+0000","objects_scrubbed":36116,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:37.187224+0000","scrub_duration":3824,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1508507648,"num_objects":23018,"num_object_clones":0,"num_object_copies":69054,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23018,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62754,"num_write_kb":2744704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"56'62498","reported_seq":62902,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:11.630299+0000","last_change":"2026-02-23T13:07:21.878287+0000","last_active":"2026-02-23T13:08:11.630299+0000","last_peered":"2026-02-23T13:08:11.630299+0000","last_clean":"2026-02-23T13:08:11.630299+0000","last_became_active":"2026-02-23T13:06:03.768238+0000","last_became_peered":"2026-02-23T13:06:03.768238+0000","last_unstale":"2026-02-23T13:08:11.630299+0000","last_undegraded":"2026-02-23T13:08:11.630299+0000","last_fullsized":"2026-02-23T13:08:11.630299+0000","mapping_epoch":48,"log_start":"56'62495","ondisk_log_start":"56'62495","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'37319","last_scrub_stamp":"2026-02-23T13:07:21.878230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:21.878230+0000","objects_scrubbed":36520,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:48.355026+0000","scrub_duration":3562,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1519386624,"num_objects":23184,"num_object_clones":0,"num_object_copies":69552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23184,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62498,"num_write_kb":2741824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"56'62718","reported_seq":63074,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:11.629754+0000","last_change":"2026-02-23T13:07:09.835508+0000","last_active":"2026-02-23T13:08:11.629754+0000","last_peered":"2026-02-23T13:08:11.629754+0000","last_clean":"2026-02-23T13:08:11.629754+0000","last_became_active":"2026-02-23T13:06:03.767947+0000","last_became_peered":"2026-02-23T13:06:03.767947+0000","last_unstale":"2026-02-23T13:08:11.629754+0000","last_undegraded":"2026-02-23T13:08:11.629754+0000","last_fullsized":"2026-02-23T13:08:11.629754+0000","mapping_epoch":48,"log_start":"56'62715","ondisk_log_start":"56'62715","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'32488","last_scrub_stamp":"2026-02-23T13:07:09.835476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:09.835476+0000","objects_scrubbed":31955,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:24.178560+0000","scrub_duration":2500,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1515978752,"num_objects":23132,"num_object_clones":0,"num_object_copies":69396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23132,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62718,"num_write_kb":2747200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"56'62717","reported_seq":63163,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:11.722135+0000","last_change":"2026-02-23T13:07:32.151615+0000","last_active":"2026-02-23T13:08:11.722135+0000","last_peered":"2026-02-23T13:08:11.722135+0000","last_clean":"2026-02-23T13:08:11.722135+0000","last_became_active":"2026-02-23T13:06:03.766859+0000","last_became_peered":"2026-02-23T13:06:03.766859+0000","last_unstale":"2026-02-23T13:08:11.722135+0000","last_undegraded":"2026-02-23T13:08:11.722135+0000","last_fullsized":"2026-02-23T13:08:11.722135+0000","mapping_epoch":48,"log_start":"56'62714","ondisk_log_start":"56'62714","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41546","last_scrub_stamp":"2026-02-23T13:07:32.151562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:32.151562+0000","objects_scrubbed":40710,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:35.090003+0000","scrub_duration":4919,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1508179968,"num_objects":23013,"num_object_clones":0,"num_object_copies":69039,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23013,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62717,"num_write_kb":2743360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"56'62727","reported_seq":63115,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:11.726271+0000","last_change":"2026-02-23T13:07:18.015015+0000","last_active":"2026-02-23T13:08:11.726271+0000","last_peered":"2026-02-23T13:08:11.726271+0000","last_clean":"2026-02-23T13:08:11.726271+0000","last_became_active":"2026-02-23T13:06:03.765502+0000","last_became_peered":"2026-02-23T13:06:03.765502+0000","last_unstale":"2026-02-23T13:08:11.726271+0000","last_undegraded":"2026-02-23T13:08:11.726271+0000","last_fullsized":"2026-02-23T13:08:11.726271+0000","mapping_epoch":48,"log_start":"56'62724","ondisk_log_start":"56'62724","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'35769","last_scrub_stamp":"2026-02-23T13:07:18.014937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:18.014937+0000","objects_scrubbed":35059,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:23.289493+0000","scrub_duration":3913,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1506213888,"num_objects":22983,"num_object_clones":0,"num_object_copies":68949,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22983,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62727,"num_write_kb":2742720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"56'65973","reported_seq":66413,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:16.620078+0000","last_change":"2026-02-23T13:07:29.741974+0000","last_active":"2026-02-23T13:08:16.620078+0000","last_peered":"2026-02-23T13:08:16.620078+0000","last_clean":"2026-02-23T13:08:16.620078+0000","last_became_active":"2026-02-23T13:06:03.767012+0000","last_became_peered":"2026-02-23T13:06:03.767012+0000","last_unstale":"2026-02-23T13:08:16.620078+0000","last_undegraded":"2026-02-23T13:08:16.620078+0000","last_fullsized":"2026-02-23T13:08:16.620078+0000","mapping_epoch":48,"log_start":"56'65970","ondisk_log_start":"56'65970","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41030","last_scrub_stamp":"2026-02-23T13:07:29.741913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:29.741913+0000","objects_scrubbed":40165,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:39.928525+0000","scrub_duration":4772,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1319567360,"num_objects":20135,"num_object_clones":0,"num_object_copies":60405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20135,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65973,"num_write_kb":2755456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"56'65463","reported_seq":65861,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:16.622748+0000","last_change":"2026-02-23T13:07:20.033733+0000","last_active":"2026-02-23T13:08:16.622748+0000","last_peered":"2026-02-23T13:08:16.622748+0000","last_clean":"2026-02-23T13:08:16.622748+0000","last_became_active":"2026-02-23T13:06:03.767200+0000","last_became_peered":"2026-02-23T13:06:03.767200+0000","last_unstale":"2026-02-23T13:08:16.622748+0000","last_undegraded":"2026-02-23T13:08:16.622748+0000","last_fullsized":"2026-02-23T13:08:16.622748+0000","mapping_epoch":48,"log_start":"56'65460","ondisk_log_start":"56'65460","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'36561","last_scrub_stamp":"2026-02-23T13:07:20.033700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:20.033700+0000","objects_scrubbed":35947,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:44.960748+0000","scrub_duration":3247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1323892736,"num_objects":20201,"num_object_clones":0,"num_object_copies":60603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20201,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65463,"num_write_kb":2741248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"56'63398","reported_seq":63785,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:11.721794+0000","last_change":"2026-02-23T13:07:17.060455+0000","last_active":"2026-02-23T13:08:11.721794+0000","last_peered":"2026-02-23T13:08:11.721794+0000","last_clean":"2026-02-23T13:08:11.721794+0000","last_became_active":"2026-02-23T13:06:03.766415+0000","last_became_peered":"2026-02-23T13:06:03.766415+0000","last_unstale":"2026-02-23T13:08:11.721794+0000","last_undegraded":"2026-02-23T13:08:11.721794+0000","last_fullsized":"2026-02-23T13:08:11.721794+0000","mapping_epoch":48,"log_start":"56'63395","ondisk_log_start":"56'63395","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'35773","last_scrub_stamp":"2026-02-23T13:07:17.060384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:17.060384+0000","objects_scrubbed":34982,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:39.770993+0000","scrub_duration":3962,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1514143744,"num_objects":23104,"num_object_clones":0,"num_object_copies":69312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23104,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63398,"num_write_kb":2768064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"56'65297","reported_seq":65730,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:16.625484+0000","last_change":"2026-02-23T13:07:44.359896+0000","last_active":"2026-02-23T13:08:16.625484+0000","last_peered":"2026-02-23T13:08:16.625484+0000","last_clean":"2026-02-23T13:08:16.625484+0000","last_became_active":"2026-02-23T13:06:03.768541+0000","last_became_peered":"2026-02-23T13:06:03.768541+0000","last_unstale":"2026-02-23T13:08:16.625484+0000","last_undegraded":"2026-02-23T13:08:16.625484+0000","last_fullsized":"2026-02-23T13:08:16.625484+0000","mapping_epoch":48,"log_start":"56'65294","ondisk_log_start":"56'65294","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'47017","last_scrub_stamp":"2026-02-23T13:07:44.359774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:44.359774+0000","objects_scrubbed":39444,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:00.349146+0000","scrub_duration":4516,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1319567360,"num_objects":20135,"num_object_clones":0,"num_object_copies":60405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20135,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65297,"num_write_kb":2733824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"56'65086","reported_seq":65473,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:16.618476+0000","last_change":"2026-02-23T13:07:18.000008+0000","last_active":"2026-02-23T13:08:16.618476+0000","last_peered":"2026-02-23T13:08:16.618476+0000","last_clean":"2026-02-23T13:08:16.618476+0000","last_became_active":"2026-02-23T13:06:03.767001+0000","last_became_peered":"2026-02-23T13:06:03.767001+0000","last_unstale":"2026-02-23T13:08:16.618476+0000","last_undegraded":"2026-02-23T13:08:16.618476+0000","last_fullsized":"2026-02-23T13:08:16.618476+0000","mapping_epoch":48,"log_start":"56'65083","ondisk_log_start":"56'65083","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'35564","last_scrub_stamp":"2026-02-23T13:07:17.999970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:17.999970+0000","objects_scrubbed":35002,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:36.421460+0000","scrub_duration":3089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1318322176,"num_objects":20116,"num_object_clones":0,"num_object_copies":60348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20116,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65086,"num_write_kb":2726464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"56'63091","reported_seq":63460,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:11.725620+0000","last_change":"2026-02-23T13:07:13.026486+0000","last_active":"2026-02-23T13:08:11.725620+0000","last_peered":"2026-02-23T13:08:11.725620+0000","last_clean":"2026-02-23T13:08:11.725620+0000","last_became_active":"2026-02-23T13:06:03.766997+0000","last_became_peered":"2026-02-23T13:06:03.766997+0000","last_unstale":"2026-02-23T13:08:11.725620+0000","last_undegraded":"2026-02-23T13:08:11.725620+0000","last_fullsized":"2026-02-23T13:08:11.725620+0000","mapping_epoch":48,"log_start":"56'63088","ondisk_log_start":"56'63088","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'33950","last_scrub_stamp":"2026-02-23T13:07:13.026390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:13.026390+0000","objects_scrubbed":33091,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:30.336827+0000","scrub_duration":3912,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1503199232,"num_objects":22937,"num_object_clones":0,"num_object_copies":68811,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22937,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63091,"num_write_kb":2752896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"56'63079","reported_seq":63542,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:11.720074+0000","last_change":"2026-02-23T13:07:38.263276+0000","last_active":"2026-02-23T13:08:11.720074+0000","last_peered":"2026-02-23T13:08:11.720074+0000","last_clean":"2026-02-23T13:08:11.720074+0000","last_became_active":"2026-02-23T13:06:03.767015+0000","last_became_peered":"2026-02-23T13:06:03.767015+0000","last_unstale":"2026-02-23T13:08:11.720074+0000","last_undegraded":"2026-02-23T13:08:11.720074+0000","last_fullsized":"2026-02-23T13:08:11.720074+0000","mapping_epoch":48,"log_start":"56'63076","ondisk_log_start":"56'63076","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'44630","last_scrub_stamp":"2026-02-23T13:07:38.263188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:38.263188+0000","objects_scrubbed":42478,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:53.250163+0000","scrub_duration":5027,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1517486080,"num_objects":23155,"num_object_clones":0,"num_object_copies":69465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23155,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63079,"num_write_kb":2759488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":274,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:07:56.312851+0000","last_change":"2026-02-23T13:07:56.312851+0000","last_active":"2026-02-23T13:07:56.312851+0000","last_peered":"2026-02-23T13:07:56.312851+0000","last_clean":"2026-02-23T13:07:56.312851+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:07:56.312851+0000","last_undegraded":"2026-02-23T13:07:56.312851+0000","last_fullsized":"2026-02-23T13:07:56.312851+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:07:56.312801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:07:56.312801+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:14.345117+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":23050584088,"num_objects":351725,"num_object_clones":0,"num_object_copies":1055175,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":351725,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1022501,"num_write_kb":43975169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":67414536192,"data_stored":67414523976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2256,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247873,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":16327896,"kb_used_data":14923012,"kb_used_omap":10,"kb_used_meta":1404853,"kb_avail":717675304,"statfs":{"total":751619276800,"available":734899511296,"internally_reserved":0,"allocated":15281164288,"data_stored":15280781751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10844,"internal_metadata":1438569892},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444101,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":19545240,"kb_used_data":18511812,"kb_used_omap":10,"kb_used_meta":1033333,"kb_avail":714457960,"statfs":{"total":751619276800,"available":731604951040,"internally_reserved":0,"allocated":18956095488,"data_stored":18955712951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10584,"internal_metadata":1058133672},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":17630864,"kb_used_data":16347388,"kb_used_omap":11,"kb_used_meta":1283444,"kb_avail":716372336,"statfs":{"total":751619276800,"available":733565272064,"internally_reserved":0,"allocated":16739725312,"data_stored":16739350399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11912,"internal_metadata":1314247032},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705736,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":18652312,"kb_used_data":17174724,"kb_used_omap":9,"kb_used_meta":1477558,"kb_avail":715350888,"statfs":{"total":751619276800,"available":732519309312,"internally_reserved":0,"allocated":17586917376,"data_stored":17586534839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9386,"internal_metadata":1513020246},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2256,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17161326592,"data_stored":17161322520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16588537856,"data_stored":16588537856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18509008896,"data_stored":18509004824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15155662848,"data_stored":15155658776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:08:18.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:17 trial046 ceph-mon[38575]: pgmap v190: 17 pgs: 17 active+clean; 21 GiB data, 69 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 9.18k op/s 2026-02-23T13:08:18.788 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:08:18.936 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:18.988 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:18 trial046 ceph-mon[38575]: from='client.14825 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:08:19.061 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:19.059+0000 7fafc4e5f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:19.061 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:19.059+0000 7fafc4e5f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:19.075 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:08:19.076 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:08:19.089 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:08:19.090 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:08:19.102 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:08:19.102 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:08:19.116 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:08:19.116 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:08:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:19 trial046 ceph-mon[38575]: pgmap v191: 17 pgs: 17 active+clean; 20 GiB data, 65 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 10.22k op/s 2026-02-23T13:08:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:19 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2278868028' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:08:21.161 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:08:21.300 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:21.662 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:21.659+0000 7fa69ce12640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:21.662 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:21.660+0000 7fa69ce12640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:21.678 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:08:21.678 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:08:21.693 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:08:21.693 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:08:21.708 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:08:21.708 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:08:21.722 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:08:21.722 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:08:21.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:21 trial046 ceph-mon[38575]: pgmap v192: 17 pgs: 17 active+clean; 20 GiB data, 65 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 7.89k op/s 2026-02-23T13:08:21.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:21 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3523209393' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:08:22.165 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:08:22.165 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:08:22.166 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_1 2026-02-23T13:08:22.166 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:08:22.295 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:22.687 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:22.667+0000 7ff41c972640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:22.687 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:22.667+0000 7ff41c972640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:22.810 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:08:22.810 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:08:23.410 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":193,"stamp":"2026-02-23T13:08:22.632875+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":17986421304,"num_objects":274445,"num_object_clones":0,"num_object_copies":823335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":274445,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":1099918,"num_write_kb":43977319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":59254168,"kb_used_data":53711048,"kb_used_omap":41,"kb_used_meta":5542934,"kb_avail":2876758632,"statfs":{"total":3006477107200,"available":2945800839168,"internally_reserved":0,"allocated":55000113152,"data_stored":54998590628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42726,"internal_metadata":5675964698},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-9333833728,"num_objects":-142423,"num_object_clones":0,"num_object_copies":-427269,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-142423,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142423,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001527"},"pg_stats":[{"pgid":"3.f","version":"56'69212","reported_seq":69560,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:21.623242+0000","last_change":"2026-02-23T13:07:08.188933+0000","last_active":"2026-02-23T13:08:21.623242+0000","last_peered":"2026-02-23T13:08:21.623242+0000","last_clean":"2026-02-23T13:08:21.623242+0000","last_became_active":"2026-02-23T13:06:03.767261+0000","last_became_peered":"2026-02-23T13:06:03.767261+0000","last_unstale":"2026-02-23T13:08:21.623242+0000","last_undegraded":"2026-02-23T13:08:21.623242+0000","last_fullsized":"2026-02-23T13:08:21.623242+0000","mapping_epoch":48,"log_start":"56'69209","ondisk_log_start":"56'69209","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'31889","last_scrub_stamp":"2026-02-23T13:07:08.188897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:08.188897+0000","objects_scrubbed":31058,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:29.284171+0000","scrub_duration":3362,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1132986368,"num_objects":17288,"num_object_clones":0,"num_object_copies":51864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17288,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69212,"num_write_kb":2768000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"56'68674","reported_seq":69114,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:21.620634+0000","last_change":"2026-02-23T13:07:30.198745+0000","last_active":"2026-02-23T13:08:21.620634+0000","last_peered":"2026-02-23T13:08:21.620634+0000","last_clean":"2026-02-23T13:08:21.620634+0000","last_became_active":"2026-02-23T13:06:03.767822+0000","last_became_peered":"2026-02-23T13:06:03.767822+0000","last_unstale":"2026-02-23T13:08:21.620634+0000","last_undegraded":"2026-02-23T13:08:21.620634+0000","last_fullsized":"2026-02-23T13:08:21.620634+0000","mapping_epoch":48,"log_start":"56'68671","ondisk_log_start":"56'68671","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41040","last_scrub_stamp":"2026-02-23T13:07:30.198713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:30.198713+0000","objects_scrubbed":40305,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:38.570153+0000","scrub_duration":4501,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134428160,"num_objects":17310,"num_object_clones":0,"num_object_copies":51930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17310,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68674,"num_write_kb":2751488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"56'68997","reported_seq":69443,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:21.625757+0000","last_change":"2026-02-23T13:07:30.466390+0000","last_active":"2026-02-23T13:08:21.625757+0000","last_peered":"2026-02-23T13:08:21.625757+0000","last_clean":"2026-02-23T13:08:21.625757+0000","last_became_active":"2026-02-23T13:06:03.768946+0000","last_became_peered":"2026-02-23T13:06:03.768946+0000","last_unstale":"2026-02-23T13:08:21.625757+0000","last_undegraded":"2026-02-23T13:08:21.625757+0000","last_fullsized":"2026-02-23T13:08:21.625757+0000","mapping_epoch":48,"log_start":"56'68994","ondisk_log_start":"56'68994","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41169","last_scrub_stamp":"2026-02-23T13:07:30.466346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:30.466346+0000","objects_scrubbed":40719,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:35.646690+0000","scrub_duration":3195,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1125777432,"num_objects":17179,"num_object_clones":0,"num_object_copies":51537,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17179,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":68997,"num_write_kb":2757569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"56'68615","reported_seq":69075,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:21.620574+0000","last_change":"2026-02-23T13:07:38.374570+0000","last_active":"2026-02-23T13:08:21.620574+0000","last_peered":"2026-02-23T13:08:21.620574+0000","last_clean":"2026-02-23T13:08:21.620574+0000","last_became_active":"2026-02-23T13:06:03.767083+0000","last_became_peered":"2026-02-23T13:06:03.767083+0000","last_unstale":"2026-02-23T13:08:21.620574+0000","last_undegraded":"2026-02-23T13:08:21.620574+0000","last_fullsized":"2026-02-23T13:08:21.620574+0000","mapping_epoch":48,"log_start":"56'68612","ondisk_log_start":"56'68612","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'44374","last_scrub_stamp":"2026-02-23T13:07:38.374512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:38.374512+0000","objects_scrubbed":42187,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:05.652994+0000","scrub_duration":4032,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1116536832,"num_objects":17037,"num_object_clones":0,"num_object_copies":51111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17037,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68615,"num_write_kb":2740864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"56'68674","reported_seq":69071,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:21.726171+0000","last_change":"2026-02-23T13:07:20.897120+0000","last_active":"2026-02-23T13:08:21.726171+0000","last_peered":"2026-02-23T13:08:21.726171+0000","last_clean":"2026-02-23T13:08:21.726171+0000","last_became_active":"2026-02-23T13:06:03.766614+0000","last_became_peered":"2026-02-23T13:06:03.766614+0000","last_unstale":"2026-02-23T13:08:21.726171+0000","last_undegraded":"2026-02-23T13:08:21.726171+0000","last_fullsized":"2026-02-23T13:08:21.726171+0000","mapping_epoch":48,"log_start":"56'68671","ondisk_log_start":"56'68671","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'36893","last_scrub_stamp":"2026-02-23T13:07:20.897051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:20.897051+0000","objects_scrubbed":36116,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:37.187224+0000","scrub_duration":3824,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120534528,"num_objects":17098,"num_object_clones":0,"num_object_copies":51294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17098,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68674,"num_write_kb":2744704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"56'68479","reported_seq":68883,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:21.621266+0000","last_change":"2026-02-23T13:07:21.878287+0000","last_active":"2026-02-23T13:08:21.621266+0000","last_peered":"2026-02-23T13:08:21.621266+0000","last_clean":"2026-02-23T13:08:21.621266+0000","last_became_active":"2026-02-23T13:06:03.768238+0000","last_became_peered":"2026-02-23T13:06:03.768238+0000","last_unstale":"2026-02-23T13:08:21.621266+0000","last_undegraded":"2026-02-23T13:08:21.621266+0000","last_fullsized":"2026-02-23T13:08:21.621266+0000","mapping_epoch":48,"log_start":"56'68476","ondisk_log_start":"56'68476","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'37319","last_scrub_stamp":"2026-02-23T13:07:21.878230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:21.878230+0000","objects_scrubbed":36520,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:48.355026+0000","scrub_duration":3562,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1127415808,"num_objects":17203,"num_object_clones":0,"num_object_copies":51609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17203,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68479,"num_write_kb":2741824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"56'68748","reported_seq":69105,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:21.623639+0000","last_change":"2026-02-23T13:07:09.835508+0000","last_active":"2026-02-23T13:08:21.623639+0000","last_peered":"2026-02-23T13:08:21.623639+0000","last_clean":"2026-02-23T13:08:21.623639+0000","last_became_active":"2026-02-23T13:06:03.767947+0000","last_became_peered":"2026-02-23T13:06:03.767947+0000","last_unstale":"2026-02-23T13:08:21.623639+0000","last_undegraded":"2026-02-23T13:08:21.623639+0000","last_fullsized":"2026-02-23T13:08:21.623639+0000","mapping_epoch":48,"log_start":"56'68745","ondisk_log_start":"56'68745","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'32488","last_scrub_stamp":"2026-02-23T13:07:09.835476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:09.835476+0000","objects_scrubbed":31955,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:24.178560+0000","scrub_duration":2500,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120796672,"num_objects":17102,"num_object_clones":0,"num_object_copies":51306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17102,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68748,"num_write_kb":2747200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"56'68565","reported_seq":69011,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:21.728527+0000","last_change":"2026-02-23T13:07:32.151615+0000","last_active":"2026-02-23T13:08:21.728527+0000","last_peered":"2026-02-23T13:08:21.728527+0000","last_clean":"2026-02-23T13:08:21.728527+0000","last_became_active":"2026-02-23T13:06:03.766859+0000","last_became_peered":"2026-02-23T13:06:03.766859+0000","last_unstale":"2026-02-23T13:08:21.728527+0000","last_undegraded":"2026-02-23T13:08:21.728527+0000","last_fullsized":"2026-02-23T13:08:21.728527+0000","mapping_epoch":48,"log_start":"56'68562","ondisk_log_start":"56'68562","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41546","last_scrub_stamp":"2026-02-23T13:07:32.151562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:32.151562+0000","objects_scrubbed":40710,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:35.090003+0000","scrub_duration":4919,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1124925440,"num_objects":17165,"num_object_clones":0,"num_object_copies":51495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17165,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68565,"num_write_kb":2743360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"56'68607","reported_seq":68994,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:21.730790+0000","last_change":"2026-02-23T13:07:18.015015+0000","last_active":"2026-02-23T13:08:21.730790+0000","last_peered":"2026-02-23T13:08:21.730790+0000","last_clean":"2026-02-23T13:08:21.730790+0000","last_became_active":"2026-02-23T13:06:03.765502+0000","last_became_peered":"2026-02-23T13:06:03.765502+0000","last_unstale":"2026-02-23T13:08:21.730790+0000","last_undegraded":"2026-02-23T13:08:21.730790+0000","last_fullsized":"2026-02-23T13:08:21.730790+0000","mapping_epoch":48,"log_start":"56'68604","ondisk_log_start":"56'68604","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'35769","last_scrub_stamp":"2026-02-23T13:07:18.014937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:18.014937+0000","objects_scrubbed":35059,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:23.289493+0000","scrub_duration":3913,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120862208,"num_objects":17103,"num_object_clones":0,"num_object_copies":51309,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68607,"num_write_kb":2742720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"56'68991","reported_seq":69431,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:21.617032+0000","last_change":"2026-02-23T13:07:29.741974+0000","last_active":"2026-02-23T13:08:21.617032+0000","last_peered":"2026-02-23T13:08:21.617032+0000","last_clean":"2026-02-23T13:08:21.617032+0000","last_became_active":"2026-02-23T13:06:03.767012+0000","last_became_peered":"2026-02-23T13:06:03.767012+0000","last_unstale":"2026-02-23T13:08:21.617032+0000","last_undegraded":"2026-02-23T13:08:21.617032+0000","last_fullsized":"2026-02-23T13:08:21.617032+0000","mapping_epoch":48,"log_start":"56'68988","ondisk_log_start":"56'68988","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41030","last_scrub_stamp":"2026-02-23T13:07:29.741913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:29.741913+0000","objects_scrubbed":40165,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:39.928525+0000","scrub_duration":4772,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1121779712,"num_objects":17117,"num_object_clones":0,"num_object_copies":51351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17117,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68991,"num_write_kb":2755456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"56'68487","reported_seq":68885,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:21.623602+0000","last_change":"2026-02-23T13:07:20.033733+0000","last_active":"2026-02-23T13:08:21.623602+0000","last_peered":"2026-02-23T13:08:21.623602+0000","last_clean":"2026-02-23T13:08:21.623602+0000","last_became_active":"2026-02-23T13:06:03.767200+0000","last_became_peered":"2026-02-23T13:06:03.767200+0000","last_unstale":"2026-02-23T13:08:21.623602+0000","last_undegraded":"2026-02-23T13:08:21.623602+0000","last_fullsized":"2026-02-23T13:08:21.623602+0000","mapping_epoch":48,"log_start":"56'68484","ondisk_log_start":"56'68484","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'36561","last_scrub_stamp":"2026-02-23T13:07:20.033700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:20.033700+0000","objects_scrubbed":35947,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:44.960748+0000","scrub_duration":3247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1125711872,"num_objects":17177,"num_object_clones":0,"num_object_copies":51531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17177,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68487,"num_write_kb":2741248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"56'69400","reported_seq":69787,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:21.729805+0000","last_change":"2026-02-23T13:07:17.060455+0000","last_active":"2026-02-23T13:08:21.729805+0000","last_peered":"2026-02-23T13:08:21.729805+0000","last_clean":"2026-02-23T13:08:21.729805+0000","last_became_active":"2026-02-23T13:06:03.766415+0000","last_became_peered":"2026-02-23T13:06:03.766415+0000","last_unstale":"2026-02-23T13:08:21.729805+0000","last_undegraded":"2026-02-23T13:08:21.729805+0000","last_fullsized":"2026-02-23T13:08:21.729805+0000","mapping_epoch":48,"log_start":"56'69397","ondisk_log_start":"56'69397","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'35773","last_scrub_stamp":"2026-02-23T13:07:17.060384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:17.060384+0000","objects_scrubbed":34982,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:39.770993+0000","scrub_duration":3962,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120796672,"num_objects":17102,"num_object_clones":0,"num_object_copies":51306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17102,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69400,"num_write_kb":2768064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"56'68315","reported_seq":68748,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:21.622467+0000","last_change":"2026-02-23T13:07:44.359896+0000","last_active":"2026-02-23T13:08:21.622467+0000","last_peered":"2026-02-23T13:08:21.622467+0000","last_clean":"2026-02-23T13:08:21.622467+0000","last_became_active":"2026-02-23T13:06:03.768541+0000","last_became_peered":"2026-02-23T13:06:03.768541+0000","last_unstale":"2026-02-23T13:08:21.622467+0000","last_undegraded":"2026-02-23T13:08:21.622467+0000","last_fullsized":"2026-02-23T13:08:21.622467+0000","mapping_epoch":48,"log_start":"56'68312","ondisk_log_start":"56'68312","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'47017","last_scrub_stamp":"2026-02-23T13:07:44.359774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:44.359774+0000","objects_scrubbed":39444,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:00.349146+0000","scrub_duration":4516,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1121779712,"num_objects":17117,"num_object_clones":0,"num_object_copies":51351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17117,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68315,"num_write_kb":2733824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"56'68069","reported_seq":68457,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:21.620208+0000","last_change":"2026-02-23T13:07:18.000008+0000","last_active":"2026-02-23T13:08:21.620208+0000","last_peered":"2026-02-23T13:08:21.620208+0000","last_clean":"2026-02-23T13:08:21.620208+0000","last_became_active":"2026-02-23T13:06:03.767001+0000","last_became_peered":"2026-02-23T13:06:03.767001+0000","last_unstale":"2026-02-23T13:08:21.620208+0000","last_undegraded":"2026-02-23T13:08:21.620208+0000","last_fullsized":"2026-02-23T13:08:21.620208+0000","mapping_epoch":48,"log_start":"56'68066","ondisk_log_start":"56'68066","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'35564","last_scrub_stamp":"2026-02-23T13:07:17.999970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:17.999970+0000","objects_scrubbed":35002,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:36.421460+0000","scrub_duration":3089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122828288,"num_objects":17133,"num_object_clones":0,"num_object_copies":51399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17133,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68069,"num_write_kb":2726464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"56'69022","reported_seq":69391,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:21.730652+0000","last_change":"2026-02-23T13:07:13.026486+0000","last_active":"2026-02-23T13:08:21.730652+0000","last_peered":"2026-02-23T13:08:21.730652+0000","last_clean":"2026-02-23T13:08:21.730652+0000","last_became_active":"2026-02-23T13:06:03.766997+0000","last_became_peered":"2026-02-23T13:06:03.766997+0000","last_unstale":"2026-02-23T13:08:21.730652+0000","last_undegraded":"2026-02-23T13:08:21.730652+0000","last_fullsized":"2026-02-23T13:08:21.730652+0000","mapping_epoch":48,"log_start":"56'69019","ondisk_log_start":"56'69019","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'33950","last_scrub_stamp":"2026-02-23T13:07:13.026390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:13.026390+0000","objects_scrubbed":33091,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:30.336827+0000","scrub_duration":3912,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114505216,"num_objects":17006,"num_object_clones":0,"num_object_copies":51018,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17006,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69022,"num_write_kb":2752896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"56'68928","reported_seq":69391,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:21.728662+0000","last_change":"2026-02-23T13:07:38.263276+0000","last_active":"2026-02-23T13:08:21.728662+0000","last_peered":"2026-02-23T13:08:21.728662+0000","last_clean":"2026-02-23T13:08:21.728662+0000","last_became_active":"2026-02-23T13:06:03.767015+0000","last_became_peered":"2026-02-23T13:06:03.767015+0000","last_unstale":"2026-02-23T13:08:21.728662+0000","last_undegraded":"2026-02-23T13:08:21.728662+0000","last_fullsized":"2026-02-23T13:08:21.728662+0000","mapping_epoch":48,"log_start":"56'68925","ondisk_log_start":"56'68925","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'44630","last_scrub_stamp":"2026-02-23T13:07:38.263188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:38.263188+0000","objects_scrubbed":42478,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:53.250163+0000","scrub_duration":5027,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134166016,"num_objects":17306,"num_object_clones":0,"num_object_copies":51918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17306,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68928,"num_write_kb":2759488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":274,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:07:56.312851+0000","last_change":"2026-02-23T13:07:56.312851+0000","last_active":"2026-02-23T13:07:56.312851+0000","last_peered":"2026-02-23T13:07:56.312851+0000","last_clean":"2026-02-23T13:07:56.312851+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:07:56.312851+0000","last_undegraded":"2026-02-23T13:07:56.312851+0000","last_fullsized":"2026-02-23T13:07:56.312851+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:07:56.312801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:07:56.312801+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:14.345117+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":17985830936,"num_objects":274443,"num_object_clones":0,"num_object_copies":823329,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":274443,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1099783,"num_write_kb":43975169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53975396352,"data_stored":53975384136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2256,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247875,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":12627288,"kb_used_data":11114436,"kb_used_omap":10,"kb_used_meta":1512757,"kb_avail":721375912,"statfs":{"total":751619276800,"available":738688933888,"internally_reserved":0,"allocated":11381182464,"data_stored":11380799927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10844,"internal_metadata":1549063588},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444102,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":16901272,"kb_used_data":15795716,"kb_used_omap":10,"kb_used_meta":1105525,"kb_avail":717101928,"statfs":{"total":751619276800,"available":734312374272,"internally_reserved":0,"allocated":16174813184,"data_stored":16174430647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10584,"internal_metadata":1132058280},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":13565776,"kb_used_data":12174012,"kb_used_omap":11,"kb_used_meta":1391732,"kb_avail":720437424,"statfs":{"total":751619276800,"available":737727922176,"internally_reserved":0,"allocated":12466188288,"data_stored":12465813375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11912,"internal_metadata":1425133944},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705737,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":16159832,"kb_used_data":14626884,"kb_used_omap":9,"kb_used_meta":1532918,"kb_avail":717843368,"statfs":{"total":751619276800,"available":735071608832,"internally_reserved":0,"allocated":14977929216,"data_stored":14977546679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9386,"internal_metadata":1569708886},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2256,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14605225984,"data_stored":14605221912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12343574528,"data_stored":12343574528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15760953344,"data_stored":15760949272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11265642496,"data_stored":11265638424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:08:23.412 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:08:23.413 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_1 pg_num 86 2026-02-23T13:08:23.562 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:23.959 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:23 trial046 ceph-mon[38575]: pgmap v193: 17 pgs: 17 active+clean; 17 GiB data, 57 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 11.87k op/s 2026-02-23T13:08:23.959 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:23 trial046 ceph-mon[38575]: from='client.14831 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:08:24.009 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:23.956+0000 7f2e83198640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:24.009 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:23.957+0000 7f2e83198640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:24.114 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:08:24.316 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:08:24.570 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:24.649 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:08:24.802 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:24.799+0000 7f470daad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:24.802 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:24.800+0000 7f470daad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:24.818 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:08:24.818 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:08:24.835 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:08:24.835 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:08:24.848 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:08:24.849 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:08:24.862 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:08:24.863 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:08:24.894 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:24 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3978275612' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_1", "var": "pg_num", "val": "86"} : dispatch 2026-02-23T13:08:24.894 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:24 trial046 ceph-mon[38575]: 3.7 scrub starts 2026-02-23T13:08:26.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:25 trial046 ceph-mon[38575]: pgmap v194: 17 pgs: 17 active+clean; 17 GiB data, 57 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 7.90k op/s 2026-02-23T13:08:26.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:25 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3457151503' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:08:26.539 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:08:26 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:08:26] "GET /metrics HTTP/1.1" 200 4225 "" "Prometheus/3.6.0" 2026-02-23T13:08:26.561 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:08:26 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:08:26.085Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:08:26.931 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:08:27.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:26 trial046 ceph-mon[38575]: 3.9 scrub starts 2026-02-23T13:08:27.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:26 trial046 ceph-mon[38575]: 3.7 scrub ok 2026-02-23T13:08:27.078 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:27.491 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:27.467+0000 7f1d27c66640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:27.491 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:27.467+0000 7f1d27c66640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:27.492 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:08:27.492 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:08:27.497 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:08:27.497 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:08:27.510 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:08:27.511 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:08:27.524 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:08:27.524 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:08:28.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:27 trial046 ceph-mon[38575]: pgmap v195: 17 pgs: 17 active+clean; 16 GiB data, 53 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 9.05k op/s 2026-02-23T13:08:28.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:27 trial046 ceph-mon[38575]: 3.9 scrub ok 2026-02-23T13:08:28.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:27 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3543097272' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:08:29.569 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:08:29.650 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:08:29.650 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:08:29.651 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_1 2026-02-23T13:08:29.651 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:08:29.714 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:29.796 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:29.844 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:29.842+0000 7fabab6a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:29.845 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:29.842+0000 7fabab6a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:29.845 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:29 trial046 ceph-mon[38575]: pgmap v196: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 15 GiB data, 50 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 9.51k op/s 2026-02-23T13:08:29.859 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:08:29.860 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:08:29.873 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:08:29.874 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:08:29.889 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:08:29.889 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:08:29.902 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:08:29.902 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:08:29.926 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:29.924+0000 7f3948df6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:29.926 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:29.924+0000 7f3948df6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:30.067 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:08:30.068 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:08:30.116 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":196,"stamp":"2026-02-23T13:08:28.633693+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":15570829880,"num_objects":237586,"num_object_clones":0,"num_object_copies":712758,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":237586,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":1136777,"num_write_kb":43977319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53,"ondisk_log_size":53,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":52376984,"kb_used_data":46635208,"kb_used_omap":41,"kb_used_meta":5741526,"kb_avail":2883635816,"statfs":{"total":3006477107200,"available":2952843075584,"internally_reserved":0,"allocated":47754452992,"data_stored":47752930468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42903,"internal_metadata":5879322729},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,1,0,3,1,17],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7480344576,"num_objects":-114141,"num_object_clones":0,"num_object_copies":-342423,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-114141,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114141,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001600"},"pg_stats":[{"pgid":"3.f","version":"56'71473","reported_seq":71821,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:26.625588+0000","last_change":"2026-02-23T13:07:08.188933+0000","last_active":"2026-02-23T13:08:26.625588+0000","last_peered":"2026-02-23T13:08:26.625588+0000","last_clean":"2026-02-23T13:08:26.625588+0000","last_became_active":"2026-02-23T13:06:03.767261+0000","last_became_peered":"2026-02-23T13:06:03.767261+0000","last_unstale":"2026-02-23T13:08:26.625588+0000","last_undegraded":"2026-02-23T13:08:26.625588+0000","last_fullsized":"2026-02-23T13:08:26.625588+0000","mapping_epoch":48,"log_start":"56'71470","ondisk_log_start":"56'71470","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'31889","last_scrub_stamp":"2026-02-23T13:07:08.188897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:08.188897+0000","objects_scrubbed":31058,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:29.284171+0000","scrub_duration":3362,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":984809472,"num_objects":15027,"num_object_clones":0,"num_object_copies":45081,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15027,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71473,"num_write_kb":2768000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"56'70990","reported_seq":71430,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:26.626773+0000","last_change":"2026-02-23T13:07:30.198745+0000","last_active":"2026-02-23T13:08:26.626773+0000","last_peered":"2026-02-23T13:08:26.626773+0000","last_clean":"2026-02-23T13:08:26.626773+0000","last_became_active":"2026-02-23T13:06:03.767822+0000","last_became_peered":"2026-02-23T13:06:03.767822+0000","last_unstale":"2026-02-23T13:08:26.626773+0000","last_undegraded":"2026-02-23T13:08:26.626773+0000","last_fullsized":"2026-02-23T13:08:26.626773+0000","mapping_epoch":48,"log_start":"56'70987","ondisk_log_start":"56'70987","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41040","last_scrub_stamp":"2026-02-23T13:07:30.198713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:30.198713+0000","objects_scrubbed":40305,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:38.570153+0000","scrub_duration":4501,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":982646784,"num_objects":14994,"num_object_clones":0,"num_object_copies":44982,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14994,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70990,"num_write_kb":2751488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"56'71225","reported_seq":71671,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:26.629992+0000","last_change":"2026-02-23T13:07:30.466390+0000","last_active":"2026-02-23T13:08:26.629992+0000","last_peered":"2026-02-23T13:08:26.629992+0000","last_clean":"2026-02-23T13:08:26.629992+0000","last_became_active":"2026-02-23T13:06:03.768946+0000","last_became_peered":"2026-02-23T13:06:03.768946+0000","last_unstale":"2026-02-23T13:08:26.629992+0000","last_undegraded":"2026-02-23T13:08:26.629992+0000","last_fullsized":"2026-02-23T13:08:26.629992+0000","mapping_epoch":48,"log_start":"56'71222","ondisk_log_start":"56'71222","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41169","last_scrub_stamp":"2026-02-23T13:07:30.466346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:30.466346+0000","objects_scrubbed":40719,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:35.646690+0000","scrub_duration":3195,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979763224,"num_objects":14951,"num_object_clones":0,"num_object_copies":44853,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14951,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":71225,"num_write_kb":2757569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"56'70977","reported_seq":71437,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:26.626782+0000","last_change":"2026-02-23T13:07:38.374570+0000","last_active":"2026-02-23T13:08:26.626782+0000","last_peered":"2026-02-23T13:08:26.626782+0000","last_clean":"2026-02-23T13:08:26.626782+0000","last_became_active":"2026-02-23T13:06:03.767083+0000","last_became_peered":"2026-02-23T13:06:03.767083+0000","last_unstale":"2026-02-23T13:08:26.626782+0000","last_undegraded":"2026-02-23T13:08:26.626782+0000","last_fullsized":"2026-02-23T13:08:26.626782+0000","mapping_epoch":48,"log_start":"56'70974","ondisk_log_start":"56'70974","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'44374","last_scrub_stamp":"2026-02-23T13:07:38.374512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:38.374512+0000","objects_scrubbed":42187,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:05.652994+0000","scrub_duration":4032,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":961740800,"num_objects":14675,"num_object_clones":0,"num_object_copies":44025,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14675,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70977,"num_write_kb":2740864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"56'70956","reported_seq":71355,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:26.721908+0000","last_change":"2026-02-23T13:07:20.897120+0000","last_active":"2026-02-23T13:08:26.721908+0000","last_peered":"2026-02-23T13:08:26.721908+0000","last_clean":"2026-02-23T13:08:26.721908+0000","last_became_active":"2026-02-23T13:06:03.766614+0000","last_became_peered":"2026-02-23T13:06:03.766614+0000","last_unstale":"2026-02-23T13:08:26.721908+0000","last_undegraded":"2026-02-23T13:08:26.721908+0000","last_fullsized":"2026-02-23T13:08:26.721908+0000","mapping_epoch":48,"log_start":"56'70953","ondisk_log_start":"56'70953","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'36893","last_scrub_stamp":"2026-02-23T13:07:20.897051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:20.897051+0000","objects_scrubbed":36116,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:37.187224+0000","scrub_duration":3824,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":970981376,"num_objects":14816,"num_object_clones":0,"num_object_copies":44448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14816,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70956,"num_write_kb":2744704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"56'70788","reported_seq":71189,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:26.629142+0000","last_change":"2026-02-23T13:07:21.878287+0000","last_active":"2026-02-23T13:08:26.629142+0000","last_peered":"2026-02-23T13:08:26.629142+0000","last_clean":"2026-02-23T13:08:26.629142+0000","last_became_active":"2026-02-23T13:06:03.768238+0000","last_became_peered":"2026-02-23T13:06:03.768238+0000","last_unstale":"2026-02-23T13:08:26.629142+0000","last_undegraded":"2026-02-23T13:08:26.629142+0000","last_fullsized":"2026-02-23T13:08:26.629142+0000","mapping_epoch":48,"log_start":"56'70784","ondisk_log_start":"56'70784","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'37319","last_scrub_stamp":"2026-02-23T13:07:21.878230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:21.878230+0000","objects_scrubbed":36520,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:48.355026+0000","scrub_duration":3562,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":976093184,"num_objects":14894,"num_object_clones":0,"num_object_copies":44682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14894,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70788,"num_write_kb":2741824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"56'71062","reported_seq":71545,"reported_epoch":56,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:08:26.626336+0000","last_change":"2026-02-23T13:08:25.372416+0000","last_active":"2026-02-23T13:08:26.626336+0000","last_peered":"2026-02-23T13:08:26.626336+0000","last_clean":"2026-02-23T13:08:26.626336+0000","last_became_active":"2026-02-23T13:06:03.767947+0000","last_became_peered":"2026-02-23T13:06:03.767947+0000","last_unstale":"2026-02-23T13:08:26.626336+0000","last_undegraded":"2026-02-23T13:08:26.626336+0000","last_fullsized":"2026-02-23T13:08:26.626336+0000","mapping_epoch":48,"log_start":"56'71059","ondisk_log_start":"56'71059","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'32488","last_scrub_stamp":"2026-02-23T13:07:09.835476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:09.835476+0000","objects_scrubbed":12049,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"scrubbing for 2s","scrub_duration":2500,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":969146368,"num_objects":14788,"num_object_clones":0,"num_object_copies":44364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14788,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71062,"num_write_kb":2747200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"56'70797","reported_seq":71243,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:26.722894+0000","last_change":"2026-02-23T13:07:32.151615+0000","last_active":"2026-02-23T13:08:26.722894+0000","last_peered":"2026-02-23T13:08:26.722894+0000","last_clean":"2026-02-23T13:08:26.722894+0000","last_became_active":"2026-02-23T13:06:03.766859+0000","last_became_peered":"2026-02-23T13:06:03.766859+0000","last_unstale":"2026-02-23T13:08:26.722894+0000","last_undegraded":"2026-02-23T13:08:26.722894+0000","last_fullsized":"2026-02-23T13:08:26.722894+0000","mapping_epoch":48,"log_start":"56'70794","ondisk_log_start":"56'70794","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41546","last_scrub_stamp":"2026-02-23T13:07:32.151562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:32.151562+0000","objects_scrubbed":40710,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:35.090003+0000","scrub_duration":4919,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978649088,"num_objects":14933,"num_object_clones":0,"num_object_copies":44799,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14933,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70797,"num_write_kb":2743360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"56'70915","reported_seq":71470,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:26.726572+0000","last_change":"2026-02-23T13:08:26.463514+0000","last_active":"2026-02-23T13:08:26.726572+0000","last_peered":"2026-02-23T13:08:26.726572+0000","last_clean":"2026-02-23T13:08:26.726572+0000","last_became_active":"2026-02-23T13:06:03.765502+0000","last_became_peered":"2026-02-23T13:06:03.765502+0000","last_unstale":"2026-02-23T13:08:26.726572+0000","last_undegraded":"2026-02-23T13:08:26.726572+0000","last_fullsized":"2026-02-23T13:08:26.726572+0000","mapping_epoch":48,"log_start":"56'70912","ondisk_log_start":"56'70912","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'70782","last_scrub_stamp":"2026-02-23T13:08:26.463431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:26.463431+0000","objects_scrubbed":15411,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:34.767761+0000","scrub_duration":2162,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":969605120,"num_objects":14795,"num_object_clones":0,"num_object_copies":44385,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14795,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70915,"num_write_kb":2742720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"56'71302","reported_seq":71742,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:26.617446+0000","last_change":"2026-02-23T13:07:29.741974+0000","last_active":"2026-02-23T13:08:26.617446+0000","last_peered":"2026-02-23T13:08:26.617446+0000","last_clean":"2026-02-23T13:08:26.617446+0000","last_became_active":"2026-02-23T13:06:03.767012+0000","last_became_peered":"2026-02-23T13:06:03.767012+0000","last_unstale":"2026-02-23T13:08:26.617446+0000","last_undegraded":"2026-02-23T13:08:26.617446+0000","last_fullsized":"2026-02-23T13:08:26.617446+0000","mapping_epoch":48,"log_start":"56'71299","ondisk_log_start":"56'71299","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41030","last_scrub_stamp":"2026-02-23T13:07:29.741913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:29.741913+0000","objects_scrubbed":40165,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:39.928525+0000","scrub_duration":4772,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":970326016,"num_objects":14806,"num_object_clones":0,"num_object_copies":44418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14806,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71302,"num_write_kb":2755456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"56'70820","reported_seq":71218,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:26.616561+0000","last_change":"2026-02-23T13:07:20.033733+0000","last_active":"2026-02-23T13:08:26.616561+0000","last_peered":"2026-02-23T13:08:26.616561+0000","last_clean":"2026-02-23T13:08:26.616561+0000","last_became_active":"2026-02-23T13:06:03.767200+0000","last_became_peered":"2026-02-23T13:06:03.767200+0000","last_unstale":"2026-02-23T13:08:26.616561+0000","last_undegraded":"2026-02-23T13:08:26.616561+0000","last_fullsized":"2026-02-23T13:08:26.616561+0000","mapping_epoch":48,"log_start":"56'70817","ondisk_log_start":"56'70817","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'36561","last_scrub_stamp":"2026-02-23T13:07:20.033700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:20.033700+0000","objects_scrubbed":35947,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:44.960748+0000","scrub_duration":3247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":972816384,"num_objects":14844,"num_object_clones":0,"num_object_copies":44532,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14844,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70820,"num_write_kb":2741248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"56'71755","reported_seq":72142,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:26.729996+0000","last_change":"2026-02-23T13:07:17.060455+0000","last_active":"2026-02-23T13:08:26.729996+0000","last_peered":"2026-02-23T13:08:26.729996+0000","last_clean":"2026-02-23T13:08:26.729996+0000","last_became_active":"2026-02-23T13:06:03.766415+0000","last_became_peered":"2026-02-23T13:06:03.766415+0000","last_unstale":"2026-02-23T13:08:26.729996+0000","last_undegraded":"2026-02-23T13:08:26.729996+0000","last_fullsized":"2026-02-23T13:08:26.729996+0000","mapping_epoch":48,"log_start":"56'71752","ondisk_log_start":"56'71752","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'35773","last_scrub_stamp":"2026-02-23T13:07:17.060384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:17.060384+0000","objects_scrubbed":34982,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:39.770993+0000","scrub_duration":3962,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":966459392,"num_objects":14747,"num_object_clones":0,"num_object_copies":44241,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14747,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71755,"num_write_kb":2768064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"56'70575","reported_seq":71008,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:26.625419+0000","last_change":"2026-02-23T13:07:44.359896+0000","last_active":"2026-02-23T13:08:26.625419+0000","last_peered":"2026-02-23T13:08:26.625419+0000","last_clean":"2026-02-23T13:08:26.625419+0000","last_became_active":"2026-02-23T13:06:03.768541+0000","last_became_peered":"2026-02-23T13:06:03.768541+0000","last_unstale":"2026-02-23T13:08:26.625419+0000","last_undegraded":"2026-02-23T13:08:26.625419+0000","last_fullsized":"2026-02-23T13:08:26.625419+0000","mapping_epoch":48,"log_start":"56'70572","ondisk_log_start":"56'70572","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'47017","last_scrub_stamp":"2026-02-23T13:07:44.359774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:44.359774+0000","objects_scrubbed":39444,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:00.349146+0000","scrub_duration":4516,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":973668352,"num_objects":14857,"num_object_clones":0,"num_object_copies":44571,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14857,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70575,"num_write_kb":2733824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"56'70411","reported_seq":70799,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:26.616930+0000","last_change":"2026-02-23T13:07:18.000008+0000","last_active":"2026-02-23T13:08:26.616930+0000","last_peered":"2026-02-23T13:08:26.616930+0000","last_clean":"2026-02-23T13:08:26.616930+0000","last_became_active":"2026-02-23T13:06:03.767001+0000","last_became_peered":"2026-02-23T13:06:03.767001+0000","last_unstale":"2026-02-23T13:08:26.616930+0000","last_undegraded":"2026-02-23T13:08:26.616930+0000","last_fullsized":"2026-02-23T13:08:26.616930+0000","mapping_epoch":48,"log_start":"56'70407","ondisk_log_start":"56'70407","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'35564","last_scrub_stamp":"2026-02-23T13:07:17.999970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:17.999970+0000","objects_scrubbed":35002,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:36.421460+0000","scrub_duration":3089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":969342976,"num_objects":14791,"num_object_clones":0,"num_object_copies":44373,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14791,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70411,"num_write_kb":2726464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"56'71337","reported_seq":71706,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:26.729063+0000","last_change":"2026-02-23T13:07:13.026486+0000","last_active":"2026-02-23T13:08:26.729063+0000","last_peered":"2026-02-23T13:08:26.729063+0000","last_clean":"2026-02-23T13:08:26.729063+0000","last_became_active":"2026-02-23T13:06:03.766997+0000","last_became_peered":"2026-02-23T13:06:03.766997+0000","last_unstale":"2026-02-23T13:08:26.729063+0000","last_undegraded":"2026-02-23T13:08:26.729063+0000","last_fullsized":"2026-02-23T13:08:26.729063+0000","mapping_epoch":48,"log_start":"56'71334","ondisk_log_start":"56'71334","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'33950","last_scrub_stamp":"2026-02-23T13:07:13.026390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:13.026390+0000","objects_scrubbed":33091,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:30.336827+0000","scrub_duration":3912,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":962789376,"num_objects":14691,"num_object_clones":0,"num_object_copies":44073,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14691,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71337,"num_write_kb":2752896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"56'71259","reported_seq":71722,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:26.728953+0000","last_change":"2026-02-23T13:07:38.263276+0000","last_active":"2026-02-23T13:08:26.728953+0000","last_peered":"2026-02-23T13:08:26.728953+0000","last_clean":"2026-02-23T13:08:26.728953+0000","last_became_active":"2026-02-23T13:06:03.767015+0000","last_became_peered":"2026-02-23T13:06:03.767015+0000","last_unstale":"2026-02-23T13:08:26.728953+0000","last_undegraded":"2026-02-23T13:08:26.728953+0000","last_fullsized":"2026-02-23T13:08:26.728953+0000","mapping_epoch":48,"log_start":"56'71256","ondisk_log_start":"56'71256","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'44630","last_scrub_stamp":"2026-02-23T13:07:38.263188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:38.263188+0000","objects_scrubbed":42478,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:53.250163+0000","scrub_duration":5027,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981401600,"num_objects":14975,"num_object_clones":0,"num_object_copies":44925,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14975,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71259,"num_write_kb":2759488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":274,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:07:56.312851+0000","last_change":"2026-02-23T13:07:56.312851+0000","last_active":"2026-02-23T13:07:56.312851+0000","last_peered":"2026-02-23T13:07:56.312851+0000","last_clean":"2026-02-23T13:07:56.312851+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:07:56.312851+0000","last_undegraded":"2026-02-23T13:07:56.312851+0000","last_fullsized":"2026-02-23T13:07:56.312851+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:07:56.312801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:07:56.312801+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:14.345117+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":15570239512,"num_objects":237584,"num_object_clones":0,"num_object_copies":712752,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":237584,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1136642,"num_write_kb":43975169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":46736420864,"data_stored":46736408648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3561,"internal_metadata":0},"log_size":50,"ondisk_log_size":50,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1734,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247876,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":11182424,"kb_used_data":9633476,"kb_used_omap":10,"kb_used_meta":1548853,"kb_avail":722820776,"statfs":{"total":751619276800,"available":740168474624,"internally_reserved":0,"allocated":9864679424,"data_stored":9864296887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10928,"internal_metadata":1586025808},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,6],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444103,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":14827672,"kb_used_data":13667972,"kb_used_omap":10,"kb_used_meta":1159669,"kb_avail":719175528,"statfs":{"total":751619276800,"available":736435740672,"internally_reserved":0,"allocated":13996003328,"data_stored":13995620791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10584,"internal_metadata":1187501736},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":12057040,"kb_used_data":10611068,"kb_used_omap":11,"kb_used_meta":1445940,"kb_avail":721946160,"statfs":{"total":751619276800,"available":739272867840,"internally_reserved":0,"allocated":10865733632,"data_stored":10865358719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12005,"internal_metadata":1480642843},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,11],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705738,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":14309848,"kb_used_data":12722692,"kb_used_omap":9,"kb_used_meta":1587062,"kb_avail":719693352,"statfs":{"total":751619276800,"available":736965992448,"internally_reserved":0,"allocated":13028036608,"data_stored":13027654071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9386,"internal_metadata":1625152342},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1734,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12650287104,"data_stored":12650283032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10672930816,"data_stored":10672930816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13656002560,"data_stored":13655998488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9757200384,"data_stored":9757196312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3468,"internal_metadata":0}]}} 2026-02-23T13:08:30.117 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:08:30.117 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_1 pg_num 96 2026-02-23T13:08:30.255 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:30.385 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:30.382+0000 7f0fdfd72640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:30.385 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:30.383+0000 7f0fdfd72640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:30.532 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:08:30.573 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:08:31.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:30 trial046 ceph-mon[38575]: 3.f scrub starts 2026-02-23T13:08:31.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:30 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3612966907' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:08:31.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:30 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3804478063' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_1", "var": "pg_num", "val": "96"} : dispatch 2026-02-23T13:08:31.947 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:08:32.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:31 trial046 ceph-mon[38575]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:08:32.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:31 trial046 ceph-mon[38575]: pgmap v197: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 15 GiB data, 50 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 7.05k op/s 2026-02-23T13:08:32.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:31 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:08:32.093 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:32.212 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:32.209+0000 7f9b18f02640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:32.212 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:32.210+0000 7f9b18f02640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:32.226 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:08:32.226 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:08:32.241 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:08:32.241 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:08:32.254 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:08:32.254 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:08:32.267 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:08:32.268 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:08:33.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:32 trial046 ceph-mon[38575]: 3.f scrub ok 2026-02-23T13:08:33.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:32 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1055859716' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:08:34.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:33 trial046 ceph-mon[38575]: pgmap v198: 17 pgs: 17 active+clean; 12 GiB data, 42 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 10.77k op/s 2026-02-23T13:08:34.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:33 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:08:34.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:33 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:08:34.315 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:08:34.468 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:34.582 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:34.580+0000 7f9caadc2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:34.582 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:34.580+0000 7f9caadc2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:34.597 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:08:34.598 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:08:34.610 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:08:34.611 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:08:34.622 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:08:34.623 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:08:34.635 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:08:34.636 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:08:35.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:34 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/642802990' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:08:35.575 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:08:35.575 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:08:35.576 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:08:35.725 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:35.856 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:35.854+0000 7fbd4db52640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:35.857 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:35 trial046 ceph-mon[38575]: pgmap v199: 17 pgs: 17 active+clean; 12 GiB data, 42 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 6.79k op/s 2026-02-23T13:08:35.857 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:35.855+0000 7fbd4db52640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:36.012 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:08:36.013 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:08:36.058 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2026-02-23T13:08:34.634472+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":12646744632,"num_objects":192968,"num_object_clones":0,"num_object_copies":578904,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192968,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":1181395,"num_write_kb":43977319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":44111448,"kb_used_data":38134984,"kb_used_omap":41,"kb_used_meta":5976150,"kb_avail":2891901352,"statfs":{"total":3006477107200,"available":2961306984448,"internally_reserved":0,"allocated":39050223616,"data_stored":39048701092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42996,"internal_metadata":6119577612},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5339676672,"num_objects":-81477,"num_object_clones":0,"num_object_copies":-244431,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-81477,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81477,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001596"},"pg_stats":[{"pgid":"3.f","version":"56'74272","reported_seq":74758,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:31.626767+0000","last_change":"2026-02-23T13:08:31.492572+0000","last_active":"2026-02-23T13:08:31.626767+0000","last_peered":"2026-02-23T13:08:31.626767+0000","last_clean":"2026-02-23T13:08:31.626767+0000","last_became_active":"2026-02-23T13:06:03.767261+0000","last_became_peered":"2026-02-23T13:06:03.767261+0000","last_unstale":"2026-02-23T13:08:31.626767+0000","last_undegraded":"2026-02-23T13:08:31.626767+0000","last_fullsized":"2026-02-23T13:08:31.626767+0000","mapping_epoch":48,"log_start":"56'74269","ondisk_log_start":"56'74269","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'74185","last_scrub_stamp":"2026-02-23T13:08:31.492489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:31.492489+0000","objects_scrubbed":12779,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:36.828294+0000","scrub_duration":1689,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":801374208,"num_objects":12228,"num_object_clones":0,"num_object_copies":36684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12228,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74272,"num_write_kb":2768000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"56'73838","reported_seq":74278,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:31.621147+0000","last_change":"2026-02-23T13:07:30.198745+0000","last_active":"2026-02-23T13:08:31.621147+0000","last_peered":"2026-02-23T13:08:31.621147+0000","last_clean":"2026-02-23T13:08:31.621147+0000","last_became_active":"2026-02-23T13:06:03.767822+0000","last_became_peered":"2026-02-23T13:06:03.767822+0000","last_unstale":"2026-02-23T13:08:31.621147+0000","last_undegraded":"2026-02-23T13:08:31.621147+0000","last_fullsized":"2026-02-23T13:08:31.621147+0000","mapping_epoch":48,"log_start":"56'73835","ondisk_log_start":"56'73835","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41040","last_scrub_stamp":"2026-02-23T13:07:30.198713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:30.198713+0000","objects_scrubbed":40305,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:38.570153+0000","scrub_duration":4501,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796000256,"num_objects":12146,"num_object_clones":0,"num_object_copies":36438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12146,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73838,"num_write_kb":2751488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"56'74032","reported_seq":74478,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:31.629491+0000","last_change":"2026-02-23T13:07:30.466390+0000","last_active":"2026-02-23T13:08:31.629491+0000","last_peered":"2026-02-23T13:08:31.629491+0000","last_clean":"2026-02-23T13:08:31.629491+0000","last_became_active":"2026-02-23T13:06:03.768946+0000","last_became_peered":"2026-02-23T13:06:03.768946+0000","last_unstale":"2026-02-23T13:08:31.629491+0000","last_undegraded":"2026-02-23T13:08:31.629491+0000","last_fullsized":"2026-02-23T13:08:31.629491+0000","mapping_epoch":48,"log_start":"56'74029","ondisk_log_start":"56'74029","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41169","last_scrub_stamp":"2026-02-23T13:07:30.466346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:30.466346+0000","objects_scrubbed":40719,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:35.646690+0000","scrub_duration":3195,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":795803672,"num_objects":12144,"num_object_clones":0,"num_object_copies":36432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12144,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":74032,"num_write_kb":2757569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"56'73724","reported_seq":74184,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:31.632771+0000","last_change":"2026-02-23T13:07:38.374570+0000","last_active":"2026-02-23T13:08:31.632771+0000","last_peered":"2026-02-23T13:08:31.632771+0000","last_clean":"2026-02-23T13:08:31.632771+0000","last_became_active":"2026-02-23T13:06:03.767083+0000","last_became_peered":"2026-02-23T13:06:03.767083+0000","last_unstale":"2026-02-23T13:08:31.632771+0000","last_undegraded":"2026-02-23T13:08:31.632771+0000","last_fullsized":"2026-02-23T13:08:31.632771+0000","mapping_epoch":48,"log_start":"56'73721","ondisk_log_start":"56'73721","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'44374","last_scrub_stamp":"2026-02-23T13:07:38.374512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:38.374512+0000","objects_scrubbed":42187,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:05.652994+0000","scrub_duration":4032,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":781713408,"num_objects":11928,"num_object_clones":0,"num_object_copies":35784,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11928,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73724,"num_write_kb":2740864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"56'73698","reported_seq":74097,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:31.727384+0000","last_change":"2026-02-23T13:07:20.897120+0000","last_active":"2026-02-23T13:08:31.727384+0000","last_peered":"2026-02-23T13:08:31.727384+0000","last_clean":"2026-02-23T13:08:31.727384+0000","last_became_active":"2026-02-23T13:06:03.766614+0000","last_became_peered":"2026-02-23T13:06:03.766614+0000","last_unstale":"2026-02-23T13:08:31.727384+0000","last_undegraded":"2026-02-23T13:08:31.727384+0000","last_fullsized":"2026-02-23T13:08:31.727384+0000","mapping_epoch":48,"log_start":"56'73695","ondisk_log_start":"56'73695","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'36893","last_scrub_stamp":"2026-02-23T13:07:20.897051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:20.897051+0000","objects_scrubbed":36116,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:37.187224+0000","scrub_duration":3824,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":791281664,"num_objects":12074,"num_object_clones":0,"num_object_copies":36222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12074,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73698,"num_write_kb":2744704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"56'73520","reported_seq":73924,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:31.633696+0000","last_change":"2026-02-23T13:07:21.878287+0000","last_active":"2026-02-23T13:08:31.633696+0000","last_peered":"2026-02-23T13:08:31.633696+0000","last_clean":"2026-02-23T13:08:31.633696+0000","last_became_active":"2026-02-23T13:06:03.768238+0000","last_became_peered":"2026-02-23T13:06:03.768238+0000","last_unstale":"2026-02-23T13:08:31.633696+0000","last_undegraded":"2026-02-23T13:08:31.633696+0000","last_fullsized":"2026-02-23T13:08:31.633696+0000","mapping_epoch":48,"log_start":"56'73517","ondisk_log_start":"56'73517","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'37319","last_scrub_stamp":"2026-02-23T13:07:21.878230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:21.878230+0000","objects_scrubbed":36520,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:48.355026+0000","scrub_duration":3562,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":797048832,"num_objects":12162,"num_object_clones":0,"num_object_copies":36486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12162,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73520,"num_write_kb":2741824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"56'73890","reported_seq":74407,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:31.631462+0000","last_change":"2026-02-23T13:08:26.944478+0000","last_active":"2026-02-23T13:08:31.631462+0000","last_peered":"2026-02-23T13:08:31.631462+0000","last_clean":"2026-02-23T13:08:31.631462+0000","last_became_active":"2026-02-23T13:06:03.767947+0000","last_became_peered":"2026-02-23T13:06:03.767947+0000","last_unstale":"2026-02-23T13:08:31.631462+0000","last_undegraded":"2026-02-23T13:08:31.631462+0000","last_fullsized":"2026-02-23T13:08:31.631462+0000","mapping_epoch":48,"log_start":"56'73887","ondisk_log_start":"56'73887","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'71240","last_scrub_stamp":"2026-02-23T13:08:26.944430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:26.944430+0000","objects_scrubbed":14999,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:28.745863+0000","scrub_duration":1572,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":783810560,"num_objects":11960,"num_object_clones":0,"num_object_copies":35880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11960,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73890,"num_write_kb":2747200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"56'73583","reported_seq":74029,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:31.729980+0000","last_change":"2026-02-23T13:07:32.151615+0000","last_active":"2026-02-23T13:08:31.729980+0000","last_peered":"2026-02-23T13:08:31.729980+0000","last_clean":"2026-02-23T13:08:31.729980+0000","last_became_active":"2026-02-23T13:06:03.766859+0000","last_became_peered":"2026-02-23T13:06:03.766859+0000","last_unstale":"2026-02-23T13:08:31.729980+0000","last_undegraded":"2026-02-23T13:08:31.729980+0000","last_fullsized":"2026-02-23T13:08:31.729980+0000","mapping_epoch":48,"log_start":"56'73580","ondisk_log_start":"56'73580","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41546","last_scrub_stamp":"2026-02-23T13:07:32.151562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:32.151562+0000","objects_scrubbed":40710,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:35.090003+0000","scrub_duration":4919,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796065792,"num_objects":12147,"num_object_clones":0,"num_object_copies":36441,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12147,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73583,"num_write_kb":2743360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"56'73743","reported_seq":74298,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:31.729727+0000","last_change":"2026-02-23T13:08:26.463514+0000","last_active":"2026-02-23T13:08:31.729727+0000","last_peered":"2026-02-23T13:08:31.729727+0000","last_clean":"2026-02-23T13:08:31.729727+0000","last_became_active":"2026-02-23T13:06:03.765502+0000","last_became_peered":"2026-02-23T13:06:03.765502+0000","last_unstale":"2026-02-23T13:08:31.729727+0000","last_undegraded":"2026-02-23T13:08:31.729727+0000","last_fullsized":"2026-02-23T13:08:31.729727+0000","mapping_epoch":48,"log_start":"56'73740","ondisk_log_start":"56'73740","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'70782","last_scrub_stamp":"2026-02-23T13:08:26.463431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:26.463431+0000","objects_scrubbed":15411,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:34.767761+0000","scrub_duration":2162,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":784269312,"num_objects":11967,"num_object_clones":0,"num_object_copies":35901,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11967,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73743,"num_write_kb":2742720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"56'74112","reported_seq":74552,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:31.622178+0000","last_change":"2026-02-23T13:07:29.741974+0000","last_active":"2026-02-23T13:08:31.622178+0000","last_peered":"2026-02-23T13:08:31.622178+0000","last_clean":"2026-02-23T13:08:31.622178+0000","last_became_active":"2026-02-23T13:06:03.767012+0000","last_became_peered":"2026-02-23T13:06:03.767012+0000","last_unstale":"2026-02-23T13:08:31.622178+0000","last_undegraded":"2026-02-23T13:08:31.622178+0000","last_fullsized":"2026-02-23T13:08:31.622178+0000","mapping_epoch":48,"log_start":"56'74109","ondisk_log_start":"56'74109","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41030","last_scrub_stamp":"2026-02-23T13:07:29.741913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:29.741913+0000","objects_scrubbed":40165,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:39.928525+0000","scrub_duration":4772,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786169856,"num_objects":11996,"num_object_clones":0,"num_object_copies":35988,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11996,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74112,"num_write_kb":2755456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"56'73583","reported_seq":73981,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:31.626677+0000","last_change":"2026-02-23T13:07:20.033733+0000","last_active":"2026-02-23T13:08:31.626677+0000","last_peered":"2026-02-23T13:08:31.626677+0000","last_clean":"2026-02-23T13:08:31.626677+0000","last_became_active":"2026-02-23T13:06:03.767200+0000","last_became_peered":"2026-02-23T13:06:03.767200+0000","last_unstale":"2026-02-23T13:08:31.626677+0000","last_undegraded":"2026-02-23T13:08:31.626677+0000","last_fullsized":"2026-02-23T13:08:31.626677+0000","mapping_epoch":48,"log_start":"56'73579","ondisk_log_start":"56'73579","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'36561","last_scrub_stamp":"2026-02-23T13:07:20.033700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:20.033700+0000","objects_scrubbed":35947,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:44.960748+0000","scrub_duration":3247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":791740416,"num_objects":12081,"num_object_clones":0,"num_object_copies":36243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12081,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73583,"num_write_kb":2741248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"56'74510","reported_seq":74897,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:31.732567+0000","last_change":"2026-02-23T13:07:17.060455+0000","last_active":"2026-02-23T13:08:31.732567+0000","last_peered":"2026-02-23T13:08:31.732567+0000","last_clean":"2026-02-23T13:08:31.732567+0000","last_became_active":"2026-02-23T13:06:03.766415+0000","last_became_peered":"2026-02-23T13:06:03.766415+0000","last_unstale":"2026-02-23T13:08:31.732567+0000","last_undegraded":"2026-02-23T13:08:31.732567+0000","last_fullsized":"2026-02-23T13:08:31.732567+0000","mapping_epoch":48,"log_start":"56'74507","ondisk_log_start":"56'74507","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'35773","last_scrub_stamp":"2026-02-23T13:07:17.060384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:17.060384+0000","objects_scrubbed":34982,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:39.770993+0000","scrub_duration":3962,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":785907712,"num_objects":11992,"num_object_clones":0,"num_object_copies":35976,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11992,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74510,"num_write_kb":2768064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"56'73338","reported_seq":73770,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:31.626317+0000","last_change":"2026-02-23T13:07:44.359896+0000","last_active":"2026-02-23T13:08:31.626317+0000","last_peered":"2026-02-23T13:08:31.626317+0000","last_clean":"2026-02-23T13:08:31.626317+0000","last_became_active":"2026-02-23T13:06:03.768541+0000","last_became_peered":"2026-02-23T13:06:03.768541+0000","last_unstale":"2026-02-23T13:08:31.626317+0000","last_undegraded":"2026-02-23T13:08:31.626317+0000","last_fullsized":"2026-02-23T13:08:31.626317+0000","mapping_epoch":48,"log_start":"56'73335","ondisk_log_start":"56'73335","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'47017","last_scrub_stamp":"2026-02-23T13:07:44.359774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:44.359774+0000","objects_scrubbed":39444,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:00.349146+0000","scrub_duration":4516,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":792592384,"num_objects":12094,"num_object_clones":0,"num_object_copies":36282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12094,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73338,"num_write_kb":2733824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"56'73196","reported_seq":73584,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:31.619486+0000","last_change":"2026-02-23T13:07:18.000008+0000","last_active":"2026-02-23T13:08:31.619486+0000","last_peered":"2026-02-23T13:08:31.619486+0000","last_clean":"2026-02-23T13:08:31.619486+0000","last_became_active":"2026-02-23T13:06:03.767001+0000","last_became_peered":"2026-02-23T13:06:03.767001+0000","last_unstale":"2026-02-23T13:08:31.619486+0000","last_undegraded":"2026-02-23T13:08:31.619486+0000","last_fullsized":"2026-02-23T13:08:31.619486+0000","mapping_epoch":48,"log_start":"56'73193","ondisk_log_start":"56'73193","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'35564","last_scrub_stamp":"2026-02-23T13:07:17.999970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:17.999970+0000","objects_scrubbed":35002,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:36.421460+0000","scrub_duration":3089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786825216,"num_objects":12006,"num_object_clones":0,"num_object_copies":36018,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12006,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73196,"num_write_kb":2726464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"56'74109","reported_seq":74476,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:31.731393+0000","last_change":"2026-02-23T13:07:13.026486+0000","last_active":"2026-02-23T13:08:31.731393+0000","last_peered":"2026-02-23T13:08:31.731393+0000","last_clean":"2026-02-23T13:08:31.731393+0000","last_became_active":"2026-02-23T13:06:03.766997+0000","last_became_peered":"2026-02-23T13:06:03.766997+0000","last_unstale":"2026-02-23T13:08:31.731393+0000","last_undegraded":"2026-02-23T13:08:31.731393+0000","last_fullsized":"2026-02-23T13:08:31.731393+0000","mapping_epoch":48,"log_start":"56'74106","ondisk_log_start":"56'74106","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'33950","last_scrub_stamp":"2026-02-23T13:07:13.026390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:13.026390+0000","objects_scrubbed":33091,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"queued for scrub","scrub_duration":3912,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":781123584,"num_objects":11919,"num_object_clones":0,"num_object_copies":35757,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11919,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74109,"num_write_kb":2752896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"56'74112","reported_seq":74575,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:31.726260+0000","last_change":"2026-02-23T13:07:38.263276+0000","last_active":"2026-02-23T13:08:31.726260+0000","last_peered":"2026-02-23T13:08:31.726260+0000","last_clean":"2026-02-23T13:08:31.726260+0000","last_became_active":"2026-02-23T13:06:03.767015+0000","last_became_peered":"2026-02-23T13:06:03.767015+0000","last_unstale":"2026-02-23T13:08:31.726260+0000","last_undegraded":"2026-02-23T13:08:31.726260+0000","last_fullsized":"2026-02-23T13:08:31.726260+0000","mapping_epoch":48,"log_start":"56'74109","ondisk_log_start":"56'74109","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'44630","last_scrub_stamp":"2026-02-23T13:07:38.263188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:38.263188+0000","objects_scrubbed":42478,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:53.250163+0000","scrub_duration":5027,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":794427392,"num_objects":12122,"num_object_clones":0,"num_object_copies":36366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74112,"num_write_kb":2759488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":274,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:07:56.312851+0000","last_change":"2026-02-23T13:07:56.312851+0000","last_active":"2026-02-23T13:07:56.312851+0000","last_peered":"2026-02-23T13:07:56.312851+0000","last_clean":"2026-02-23T13:07:56.312851+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:07:56.312851+0000","last_undegraded":"2026-02-23T13:07:56.312851+0000","last_fullsized":"2026-02-23T13:07:56.312851+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:07:56.312801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:07:56.312801+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:14.345117+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":12646154264,"num_objects":192966,"num_object_clones":0,"num_object_copies":578898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192966,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1181260,"num_write_kb":43975169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":37967310848,"data_stored":37967298632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3654,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1734,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247877,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":9436824,"kb_used_data":7833732,"kb_used_omap":10,"kb_used_meta":1602997,"kb_avail":724566376,"statfs":{"total":751619276800,"available":741955969024,"internally_reserved":0,"allocated":8021741568,"data_stored":8021359031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10928,"internal_metadata":1641469264},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444104,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":12487512,"kb_used_data":11255556,"kb_used_omap":10,"kb_used_meta":1231861,"kb_avail":721515688,"statfs":{"total":751619276800,"available":738832064512,"internally_reserved":0,"allocated":11525689344,"data_stored":11525306807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10677,"internal_metadata":1261426251},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":10166096,"kb_used_data":8665916,"kb_used_omap":11,"kb_used_meta":1500084,"kb_avail":723837104,"statfs":{"total":751619276800,"available":741209194496,"internally_reserved":0,"allocated":8873897984,"data_stored":8873523071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12005,"internal_metadata":1536086299},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705739,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":12021016,"kb_used_data":10379780,"kb_used_omap":9,"kb_used_meta":1641206,"kb_avail":721982184,"statfs":{"total":751619276800,"available":739309756416,"internally_reserved":0,"allocated":10628894720,"data_stored":10628512183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9386,"internal_metadata":1680595798},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1734,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10281947136,"data_stored":10281943064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8659009536,"data_stored":8659009536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11099705344,"data_stored":11099701272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7926648832,"data_stored":7926644760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3468,"internal_metadata":0}]}} 2026-02-23T13:08:36.289 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:08:36 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:08:36] "GET /metrics HTTP/1.1" 200 4232 "" "Prometheus/3.6.0" 2026-02-23T13:08:36.561 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:08:36 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:08:36.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:08:36.677 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:08:36.829 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:36.959 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:36.956+0000 7fb1faaab640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:36.959 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:36.956+0000 7fb1faaab640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:36.974 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:08:36.975 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:08:36.987 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:08:36.988 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:08:37.000 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:08:37.001 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:08:37.013 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:08:37.014 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:08:38.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:37 trial046 ceph-mon[38575]: from='client.14849 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:08:38.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:37 trial046 ceph-mon[38575]: pgmap v200: 17 pgs: 17 active+clean; 11 GiB data, 37 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 8.31k op/s 2026-02-23T13:08:38.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:37 trial046 ceph-mon[38575]: 3.1 scrub starts 2026-02-23T13:08:38.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:37 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1895615751' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:08:39.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:38 trial046 ceph-mon[38575]: 3.1 scrub ok 2026-02-23T13:08:39.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:38 trial046 ceph-mon[38575]: 3.d scrub starts 2026-02-23T13:08:39.057 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:08:39.203 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:39.768 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:39.689+0000 7f413b898640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:39.768 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:39.690+0000 7f413b898640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:39.768 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:08:39.768 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:08:39.768 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:08:39.768 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:08:39.769 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:08:39.769 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:08:39.769 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:08:39.769 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:08:40.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:39 trial046 ceph-mon[38575]: pgmap v201: 17 pgs: 17 active+clean; 8.8 GiB data, 33 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 9.68k op/s 2026-02-23T13:08:40.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:39 trial046 ceph-mon[38575]: 3.d scrub ok 2026-02-23T13:08:40.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:39 trial046 ceph-mon[38575]: 3.0 scrub starts 2026-02-23T13:08:40.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:39 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1506851943' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:08:41.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:40 trial046 ceph-mon[38575]: 3.8 scrub starts 2026-02-23T13:08:41.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:40 trial046 ceph-mon[38575]: 3.0 scrub ok 2026-02-23T13:08:41.059 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:08:41.060 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-23T13:08:41.198 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:41.587 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:41.584+0000 7fc258aed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:41.588 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:41.585+0000 7fc258aed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:41.745 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.0 to 1 (10000) 2026-02-23T13:08:42.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:41 trial046 ceph-mon[38575]: pgmap v202: 17 pgs: 17 active+clean; 8.8 GiB data, 33 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 7.76k op/s 2026-02-23T13:08:42.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:41 trial046 ceph-mon[38575]: 3.6 scrub starts 2026-02-23T13:08:42.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:41 trial046 ceph-mon[38575]: 3.8 scrub ok 2026-02-23T13:08:42.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:41 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1300375061' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-23T13:08:42.404 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-23T13:08:42.507 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:08:42.556 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:42.661 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:42.678 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:42.676+0000 7faf2f2c5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:42.678 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:42.676+0000 7faf2f2c5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:42.788 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:42.786+0000 7ff2edc19640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:42.789 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:42.786+0000 7ff2edc19640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:42.803 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:08:42.804 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:08:42.820 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:08:42.820 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:08:42.834 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:08:42.835 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:08:42.847 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:08:42.848 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:08:43.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:42 trial046 ceph-mon[38575]: 3.e scrub starts 2026-02-23T13:08:43.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:42 trial046 ceph-mon[38575]: 3.6 scrub ok 2026-02-23T13:08:43.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:42 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1300375061' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-23T13:08:43.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:42 trial046 ceph-mon[38575]: osdmap e57: 4 total, 4 up, 4 in 2026-02-23T13:08:43.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:42 trial046 ceph-mon[38575]: 3.e scrub ok 2026-02-23T13:08:43.750 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.1 to 1 (10000) 2026-02-23T13:08:43.795 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-23T13:08:43.938 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:44.005 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:43 trial046 ceph-mon[38575]: pgmap v204: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 6.5 GiB data, 26 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 8.59k op/s 2026-02-23T13:08:44.006 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:43 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/925059999' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:08:44.006 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:43 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3581723822' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-23T13:08:44.069 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:44.067+0000 7f5d9f380640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:44.070 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:44.067+0000 7f5d9f380640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:44.753 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.2 to 1 (10000) 2026-02-23T13:08:44.803 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-23T13:08:44.893 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:08:44.950 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:45.011 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:44 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3581723822' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-23T13:08:45.011 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:44 trial046 ceph-mon[38575]: osdmap e58: 4 total, 4 up, 4 in 2026-02-23T13:08:45.011 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:44 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/42954518' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-23T13:08:45.046 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:45.087 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:45.084+0000 7f8fd9fb2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:45.087 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:45.085+0000 7f8fd9fb2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:45.178 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:45.176+0000 7f6b4773f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:45.179 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:45.177+0000 7f6b4773f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:45.193 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:08:45.194 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:08:45.207 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:08:45.207 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:08:45.220 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:08:45.220 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:08:45.234 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:08:45.234 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:08:45.757 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.3 to 1 (10000) 2026-02-23T13:08:45.802 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-23T13:08:45.803 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:08:45.944 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:46.007 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:45 trial046 ceph-mon[38575]: pgmap v206: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 6.5 GiB data, 26 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 8.46k op/s 2026-02-23T13:08:46.007 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:45 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/42954518' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-23T13:08:46.007 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:45 trial046 ceph-mon[38575]: osdmap e59: 4 total, 4 up, 4 in 2026-02-23T13:08:46.008 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:45 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3038711149' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:08:46.008 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:45 trial046 ceph-mon[38575]: 3.b scrub starts 2026-02-23T13:08:46.008 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:45 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/821264821' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-23T13:08:46.073 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:46.070+0000 7f043b49b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:46.073 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:46.070+0000 7f043b49b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:46.213 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:08:46.214 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:08:46.258 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":208,"stamp":"2026-02-23T13:08:45.755826+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7015694904,"num_objects":107045,"num_object_clones":0,"num_object_copies":321135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107045,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":1267318,"num_write_kb":43977319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53,"ondisk_log_size":53,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":27228248,"kb_used_data":21373640,"kb_used_omap":42,"kb_used_meta":5854357,"kb_avail":2908784552,"statfs":{"total":3006477107200,"available":2978595381248,"internally_reserved":0,"allocated":21886607360,"data_stored":21885084836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44029,"internal_metadata":5994861571},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,4],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2451243008,"num_objects":-37403,"num_object_clones":0,"num_object_copies":-112209,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-37403,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37403,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.120625"},"pg_stats":[{"pgid":"3.f","version":"56'79725","reported_seq":80211,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:41.632408+0000","last_change":"2026-02-23T13:08:31.492572+0000","last_active":"2026-02-23T13:08:41.632408+0000","last_peered":"2026-02-23T13:08:41.632408+0000","last_clean":"2026-02-23T13:08:41.632408+0000","last_became_active":"2026-02-23T13:06:03.767261+0000","last_became_peered":"2026-02-23T13:06:03.767261+0000","last_unstale":"2026-02-23T13:08:41.632408+0000","last_undegraded":"2026-02-23T13:08:41.632408+0000","last_fullsized":"2026-02-23T13:08:41.632408+0000","mapping_epoch":48,"log_start":"56'79722","ondisk_log_start":"56'79722","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'74185","last_scrub_stamp":"2026-02-23T13:08:31.492489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:31.492489+0000","objects_scrubbed":12779,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:36.828294+0000","scrub_duration":1689,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444006400,"num_objects":6775,"num_object_clones":0,"num_object_copies":20325,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6775,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79725,"num_write_kb":2768000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"56'79249","reported_seq":79751,"reported_epoch":56,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:08:41.626873+0000","last_change":"2026-02-23T13:08:40.889112+0000","last_active":"2026-02-23T13:08:41.626873+0000","last_peered":"2026-02-23T13:08:41.626873+0000","last_clean":"2026-02-23T13:08:41.626873+0000","last_became_active":"2026-02-23T13:06:03.767822+0000","last_became_peered":"2026-02-23T13:06:03.767822+0000","last_unstale":"2026-02-23T13:08:41.626873+0000","last_undegraded":"2026-02-23T13:08:41.626873+0000","last_fullsized":"2026-02-23T13:08:41.626873+0000","mapping_epoch":48,"log_start":"56'79246","ondisk_log_start":"56'79246","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41040","last_scrub_stamp":"2026-02-23T13:07:30.198713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:30.198713+0000","objects_scrubbed":5749,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"scrubbing for 1s","scrub_duration":4501,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441384960,"num_objects":6735,"num_object_clones":0,"num_object_copies":20205,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6735,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79249,"num_write_kb":2751488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"56'79326","reported_seq":79861,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:41.632844+0000","last_change":"2026-02-23T13:08:39.116293+0000","last_active":"2026-02-23T13:08:41.632844+0000","last_peered":"2026-02-23T13:08:41.632844+0000","last_clean":"2026-02-23T13:08:41.632844+0000","last_became_active":"2026-02-23T13:06:03.768946+0000","last_became_peered":"2026-02-23T13:06:03.768946+0000","last_unstale":"2026-02-23T13:08:41.632844+0000","last_undegraded":"2026-02-23T13:08:41.632844+0000","last_fullsized":"2026-02-23T13:08:41.632844+0000","mapping_epoch":48,"log_start":"56'79323","ondisk_log_start":"56'79323","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'78318","last_scrub_stamp":"2026-02-23T13:08:39.116213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:39.116213+0000","objects_scrubbed":8047,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:51.238638+0000","scrub_duration":832,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448856088,"num_objects":6850,"num_object_clones":0,"num_object_copies":20550,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6850,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":79326,"num_write_kb":2757569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"56'79020","reported_seq":79480,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:41.634560+0000","last_change":"2026-02-23T13:07:38.374570+0000","last_active":"2026-02-23T13:08:41.634560+0000","last_peered":"2026-02-23T13:08:41.634560+0000","last_clean":"2026-02-23T13:08:41.634560+0000","last_became_active":"2026-02-23T13:06:03.767083+0000","last_became_peered":"2026-02-23T13:06:03.767083+0000","last_unstale":"2026-02-23T13:08:41.634560+0000","last_undegraded":"2026-02-23T13:08:41.634560+0000","last_fullsized":"2026-02-23T13:08:41.634560+0000","mapping_epoch":48,"log_start":"56'79017","ondisk_log_start":"56'79017","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'44374","last_scrub_stamp":"2026-02-23T13:07:38.374512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:38.374512+0000","objects_scrubbed":42187,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:05.652994+0000","scrub_duration":4032,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":434634752,"num_objects":6632,"num_object_clones":0,"num_object_copies":19896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6632,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79020,"num_write_kb":2740864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"56'79096","reported_seq":79495,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:41.728725+0000","last_change":"2026-02-23T13:07:20.897120+0000","last_active":"2026-02-23T13:08:41.728725+0000","last_peered":"2026-02-23T13:08:41.728725+0000","last_clean":"2026-02-23T13:08:41.728725+0000","last_became_active":"2026-02-23T13:06:03.766614+0000","last_became_peered":"2026-02-23T13:06:03.766614+0000","last_unstale":"2026-02-23T13:08:41.728725+0000","last_undegraded":"2026-02-23T13:08:41.728725+0000","last_fullsized":"2026-02-23T13:08:41.728725+0000","mapping_epoch":48,"log_start":"56'79093","ondisk_log_start":"56'79093","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'36893","last_scrub_stamp":"2026-02-23T13:07:20.897051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:20.897051+0000","objects_scrubbed":36116,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"queued for scrub","scrub_duration":3824,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":437518336,"num_objects":6676,"num_object_clones":0,"num_object_copies":20028,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6676,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79096,"num_write_kb":2744704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"56'78984","reported_seq":79388,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:41.630660+0000","last_change":"2026-02-23T13:07:21.878287+0000","last_active":"2026-02-23T13:08:41.630660+0000","last_peered":"2026-02-23T13:08:41.630660+0000","last_clean":"2026-02-23T13:08:41.630660+0000","last_became_active":"2026-02-23T13:06:03.768238+0000","last_became_peered":"2026-02-23T13:06:03.768238+0000","last_unstale":"2026-02-23T13:08:41.630660+0000","last_undegraded":"2026-02-23T13:08:41.630660+0000","last_fullsized":"2026-02-23T13:08:41.630660+0000","mapping_epoch":48,"log_start":"56'78981","ondisk_log_start":"56'78981","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'37319","last_scrub_stamp":"2026-02-23T13:07:21.878230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:21.878230+0000","objects_scrubbed":36520,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:48.355026+0000","scrub_duration":3562,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438960128,"num_objects":6698,"num_object_clones":0,"num_object_copies":20094,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6698,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78984,"num_write_kb":2741824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"56'79318","reported_seq":79835,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:41.632675+0000","last_change":"2026-02-23T13:08:26.944478+0000","last_active":"2026-02-23T13:08:41.632675+0000","last_peered":"2026-02-23T13:08:41.632675+0000","last_clean":"2026-02-23T13:08:41.632675+0000","last_became_active":"2026-02-23T13:06:03.767947+0000","last_became_peered":"2026-02-23T13:06:03.767947+0000","last_unstale":"2026-02-23T13:08:41.632675+0000","last_undegraded":"2026-02-23T13:08:41.632675+0000","last_fullsized":"2026-02-23T13:08:41.632675+0000","mapping_epoch":48,"log_start":"56'79315","ondisk_log_start":"56'79315","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'71240","last_scrub_stamp":"2026-02-23T13:08:26.944430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:26.944430+0000","objects_scrubbed":14999,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:28.745863+0000","scrub_duration":1572,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":428081152,"num_objects":6532,"num_object_clones":0,"num_object_copies":19596,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6532,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79318,"num_write_kb":2747200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"56'78981","reported_seq":79509,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:41.733673+0000","last_change":"2026-02-23T13:08:41.327885+0000","last_active":"2026-02-23T13:08:41.733673+0000","last_peered":"2026-02-23T13:08:41.733673+0000","last_clean":"2026-02-23T13:08:41.733673+0000","last_became_active":"2026-02-23T13:06:03.766859+0000","last_became_peered":"2026-02-23T13:06:03.766859+0000","last_unstale":"2026-02-23T13:08:41.733673+0000","last_undegraded":"2026-02-23T13:08:41.733673+0000","last_fullsized":"2026-02-23T13:08:41.733673+0000","mapping_epoch":48,"log_start":"56'78978","ondisk_log_start":"56'78978","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'78824","last_scrub_stamp":"2026-02-23T13:08:41.327826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:41.327826+0000","objects_scrubbed":7081,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:52.060806+0000","scrub_duration":1129,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442302464,"num_objects":6749,"num_object_clones":0,"num_object_copies":20247,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6749,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78981,"num_write_kb":2743360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"56'79119","reported_seq":79674,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:41.731129+0000","last_change":"2026-02-23T13:08:26.463514+0000","last_active":"2026-02-23T13:08:41.731129+0000","last_peered":"2026-02-23T13:08:41.731129+0000","last_clean":"2026-02-23T13:08:41.731129+0000","last_became_active":"2026-02-23T13:06:03.765502+0000","last_became_peered":"2026-02-23T13:06:03.765502+0000","last_unstale":"2026-02-23T13:08:41.731129+0000","last_undegraded":"2026-02-23T13:08:41.731129+0000","last_fullsized":"2026-02-23T13:08:41.731129+0000","mapping_epoch":48,"log_start":"56'79116","ondisk_log_start":"56'79116","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'70782","last_scrub_stamp":"2026-02-23T13:08:26.463431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:26.463431+0000","objects_scrubbed":15411,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:34.767761+0000","scrub_duration":2162,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":431947776,"num_objects":6591,"num_object_clones":0,"num_object_copies":19773,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6591,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79119,"num_write_kb":2742720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"56'79419","reported_seq":79933,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:41.617511+0000","last_change":"2026-02-23T13:08:41.617449+0000","last_active":"2026-02-23T13:08:41.617511+0000","last_peered":"2026-02-23T13:08:41.617511+0000","last_clean":"2026-02-23T13:08:41.617511+0000","last_became_active":"2026-02-23T13:06:03.767012+0000","last_became_peered":"2026-02-23T13:06:03.767012+0000","last_unstale":"2026-02-23T13:08:41.617511+0000","last_undegraded":"2026-02-23T13:08:41.617511+0000","last_fullsized":"2026-02-23T13:08:41.617511+0000","mapping_epoch":48,"log_start":"56'79414","ondisk_log_start":"56'79414","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'79417","last_scrub_stamp":"2026-02-23T13:08:41.617359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:41.617359+0000","objects_scrubbed":6886,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:52.732199+0000","scrub_duration":898,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438370304,"num_objects":6689,"num_object_clones":0,"num_object_copies":20067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6689,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79419,"num_write_kb":2755456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"56'79035","reported_seq":79433,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:41.626586+0000","last_change":"2026-02-23T13:07:20.033733+0000","last_active":"2026-02-23T13:08:41.626586+0000","last_peered":"2026-02-23T13:08:41.626586+0000","last_clean":"2026-02-23T13:08:41.626586+0000","last_became_active":"2026-02-23T13:06:03.767200+0000","last_became_peered":"2026-02-23T13:06:03.767200+0000","last_unstale":"2026-02-23T13:08:41.626586+0000","last_undegraded":"2026-02-23T13:08:41.626586+0000","last_fullsized":"2026-02-23T13:08:41.626586+0000","mapping_epoch":48,"log_start":"56'79032","ondisk_log_start":"56'79032","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'36561","last_scrub_stamp":"2026-02-23T13:07:20.033700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:20.033700+0000","objects_scrubbed":35947,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:44.960748+0000","scrub_duration":3247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":434438144,"num_objects":6629,"num_object_clones":0,"num_object_copies":19887,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6629,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79035,"num_write_kb":2741248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"56'79813","reported_seq":80200,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:41.728145+0000","last_change":"2026-02-23T13:07:17.060455+0000","last_active":"2026-02-23T13:08:41.728145+0000","last_peered":"2026-02-23T13:08:41.728145+0000","last_clean":"2026-02-23T13:08:41.728145+0000","last_became_active":"2026-02-23T13:06:03.766415+0000","last_became_peered":"2026-02-23T13:06:03.766415+0000","last_unstale":"2026-02-23T13:08:41.728145+0000","last_undegraded":"2026-02-23T13:08:41.728145+0000","last_fullsized":"2026-02-23T13:08:41.728145+0000","mapping_epoch":48,"log_start":"56'79810","ondisk_log_start":"56'79810","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'35773","last_scrub_stamp":"2026-02-23T13:07:17.060384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:17.060384+0000","objects_scrubbed":34982,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"queued for scrub","scrub_duration":3962,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438370304,"num_objects":6689,"num_object_clones":0,"num_object_copies":20067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6689,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79813,"num_write_kb":2768064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"56'78648","reported_seq":79080,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:41.630500+0000","last_change":"2026-02-23T13:07:44.359896+0000","last_active":"2026-02-23T13:08:41.630500+0000","last_peered":"2026-02-23T13:08:41.630500+0000","last_clean":"2026-02-23T13:08:41.630500+0000","last_became_active":"2026-02-23T13:06:03.768541+0000","last_became_peered":"2026-02-23T13:06:03.768541+0000","last_unstale":"2026-02-23T13:08:41.630500+0000","last_undegraded":"2026-02-23T13:08:41.630500+0000","last_fullsized":"2026-02-23T13:08:41.630500+0000","mapping_epoch":48,"log_start":"56'78645","ondisk_log_start":"56'78645","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'47017","last_scrub_stamp":"2026-02-23T13:07:44.359774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:44.359774+0000","objects_scrubbed":39444,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:00.349146+0000","scrub_duration":4516,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444596224,"num_objects":6784,"num_object_clones":0,"num_object_copies":20352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6784,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78648,"num_write_kb":2733824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"56'78569","reported_seq":79052,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:41.621370+0000","last_change":"2026-02-23T13:08:37.674953+0000","last_active":"2026-02-23T13:08:41.621370+0000","last_peered":"2026-02-23T13:08:41.621370+0000","last_clean":"2026-02-23T13:08:41.621370+0000","last_became_active":"2026-02-23T13:06:03.767001+0000","last_became_peered":"2026-02-23T13:06:03.767001+0000","last_unstale":"2026-02-23T13:08:41.621370+0000","last_undegraded":"2026-02-23T13:08:41.621370+0000","last_fullsized":"2026-02-23T13:08:41.621370+0000","mapping_epoch":48,"log_start":"56'78566","ondisk_log_start":"56'78566","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'76827","last_scrub_stamp":"2026-02-23T13:08:37.674915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:37.674915+0000","objects_scrubbed":8591,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:53.455324+0000","scrub_duration":879,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":434700288,"num_objects":6633,"num_object_clones":0,"num_object_copies":19899,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6633,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78569,"num_write_kb":2726464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"56'79424","reported_seq":79874,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:41.731890+0000","last_change":"2026-02-23T13:08:40.487488+0000","last_active":"2026-02-23T13:08:41.731890+0000","last_peered":"2026-02-23T13:08:41.731890+0000","last_clean":"2026-02-23T13:08:41.731890+0000","last_became_active":"2026-02-23T13:06:03.766997+0000","last_became_peered":"2026-02-23T13:06:03.766997+0000","last_unstale":"2026-02-23T13:08:41.731890+0000","last_undegraded":"2026-02-23T13:08:41.731890+0000","last_fullsized":"2026-02-23T13:08:41.731890+0000","mapping_epoch":48,"log_start":"56'79421","ondisk_log_start":"56'79421","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'78912","last_scrub_stamp":"2026-02-23T13:08:40.487413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:40.487413+0000","objects_scrubbed":7357,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:59.679746+0000","scrub_duration":1309,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432799744,"num_objects":6604,"num_object_clones":0,"num_object_copies":19812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6604,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79424,"num_write_kb":2752896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"56'79457","reported_seq":79920,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:41.730279+0000","last_change":"2026-02-23T13:07:38.263276+0000","last_active":"2026-02-23T13:08:41.730279+0000","last_peered":"2026-02-23T13:08:41.730279+0000","last_clean":"2026-02-23T13:08:41.730279+0000","last_became_active":"2026-02-23T13:06:03.767015+0000","last_became_peered":"2026-02-23T13:06:03.767015+0000","last_unstale":"2026-02-23T13:08:41.730279+0000","last_undegraded":"2026-02-23T13:08:41.730279+0000","last_fullsized":"2026-02-23T13:08:41.730279+0000","mapping_epoch":48,"log_start":"56'79454","ondisk_log_start":"56'79454","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'44630","last_scrub_stamp":"2026-02-23T13:07:38.263188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:38.263188+0000","objects_scrubbed":42478,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:53.250163+0000","scrub_duration":5027,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444137472,"num_objects":6777,"num_object_clones":0,"num_object_copies":20331,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6777,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79457,"num_write_kb":2759488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":274,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:07:56.312851+0000","last_change":"2026-02-23T13:07:56.312851+0000","last_active":"2026-02-23T13:07:56.312851+0000","last_peered":"2026-02-23T13:07:56.312851+0000","last_clean":"2026-02-23T13:07:56.312851+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:07:56.312851+0000","last_undegraded":"2026-02-23T13:07:56.312851+0000","last_fullsized":"2026-02-23T13:07:56.312851+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:07:56.312801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:07:56.312801+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:14.345117+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":7015104536,"num_objects":107043,"num_object_clones":0,"num_object_copies":321129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107043,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1267183,"num_write_kb":43975169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":21073833984,"data_stored":21073821768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4221,"internal_metadata":0},"log_size":50,"ondisk_log_size":50,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1428,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247879,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6070168,"kb_used_data":4376772,"kb_used_omap":10,"kb_used_meta":1693237,"kb_avail":727933032,"statfs":{"total":751619276800,"available":745403424768,"internally_reserved":0,"allocated":4481814528,"data_stored":4481431991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11030,"internal_metadata":1733874922},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444106,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":7633560,"kb_used_data":6275332,"kb_used_omap":10,"kb_used_meta":1358197,"kb_avail":726369640,"statfs":{"total":751619276800,"available":743802511360,"internally_reserved":0,"allocated":6425939968,"data_stored":6425557431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10677,"internal_metadata":1390794315},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,4],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6451152,"kb_used_data":4842748,"kb_used_omap":12,"kb_used_meta":1608371,"kb_avail":727552048,"statfs":{"total":751619276800,"available":745013297152,"internally_reserved":0,"allocated":4958973952,"data_stored":4958599039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12843,"internal_metadata":1646972373},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705741,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":7073368,"kb_used_data":5878788,"kb_used_omap":9,"kb_used_meta":1194550,"kb_avail":726929832,"statfs":{"total":751619276800,"available":744376147968,"internally_reserved":0,"allocated":6019878912,"data_stored":6019496375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9479,"internal_metadata":1223219961},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1428,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5714087936,"data_stored":5714083864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":186,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4797825024,"data_stored":4797825024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":279,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6165565440,"data_stored":6165561368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":186,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4396355584,"data_stored":4396351512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3570,"internal_metadata":0}]}} 2026-02-23T13:08:46.260 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:08:46.286 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:08:46 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:08:46] "GET /metrics HTTP/1.1" 200 4241 "" "Prometheus/3.6.0" 2026-02-23T13:08:46.413 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:46.469 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:08:46 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:08:46.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:08:46.549 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:46.547+0000 7f643d76d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:46.549 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:46.547+0000 7f643d76d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:46.697 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:08:46.697 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:08:46.742 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":209,"stamp":"2026-02-23T13:08:46.635965+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5895684664,"num_objects":89955,"num_object_clones":0,"num_object_copies":269865,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89955,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":1284408,"num_write_kb":43977319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":22699500,"kb_used_data":16718492,"kb_used_omap":47,"kb_used_meta":5980688,"kb_avail":2913313300,"statfs":{"total":3006477107200,"available":2983232819200,"internally_reserved":0,"allocated":17119735808,"data_stored":17118158131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":48779,"internal_metadata":6124224885},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1120010240,"num_objects":-17090,"num_object_clones":0,"num_object_copies":-51270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-17090,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17090,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.891331"},"pg_stats":[{"pgid":"3.f","version":"60'82571","reported_seq":83065,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-23T13:08:46.631938+0000","last_change":"2026-02-23T13:08:31.492572+0000","last_active":"2026-02-23T13:08:46.631938+0000","last_peered":"2026-02-23T13:08:46.631938+0000","last_clean":"2026-02-23T13:08:46.631938+0000","last_became_active":"2026-02-23T13:06:03.767261+0000","last_became_peered":"2026-02-23T13:06:03.767261+0000","last_unstale":"2026-02-23T13:08:46.631938+0000","last_undegraded":"2026-02-23T13:08:46.631938+0000","last_fullsized":"2026-02-23T13:08:46.631938+0000","mapping_epoch":48,"log_start":"60'82568","ondisk_log_start":"60'82568","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'74185","last_scrub_stamp":"2026-02-23T13:08:31.492489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:31.492489+0000","objects_scrubbed":12779,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:36.828294+0000","scrub_duration":1689,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":257490944,"num_objects":3929,"num_object_clones":0,"num_object_copies":11787,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3929,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82571,"num_write_kb":2768000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"60'82038","reported_seq":82564,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-23T13:08:46.633082+0000","last_change":"2026-02-23T13:08:41.781710+0000","last_active":"2026-02-23T13:08:46.633082+0000","last_peered":"2026-02-23T13:08:46.633082+0000","last_clean":"2026-02-23T13:08:46.633082+0000","last_became_active":"2026-02-23T13:06:03.767822+0000","last_became_peered":"2026-02-23T13:06:03.767822+0000","last_unstale":"2026-02-23T13:08:46.633082+0000","last_undegraded":"2026-02-23T13:08:46.633082+0000","last_fullsized":"2026-02-23T13:08:46.633082+0000","mapping_epoch":48,"log_start":"60'82035","ondisk_log_start":"60'82035","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'79322","last_scrub_stamp":"2026-02-23T13:08:41.781660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:41.781660+0000","objects_scrubbed":6864,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:06.639282+0000","scrub_duration":892,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":258605056,"num_objects":3946,"num_object_clones":0,"num_object_copies":11838,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3946,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82038,"num_write_kb":2751488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"56'79326","reported_seq":79861,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:41.632844+0000","last_change":"2026-02-23T13:08:39.116293+0000","last_active":"2026-02-23T13:08:41.632844+0000","last_peered":"2026-02-23T13:08:41.632844+0000","last_clean":"2026-02-23T13:08:41.632844+0000","last_became_active":"2026-02-23T13:06:03.768946+0000","last_became_peered":"2026-02-23T13:06:03.768946+0000","last_unstale":"2026-02-23T13:08:41.632844+0000","last_undegraded":"2026-02-23T13:08:41.632844+0000","last_fullsized":"2026-02-23T13:08:41.632844+0000","mapping_epoch":48,"log_start":"56'79323","ondisk_log_start":"56'79323","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'78318","last_scrub_stamp":"2026-02-23T13:08:39.116213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:39.116213+0000","objects_scrubbed":8047,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:51.238638+0000","scrub_duration":832,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448856088,"num_objects":6850,"num_object_clones":0,"num_object_copies":20550,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6850,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":79326,"num_write_kb":2757569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"56'79020","reported_seq":79480,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:41.634560+0000","last_change":"2026-02-23T13:07:38.374570+0000","last_active":"2026-02-23T13:08:41.634560+0000","last_peered":"2026-02-23T13:08:41.634560+0000","last_clean":"2026-02-23T13:08:41.634560+0000","last_became_active":"2026-02-23T13:06:03.767083+0000","last_became_peered":"2026-02-23T13:06:03.767083+0000","last_unstale":"2026-02-23T13:08:41.634560+0000","last_undegraded":"2026-02-23T13:08:41.634560+0000","last_fullsized":"2026-02-23T13:08:41.634560+0000","mapping_epoch":48,"log_start":"56'79017","ondisk_log_start":"56'79017","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'44374","last_scrub_stamp":"2026-02-23T13:07:38.374512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:38.374512+0000","objects_scrubbed":42187,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:05.652994+0000","scrub_duration":4032,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":434634752,"num_objects":6632,"num_object_clones":0,"num_object_copies":19896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6632,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79020,"num_write_kb":2740864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"56'79096","reported_seq":79495,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:41.728725+0000","last_change":"2026-02-23T13:07:20.897120+0000","last_active":"2026-02-23T13:08:41.728725+0000","last_peered":"2026-02-23T13:08:41.728725+0000","last_clean":"2026-02-23T13:08:41.728725+0000","last_became_active":"2026-02-23T13:06:03.766614+0000","last_became_peered":"2026-02-23T13:06:03.766614+0000","last_unstale":"2026-02-23T13:08:41.728725+0000","last_undegraded":"2026-02-23T13:08:41.728725+0000","last_fullsized":"2026-02-23T13:08:41.728725+0000","mapping_epoch":48,"log_start":"56'79093","ondisk_log_start":"56'79093","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'36893","last_scrub_stamp":"2026-02-23T13:07:20.897051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:20.897051+0000","objects_scrubbed":36116,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"queued for scrub","scrub_duration":3824,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":437518336,"num_objects":6676,"num_object_clones":0,"num_object_copies":20028,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6676,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79096,"num_write_kb":2744704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"56'78984","reported_seq":79388,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:41.630660+0000","last_change":"2026-02-23T13:07:21.878287+0000","last_active":"2026-02-23T13:08:41.630660+0000","last_peered":"2026-02-23T13:08:41.630660+0000","last_clean":"2026-02-23T13:08:41.630660+0000","last_became_active":"2026-02-23T13:06:03.768238+0000","last_became_peered":"2026-02-23T13:06:03.768238+0000","last_unstale":"2026-02-23T13:08:41.630660+0000","last_undegraded":"2026-02-23T13:08:41.630660+0000","last_fullsized":"2026-02-23T13:08:41.630660+0000","mapping_epoch":48,"log_start":"56'78981","ondisk_log_start":"56'78981","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'37319","last_scrub_stamp":"2026-02-23T13:07:21.878230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:21.878230+0000","objects_scrubbed":36520,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:48.355026+0000","scrub_duration":3562,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438960128,"num_objects":6698,"num_object_clones":0,"num_object_copies":20094,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6698,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78984,"num_write_kb":2741824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"56'79318","reported_seq":79835,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:41.632675+0000","last_change":"2026-02-23T13:08:26.944478+0000","last_active":"2026-02-23T13:08:41.632675+0000","last_peered":"2026-02-23T13:08:41.632675+0000","last_clean":"2026-02-23T13:08:41.632675+0000","last_became_active":"2026-02-23T13:06:03.767947+0000","last_became_peered":"2026-02-23T13:06:03.767947+0000","last_unstale":"2026-02-23T13:08:41.632675+0000","last_undegraded":"2026-02-23T13:08:41.632675+0000","last_fullsized":"2026-02-23T13:08:41.632675+0000","mapping_epoch":48,"log_start":"56'79315","ondisk_log_start":"56'79315","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'71240","last_scrub_stamp":"2026-02-23T13:08:26.944430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:26.944430+0000","objects_scrubbed":14999,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:28.745863+0000","scrub_duration":1572,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":428081152,"num_objects":6532,"num_object_clones":0,"num_object_copies":19596,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6532,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79318,"num_write_kb":2747200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"56'78981","reported_seq":79509,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:41.733673+0000","last_change":"2026-02-23T13:08:41.327885+0000","last_active":"2026-02-23T13:08:41.733673+0000","last_peered":"2026-02-23T13:08:41.733673+0000","last_clean":"2026-02-23T13:08:41.733673+0000","last_became_active":"2026-02-23T13:06:03.766859+0000","last_became_peered":"2026-02-23T13:06:03.766859+0000","last_unstale":"2026-02-23T13:08:41.733673+0000","last_undegraded":"2026-02-23T13:08:41.733673+0000","last_fullsized":"2026-02-23T13:08:41.733673+0000","mapping_epoch":48,"log_start":"56'78978","ondisk_log_start":"56'78978","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'78824","last_scrub_stamp":"2026-02-23T13:08:41.327826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:41.327826+0000","objects_scrubbed":7081,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:52.060806+0000","scrub_duration":1129,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442302464,"num_objects":6749,"num_object_clones":0,"num_object_copies":20247,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6749,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78981,"num_write_kb":2743360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"56'79119","reported_seq":79674,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:41.731129+0000","last_change":"2026-02-23T13:08:26.463514+0000","last_active":"2026-02-23T13:08:41.731129+0000","last_peered":"2026-02-23T13:08:41.731129+0000","last_clean":"2026-02-23T13:08:41.731129+0000","last_became_active":"2026-02-23T13:06:03.765502+0000","last_became_peered":"2026-02-23T13:06:03.765502+0000","last_unstale":"2026-02-23T13:08:41.731129+0000","last_undegraded":"2026-02-23T13:08:41.731129+0000","last_fullsized":"2026-02-23T13:08:41.731129+0000","mapping_epoch":48,"log_start":"56'79116","ondisk_log_start":"56'79116","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'70782","last_scrub_stamp":"2026-02-23T13:08:26.463431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:26.463431+0000","objects_scrubbed":15411,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:34.767761+0000","scrub_duration":2162,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":431947776,"num_objects":6591,"num_object_clones":0,"num_object_copies":19773,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6591,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79119,"num_write_kb":2742720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"60'82310","reported_seq":82836,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-23T13:08:46.619931+0000","last_change":"2026-02-23T13:08:41.617449+0000","last_active":"2026-02-23T13:08:46.619931+0000","last_peered":"2026-02-23T13:08:46.619931+0000","last_clean":"2026-02-23T13:08:46.619931+0000","last_became_active":"2026-02-23T13:06:03.767012+0000","last_became_peered":"2026-02-23T13:06:03.767012+0000","last_unstale":"2026-02-23T13:08:46.619931+0000","last_undegraded":"2026-02-23T13:08:46.619931+0000","last_fullsized":"2026-02-23T13:08:46.619931+0000","mapping_epoch":48,"log_start":"60'82307","ondisk_log_start":"60'82307","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'79417","last_scrub_stamp":"2026-02-23T13:08:41.617359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:41.617359+0000","objects_scrubbed":6886,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:52.732199+0000","scrub_duration":898,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248905728,"num_objects":3798,"num_object_clones":0,"num_object_copies":11394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3798,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82310,"num_write_kb":2755456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"60'81841","reported_seq":82247,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-23T13:08:46.633703+0000","last_change":"2026-02-23T13:07:20.033733+0000","last_active":"2026-02-23T13:08:46.633703+0000","last_peered":"2026-02-23T13:08:46.633703+0000","last_clean":"2026-02-23T13:08:46.633703+0000","last_became_active":"2026-02-23T13:06:03.767200+0000","last_became_peered":"2026-02-23T13:06:03.767200+0000","last_unstale":"2026-02-23T13:08:46.633703+0000","last_undegraded":"2026-02-23T13:08:46.633703+0000","last_fullsized":"2026-02-23T13:08:46.633703+0000","mapping_epoch":48,"log_start":"60'81838","ondisk_log_start":"60'81838","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'36561","last_scrub_stamp":"2026-02-23T13:07:20.033700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:20.033700+0000","objects_scrubbed":35947,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"queued for scrub","scrub_duration":3247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250544128,"num_objects":3823,"num_object_clones":0,"num_object_copies":11469,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3823,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81841,"num_write_kb":2741248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"56'79813","reported_seq":80200,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:41.728145+0000","last_change":"2026-02-23T13:07:17.060455+0000","last_active":"2026-02-23T13:08:41.728145+0000","last_peered":"2026-02-23T13:08:41.728145+0000","last_clean":"2026-02-23T13:08:41.728145+0000","last_became_active":"2026-02-23T13:06:03.766415+0000","last_became_peered":"2026-02-23T13:06:03.766415+0000","last_unstale":"2026-02-23T13:08:41.728145+0000","last_undegraded":"2026-02-23T13:08:41.728145+0000","last_fullsized":"2026-02-23T13:08:41.728145+0000","mapping_epoch":48,"log_start":"56'79810","ondisk_log_start":"56'79810","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'35773","last_scrub_stamp":"2026-02-23T13:07:17.060384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:17.060384+0000","objects_scrubbed":34982,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"queued for scrub","scrub_duration":3962,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438370304,"num_objects":6689,"num_object_clones":0,"num_object_copies":20067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6689,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79813,"num_write_kb":2768064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"60'81560","reported_seq":82001,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-23T13:08:46.631746+0000","last_change":"2026-02-23T13:07:44.359896+0000","last_active":"2026-02-23T13:08:46.631746+0000","last_peered":"2026-02-23T13:08:46.631746+0000","last_clean":"2026-02-23T13:08:46.631746+0000","last_became_active":"2026-02-23T13:06:03.768541+0000","last_became_peered":"2026-02-23T13:06:03.768541+0000","last_unstale":"2026-02-23T13:08:46.631746+0000","last_undegraded":"2026-02-23T13:08:46.631746+0000","last_fullsized":"2026-02-23T13:08:46.631746+0000","mapping_epoch":48,"log_start":"60'81557","ondisk_log_start":"60'81557","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'47017","last_scrub_stamp":"2026-02-23T13:07:44.359774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:44.359774+0000","objects_scrubbed":39444,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:00.349146+0000","scrub_duration":4516,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":253755392,"num_objects":3872,"num_object_clones":0,"num_object_copies":11616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3872,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81560,"num_write_kb":2733824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"60'81415","reported_seq":81906,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-23T13:08:46.621754+0000","last_change":"2026-02-23T13:08:37.674953+0000","last_active":"2026-02-23T13:08:46.621754+0000","last_peered":"2026-02-23T13:08:46.621754+0000","last_clean":"2026-02-23T13:08:46.621754+0000","last_became_active":"2026-02-23T13:06:03.767001+0000","last_became_peered":"2026-02-23T13:06:03.767001+0000","last_unstale":"2026-02-23T13:08:46.621754+0000","last_undegraded":"2026-02-23T13:08:46.621754+0000","last_fullsized":"2026-02-23T13:08:46.621754+0000","mapping_epoch":48,"log_start":"60'81411","ondisk_log_start":"60'81411","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'76827","last_scrub_stamp":"2026-02-23T13:08:37.674915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:37.674915+0000","objects_scrubbed":8591,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:53.455324+0000","scrub_duration":879,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248184832,"num_objects":3787,"num_object_clones":0,"num_object_copies":11361,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3787,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81415,"num_write_kb":2726464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"56'79424","reported_seq":79874,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:41.731890+0000","last_change":"2026-02-23T13:08:40.487488+0000","last_active":"2026-02-23T13:08:41.731890+0000","last_peered":"2026-02-23T13:08:41.731890+0000","last_clean":"2026-02-23T13:08:41.731890+0000","last_became_active":"2026-02-23T13:06:03.766997+0000","last_became_peered":"2026-02-23T13:06:03.766997+0000","last_unstale":"2026-02-23T13:08:41.731890+0000","last_undegraded":"2026-02-23T13:08:41.731890+0000","last_fullsized":"2026-02-23T13:08:41.731890+0000","mapping_epoch":48,"log_start":"56'79421","ondisk_log_start":"56'79421","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'78912","last_scrub_stamp":"2026-02-23T13:08:40.487413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:40.487413+0000","objects_scrubbed":7357,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:59.679746+0000","scrub_duration":1309,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432799744,"num_objects":6604,"num_object_clones":0,"num_object_copies":19812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6604,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79424,"num_write_kb":2752896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"56'79457","reported_seq":79920,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:41.730279+0000","last_change":"2026-02-23T13:07:38.263276+0000","last_active":"2026-02-23T13:08:41.730279+0000","last_peered":"2026-02-23T13:08:41.730279+0000","last_clean":"2026-02-23T13:08:41.730279+0000","last_became_active":"2026-02-23T13:06:03.767015+0000","last_became_peered":"2026-02-23T13:06:03.767015+0000","last_unstale":"2026-02-23T13:08:41.730279+0000","last_undegraded":"2026-02-23T13:08:41.730279+0000","last_fullsized":"2026-02-23T13:08:41.730279+0000","mapping_epoch":48,"log_start":"56'79454","ondisk_log_start":"56'79454","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'44630","last_scrub_stamp":"2026-02-23T13:07:38.263188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:38.263188+0000","objects_scrubbed":42478,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:53.250163+0000","scrub_duration":5027,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444137472,"num_objects":6777,"num_object_clones":0,"num_object_copies":20331,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6777,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79457,"num_write_kb":2759488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":274,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:07:56.312851+0000","last_change":"2026-02-23T13:07:56.312851+0000","last_active":"2026-02-23T13:07:56.312851+0000","last_peered":"2026-02-23T13:07:56.312851+0000","last_clean":"2026-02-23T13:07:56.312851+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:07:56.312851+0000","last_undegraded":"2026-02-23T13:07:56.312851+0000","last_fullsized":"2026-02-23T13:07:56.312851+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:07:56.312801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:07:56.312801+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:14.345117+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":5895094296,"num_objects":89953,"num_object_clones":0,"num_object_copies":269859,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89953,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1284273,"num_write_kb":43975169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16009539584,"data_stored":16009527368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4221,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1428,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247879,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6070168,"kb_used_data":4376772,"kb_used_omap":10,"kb_used_meta":1693237,"kb_avail":727933032,"statfs":{"total":751619276800,"available":745403424768,"internally_reserved":0,"allocated":4481814528,"data_stored":4481431991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11030,"internal_metadata":1733874922},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444107,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5288904,"kb_used_data":3858420,"kb_used_omap":13,"kb_used_meta":1430386,"kb_avail":728714296,"statfs":{"total":751619276800,"available":746203439104,"internally_reserved":0,"allocated":3951022080,"data_stored":3950608027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13378,"internal_metadata":1464716222},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6451152,"kb_used_data":4842748,"kb_used_omap":12,"kb_used_meta":1608371,"kb_avail":727552048,"statfs":{"total":751619276800,"available":745013297152,"internally_reserved":0,"allocated":4958973952,"data_stored":4958599039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12843,"internal_metadata":1646972373},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705742,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4889276,"kb_used_data":3640552,"kb_used_omap":11,"kb_used_meta":1248692,"kb_avail":729113924,"statfs":{"total":751619276800,"available":746612658176,"internally_reserved":0,"allocated":3727925248,"data_stored":3727519074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11528,"internal_metadata":1278661368},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1428,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3276607488,"data_stored":3276603416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":186,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4797825024,"data_stored":4797825024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":279,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3538751488,"data_stored":3538747416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":186,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4396355584,"data_stored":4396351512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3570,"internal_metadata":0}]}} 2026-02-23T13:08:46.744 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-23T13:08:46.744 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:08:46.745 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:08:46.745 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:08:46.807 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:46 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:08:46.807 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:46 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:08:46.807 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:46 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/821264821' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-23T13:08:46.807 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:46 trial046 ceph-mon[38575]: osdmap e60: 4 total, 4 up, 4 in 2026-02-23T13:08:46.807 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:46 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:08:46.807 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:46 trial046 ceph-mon[38575]: 3.b scrub ok 2026-02-23T13:08:46.927 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:47.050 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:47.047+0000 7fa2a5c8f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:47.050 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:47.048+0000 7fa2a5c8f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:47.192 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:08:47.193 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:08:47.235 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":209,"stamp":"2026-02-23T13:08:46.635965+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5895684664,"num_objects":89955,"num_object_clones":0,"num_object_copies":269865,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89955,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":1284408,"num_write_kb":43977319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":22699500,"kb_used_data":16718492,"kb_used_omap":47,"kb_used_meta":5980688,"kb_avail":2913313300,"statfs":{"total":3006477107200,"available":2983232819200,"internally_reserved":0,"allocated":17119735808,"data_stored":17118158131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":48779,"internal_metadata":6124224885},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1120010240,"num_objects":-17090,"num_object_clones":0,"num_object_copies":-51270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-17090,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17090,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.891331"},"pg_stats":[{"pgid":"3.f","version":"60'82571","reported_seq":83065,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-23T13:08:46.631938+0000","last_change":"2026-02-23T13:08:31.492572+0000","last_active":"2026-02-23T13:08:46.631938+0000","last_peered":"2026-02-23T13:08:46.631938+0000","last_clean":"2026-02-23T13:08:46.631938+0000","last_became_active":"2026-02-23T13:06:03.767261+0000","last_became_peered":"2026-02-23T13:06:03.767261+0000","last_unstale":"2026-02-23T13:08:46.631938+0000","last_undegraded":"2026-02-23T13:08:46.631938+0000","last_fullsized":"2026-02-23T13:08:46.631938+0000","mapping_epoch":48,"log_start":"60'82568","ondisk_log_start":"60'82568","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'74185","last_scrub_stamp":"2026-02-23T13:08:31.492489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:31.492489+0000","objects_scrubbed":12779,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:36.828294+0000","scrub_duration":1689,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":257490944,"num_objects":3929,"num_object_clones":0,"num_object_copies":11787,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3929,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82571,"num_write_kb":2768000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"60'82038","reported_seq":82564,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-23T13:08:46.633082+0000","last_change":"2026-02-23T13:08:41.781710+0000","last_active":"2026-02-23T13:08:46.633082+0000","last_peered":"2026-02-23T13:08:46.633082+0000","last_clean":"2026-02-23T13:08:46.633082+0000","last_became_active":"2026-02-23T13:06:03.767822+0000","last_became_peered":"2026-02-23T13:06:03.767822+0000","last_unstale":"2026-02-23T13:08:46.633082+0000","last_undegraded":"2026-02-23T13:08:46.633082+0000","last_fullsized":"2026-02-23T13:08:46.633082+0000","mapping_epoch":48,"log_start":"60'82035","ondisk_log_start":"60'82035","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'79322","last_scrub_stamp":"2026-02-23T13:08:41.781660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:41.781660+0000","objects_scrubbed":6864,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:06.639282+0000","scrub_duration":892,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":258605056,"num_objects":3946,"num_object_clones":0,"num_object_copies":11838,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3946,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82038,"num_write_kb":2751488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"56'79326","reported_seq":79861,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:41.632844+0000","last_change":"2026-02-23T13:08:39.116293+0000","last_active":"2026-02-23T13:08:41.632844+0000","last_peered":"2026-02-23T13:08:41.632844+0000","last_clean":"2026-02-23T13:08:41.632844+0000","last_became_active":"2026-02-23T13:06:03.768946+0000","last_became_peered":"2026-02-23T13:06:03.768946+0000","last_unstale":"2026-02-23T13:08:41.632844+0000","last_undegraded":"2026-02-23T13:08:41.632844+0000","last_fullsized":"2026-02-23T13:08:41.632844+0000","mapping_epoch":48,"log_start":"56'79323","ondisk_log_start":"56'79323","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'78318","last_scrub_stamp":"2026-02-23T13:08:39.116213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:39.116213+0000","objects_scrubbed":8047,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:51.238638+0000","scrub_duration":832,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448856088,"num_objects":6850,"num_object_clones":0,"num_object_copies":20550,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6850,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":79326,"num_write_kb":2757569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"56'79020","reported_seq":79480,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:41.634560+0000","last_change":"2026-02-23T13:07:38.374570+0000","last_active":"2026-02-23T13:08:41.634560+0000","last_peered":"2026-02-23T13:08:41.634560+0000","last_clean":"2026-02-23T13:08:41.634560+0000","last_became_active":"2026-02-23T13:06:03.767083+0000","last_became_peered":"2026-02-23T13:06:03.767083+0000","last_unstale":"2026-02-23T13:08:41.634560+0000","last_undegraded":"2026-02-23T13:08:41.634560+0000","last_fullsized":"2026-02-23T13:08:41.634560+0000","mapping_epoch":48,"log_start":"56'79017","ondisk_log_start":"56'79017","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'44374","last_scrub_stamp":"2026-02-23T13:07:38.374512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:38.374512+0000","objects_scrubbed":42187,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:05.652994+0000","scrub_duration":4032,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":434634752,"num_objects":6632,"num_object_clones":0,"num_object_copies":19896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6632,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79020,"num_write_kb":2740864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"56'79096","reported_seq":79495,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:41.728725+0000","last_change":"2026-02-23T13:07:20.897120+0000","last_active":"2026-02-23T13:08:41.728725+0000","last_peered":"2026-02-23T13:08:41.728725+0000","last_clean":"2026-02-23T13:08:41.728725+0000","last_became_active":"2026-02-23T13:06:03.766614+0000","last_became_peered":"2026-02-23T13:06:03.766614+0000","last_unstale":"2026-02-23T13:08:41.728725+0000","last_undegraded":"2026-02-23T13:08:41.728725+0000","last_fullsized":"2026-02-23T13:08:41.728725+0000","mapping_epoch":48,"log_start":"56'79093","ondisk_log_start":"56'79093","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'36893","last_scrub_stamp":"2026-02-23T13:07:20.897051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:20.897051+0000","objects_scrubbed":36116,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"queued for scrub","scrub_duration":3824,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":437518336,"num_objects":6676,"num_object_clones":0,"num_object_copies":20028,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6676,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79096,"num_write_kb":2744704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"56'78984","reported_seq":79388,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:41.630660+0000","last_change":"2026-02-23T13:07:21.878287+0000","last_active":"2026-02-23T13:08:41.630660+0000","last_peered":"2026-02-23T13:08:41.630660+0000","last_clean":"2026-02-23T13:08:41.630660+0000","last_became_active":"2026-02-23T13:06:03.768238+0000","last_became_peered":"2026-02-23T13:06:03.768238+0000","last_unstale":"2026-02-23T13:08:41.630660+0000","last_undegraded":"2026-02-23T13:08:41.630660+0000","last_fullsized":"2026-02-23T13:08:41.630660+0000","mapping_epoch":48,"log_start":"56'78981","ondisk_log_start":"56'78981","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'37319","last_scrub_stamp":"2026-02-23T13:07:21.878230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:21.878230+0000","objects_scrubbed":36520,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:48.355026+0000","scrub_duration":3562,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438960128,"num_objects":6698,"num_object_clones":0,"num_object_copies":20094,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6698,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78984,"num_write_kb":2741824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"56'79318","reported_seq":79835,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:41.632675+0000","last_change":"2026-02-23T13:08:26.944478+0000","last_active":"2026-02-23T13:08:41.632675+0000","last_peered":"2026-02-23T13:08:41.632675+0000","last_clean":"2026-02-23T13:08:41.632675+0000","last_became_active":"2026-02-23T13:06:03.767947+0000","last_became_peered":"2026-02-23T13:06:03.767947+0000","last_unstale":"2026-02-23T13:08:41.632675+0000","last_undegraded":"2026-02-23T13:08:41.632675+0000","last_fullsized":"2026-02-23T13:08:41.632675+0000","mapping_epoch":48,"log_start":"56'79315","ondisk_log_start":"56'79315","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'71240","last_scrub_stamp":"2026-02-23T13:08:26.944430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:26.944430+0000","objects_scrubbed":14999,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:28.745863+0000","scrub_duration":1572,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":428081152,"num_objects":6532,"num_object_clones":0,"num_object_copies":19596,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6532,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79318,"num_write_kb":2747200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"56'78981","reported_seq":79509,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:41.733673+0000","last_change":"2026-02-23T13:08:41.327885+0000","last_active":"2026-02-23T13:08:41.733673+0000","last_peered":"2026-02-23T13:08:41.733673+0000","last_clean":"2026-02-23T13:08:41.733673+0000","last_became_active":"2026-02-23T13:06:03.766859+0000","last_became_peered":"2026-02-23T13:06:03.766859+0000","last_unstale":"2026-02-23T13:08:41.733673+0000","last_undegraded":"2026-02-23T13:08:41.733673+0000","last_fullsized":"2026-02-23T13:08:41.733673+0000","mapping_epoch":48,"log_start":"56'78978","ondisk_log_start":"56'78978","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'78824","last_scrub_stamp":"2026-02-23T13:08:41.327826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:41.327826+0000","objects_scrubbed":7081,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:52.060806+0000","scrub_duration":1129,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442302464,"num_objects":6749,"num_object_clones":0,"num_object_copies":20247,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6749,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78981,"num_write_kb":2743360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"56'79119","reported_seq":79674,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:41.731129+0000","last_change":"2026-02-23T13:08:26.463514+0000","last_active":"2026-02-23T13:08:41.731129+0000","last_peered":"2026-02-23T13:08:41.731129+0000","last_clean":"2026-02-23T13:08:41.731129+0000","last_became_active":"2026-02-23T13:06:03.765502+0000","last_became_peered":"2026-02-23T13:06:03.765502+0000","last_unstale":"2026-02-23T13:08:41.731129+0000","last_undegraded":"2026-02-23T13:08:41.731129+0000","last_fullsized":"2026-02-23T13:08:41.731129+0000","mapping_epoch":48,"log_start":"56'79116","ondisk_log_start":"56'79116","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'70782","last_scrub_stamp":"2026-02-23T13:08:26.463431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:26.463431+0000","objects_scrubbed":15411,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:34.767761+0000","scrub_duration":2162,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":431947776,"num_objects":6591,"num_object_clones":0,"num_object_copies":19773,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6591,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79119,"num_write_kb":2742720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"60'82310","reported_seq":82836,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-23T13:08:46.619931+0000","last_change":"2026-02-23T13:08:41.617449+0000","last_active":"2026-02-23T13:08:46.619931+0000","last_peered":"2026-02-23T13:08:46.619931+0000","last_clean":"2026-02-23T13:08:46.619931+0000","last_became_active":"2026-02-23T13:06:03.767012+0000","last_became_peered":"2026-02-23T13:06:03.767012+0000","last_unstale":"2026-02-23T13:08:46.619931+0000","last_undegraded":"2026-02-23T13:08:46.619931+0000","last_fullsized":"2026-02-23T13:08:46.619931+0000","mapping_epoch":48,"log_start":"60'82307","ondisk_log_start":"60'82307","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'79417","last_scrub_stamp":"2026-02-23T13:08:41.617359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:41.617359+0000","objects_scrubbed":6886,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:52.732199+0000","scrub_duration":898,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248905728,"num_objects":3798,"num_object_clones":0,"num_object_copies":11394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3798,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82310,"num_write_kb":2755456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"60'81841","reported_seq":82247,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-23T13:08:46.633703+0000","last_change":"2026-02-23T13:07:20.033733+0000","last_active":"2026-02-23T13:08:46.633703+0000","last_peered":"2026-02-23T13:08:46.633703+0000","last_clean":"2026-02-23T13:08:46.633703+0000","last_became_active":"2026-02-23T13:06:03.767200+0000","last_became_peered":"2026-02-23T13:06:03.767200+0000","last_unstale":"2026-02-23T13:08:46.633703+0000","last_undegraded":"2026-02-23T13:08:46.633703+0000","last_fullsized":"2026-02-23T13:08:46.633703+0000","mapping_epoch":48,"log_start":"60'81838","ondisk_log_start":"60'81838","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'36561","last_scrub_stamp":"2026-02-23T13:07:20.033700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:20.033700+0000","objects_scrubbed":35947,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"queued for scrub","scrub_duration":3247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250544128,"num_objects":3823,"num_object_clones":0,"num_object_copies":11469,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3823,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81841,"num_write_kb":2741248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"56'79813","reported_seq":80200,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:41.728145+0000","last_change":"2026-02-23T13:07:17.060455+0000","last_active":"2026-02-23T13:08:41.728145+0000","last_peered":"2026-02-23T13:08:41.728145+0000","last_clean":"2026-02-23T13:08:41.728145+0000","last_became_active":"2026-02-23T13:06:03.766415+0000","last_became_peered":"2026-02-23T13:06:03.766415+0000","last_unstale":"2026-02-23T13:08:41.728145+0000","last_undegraded":"2026-02-23T13:08:41.728145+0000","last_fullsized":"2026-02-23T13:08:41.728145+0000","mapping_epoch":48,"log_start":"56'79810","ondisk_log_start":"56'79810","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'35773","last_scrub_stamp":"2026-02-23T13:07:17.060384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:17.060384+0000","objects_scrubbed":34982,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"queued for scrub","scrub_duration":3962,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438370304,"num_objects":6689,"num_object_clones":0,"num_object_copies":20067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6689,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79813,"num_write_kb":2768064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"60'81560","reported_seq":82001,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-23T13:08:46.631746+0000","last_change":"2026-02-23T13:07:44.359896+0000","last_active":"2026-02-23T13:08:46.631746+0000","last_peered":"2026-02-23T13:08:46.631746+0000","last_clean":"2026-02-23T13:08:46.631746+0000","last_became_active":"2026-02-23T13:06:03.768541+0000","last_became_peered":"2026-02-23T13:06:03.768541+0000","last_unstale":"2026-02-23T13:08:46.631746+0000","last_undegraded":"2026-02-23T13:08:46.631746+0000","last_fullsized":"2026-02-23T13:08:46.631746+0000","mapping_epoch":48,"log_start":"60'81557","ondisk_log_start":"60'81557","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'47017","last_scrub_stamp":"2026-02-23T13:07:44.359774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:44.359774+0000","objects_scrubbed":39444,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:00.349146+0000","scrub_duration":4516,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":253755392,"num_objects":3872,"num_object_clones":0,"num_object_copies":11616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3872,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81560,"num_write_kb":2733824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"60'81415","reported_seq":81906,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-23T13:08:46.621754+0000","last_change":"2026-02-23T13:08:37.674953+0000","last_active":"2026-02-23T13:08:46.621754+0000","last_peered":"2026-02-23T13:08:46.621754+0000","last_clean":"2026-02-23T13:08:46.621754+0000","last_became_active":"2026-02-23T13:06:03.767001+0000","last_became_peered":"2026-02-23T13:06:03.767001+0000","last_unstale":"2026-02-23T13:08:46.621754+0000","last_undegraded":"2026-02-23T13:08:46.621754+0000","last_fullsized":"2026-02-23T13:08:46.621754+0000","mapping_epoch":48,"log_start":"60'81411","ondisk_log_start":"60'81411","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'76827","last_scrub_stamp":"2026-02-23T13:08:37.674915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:37.674915+0000","objects_scrubbed":8591,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:53.455324+0000","scrub_duration":879,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248184832,"num_objects":3787,"num_object_clones":0,"num_object_copies":11361,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3787,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81415,"num_write_kb":2726464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"56'79424","reported_seq":79874,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:41.731890+0000","last_change":"2026-02-23T13:08:40.487488+0000","last_active":"2026-02-23T13:08:41.731890+0000","last_peered":"2026-02-23T13:08:41.731890+0000","last_clean":"2026-02-23T13:08:41.731890+0000","last_became_active":"2026-02-23T13:06:03.766997+0000","last_became_peered":"2026-02-23T13:06:03.766997+0000","last_unstale":"2026-02-23T13:08:41.731890+0000","last_undegraded":"2026-02-23T13:08:41.731890+0000","last_fullsized":"2026-02-23T13:08:41.731890+0000","mapping_epoch":48,"log_start":"56'79421","ondisk_log_start":"56'79421","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'78912","last_scrub_stamp":"2026-02-23T13:08:40.487413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:40.487413+0000","objects_scrubbed":7357,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:59.679746+0000","scrub_duration":1309,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432799744,"num_objects":6604,"num_object_clones":0,"num_object_copies":19812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6604,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79424,"num_write_kb":2752896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"56'79457","reported_seq":79920,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:08:41.730279+0000","last_change":"2026-02-23T13:07:38.263276+0000","last_active":"2026-02-23T13:08:41.730279+0000","last_peered":"2026-02-23T13:08:41.730279+0000","last_clean":"2026-02-23T13:08:41.730279+0000","last_became_active":"2026-02-23T13:06:03.767015+0000","last_became_peered":"2026-02-23T13:06:03.767015+0000","last_unstale":"2026-02-23T13:08:41.730279+0000","last_undegraded":"2026-02-23T13:08:41.730279+0000","last_fullsized":"2026-02-23T13:08:41.730279+0000","mapping_epoch":48,"log_start":"56'79454","ondisk_log_start":"56'79454","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'44630","last_scrub_stamp":"2026-02-23T13:07:38.263188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:38.263188+0000","objects_scrubbed":42478,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:53.250163+0000","scrub_duration":5027,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444137472,"num_objects":6777,"num_object_clones":0,"num_object_copies":20331,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6777,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79457,"num_write_kb":2759488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":274,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-23T13:07:56.312851+0000","last_change":"2026-02-23T13:07:56.312851+0000","last_active":"2026-02-23T13:07:56.312851+0000","last_peered":"2026-02-23T13:07:56.312851+0000","last_clean":"2026-02-23T13:07:56.312851+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:07:56.312851+0000","last_undegraded":"2026-02-23T13:07:56.312851+0000","last_fullsized":"2026-02-23T13:07:56.312851+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:07:56.312801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:07:56.312801+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:14.345117+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":5895094296,"num_objects":89953,"num_object_clones":0,"num_object_copies":269859,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89953,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1284273,"num_write_kb":43975169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16009539584,"data_stored":16009527368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4221,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1428,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247879,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6070168,"kb_used_data":4376772,"kb_used_omap":10,"kb_used_meta":1693237,"kb_avail":727933032,"statfs":{"total":751619276800,"available":745403424768,"internally_reserved":0,"allocated":4481814528,"data_stored":4481431991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11030,"internal_metadata":1733874922},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444107,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5288904,"kb_used_data":3858420,"kb_used_omap":13,"kb_used_meta":1430386,"kb_avail":728714296,"statfs":{"total":751619276800,"available":746203439104,"internally_reserved":0,"allocated":3951022080,"data_stored":3950608027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13378,"internal_metadata":1464716222},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6451152,"kb_used_data":4842748,"kb_used_omap":12,"kb_used_meta":1608371,"kb_avail":727552048,"statfs":{"total":751619276800,"available":745013297152,"internally_reserved":0,"allocated":4958973952,"data_stored":4958599039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12843,"internal_metadata":1646972373},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705742,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4889276,"kb_used_data":3640552,"kb_used_omap":11,"kb_used_meta":1248692,"kb_avail":729113924,"statfs":{"total":751619276800,"available":746612658176,"internally_reserved":0,"allocated":3727925248,"data_stored":3727519074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11528,"internal_metadata":1278661368},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1428,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3276607488,"data_stored":3276603416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":186,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4797825024,"data_stored":4797825024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":279,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3538751488,"data_stored":3538747416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":186,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4396355584,"data_stored":4396351512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3570,"internal_metadata":0}]}} 2026-02-23T13:08:47.237 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:08:47.237 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 141 2026-02-23T13:08:47.277 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:08:47.421 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:47.422 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:47.547 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:47.544+0000 7f1abbbcf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:47.547 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:47.545+0000 7f1abbbcf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:47.549 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:47.547+0000 7fa15b4ab640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:47.549 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:47.547+0000 7fa15b4ab640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:47.564 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:08:47.564 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:08:47.579 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:08:47.579 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:08:47.596 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:08:47.596 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:08:47.611 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:08:47.611 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:08:47.710 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:08:47.749 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:08:48.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:47 trial046 ceph-mon[38575]: from='client.14867 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:08:48.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:47 trial046 ceph-mon[38575]: pgmap v209: 17 pgs: 17 active+clean; 5.5 GiB data, 22 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 3.49k op/s 2026-02-23T13:08:48.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:47 trial046 ceph-mon[38575]: from='client.14869 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:08:48.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:47 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2777798406' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:08:48.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:47 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1478266762' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "141"} : dispatch 2026-02-23T13:08:49.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:48 trial046 ceph-mon[38575]: 3.5 scrub starts 2026-02-23T13:08:49.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:48 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:08:49.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:48 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:08:49.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:48 trial046 ceph-mon[38575]: from='client.14871 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:08:49.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:48 trial046 ceph-mon[38575]: 3.5 scrub ok 2026-02-23T13:08:49.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:48 trial046 ceph-mon[38575]: 3.4 scrub starts 2026-02-23T13:08:49.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:48 trial046 ceph-mon[38575]: 3.4 scrub ok 2026-02-23T13:08:49.657 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:08:49.795 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:49.927 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:49.924+0000 7efea719e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:49.927 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:49.925+0000 7efea719e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:49.943 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:08:49.943 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:08:49.944 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:49 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:08:49.944 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:49 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:08:49.944 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:49 trial046 ceph-mon[38575]: 3.a scrub starts 2026-02-23T13:08:49.944 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:49 trial046 ceph-mon[38575]: pgmap v210: 17 pgs: 17 active+clean; 3.7 GiB data, 18 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 7.62k op/s 2026-02-23T13:08:49.944 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:49 trial046 ceph-mon[38575]: 3.a scrub ok 2026-02-23T13:08:49.958 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:08:49.958 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:08:49.973 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:08:49.973 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:08:49.987 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:08:49.987 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:08:51.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:50 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2508345738' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:08:52.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:51 trial046 ceph-mon[38575]: pgmap v211: 17 pgs: 17 active+clean; 3.7 GiB data, 18 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 6.64k op/s 2026-02-23T13:08:52.053 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:08:52.198 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:52.324 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:52.323+0000 7f4f56a2b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:52.324 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:52.323+0000 7f4f56a2b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:52.340 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:08:52.340 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:08:52.352 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:08:52.353 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:08:52.366 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:08:52.367 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:08:52.382 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:08:52.383 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:08:52.751 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:08:52.751 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:08:52.751 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_1 2026-02-23T13:08:52.752 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:08:52.893 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:53.012 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:53.011+0000 7fac1d7c0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:53.012 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:53.011+0000 7fac1d7c0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:53.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:52 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1827398867' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:08:53.159 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:08:53.160 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:08:53.197 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Removed 687112 objects 2026-02-23T13:08:53.197 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Clean up completed and total clean up time :78.335 2026-02-23T13:08:53.203 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":212,"stamp":"2026-02-23T13:08:52.636765+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":985268792,"num_objects":15028,"num_object_clones":0,"num_object_copies":45084,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15028,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":1359335,"num_write_kb":43977319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":8898392,"kb_used_data":3997128,"kb_used_omap":50,"kb_used_meta":4901069,"kb_avail":2927114408,"statfs":{"total":3006477107200,"available":2997365153792,"internally_reserved":0,"allocated":4093059072,"data_stored":4091410484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":51875,"internal_metadata":5018695005},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6030426112,"num_objects":-92017,"num_object_clones":0,"num_object_copies":-276051,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-92017,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92017,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001079"},"pg_stats":[{"pgid":"3.f","version":"60'85557","reported_seq":86050,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-23T13:08:51.627702+0000","last_change":"2026-02-23T13:08:31.492572+0000","last_active":"2026-02-23T13:08:51.627702+0000","last_peered":"2026-02-23T13:08:51.627702+0000","last_clean":"2026-02-23T13:08:51.627702+0000","last_became_active":"2026-02-23T13:06:03.767261+0000","last_became_peered":"2026-02-23T13:06:03.767261+0000","last_unstale":"2026-02-23T13:08:51.627702+0000","last_undegraded":"2026-02-23T13:08:51.627702+0000","last_fullsized":"2026-02-23T13:08:51.627702+0000","mapping_epoch":48,"log_start":"60'85554","ondisk_log_start":"60'85554","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'74185","last_scrub_stamp":"2026-02-23T13:08:31.492489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:31.492489+0000","objects_scrubbed":12779,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:36.828294+0000","scrub_duration":1689,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61800448,"num_objects":943,"num_object_clones":0,"num_object_copies":2829,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":943,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85557,"num_write_kb":2768000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"60'85053","reported_seq":85579,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-23T13:08:51.631347+0000","last_change":"2026-02-23T13:08:41.781710+0000","last_active":"2026-02-23T13:08:51.631347+0000","last_peered":"2026-02-23T13:08:51.631347+0000","last_clean":"2026-02-23T13:08:51.631347+0000","last_became_active":"2026-02-23T13:06:03.767822+0000","last_became_peered":"2026-02-23T13:06:03.767822+0000","last_unstale":"2026-02-23T13:08:51.631347+0000","last_undegraded":"2026-02-23T13:08:51.631347+0000","last_fullsized":"2026-02-23T13:08:51.631347+0000","mapping_epoch":48,"log_start":"60'85050","ondisk_log_start":"60'85050","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'79322","last_scrub_stamp":"2026-02-23T13:08:41.781660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:41.781660+0000","objects_scrubbed":6864,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:06.639282+0000","scrub_duration":892,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61014016,"num_objects":931,"num_object_clones":0,"num_object_copies":2793,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":931,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85053,"num_write_kb":2751488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"60'85143","reported_seq":85686,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-23T13:08:51.636271+0000","last_change":"2026-02-23T13:08:39.116293+0000","last_active":"2026-02-23T13:08:51.636271+0000","last_peered":"2026-02-23T13:08:51.636271+0000","last_clean":"2026-02-23T13:08:51.636271+0000","last_became_active":"2026-02-23T13:06:03.768946+0000","last_became_peered":"2026-02-23T13:06:03.768946+0000","last_unstale":"2026-02-23T13:08:51.636271+0000","last_undegraded":"2026-02-23T13:08:51.636271+0000","last_fullsized":"2026-02-23T13:08:51.636271+0000","mapping_epoch":48,"log_start":"60'85140","ondisk_log_start":"60'85140","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'78318","last_scrub_stamp":"2026-02-23T13:08:39.116213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:39.116213+0000","objects_scrubbed":8047,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:51.238638+0000","scrub_duration":832,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67633176,"num_objects":1033,"num_object_clones":0,"num_object_copies":3099,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1033,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":85143,"num_write_kb":2757569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"60'84673","reported_seq":85141,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-23T13:08:51.634399+0000","last_change":"2026-02-23T13:07:38.374570+0000","last_active":"2026-02-23T13:08:51.634399+0000","last_peered":"2026-02-23T13:08:51.634399+0000","last_clean":"2026-02-23T13:08:51.634399+0000","last_became_active":"2026-02-23T13:06:03.767083+0000","last_became_peered":"2026-02-23T13:06:03.767083+0000","last_unstale":"2026-02-23T13:08:51.634399+0000","last_undegraded":"2026-02-23T13:08:51.634399+0000","last_fullsized":"2026-02-23T13:08:51.634399+0000","mapping_epoch":48,"log_start":"60'84670","ondisk_log_start":"60'84670","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'44374","last_scrub_stamp":"2026-02-23T13:07:38.374512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:38.374512+0000","objects_scrubbed":42187,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:05.652994+0000","scrub_duration":4032,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64159744,"num_objects":979,"num_object_clones":0,"num_object_copies":2937,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":979,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84673,"num_write_kb":2740864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"60'84858","reported_seq":85318,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-23T13:08:51.732179+0000","last_change":"2026-02-23T13:08:45.831245+0000","last_active":"2026-02-23T13:08:51.732179+0000","last_peered":"2026-02-23T13:08:51.732179+0000","last_clean":"2026-02-23T13:08:51.732179+0000","last_became_active":"2026-02-23T13:06:03.766614+0000","last_became_peered":"2026-02-23T13:06:03.766614+0000","last_unstale":"2026-02-23T13:08:51.732179+0000","last_undegraded":"2026-02-23T13:08:51.732179+0000","last_fullsized":"2026-02-23T13:08:51.732179+0000","mapping_epoch":48,"log_start":"60'84855","ondisk_log_start":"60'84855","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'81413","last_scrub_stamp":"2026-02-23T13:08:45.831169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:45.831169+0000","objects_scrubbed":4516,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:52.491122+0000","scrub_duration":640,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59899904,"num_objects":914,"num_object_clones":0,"num_object_copies":2742,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":914,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84858,"num_write_kb":2744704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"60'84704","reported_seq":85152,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-23T13:08:51.634066+0000","last_change":"2026-02-23T13:08:48.721525+0000","last_active":"2026-02-23T13:08:51.634066+0000","last_peered":"2026-02-23T13:08:51.634066+0000","last_clean":"2026-02-23T13:08:51.634066+0000","last_became_active":"2026-02-23T13:06:03.768238+0000","last_became_peered":"2026-02-23T13:06:03.768238+0000","last_unstale":"2026-02-23T13:08:51.634066+0000","last_undegraded":"2026-02-23T13:08:51.634066+0000","last_fullsized":"2026-02-23T13:08:51.634066+0000","mapping_epoch":48,"log_start":"60'84701","ondisk_log_start":"60'84701","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'83001","last_scrub_stamp":"2026-02-23T13:08:48.721487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:48.721487+0000","objects_scrubbed":2763,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:10.095679+0000","scrub_duration":326,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64094208,"num_objects":978,"num_object_clones":0,"num_object_copies":2934,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":978,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84704,"num_write_kb":2741824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"60'84889","reported_seq":85414,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-23T13:08:51.635204+0000","last_change":"2026-02-23T13:08:26.944478+0000","last_active":"2026-02-23T13:08:51.635204+0000","last_peered":"2026-02-23T13:08:51.635204+0000","last_clean":"2026-02-23T13:08:51.635204+0000","last_became_active":"2026-02-23T13:06:03.767947+0000","last_became_peered":"2026-02-23T13:06:03.767947+0000","last_unstale":"2026-02-23T13:08:51.635204+0000","last_undegraded":"2026-02-23T13:08:51.635204+0000","last_fullsized":"2026-02-23T13:08:51.635204+0000","mapping_epoch":48,"log_start":"60'84886","ondisk_log_start":"60'84886","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'71240","last_scrub_stamp":"2026-02-23T13:08:26.944430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:26.944430+0000","objects_scrubbed":14999,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:28.745863+0000","scrub_duration":1572,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62980096,"num_objects":961,"num_object_clones":0,"num_object_copies":2883,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":961,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84889,"num_write_kb":2747200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"60'84776","reported_seq":85312,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-23T13:08:51.734948+0000","last_change":"2026-02-23T13:08:41.327885+0000","last_active":"2026-02-23T13:08:51.734948+0000","last_peered":"2026-02-23T13:08:51.734948+0000","last_clean":"2026-02-23T13:08:51.734948+0000","last_became_active":"2026-02-23T13:06:03.766859+0000","last_became_peered":"2026-02-23T13:06:03.766859+0000","last_unstale":"2026-02-23T13:08:51.734948+0000","last_undegraded":"2026-02-23T13:08:51.734948+0000","last_fullsized":"2026-02-23T13:08:51.734948+0000","mapping_epoch":48,"log_start":"60'84773","ondisk_log_start":"60'84773","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'78824","last_scrub_stamp":"2026-02-23T13:08:41.327826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:41.327826+0000","objects_scrubbed":7081,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:52.060806+0000","scrub_duration":1129,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62521344,"num_objects":954,"num_object_clones":0,"num_object_copies":2862,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":954,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84776,"num_write_kb":2743360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"60'84848","reported_seq":85411,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-23T13:08:51.735762+0000","last_change":"2026-02-23T13:08:26.463514+0000","last_active":"2026-02-23T13:08:51.735762+0000","last_peered":"2026-02-23T13:08:51.735762+0000","last_clean":"2026-02-23T13:08:51.735762+0000","last_became_active":"2026-02-23T13:06:03.765502+0000","last_became_peered":"2026-02-23T13:06:03.765502+0000","last_unstale":"2026-02-23T13:08:51.735762+0000","last_undegraded":"2026-02-23T13:08:51.735762+0000","last_fullsized":"2026-02-23T13:08:51.735762+0000","mapping_epoch":48,"log_start":"60'84845","ondisk_log_start":"60'84845","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'70782","last_scrub_stamp":"2026-02-23T13:08:26.463431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:26.463431+0000","objects_scrubbed":15411,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:34.767761+0000","scrub_duration":2162,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56492032,"num_objects":862,"num_object_clones":0,"num_object_copies":2586,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":862,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84848,"num_write_kb":2742720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"60'85175","reported_seq":85701,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-23T13:08:51.622058+0000","last_change":"2026-02-23T13:08:41.617449+0000","last_active":"2026-02-23T13:08:51.622058+0000","last_peered":"2026-02-23T13:08:51.622058+0000","last_clean":"2026-02-23T13:08:51.622058+0000","last_became_active":"2026-02-23T13:06:03.767012+0000","last_became_peered":"2026-02-23T13:06:03.767012+0000","last_unstale":"2026-02-23T13:08:51.622058+0000","last_undegraded":"2026-02-23T13:08:51.622058+0000","last_fullsized":"2026-02-23T13:08:51.622058+0000","mapping_epoch":48,"log_start":"60'85172","ondisk_log_start":"60'85172","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'79417","last_scrub_stamp":"2026-02-23T13:08:41.617359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:41.617359+0000","objects_scrubbed":6886,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:52.732199+0000","scrub_duration":898,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61145088,"num_objects":933,"num_object_clones":0,"num_object_copies":2799,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":933,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85175,"num_write_kb":2755456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"60'84716","reported_seq":85168,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-23T13:08:51.632742+0000","last_change":"2026-02-23T13:08:47.353629+0000","last_active":"2026-02-23T13:08:51.632742+0000","last_peered":"2026-02-23T13:08:51.632742+0000","last_clean":"2026-02-23T13:08:51.632742+0000","last_became_active":"2026-02-23T13:06:03.767200+0000","last_became_peered":"2026-02-23T13:06:03.767200+0000","last_unstale":"2026-02-23T13:08:51.632742+0000","last_undegraded":"2026-02-23T13:08:51.632742+0000","last_fullsized":"2026-02-23T13:08:51.632742+0000","mapping_epoch":48,"log_start":"60'84713","ondisk_log_start":"60'84713","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'82232","last_scrub_stamp":"2026-02-23T13:08:47.353540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:47.353540+0000","objects_scrubbed":3549,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:48.766344+0000","scrub_duration":458,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62128128,"num_objects":948,"num_object_clones":0,"num_object_copies":2844,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":948,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84716,"num_write_kb":2741248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"60'85594","reported_seq":86029,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-23T13:08:51.733738+0000","last_change":"2026-02-23T13:08:48.610238+0000","last_active":"2026-02-23T13:08:51.733738+0000","last_peered":"2026-02-23T13:08:51.733738+0000","last_clean":"2026-02-23T13:08:51.733738+0000","last_became_active":"2026-02-23T13:06:03.766415+0000","last_became_peered":"2026-02-23T13:06:03.766415+0000","last_unstale":"2026-02-23T13:08:51.733738+0000","last_undegraded":"2026-02-23T13:08:51.733738+0000","last_fullsized":"2026-02-23T13:08:51.733738+0000","mapping_epoch":48,"log_start":"60'85591","ondisk_log_start":"60'85591","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'83767","last_scrub_stamp":"2026-02-23T13:08:48.610071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:48.610071+0000","objects_scrubbed":2822,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:12.127192+0000","scrub_duration":415,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59506688,"num_objects":908,"num_object_clones":0,"num_object_copies":2724,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":908,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85594,"num_write_kb":2768064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"60'84524","reported_seq":84965,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-23T13:08:51.633108+0000","last_change":"2026-02-23T13:07:44.359896+0000","last_active":"2026-02-23T13:08:51.633108+0000","last_peered":"2026-02-23T13:08:51.633108+0000","last_clean":"2026-02-23T13:08:51.633108+0000","last_became_active":"2026-02-23T13:06:03.768541+0000","last_became_peered":"2026-02-23T13:06:03.768541+0000","last_unstale":"2026-02-23T13:08:51.633108+0000","last_undegraded":"2026-02-23T13:08:51.633108+0000","last_fullsized":"2026-02-23T13:08:51.633108+0000","mapping_epoch":48,"log_start":"60'84521","ondisk_log_start":"60'84521","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'47017","last_scrub_stamp":"2026-02-23T13:07:44.359774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:44.359774+0000","objects_scrubbed":39444,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:00.349146+0000","scrub_duration":4516,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59506688,"num_objects":908,"num_object_clones":0,"num_object_copies":2724,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":908,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84524,"num_write_kb":2733824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"60'84284","reported_seq":84775,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-23T13:08:51.622162+0000","last_change":"2026-02-23T13:08:37.674953+0000","last_active":"2026-02-23T13:08:51.622162+0000","last_peered":"2026-02-23T13:08:51.622162+0000","last_clean":"2026-02-23T13:08:51.622162+0000","last_became_active":"2026-02-23T13:06:03.767001+0000","last_became_peered":"2026-02-23T13:06:03.767001+0000","last_unstale":"2026-02-23T13:08:51.622162+0000","last_undegraded":"2026-02-23T13:08:51.622162+0000","last_fullsized":"2026-02-23T13:08:51.622162+0000","mapping_epoch":48,"log_start":"60'84281","ondisk_log_start":"60'84281","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'76827","last_scrub_stamp":"2026-02-23T13:08:37.674915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:37.674915+0000","objects_scrubbed":8591,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:53.455324+0000","scrub_duration":879,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60162048,"num_objects":918,"num_object_clones":0,"num_object_copies":2754,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":918,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84284,"num_write_kb":2726464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"60'85161","reported_seq":85620,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-23T13:08:51.731902+0000","last_change":"2026-02-23T13:08:40.487488+0000","last_active":"2026-02-23T13:08:51.731902+0000","last_peered":"2026-02-23T13:08:51.731902+0000","last_clean":"2026-02-23T13:08:51.731902+0000","last_became_active":"2026-02-23T13:06:03.766997+0000","last_became_peered":"2026-02-23T13:06:03.766997+0000","last_unstale":"2026-02-23T13:08:51.731902+0000","last_undegraded":"2026-02-23T13:08:51.731902+0000","last_fullsized":"2026-02-23T13:08:51.731902+0000","mapping_epoch":48,"log_start":"60'85158","ondisk_log_start":"60'85158","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'78912","last_scrub_stamp":"2026-02-23T13:08:40.487413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:08:40.487413+0000","objects_scrubbed":7357,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:59.679746+0000","scrub_duration":1309,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56819712,"num_objects":867,"num_object_clones":0,"num_object_copies":2601,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":867,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85161,"num_write_kb":2752896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"60'85245","reported_seq":85716,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-23T13:08:51.724846+0000","last_change":"2026-02-23T13:07:38.263276+0000","last_active":"2026-02-23T13:08:51.724846+0000","last_peered":"2026-02-23T13:08:51.724846+0000","last_clean":"2026-02-23T13:08:51.724846+0000","last_became_active":"2026-02-23T13:06:03.767015+0000","last_became_peered":"2026-02-23T13:06:03.767015+0000","last_unstale":"2026-02-23T13:08:51.724846+0000","last_undegraded":"2026-02-23T13:08:51.724846+0000","last_fullsized":"2026-02-23T13:08:51.724846+0000","mapping_epoch":48,"log_start":"60'85242","ondisk_log_start":"60'85242","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'44630","last_scrub_stamp":"2026-02-23T13:07:38.263188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:06:02.754918+0000","last_clean_scrub_stamp":"2026-02-23T13:07:38.263188+0000","objects_scrubbed":42478,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:08:53.250163+0000","scrub_duration":5027,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64815104,"num_objects":989,"num_object_clones":0,"num_object_copies":2967,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":989,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85245,"num_write_kb":2759488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":282,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-23T13:08:45.757410+0000","last_change":"2026-02-23T13:07:56.312851+0000","last_active":"2026-02-23T13:08:45.757410+0000","last_peered":"2026-02-23T13:08:45.757410+0000","last_clean":"2026-02-23T13:08:45.757410+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:08:45.757410+0000","last_undegraded":"2026-02-23T13:08:45.757410+0000","last_fullsized":"2026-02-23T13:08:45.757410+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:07:56.312801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:07:56.312801+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:14.345117+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":984678424,"num_objects":15026,"num_object_clones":0,"num_object_copies":45078,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15026,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1359200,"num_write_kb":43975169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2985177088,"data_stored":2985164872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4193,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247881,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1454536,"kb_used_data":717748,"kb_used_omap":9,"kb_used_meta":736758,"kb_avail":732548664,"statfs":{"total":751619276800,"available":750129831936,"internally_reserved":0,"allocated":734973952,"data_stored":734559899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9292,"internal_metadata":754441140},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444108,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2746440,"kb_used_data":1269044,"kb_used_omap":13,"kb_used_meta":1477362,"kb_avail":731256760,"statfs":{"total":751619276800,"available":748806922240,"internally_reserved":0,"allocated":1299501056,"data_stored":1299087003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14123,"internal_metadata":1512818901},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2187008,"kb_used_data":820908,"kb_used_omap":15,"kb_used_meta":1366064,"kb_avail":731816192,"statfs":{"total":751619276800,"available":749379780608,"internally_reserved":0,"allocated":840609792,"data_stored":840203363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15628,"internal_metadata":1398850292},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705743,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2510408,"kb_used_data":1189428,"kb_used_omap":12,"kb_used_meta":1320883,"kb_avail":731492792,"statfs":{"total":751619276800,"available":749048619008,"internally_reserved":0,"allocated":1217974272,"data_stored":1217560219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12832,"internal_metadata":1352584672},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":819531776,"data_stored":819527704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":186,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":650575872,"data_stored":650575872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1896,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":883494912,"data_stored":883490840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":279,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":631574528,"data_stored":631570456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1832,"internal_metadata":0}]}} 2026-02-23T13:08:53.205 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:08:53.206 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_1 pg_num 106 2026-02-23T13:08:53.359 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:53.460 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:53.459+0000 7f01d4a33640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:53.461 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:53.459+0000 7f01d4a33640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:53.571 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:08:53.602 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:08:54.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:53 trial046 ceph-mon[38575]: pgmap v212: 17 pgs: 17 active+clean; 940 MiB data, 8.5 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 11.50k op/s 2026-02-23T13:08:54.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:53 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3077922321' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_1", "var": "pg_num", "val": "106"} : dispatch 2026-02-23T13:08:54.429 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:08:54.546 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:54.642 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:54.641+0000 7fd13301a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:54.642 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:54.641+0000 7fd13301a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:54.654 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:08:54.654 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:08:54.665 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:08:54.666 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:08:54.677 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:08:54.677 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:08:54.688 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:08:54.689 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:08:55.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:54 trial046 ceph-mon[38575]: from='client.14881 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:08:55.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:54 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2934578093' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:08:55.639 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_1 2026-02-23T13:08:55.639 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool rm unique_pool_1 unique_pool_1 --yes-i-really-really-mean-it 2026-02-23T13:08:55.757 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:55.859 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:55.858+0000 7f9b80f70640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:55.859 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:55.858+0000 7f9b80f70640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:56.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:55 trial046 ceph-mon[38575]: pgmap v213: 17 pgs: 17 active+clean; 940 MiB data, 8.5 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 9.31k op/s 2026-02-23T13:08:56.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:55 trial046 ceph-mon[38575]: 3.2 scrub starts 2026-02-23T13:08:56.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:55 trial046 ceph-mon[38575]: 3.2 scrub ok 2026-02-23T13:08:56.539 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:08:56 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:08:56] "GET /metrics HTTP/1.1" 200 4241 "" "Prometheus/3.6.0" 2026-02-23T13:08:56.561 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:08:56 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:08:56.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:08:56.724 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:08:56.774 INFO:teuthology.orchestra.run.trial046.stderr:pool 'unique_pool_1' removed 2026-02-23T13:08:56.799 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:56 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/191567535' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "unique_pool_1", "pool2": "unique_pool_1", "yes_i_really_really_mean_it": true} : dispatch 2026-02-23T13:08:56.829 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2026-02-23T13:08:56.829 INFO:tasks.radosbench:Beginning radosbench... 2026-02-23T13:08:56.830 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_2 2026-02-23T13:08:56.830 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool create unique_pool_2 16 2026-02-23T13:08:56.857 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:57.066 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:57.454 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:57.197+0000 7f977908e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:57.454 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:57.197+0000 7f977908e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:57.454 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:08:57.455 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:08:57.455 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:08:57.455 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:08:57.455 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:08:57.455 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:08:57.456 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:08:57.456 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:08:58.005 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:57 trial046 ceph-mon[38575]: pgmap v214: 17 pgs: 17 active+clean; 591 MiB data, 5.2 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 8.97k op/s 2026-02-23T13:08:58.005 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:57 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/191567535' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_1", "pool2": "unique_pool_1", "yes_i_really_really_mean_it": true}]': finished 2026-02-23T13:08:58.005 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:57 trial046 ceph-mon[38575]: osdmap e61: 4 total, 4 up, 4 in 2026-02-23T13:08:58.005 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:57 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/300651008' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:08:58.159 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:58.131+0000 7f08e20ee640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:58.159 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:58.131+0000 7f08e20ee640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:58.603 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:08:58.603 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:08:58.777 INFO:teuthology.orchestra.run.trial046.stderr:pool 'unique_pool_2' created 2026-02-23T13:08:59.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:58 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1405120535' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "unique_pool_2", "pg_num": 16} : dispatch 2026-02-23T13:08:59.285 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool application enable unique_pool_2 rados --yes-i-really-mean-it || true 2026-02-23T13:08:59.404 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:08:59.510 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:59.509+0000 7f3d80536640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:59.510 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:08:59.509+0000 7f3d80536640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:08:59.778 INFO:teuthology.orchestra.run.trial046.stderr:enabled application 'rados' on pool 'unique_pool_2' 2026-02-23T13:09:00.024 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:09:00.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:59 trial046 ceph-mon[38575]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 3.8 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-23T13:09:00.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:59 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1405120535' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_2", "pg_num": 16}]': finished 2026-02-23T13:09:00.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:59 trial046 ceph-mon[38575]: osdmap e62: 4 total, 4 up, 4 in 2026-02-23T13:09:00.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:08:59 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/576423023' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true} : dispatch 2026-02-23T13:09:00.143 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:00.238 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:00.237+0000 7f3225b9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:00.238 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:00.238+0000 7f3225b9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:00.251 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:09:00.251 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:09:00.262 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:09:00.262 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:09:00.273 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:09:00.273 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:09:00.284 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:09:00.284 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:09:00.821 DEBUG:teuthology.orchestra.run.trial046:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -t 16 -b 65536 --object-size 65536 -p unique_pool_2 bench 90 write' 2026-02-23T13:09:00.822 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_2 2026-02-23T13:09:00.822 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:09:00.824 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2026-02-23T13:09:00.825 INFO:teuthology.orchestra.run:waiting for 3000 2026-02-23T13:09:00.873 INFO:tasks.radosbench.radosbench.0.trial046.stdout:hints = 1 2026-02-23T13:09:00.873 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2026-02-23T13:09:00.873 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Object prefix: benchmark_data_trial046_110246 2026-02-23T13:09:00.873 INFO:tasks.radosbench.radosbench.0.trial046.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-23T13:09:00.873 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 0 0 0 0 0 0 - 0 2026-02-23T13:09:00.961 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:01.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:00 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/576423023' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true}]': finished 2026-02-23T13:09:01.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:00 trial046 ceph-mon[38575]: osdmap e63: 4 total, 4 up, 4 in 2026-02-23T13:09:01.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:00 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1660291698' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:09:01.099 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:01.097+0000 7f857f126640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:01.099 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:01.098+0000 7f857f126640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:01.247 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:09:01.247 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:09:01.297 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":220,"stamp":"2026-02-23T13:09:00.785356+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":4003084,"kb_used_data":4220,"kb_used_omap":46,"kb_used_meta":3998737,"kb_avail":2932009716,"statfs":{"total":3006477107200,"available":3002377949184,"internally_reserved":0,"allocated":4321280,"data_stored":2684908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47131,"internal_metadata":4094707685},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-618922008,"num_objects":-9445,"num_object_clones":0,"num_object_copies":-28335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-9445,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-1364781,"num_write_kb":-43975169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.148028"},"pg_stats":[{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:08:58.774458+0000","last_change":"2026-02-23T13:08:58.774458+0000","last_active":"2026-02-23T13:08:58.774458+0000","last_peered":"2026-02-23T13:08:58.774458+0000","last_clean":"2026-02-23T13:08:58.774458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:08:58.774458+0000","last_undegraded":"2026-02-23T13:08:58.774458+0000","last_fullsized":"2026-02-23T13:08:58.774458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:08:58.774458+0000","last_change":"2026-02-23T13:08:58.774458+0000","last_active":"2026-02-23T13:08:58.774458+0000","last_peered":"2026-02-23T13:08:58.774458+0000","last_clean":"2026-02-23T13:08:58.774458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:08:58.774458+0000","last_undegraded":"2026-02-23T13:08:58.774458+0000","last_fullsized":"2026-02-23T13:08:58.774458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:08:58.774458+0000","last_change":"2026-02-23T13:08:58.774458+0000","last_active":"2026-02-23T13:08:58.774458+0000","last_peered":"2026-02-23T13:08:58.774458+0000","last_clean":"2026-02-23T13:08:58.774458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:08:58.774458+0000","last_undegraded":"2026-02-23T13:08:58.774458+0000","last_fullsized":"2026-02-23T13:08:58.774458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:08:58.774458+0000","last_change":"2026-02-23T13:08:58.774458+0000","last_active":"2026-02-23T13:08:58.774458+0000","last_peered":"2026-02-23T13:08:58.774458+0000","last_clean":"2026-02-23T13:08:58.774458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:08:58.774458+0000","last_undegraded":"2026-02-23T13:08:58.774458+0000","last_fullsized":"2026-02-23T13:08:58.774458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:08:58.774458+0000","last_change":"2026-02-23T13:08:58.774458+0000","last_active":"2026-02-23T13:08:58.774458+0000","last_peered":"2026-02-23T13:08:58.774458+0000","last_clean":"2026-02-23T13:08:58.774458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:08:58.774458+0000","last_undegraded":"2026-02-23T13:08:58.774458+0000","last_fullsized":"2026-02-23T13:08:58.774458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:08:58.774458+0000","last_change":"2026-02-23T13:08:58.774458+0000","last_active":"2026-02-23T13:08:58.774458+0000","last_peered":"2026-02-23T13:08:58.774458+0000","last_clean":"2026-02-23T13:08:58.774458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:08:58.774458+0000","last_undegraded":"2026-02-23T13:08:58.774458+0000","last_fullsized":"2026-02-23T13:08:58.774458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:08:58.774458+0000","last_change":"2026-02-23T13:08:58.774458+0000","last_active":"2026-02-23T13:08:58.774458+0000","last_peered":"2026-02-23T13:08:58.774458+0000","last_clean":"2026-02-23T13:08:58.774458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:08:58.774458+0000","last_undegraded":"2026-02-23T13:08:58.774458+0000","last_fullsized":"2026-02-23T13:08:58.774458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:08:58.774458+0000","last_change":"2026-02-23T13:08:58.774458+0000","last_active":"2026-02-23T13:08:58.774458+0000","last_peered":"2026-02-23T13:08:58.774458+0000","last_clean":"2026-02-23T13:08:58.774458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:08:58.774458+0000","last_undegraded":"2026-02-23T13:08:58.774458+0000","last_fullsized":"2026-02-23T13:08:58.774458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:08:58.774458+0000","last_change":"2026-02-23T13:08:58.774458+0000","last_active":"2026-02-23T13:08:58.774458+0000","last_peered":"2026-02-23T13:08:58.774458+0000","last_clean":"2026-02-23T13:08:58.774458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:08:58.774458+0000","last_undegraded":"2026-02-23T13:08:58.774458+0000","last_fullsized":"2026-02-23T13:08:58.774458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:08:58.774458+0000","last_change":"2026-02-23T13:08:58.774458+0000","last_active":"2026-02-23T13:08:58.774458+0000","last_peered":"2026-02-23T13:08:58.774458+0000","last_clean":"2026-02-23T13:08:58.774458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:08:58.774458+0000","last_undegraded":"2026-02-23T13:08:58.774458+0000","last_fullsized":"2026-02-23T13:08:58.774458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:08:58.774458+0000","last_change":"2026-02-23T13:08:58.774458+0000","last_active":"2026-02-23T13:08:58.774458+0000","last_peered":"2026-02-23T13:08:58.774458+0000","last_clean":"2026-02-23T13:08:58.774458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:08:58.774458+0000","last_undegraded":"2026-02-23T13:08:58.774458+0000","last_fullsized":"2026-02-23T13:08:58.774458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:08:58.774458+0000","last_change":"2026-02-23T13:08:58.774458+0000","last_active":"2026-02-23T13:08:58.774458+0000","last_peered":"2026-02-23T13:08:58.774458+0000","last_clean":"2026-02-23T13:08:58.774458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:08:58.774458+0000","last_undegraded":"2026-02-23T13:08:58.774458+0000","last_fullsized":"2026-02-23T13:08:58.774458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:08:58.774458+0000","last_change":"2026-02-23T13:08:58.774458+0000","last_active":"2026-02-23T13:08:58.774458+0000","last_peered":"2026-02-23T13:08:58.774458+0000","last_clean":"2026-02-23T13:08:58.774458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:08:58.774458+0000","last_undegraded":"2026-02-23T13:08:58.774458+0000","last_fullsized":"2026-02-23T13:08:58.774458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:08:58.774458+0000","last_change":"2026-02-23T13:08:58.774458+0000","last_active":"2026-02-23T13:08:58.774458+0000","last_peered":"2026-02-23T13:08:58.774458+0000","last_clean":"2026-02-23T13:08:58.774458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:08:58.774458+0000","last_undegraded":"2026-02-23T13:08:58.774458+0000","last_fullsized":"2026-02-23T13:08:58.774458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:08:58.774458+0000","last_change":"2026-02-23T13:08:58.774458+0000","last_active":"2026-02-23T13:08:58.774458+0000","last_peered":"2026-02-23T13:08:58.774458+0000","last_clean":"2026-02-23T13:08:58.774458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:08:58.774458+0000","last_undegraded":"2026-02-23T13:08:58.774458+0000","last_fullsized":"2026-02-23T13:08:58.774458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:08:58.774458+0000","last_change":"2026-02-23T13:08:58.774458+0000","last_active":"2026-02-23T13:08:58.774458+0000","last_peered":"2026-02-23T13:08:58.774458+0000","last_clean":"2026-02-23T13:08:58.774458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:08:58.774458+0000","last_undegraded":"2026-02-23T13:08:58.774458+0000","last_fullsized":"2026-02-23T13:08:58.774458+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":282,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-23T13:08:45.757410+0000","last_change":"2026-02-23T13:07:56.312851+0000","last_active":"2026-02-23T13:08:45.757410+0000","last_peered":"2026-02-23T13:08:45.757410+0000","last_clean":"2026-02-23T13:08:45.757410+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:08:45.757410+0000","last_undegraded":"2026-02-23T13:08:45.757410+0000","last_fullsized":"2026-02-23T13:08:45.757410+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:07:56.312801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:07:56.312801+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:14.345117+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247882,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":756036,"kb_used_data":1200,"kb_used_omap":9,"kb_used_meta":754806,"kb_avail":733247164,"statfs":{"total":751619276800,"available":750845095936,"internally_reserved":0,"allocated":1228800,"data_stored":818819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9292,"internal_metadata":772922292},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444109,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":504068,"kb_used_data":1200,"kb_used_omap":9,"kb_used_meta":502838,"kb_avail":733499132,"statfs":{"total":751619276800,"available":751103111168,"internally_reserved":0,"allocated":1228800,"data_stored":818819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9279,"internal_metadata":514907073},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1384768,"kb_used_data":620,"kb_used_omap":15,"kb_used_meta":1384112,"kb_avail":732618432,"statfs":{"total":751619276800,"available":750201274368,"internally_reserved":0,"allocated":634880,"data_stored":228451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15728,"internal_metadata":1417331344},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705744,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1358212,"kb_used_data":1200,"kb_used_omap":12,"kb_used_meta":1356979,"kb_avail":732644988,"statfs":{"total":751619276800,"available":750228467712,"internally_reserved":0,"allocated":1228800,"data_stored":818819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12832,"internal_metadata":1389546976},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:09:01.299 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_2 pgp_num 16 2026-02-23T13:09:01.439 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:01.569 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:01.567+0000 7f3683ff6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:01.569 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:01.567+0000 7f3683ff6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:01.790 INFO:teuthology.orchestra.run.trial046.stderr:set pool 4 pgp_num to 16 2026-02-23T13:09:01.810 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:01 trial046 ceph-mon[38575]: pgmap v219: 17 pgs: 16 unknown, 1 active+clean; 577 KiB data, 3.8 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-23T13:09:01.810 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:01 trial046 ceph-mon[38575]: osdmap e64: 4 total, 4 up, 4 in 2026-02-23T13:09:01.810 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:01 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:09:01.810 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:01 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3032358885' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_2", "var": "pgp_num", "val": "16"} : dispatch 2026-02-23T13:09:01.873 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 1 15 8323 8308 519.209 519.25 0.00237042 0.00192271 2026-02-23T13:09:02.319 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:09:02.474 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:02.606 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:02.605+0000 7f02d30c5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:02.606 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:02.605+0000 7f02d30c5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:02.621 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:09:02.622 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:09:02.634 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:09:02.635 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:09:02.651 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:09:02.652 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:09:02.665 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:09:02.666 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:09:02.873 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 2 16 16942 16926 528.896 538.625 0.00129156 0.00188826 2026-02-23T13:09:03.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:02 trial046 ceph-mon[38575]: from='client.14900 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:09:03.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:02 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3032358885' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "unique_pool_2", "var": "pgp_num", "val": "16"}]': finished 2026-02-23T13:09:03.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:02 trial046 ceph-mon[38575]: osdmap e65: 4 total, 4 up, 4 in 2026-02-23T13:09:03.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:02 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4215488709' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:09:03.873 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 3 16 25419 25403 529.188 529.812 0.00187551 0.00188784 2026-02-23T13:09:04.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:03 trial046 ceph-mon[38575]: pgmap v222: 17 pgs: 17 active+clean; 405 MiB data, 4.1 GiB used, 2.7 TiB / 2.7 TiB avail; 101 MiB/s wr, 1.62k op/s 2026-02-23T13:09:04.713 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:09:04.864 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:04.873 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 4 16 33884 33868 529.146 529.062 0.00155827 0.00188814 2026-02-23T13:09:05.351 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:09:05.352 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:09:05.352 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:05.292+0000 7f3d0a526640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:05.352 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:05.292+0000 7f3d0a526640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:05.352 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:09:05.352 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:09:05.355 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:09:05.355 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:09:05.369 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:09:05.369 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:09:05.873 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 5 16 39925 39909 498.823 377.562 0.00158322 0.00200318 2026-02-23T13:09:06.013 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:05 trial046 ceph-mon[38575]: pgmap v223: 17 pgs: 17 active+clean; 405 MiB data, 4.1 GiB used, 2.7 TiB / 2.7 TiB avail; 69 MiB/s wr, 1.10k op/s 2026-02-23T13:09:06.013 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:05 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/52437611' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:09:06.289 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:09:06 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:09:06] "GET /metrics HTTP/1.1" 200 4152 "" "Prometheus/3.6.0" 2026-02-23T13:09:06.561 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:09:06 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:09:06.087Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:09:06.838 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:09:06.838 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:09:06.838 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:09:06.838 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:09:06.873 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 6 15 48305 48290 502.982 523.812 0.00236974 0.00198649 2026-02-23T13:09:06.986 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:07.115 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:07.113+0000 7f66b94c1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:07.116 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:07.113+0000 7f66b94c1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:07.260 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:09:07.260 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:09:07.308 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":224,"stamp":"2026-02-23T13:09:06.638738+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2387477024,"num_objects":36423,"num_object_clones":0,"num_object_copies":109269,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36423,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":36556,"num_write_kb":2333094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":10706480,"kb_used_data":6418784,"kb_used_omap":58,"kb_used_meta":4287493,"kb_avail":2925306320,"statfs":{"total":3006477107200,"available":2995513671680,"internally_reserved":0,"allocated":6572834816,"data_stored":6571053972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":59947,"internal_metadata":4390393301},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2386886656,"num_objects":36421,"num_object_clones":0,"num_object_copies":109263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36421,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36421,"num_write_kb":2330944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.860528"},"pg_stats":[{"pgid":"4.f","version":"64'432","reported_seq":442,"reported_epoch":64,"state":"active+clean","last_fresh":"2026-02-23T13:09:01.736845+0000","last_change":"2026-02-23T13:08:59.785158+0000","last_active":"2026-02-23T13:09:01.736845+0000","last_peered":"2026-02-23T13:09:01.736845+0000","last_clean":"2026-02-23T13:09:01.736845+0000","last_became_active":"2026-02-23T13:08:59.784888+0000","last_became_peered":"2026-02-23T13:08:59.784888+0000","last_unstale":"2026-02-23T13:09:01.736845+0000","last_undegraded":"2026-02-23T13:09:01.736845+0000","last_fullsized":"2026-02-23T13:09:01.736845+0000","mapping_epoch":62,"log_start":"64'428","ondisk_log_start":"64'428","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":428,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:03.961570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28311552,"num_objects":432,"num_object_clones":0,"num_object_copies":1296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":432,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":27648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"65'2832","reported_seq":2849,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:06.631765+0000","last_change":"2026-02-23T13:08:59.785686+0000","last_active":"2026-02-23T13:09:06.631765+0000","last_peered":"2026-02-23T13:09:06.631765+0000","last_clean":"2026-02-23T13:09:06.631765+0000","last_became_active":"2026-02-23T13:08:59.785397+0000","last_became_peered":"2026-02-23T13:08:59.785397+0000","last_unstale":"2026-02-23T13:09:06.631765+0000","last_undegraded":"2026-02-23T13:09:06.631765+0000","last_fullsized":"2026-02-23T13:09:06.631765+0000","mapping_epoch":62,"log_start":"65'2829","ondisk_log_start":"65'2829","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2829,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:19.572572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185597952,"num_objects":2832,"num_object_clones":0,"num_object_copies":8496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2832,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2832,"num_write_kb":181248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"65'2845","reported_seq":2862,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:06.634999+0000","last_change":"2026-02-23T13:08:59.786322+0000","last_active":"2026-02-23T13:09:06.634999+0000","last_peered":"2026-02-23T13:09:06.634999+0000","last_clean":"2026-02-23T13:09:06.634999+0000","last_became_active":"2026-02-23T13:08:59.785780+0000","last_became_peered":"2026-02-23T13:08:59.785780+0000","last_unstale":"2026-02-23T13:09:06.634999+0000","last_undegraded":"2026-02-23T13:09:06.634999+0000","last_fullsized":"2026-02-23T13:09:06.634999+0000","mapping_epoch":62,"log_start":"65'2842","ondisk_log_start":"65'2842","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2842,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:01.263222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186449920,"num_objects":2845,"num_object_clones":0,"num_object_copies":8535,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2845,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2845,"num_write_kb":182080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"65'2872","reported_seq":2889,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:06.631172+0000","last_change":"2026-02-23T13:08:59.784416+0000","last_active":"2026-02-23T13:09:06.631172+0000","last_peered":"2026-02-23T13:09:06.631172+0000","last_clean":"2026-02-23T13:09:06.631172+0000","last_became_active":"2026-02-23T13:08:59.783982+0000","last_became_peered":"2026-02-23T13:08:59.783982+0000","last_unstale":"2026-02-23T13:09:06.631172+0000","last_undegraded":"2026-02-23T13:09:06.631172+0000","last_fullsized":"2026-02-23T13:09:06.631172+0000","mapping_epoch":62,"log_start":"65'2869","ondisk_log_start":"65'2869","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2869,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:19.759236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188219392,"num_objects":2872,"num_object_clones":0,"num_object_copies":8616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2872,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2872,"num_write_kb":183808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"65'2932","reported_seq":2947,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:06.626244+0000","last_change":"2026-02-23T13:08:59.784919+0000","last_active":"2026-02-23T13:09:06.626244+0000","last_peered":"2026-02-23T13:09:06.626244+0000","last_clean":"2026-02-23T13:09:06.626244+0000","last_became_active":"2026-02-23T13:08:59.784710+0000","last_became_peered":"2026-02-23T13:08:59.784710+0000","last_unstale":"2026-02-23T13:09:06.626244+0000","last_undegraded":"2026-02-23T13:09:06.626244+0000","last_fullsized":"2026-02-23T13:09:06.626244+0000","mapping_epoch":62,"log_start":"65'2929","ondisk_log_start":"65'2929","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2929,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:22.287957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192151552,"num_objects":2932,"num_object_clones":0,"num_object_copies":8796,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2932,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2932,"num_write_kb":187648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"65'2972","reported_seq":2988,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:06.636023+0000","last_change":"2026-02-23T13:08:59.784739+0000","last_active":"2026-02-23T13:09:06.636023+0000","last_peered":"2026-02-23T13:09:06.636023+0000","last_clean":"2026-02-23T13:09:06.636023+0000","last_became_active":"2026-02-23T13:08:59.784218+0000","last_became_peered":"2026-02-23T13:08:59.784218+0000","last_unstale":"2026-02-23T13:09:06.636023+0000","last_undegraded":"2026-02-23T13:09:06.636023+0000","last_fullsized":"2026-02-23T13:09:06.636023+0000","mapping_epoch":62,"log_start":"65'2969","ondisk_log_start":"65'2969","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2969,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:25.462760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194772992,"num_objects":2972,"num_object_clones":0,"num_object_copies":8916,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2972,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2972,"num_write_kb":190208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"65'2915","reported_seq":2932,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:06.633372+0000","last_change":"2026-02-23T13:08:59.784708+0000","last_active":"2026-02-23T13:09:06.633372+0000","last_peered":"2026-02-23T13:09:06.633372+0000","last_clean":"2026-02-23T13:09:06.633372+0000","last_became_active":"2026-02-23T13:08:59.784210+0000","last_became_peered":"2026-02-23T13:08:59.784210+0000","last_unstale":"2026-02-23T13:09:06.633372+0000","last_undegraded":"2026-02-23T13:09:06.633372+0000","last_fullsized":"2026-02-23T13:09:06.633372+0000","mapping_epoch":62,"log_start":"65'2912","ondisk_log_start":"65'2912","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2912,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:01.093732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191037440,"num_objects":2915,"num_object_clones":0,"num_object_copies":8745,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2915,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2915,"num_write_kb":186560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"65'2785","reported_seq":2802,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:06.634650+0000","last_change":"2026-02-23T13:08:59.785913+0000","last_active":"2026-02-23T13:09:06.634650+0000","last_peered":"2026-02-23T13:09:06.634650+0000","last_clean":"2026-02-23T13:09:06.634650+0000","last_became_active":"2026-02-23T13:08:59.785359+0000","last_became_peered":"2026-02-23T13:08:59.785359+0000","last_unstale":"2026-02-23T13:09:06.634650+0000","last_undegraded":"2026-02-23T13:09:06.634650+0000","last_fullsized":"2026-02-23T13:09:06.634650+0000","mapping_epoch":62,"log_start":"65'2782","ondisk_log_start":"65'2782","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2782,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:18.876316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182517760,"num_objects":2785,"num_object_clones":0,"num_object_copies":8355,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2785,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2785,"num_write_kb":178240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"64'432","reported_seq":444,"reported_epoch":64,"state":"active+clean","last_fresh":"2026-02-23T13:09:01.736572+0000","last_change":"2026-02-23T13:08:59.786387+0000","last_active":"2026-02-23T13:09:01.736572+0000","last_peered":"2026-02-23T13:09:01.736572+0000","last_clean":"2026-02-23T13:09:01.736572+0000","last_became_active":"2026-02-23T13:08:59.785106+0000","last_became_peered":"2026-02-23T13:08:59.785106+0000","last_unstale":"2026-02-23T13:09:01.736572+0000","last_undegraded":"2026-02-23T13:09:01.736572+0000","last_fullsized":"2026-02-23T13:09:01.736572+0000","mapping_epoch":62,"log_start":"64'429","ondisk_log_start":"64'429","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":429,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:00.612594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28311552,"num_objects":432,"num_object_clones":0,"num_object_copies":1296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":432,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":27648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"65'2804","reported_seq":2821,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:06.624166+0000","last_change":"2026-02-23T13:08:59.784789+0000","last_active":"2026-02-23T13:09:06.624166+0000","last_peered":"2026-02-23T13:09:06.624166+0000","last_clean":"2026-02-23T13:09:06.624166+0000","last_became_active":"2026-02-23T13:08:59.784457+0000","last_became_peered":"2026-02-23T13:08:59.784457+0000","last_unstale":"2026-02-23T13:09:06.624166+0000","last_undegraded":"2026-02-23T13:09:06.624166+0000","last_fullsized":"2026-02-23T13:09:06.624166+0000","mapping_epoch":62,"log_start":"65'2801","ondisk_log_start":"65'2801","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2801,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:10.735235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183762944,"num_objects":2804,"num_object_clones":0,"num_object_copies":8412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2804,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2804,"num_write_kb":179456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"64'468","reported_seq":482,"reported_epoch":64,"state":"active+clean","last_fresh":"2026-02-23T13:09:01.735926+0000","last_change":"2026-02-23T13:08:59.784450+0000","last_active":"2026-02-23T13:09:01.735926+0000","last_peered":"2026-02-23T13:09:01.735926+0000","last_clean":"2026-02-23T13:09:01.735926+0000","last_became_active":"2026-02-23T13:08:59.784235+0000","last_became_peered":"2026-02-23T13:08:59.784235+0000","last_unstale":"2026-02-23T13:09:01.735926+0000","last_undegraded":"2026-02-23T13:09:01.735926+0000","last_fullsized":"2026-02-23T13:09:01.735926+0000","mapping_epoch":62,"log_start":"64'465","ondisk_log_start":"64'465","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":465,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:16.050902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30670848,"num_objects":468,"num_object_clones":0,"num_object_copies":1404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":468,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":468,"num_write_kb":29952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"65'2968","reported_seq":2985,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:06.619084+0000","last_change":"2026-02-23T13:08:59.784582+0000","last_active":"2026-02-23T13:09:06.619084+0000","last_peered":"2026-02-23T13:09:06.619084+0000","last_clean":"2026-02-23T13:09:06.619084+0000","last_became_active":"2026-02-23T13:08:59.784318+0000","last_became_peered":"2026-02-23T13:08:59.784318+0000","last_unstale":"2026-02-23T13:09:06.619084+0000","last_undegraded":"2026-02-23T13:09:06.619084+0000","last_fullsized":"2026-02-23T13:09:06.619084+0000","mapping_epoch":62,"log_start":"65'2965","ondisk_log_start":"65'2965","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2965,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:59.400673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194510848,"num_objects":2968,"num_object_clones":0,"num_object_copies":8904,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2968,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2968,"num_write_kb":189952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"64'456","reported_seq":468,"reported_epoch":64,"state":"active+clean","last_fresh":"2026-02-23T13:09:01.734352+0000","last_change":"2026-02-23T13:08:59.784710+0000","last_active":"2026-02-23T13:09:01.734352+0000","last_peered":"2026-02-23T13:09:01.734352+0000","last_clean":"2026-02-23T13:09:01.734352+0000","last_became_active":"2026-02-23T13:08:59.784463+0000","last_became_peered":"2026-02-23T13:08:59.784463+0000","last_unstale":"2026-02-23T13:09:01.734352+0000","last_undegraded":"2026-02-23T13:09:01.734352+0000","last_fullsized":"2026-02-23T13:09:01.734352+0000","mapping_epoch":62,"log_start":"64'453","ondisk_log_start":"64'453","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":453,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:10.646767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29884416,"num_objects":456,"num_object_clones":0,"num_object_copies":1368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":456,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":456,"num_write_kb":29184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"65'2854","reported_seq":2871,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:06.635327+0000","last_change":"2026-02-23T13:08:59.784910+0000","last_active":"2026-02-23T13:09:06.635327+0000","last_peered":"2026-02-23T13:09:06.635327+0000","last_clean":"2026-02-23T13:09:06.635327+0000","last_became_active":"2026-02-23T13:08:59.784436+0000","last_became_peered":"2026-02-23T13:08:59.784436+0000","last_unstale":"2026-02-23T13:09:06.635327+0000","last_undegraded":"2026-02-23T13:09:06.635327+0000","last_fullsized":"2026-02-23T13:09:06.635327+0000","mapping_epoch":62,"log_start":"65'2851","ondisk_log_start":"65'2851","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2851,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:02.594318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187039744,"num_objects":2854,"num_object_clones":0,"num_object_copies":8562,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2854,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2854,"num_write_kb":182656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"65'2942","reported_seq":2959,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:06.624481+0000","last_change":"2026-02-23T13:08:59.784689+0000","last_active":"2026-02-23T13:09:06.624481+0000","last_peered":"2026-02-23T13:09:06.624481+0000","last_clean":"2026-02-23T13:09:06.624481+0000","last_became_active":"2026-02-23T13:08:59.784290+0000","last_became_peered":"2026-02-23T13:08:59.784290+0000","last_unstale":"2026-02-23T13:09:06.624481+0000","last_undegraded":"2026-02-23T13:09:06.624481+0000","last_fullsized":"2026-02-23T13:09:06.624481+0000","mapping_epoch":62,"log_start":"65'2939","ondisk_log_start":"65'2939","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2939,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:25.847402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192806912,"num_objects":2942,"num_object_clones":0,"num_object_copies":8826,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2942,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2942,"num_write_kb":188288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"65'2912","reported_seq":2929,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:06.637865+0000","last_change":"2026-02-23T13:08:59.786106+0000","last_active":"2026-02-23T13:09:06.637865+0000","last_peered":"2026-02-23T13:09:06.637865+0000","last_clean":"2026-02-23T13:09:06.637865+0000","last_became_active":"2026-02-23T13:08:59.785634+0000","last_became_peered":"2026-02-23T13:08:59.785634+0000","last_unstale":"2026-02-23T13:09:06.637865+0000","last_undegraded":"2026-02-23T13:09:06.637865+0000","last_fullsized":"2026-02-23T13:09:06.637865+0000","mapping_epoch":62,"log_start":"65'2909","ondisk_log_start":"65'2909","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2909,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:01.725790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190840832,"num_objects":2912,"num_object_clones":0,"num_object_copies":8736,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2912,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2912,"num_write_kb":186368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":293,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:01.789466+0000","last_change":"2026-02-23T13:07:56.312851+0000","last_active":"2026-02-23T13:09:01.789466+0000","last_peered":"2026-02-23T13:09:01.789466+0000","last_clean":"2026-02-23T13:09:01.789466+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:09:01.789466+0000","last_undegraded":"2026-02-23T13:09:01.789466+0000","last_fullsized":"2026-02-23T13:09:01.789466+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:07:56.312801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:07:56.312801+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:14.345117+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":2386886656,"num_objects":36421,"num_object_clones":0,"num_object_copies":109263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36421,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36421,"num_write_kb":2330944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7477395456,"data_stored":7477395456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247884,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2994688,"kb_used_data":2131564,"kb_used_omap":12,"kb_used_meta":863091,"kb_avail":731008512,"statfs":{"total":751619276800,"available":748552716288,"internally_reserved":0,"allocated":2182721536,"data_stored":2182273551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12641,"internal_metadata":883805855},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444111,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2866816,"kb_used_data":2273708,"kb_used_omap":12,"kb_used_meta":593075,"kb_avail":731136384,"statfs":{"total":751619276800,"available":748683657216,"internally_reserved":0,"allocated":2328276992,"data_stored":2327829007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12632,"internal_metadata":607309480},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1501488,"kb_used_data":117276,"kb_used_omap":18,"kb_used_meta":1384109,"kb_avail":732501712,"statfs":{"total":751619276800,"available":750081753088,"internally_reserved":0,"allocated":120090624,"data_stored":119653735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18520,"internal_metadata":1417328552},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705746,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3343488,"kb_used_data":1896236,"kb_used_omap":15,"kb_used_meta":1447216,"kb_avail":730659712,"statfs":{"total":751619276800,"available":748195545088,"internally_reserved":0,"allocated":1941745664,"data_stored":1941297679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16154,"internal_metadata":1481949414},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2261057536,"data_stored":2261057536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":294846464,"data_stored":294846464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2647654400,"data_stored":2647654400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2273837056,"data_stored":2273837056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:09:07.310 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:09:07.311 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 151 2026-02-23T13:09:07.492 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:07.626 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:07.623+0000 7fbc25405640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:07.626 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:07.624+0000 7fbc25405640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:07.787 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:09:07.826 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:09:07.874 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 7 16 56946 56930 508.265 540 0.00164873 0.0019659 2026-02-23T13:09:08.038 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:09:08.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:07 trial046 ceph-mon[38575]: pgmap v224: 17 pgs: 17 active+clean; 2.2 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 332 MiB/s wr, 5.31k op/s 2026-02-23T13:09:08.181 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:08.308 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:08.305+0000 7f9bcaa33640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:08.308 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:08.306+0000 7f9bcaa33640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:08.323 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:09:08.324 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:09:08.336 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:09:08.336 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:09:08.349 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:09:08.350 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:09:08.362 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:09:08.363 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:09:08.873 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 8 16 65395 65379 510.734 528.062 0.00259104 0.0019565 2026-02-23T13:09:09.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:08 trial046 ceph-mon[38575]: from='client.14908 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:09:09.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:08 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3092569714' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "151"} : dispatch 2026-02-23T13:09:09.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:08 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-23T13:09:09.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:08 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:09:09.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:08 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-23T13:09:09.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:08 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:09:09.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:08 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-23T13:09:09.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:08 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1795840115' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:09:09.874 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 9 15 73715 73700 511.768 520.062 0.0018194 0.00195255 2026-02-23T13:09:10.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:09 trial046 ceph-mon[38575]: pgmap v225: 17 pgs: 17 active+clean; 2.8 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 362 MiB/s wr, 5.79k op/s 2026-02-23T13:09:10.409 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:09:10.549 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:10.684 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:10.681+0000 7ff017c49640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:10.684 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:10.681+0000 7ff017c49640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:10.697 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:09:10.698 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:09:10.711 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:09:10.711 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:09:10.728 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:09:10.728 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:09:10.741 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:09:10.741 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:09:10.874 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 10 16 81727 81711 510.656 500.688 0.00166795 0.00195682 2026-02-23T13:09:11.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:10 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/220169786' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:09:11.874 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 11 16 90211 90195 512.433 530.25 0.00104587 0.00194996 2026-02-23T13:09:12.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:11 trial046 ceph-mon[38575]: pgmap v226: 17 pgs: 17 active+clean; 2.8 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 294 MiB/s wr, 4.71k op/s 2026-02-23T13:09:12.785 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:09:12.828 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:09:12.828 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:09:12.828 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:09:12.829 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:09:12.874 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 12 15 98879 98864 514.878 541.812 0.00119331 0.00194085 2026-02-23T13:09:12.938 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:12.982 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:13.075 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:13.073+0000 7f6de066a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:13.075 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:13.073+0000 7f6de066a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:13.089 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:13.087+0000 7fc8aa38a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:13.090 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:13.088+0000 7fc8aa38a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:13.091 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:09:13.091 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:09:13.105 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:09:13.106 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:09:13.120 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:09:13.120 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:09:13.133 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:09:13.133 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:09:13.238 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:09:13.239 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:09:13.283 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":227,"stamp":"2026-02-23T13:09:12.639590+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5791613472,"num_objects":88366,"num_object_clones":0,"num_object_copies":265098,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88366,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":88499,"num_write_kb":5657446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":19922940,"kb_used_data":16032364,"kb_used_omap":51,"kb_used_meta":3890444,"kb_avail":2916089860,"statfs":{"total":3006477107200,"available":2986076016640,"internally_reserved":0,"allocated":16417140736,"data_stored":16415352348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52499,"internal_metadata":3983815405},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[13,4],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5366546432,"num_objects":81887,"num_object_clones":0,"num_object_copies":245661,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81887,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81887,"num_write_kb":5240768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.850329"},"pg_stats":[{"pgid":"4.f","version":"65'5651","reported_seq":5668,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:11.735334+0000","last_change":"2026-02-23T13:08:59.785158+0000","last_active":"2026-02-23T13:09:11.735334+0000","last_peered":"2026-02-23T13:09:11.735334+0000","last_clean":"2026-02-23T13:09:11.735334+0000","last_became_active":"2026-02-23T13:08:59.784888+0000","last_became_peered":"2026-02-23T13:08:59.784888+0000","last_unstale":"2026-02-23T13:09:11.735334+0000","last_undegraded":"2026-02-23T13:09:11.735334+0000","last_fullsized":"2026-02-23T13:09:11.735334+0000","mapping_epoch":62,"log_start":"65'5648","ondisk_log_start":"65'5648","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:14.965697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":370343936,"num_objects":5651,"num_object_clones":0,"num_object_copies":16953,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5651,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5651,"num_write_kb":361664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"65'5440","reported_seq":5457,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:11.634856+0000","last_change":"2026-02-23T13:08:59.785686+0000","last_active":"2026-02-23T13:09:11.634856+0000","last_peered":"2026-02-23T13:09:11.634856+0000","last_clean":"2026-02-23T13:09:11.634856+0000","last_became_active":"2026-02-23T13:08:59.785397+0000","last_became_peered":"2026-02-23T13:08:59.785397+0000","last_unstale":"2026-02-23T13:09:11.634856+0000","last_undegraded":"2026-02-23T13:09:11.634856+0000","last_fullsized":"2026-02-23T13:09:11.634856+0000","mapping_epoch":62,"log_start":"65'5437","ondisk_log_start":"65'5437","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:19.572572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356515840,"num_objects":5440,"num_object_clones":0,"num_object_copies":16320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5440,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5440,"num_write_kb":348160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"65'5429","reported_seq":5446,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:11.627373+0000","last_change":"2026-02-23T13:08:59.786322+0000","last_active":"2026-02-23T13:09:11.627373+0000","last_peered":"2026-02-23T13:09:11.627373+0000","last_clean":"2026-02-23T13:09:11.627373+0000","last_became_active":"2026-02-23T13:08:59.785780+0000","last_became_peered":"2026-02-23T13:08:59.785780+0000","last_unstale":"2026-02-23T13:09:11.627373+0000","last_undegraded":"2026-02-23T13:09:11.627373+0000","last_fullsized":"2026-02-23T13:09:11.627373+0000","mapping_epoch":62,"log_start":"65'5426","ondisk_log_start":"65'5426","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:01.263222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":355794944,"num_objects":5429,"num_object_clones":0,"num_object_copies":16287,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5429,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5429,"num_write_kb":347456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"65'5476","reported_seq":5491,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:11.634396+0000","last_change":"2026-02-23T13:08:59.784416+0000","last_active":"2026-02-23T13:09:11.634396+0000","last_peered":"2026-02-23T13:09:11.634396+0000","last_clean":"2026-02-23T13:09:11.634396+0000","last_became_active":"2026-02-23T13:08:59.783982+0000","last_became_peered":"2026-02-23T13:08:59.783982+0000","last_unstale":"2026-02-23T13:09:11.634396+0000","last_undegraded":"2026-02-23T13:09:11.634396+0000","last_fullsized":"2026-02-23T13:09:11.634396+0000","mapping_epoch":62,"log_start":"65'5473","ondisk_log_start":"65'5473","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:19.759236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358875136,"num_objects":5476,"num_object_clones":0,"num_object_copies":16428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5476,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5476,"num_write_kb":350464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"65'5616","reported_seq":5633,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:11.625922+0000","last_change":"2026-02-23T13:08:59.784919+0000","last_active":"2026-02-23T13:09:11.625922+0000","last_peered":"2026-02-23T13:09:11.625922+0000","last_clean":"2026-02-23T13:09:11.625922+0000","last_became_active":"2026-02-23T13:08:59.784710+0000","last_became_peered":"2026-02-23T13:08:59.784710+0000","last_unstale":"2026-02-23T13:09:11.625922+0000","last_undegraded":"2026-02-23T13:09:11.625922+0000","last_fullsized":"2026-02-23T13:09:11.625922+0000","mapping_epoch":62,"log_start":"65'5613","ondisk_log_start":"65'5613","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:22.287957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":368050176,"num_objects":5616,"num_object_clones":0,"num_object_copies":16848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5616,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5616,"num_write_kb":359424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"65'5586","reported_seq":5603,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:11.636259+0000","last_change":"2026-02-23T13:08:59.784739+0000","last_active":"2026-02-23T13:09:11.636259+0000","last_peered":"2026-02-23T13:09:11.636259+0000","last_clean":"2026-02-23T13:09:11.636259+0000","last_became_active":"2026-02-23T13:08:59.784218+0000","last_became_peered":"2026-02-23T13:08:59.784218+0000","last_unstale":"2026-02-23T13:09:11.636259+0000","last_undegraded":"2026-02-23T13:09:11.636259+0000","last_fullsized":"2026-02-23T13:09:11.636259+0000","mapping_epoch":62,"log_start":"65'5583","ondisk_log_start":"65'5583","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:25.462760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":366084096,"num_objects":5586,"num_object_clones":0,"num_object_copies":16758,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5586,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5586,"num_write_kb":357504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"65'5551","reported_seq":5567,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:11.632402+0000","last_change":"2026-02-23T13:08:59.784708+0000","last_active":"2026-02-23T13:09:11.632402+0000","last_peered":"2026-02-23T13:09:11.632402+0000","last_clean":"2026-02-23T13:09:11.632402+0000","last_became_active":"2026-02-23T13:08:59.784210+0000","last_became_peered":"2026-02-23T13:08:59.784210+0000","last_unstale":"2026-02-23T13:09:11.632402+0000","last_undegraded":"2026-02-23T13:09:11.632402+0000","last_fullsized":"2026-02-23T13:09:11.632402+0000","mapping_epoch":62,"log_start":"65'5548","ondisk_log_start":"65'5548","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:01.093732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":363790336,"num_objects":5551,"num_object_clones":0,"num_object_copies":16653,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5551,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5551,"num_write_kb":355264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"65'5427","reported_seq":5443,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:11.636063+0000","last_change":"2026-02-23T13:08:59.785913+0000","last_active":"2026-02-23T13:09:11.636063+0000","last_peered":"2026-02-23T13:09:11.636063+0000","last_clean":"2026-02-23T13:09:11.636063+0000","last_became_active":"2026-02-23T13:08:59.785359+0000","last_became_peered":"2026-02-23T13:08:59.785359+0000","last_unstale":"2026-02-23T13:09:11.636063+0000","last_undegraded":"2026-02-23T13:09:11.636063+0000","last_fullsized":"2026-02-23T13:09:11.636063+0000","mapping_epoch":62,"log_start":"65'5424","ondisk_log_start":"65'5424","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:18.876316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":355663872,"num_objects":5427,"num_object_clones":0,"num_object_copies":16281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5427,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5427,"num_write_kb":347328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"65'5453","reported_seq":5470,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:11.736710+0000","last_change":"2026-02-23T13:08:59.786387+0000","last_active":"2026-02-23T13:09:11.736710+0000","last_peered":"2026-02-23T13:09:11.736710+0000","last_clean":"2026-02-23T13:09:11.736710+0000","last_became_active":"2026-02-23T13:08:59.785106+0000","last_became_peered":"2026-02-23T13:08:59.785106+0000","last_unstale":"2026-02-23T13:09:11.736710+0000","last_undegraded":"2026-02-23T13:09:11.736710+0000","last_fullsized":"2026-02-23T13:09:11.736710+0000","mapping_epoch":62,"log_start":"65'5450","ondisk_log_start":"65'5450","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:27.939858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":357367808,"num_objects":5453,"num_object_clones":0,"num_object_copies":16359,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5453,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5453,"num_write_kb":348992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"65'5462","reported_seq":5479,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:11.622506+0000","last_change":"2026-02-23T13:08:59.784789+0000","last_active":"2026-02-23T13:09:11.622506+0000","last_peered":"2026-02-23T13:09:11.622506+0000","last_clean":"2026-02-23T13:09:11.622506+0000","last_became_active":"2026-02-23T13:08:59.784457+0000","last_became_peered":"2026-02-23T13:08:59.784457+0000","last_unstale":"2026-02-23T13:09:11.622506+0000","last_undegraded":"2026-02-23T13:09:11.622506+0000","last_fullsized":"2026-02-23T13:09:11.622506+0000","mapping_epoch":62,"log_start":"65'5459","ondisk_log_start":"65'5459","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:10.735235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":357957632,"num_objects":5462,"num_object_clones":0,"num_object_copies":16386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5462,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5462,"num_write_kb":349568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"65'5514","reported_seq":5531,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:11.732182+0000","last_change":"2026-02-23T13:08:59.784450+0000","last_active":"2026-02-23T13:09:11.732182+0000","last_peered":"2026-02-23T13:09:11.732182+0000","last_clean":"2026-02-23T13:09:11.732182+0000","last_became_active":"2026-02-23T13:08:59.784235+0000","last_became_peered":"2026-02-23T13:08:59.784235+0000","last_unstale":"2026-02-23T13:09:11.732182+0000","last_undegraded":"2026-02-23T13:09:11.732182+0000","last_fullsized":"2026-02-23T13:09:11.732182+0000","mapping_epoch":62,"log_start":"65'5511","ondisk_log_start":"65'5511","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:12.986395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":361365504,"num_objects":5514,"num_object_clones":0,"num_object_copies":16542,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5514,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5514,"num_write_kb":352896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"65'5566","reported_seq":5583,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:11.614400+0000","last_change":"2026-02-23T13:08:59.784582+0000","last_active":"2026-02-23T13:09:11.614400+0000","last_peered":"2026-02-23T13:09:11.614400+0000","last_clean":"2026-02-23T13:09:11.614400+0000","last_became_active":"2026-02-23T13:08:59.784318+0000","last_became_peered":"2026-02-23T13:08:59.784318+0000","last_unstale":"2026-02-23T13:09:11.614400+0000","last_undegraded":"2026-02-23T13:09:11.614400+0000","last_fullsized":"2026-02-23T13:09:11.614400+0000","mapping_epoch":62,"log_start":"65'5563","ondisk_log_start":"65'5563","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:59.400673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":364773376,"num_objects":5566,"num_object_clones":0,"num_object_copies":16698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5566,"num_write_kb":356224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"65'5529","reported_seq":5546,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:11.737310+0000","last_change":"2026-02-23T13:08:59.784710+0000","last_active":"2026-02-23T13:09:11.737310+0000","last_peered":"2026-02-23T13:09:11.737310+0000","last_clean":"2026-02-23T13:09:11.737310+0000","last_became_active":"2026-02-23T13:08:59.784463+0000","last_became_peered":"2026-02-23T13:08:59.784463+0000","last_unstale":"2026-02-23T13:09:11.737310+0000","last_undegraded":"2026-02-23T13:09:11.737310+0000","last_fullsized":"2026-02-23T13:09:11.737310+0000","mapping_epoch":62,"log_start":"65'5526","ondisk_log_start":"65'5526","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:08.630348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":362348544,"num_objects":5529,"num_object_clones":0,"num_object_copies":16587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5529,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5529,"num_write_kb":353856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"65'5517","reported_seq":5534,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:11.634734+0000","last_change":"2026-02-23T13:08:59.784910+0000","last_active":"2026-02-23T13:09:11.634734+0000","last_peered":"2026-02-23T13:09:11.634734+0000","last_clean":"2026-02-23T13:09:11.634734+0000","last_became_active":"2026-02-23T13:08:59.784436+0000","last_became_peered":"2026-02-23T13:08:59.784436+0000","last_unstale":"2026-02-23T13:09:11.634734+0000","last_undegraded":"2026-02-23T13:09:11.634734+0000","last_fullsized":"2026-02-23T13:09:11.634734+0000","mapping_epoch":62,"log_start":"65'5514","ondisk_log_start":"65'5514","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:02.594318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":361562112,"num_objects":5517,"num_object_clones":0,"num_object_copies":16551,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5517,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5517,"num_write_kb":353088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"65'5550","reported_seq":5566,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:11.624498+0000","last_change":"2026-02-23T13:08:59.784689+0000","last_active":"2026-02-23T13:09:11.624498+0000","last_peered":"2026-02-23T13:09:11.624498+0000","last_clean":"2026-02-23T13:09:11.624498+0000","last_became_active":"2026-02-23T13:08:59.784290+0000","last_became_peered":"2026-02-23T13:08:59.784290+0000","last_unstale":"2026-02-23T13:09:11.624498+0000","last_undegraded":"2026-02-23T13:09:11.624498+0000","last_fullsized":"2026-02-23T13:09:11.624498+0000","mapping_epoch":62,"log_start":"65'5547","ondisk_log_start":"65'5547","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:25.847402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":363724800,"num_objects":5550,"num_object_clones":0,"num_object_copies":16650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5550,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5550,"num_write_kb":355200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"65'5597","reported_seq":5614,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:11.634593+0000","last_change":"2026-02-23T13:08:59.786106+0000","last_active":"2026-02-23T13:09:11.634593+0000","last_peered":"2026-02-23T13:09:11.634593+0000","last_clean":"2026-02-23T13:09:11.634593+0000","last_became_active":"2026-02-23T13:08:59.785634+0000","last_became_peered":"2026-02-23T13:08:59.785634+0000","last_unstale":"2026-02-23T13:09:11.634593+0000","last_undegraded":"2026-02-23T13:09:11.634593+0000","last_fullsized":"2026-02-23T13:09:11.634593+0000","mapping_epoch":62,"log_start":"65'5594","ondisk_log_start":"65'5594","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:01.725790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":366804992,"num_objects":5597,"num_object_clones":0,"num_object_copies":16791,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5597,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5597,"num_write_kb":358208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":293,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:01.789466+0000","last_change":"2026-02-23T13:07:56.312851+0000","last_active":"2026-02-23T13:09:01.789466+0000","last_peered":"2026-02-23T13:09:01.789466+0000","last_clean":"2026-02-23T13:09:01.789466+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:09:01.789466+0000","last_undegraded":"2026-02-23T13:09:01.789466+0000","last_fullsized":"2026-02-23T13:09:01.789466+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:07:56.312801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:07:56.312801+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:14.345117+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":5791023104,"num_objects":88364,"num_object_clones":0,"num_object_copies":265092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88364,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88364,"num_write_kb":5655296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17364811776,"data_stored":17364811776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247885,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5136448,"kb_used_data":4128940,"kb_used_omap":12,"kb_used_meta":1007475,"kb_avail":728866752,"statfs":{"total":751619276800,"available":746359554048,"internally_reserved":0,"allocated":4228034560,"data_stored":4227586575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12641,"internal_metadata":1031655071},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444112,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5353344,"kb_used_data":4615852,"kb_used_omap":12,"kb_used_meta":737459,"kb_avail":728649856,"statfs":{"total":751619276800,"available":746137452544,"internally_reserved":0,"allocated":4726632448,"data_stored":4726184463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12632,"internal_metadata":755158696},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4918012,"kb_used_data":3371432,"kb_used_omap":18,"kb_used_meta":1546541,"kb_avail":729085188,"statfs":{"total":751619276800,"available":746583232512,"internally_reserved":0,"allocated":3452346368,"data_stored":3451901935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19176,"internal_metadata":1583658264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,3],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705747,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4515136,"kb_used_data":3916140,"kb_used_omap":7,"kb_used_meta":598968,"kb_avail":729488064,"statfs":{"total":751619276800,"available":746995777536,"internally_reserved":0,"allocated":4010127360,"data_stored":4009679375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8050,"internal_metadata":613343374},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4325703680,"data_stored":4325703680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3643277312,"data_stored":3643277312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5062262784,"data_stored":5062262784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4333568000,"data_stored":4333568000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:09:13.285 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:09:13.286 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 161 2026-02-23T13:09:13.429 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:13.550 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:13.548+0000 7f97a9ca6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:13.551 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:13.548+0000 7f97a9ca6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:13.699 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:09:13.716 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:13 trial046 ceph-mon[38575]: pgmap v227: 17 pgs: 17 active+clean; 5.4 GiB data, 19 GiB used, 2.7 TiB / 2.7 TiB avail; 472 MiB/s wr, 7.55k op/s 2026-02-23T13:09:13.716 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:13 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3868250768' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:09:13.742 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:09:13.874 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 13 15 107292 107277 515.716 525.812 0.00150242 0.00193768 2026-02-23T13:09:14.874 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 14 16 115615 115599 516.028 520.125 0.00229537 0.00193652 2026-02-23T13:09:15.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:14 trial046 ceph-mon[38575]: from='client.14918 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:09:15.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:14 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2034538670' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "161"} : dispatch 2026-02-23T13:09:15.183 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:09:15.335 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:15.477 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:15.474+0000 7f3650547640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:15.477 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:15.474+0000 7f3650547640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:15.492 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:09:15.493 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:09:15.508 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:09:15.509 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:09:15.524 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:09:15.524 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:09:15.538 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:09:15.538 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:09:15.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:15 trial046 ceph-mon[38575]: pgmap v228: 17 pgs: 17 active+clean; 5.4 GiB data, 19 GiB used, 2.7 TiB / 2.7 TiB avail; 426 MiB/s wr, 6.82k op/s 2026-02-23T13:09:15.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:15 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/347822985' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:09:15.874 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 15 15 124071 124056 516.861 528.562 0.00220445 0.00193344 2026-02-23T13:09:16.470 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:09:16 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:09:16.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:09:16.539 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:09:16 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:09:16] "GET /metrics HTTP/1.1" 200 4211 "" "Prometheus/3.6.0" 2026-02-23T13:09:16.874 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 16 16 132167 132151 516.176 505.938 0.00261178 0.00193593 2026-02-23T13:09:17.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:16 trial046 ceph-mon[38575]: 1.0 scrub starts 2026-02-23T13:09:17.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:16 trial046 ceph-mon[38575]: 1.0 scrub ok 2026-02-23T13:09:17.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:16 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:09:17.582 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:09:17.720 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:17.867 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:17 trial046 ceph-mon[38575]: pgmap v229: 17 pgs: 17 active+clean; 7.3 GiB data, 26 GiB used, 2.7 TiB / 2.7 TiB avail; 590 MiB/s wr, 9.43k op/s 2026-02-23T13:09:17.874 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 17 16 139885 139869 514.185 482.375 0.00132729 0.00194347 2026-02-23T13:09:18.302 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:18.234+0000 7f6433e52640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:18.303 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:18.234+0000 7f6433e52640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:18.303 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:09:18.303 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:09:18.303 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:09:18.303 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:09:18.326 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:09:18.326 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:09:18.339 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:09:18.339 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:09:18.743 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:09:18.743 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:09:18.743 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_2 2026-02-23T13:09:18.744 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:09:18.874 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 18 16 145795 145779 506.139 369.375 0.0117789 0.00197398 2026-02-23T13:09:18.998 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:18 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4089402504' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:09:19.010 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:19.439 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:19.363+0000 7f153d61b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:19.439 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:19.363+0000 7f153d61b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:19.517 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:09:19.518 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:09:19.875 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 19 16 151775 151759 499.169 373.75 0.00308681 0.00200199 2026-02-23T13:09:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:19 trial046 ceph-mon[38575]: pgmap v230: 17 pgs: 17 active+clean; 8.0 GiB data, 26 GiB used, 2.7 TiB / 2.7 TiB avail; 490 MiB/s wr, 7.83k op/s 2026-02-23T13:09:20.279 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":230,"stamp":"2026-02-23T13:09:18.640534+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8550220320,"num_objects":130459,"num_object_clones":0,"num_object_copies":391377,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130459,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":130592,"num_write_kb":8351398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":27647100,"kb_used_data":24171500,"kb_used_omap":43,"kb_used_meta":3475412,"kb_avail":2908365700,"statfs":{"total":3006477107200,"available":2978166476800,"internally_reserved":0,"allocated":24751616000,"data_stored":24749827612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44261,"internal_metadata":3558822683},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6162743296,"num_objects":94036,"num_object_clones":0,"num_object_copies":282108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94036,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94036,"num_write_kb":6018304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001796"},"pg_stats":[{"pgid":"4.f","version":"65'8325","reported_seq":8342,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:16.729412+0000","last_change":"2026-02-23T13:08:59.785158+0000","last_active":"2026-02-23T13:09:16.729412+0000","last_peered":"2026-02-23T13:09:16.729412+0000","last_clean":"2026-02-23T13:09:16.729412+0000","last_became_active":"2026-02-23T13:08:59.784888+0000","last_became_peered":"2026-02-23T13:08:59.784888+0000","last_unstale":"2026-02-23T13:09:16.729412+0000","last_undegraded":"2026-02-23T13:09:16.729412+0000","last_fullsized":"2026-02-23T13:09:16.729412+0000","mapping_epoch":62,"log_start":"65'8322","ondisk_log_start":"65'8322","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:14.965697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":545587200,"num_objects":8325,"num_object_clones":0,"num_object_copies":24975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8325,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8325,"num_write_kb":532800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"65'8039","reported_seq":8056,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:16.637021+0000","last_change":"2026-02-23T13:08:59.785686+0000","last_active":"2026-02-23T13:09:16.637021+0000","last_peered":"2026-02-23T13:09:16.637021+0000","last_clean":"2026-02-23T13:09:16.637021+0000","last_became_active":"2026-02-23T13:08:59.785397+0000","last_became_peered":"2026-02-23T13:08:59.785397+0000","last_unstale":"2026-02-23T13:09:16.637021+0000","last_undegraded":"2026-02-23T13:09:16.637021+0000","last_fullsized":"2026-02-23T13:09:16.637021+0000","mapping_epoch":62,"log_start":"65'8036","ondisk_log_start":"65'8036","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:19.572572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526843904,"num_objects":8039,"num_object_clones":0,"num_object_copies":24117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8039,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8039,"num_write_kb":514496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"65'8085","reported_seq":8101,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:16.637344+0000","last_change":"2026-02-23T13:08:59.786322+0000","last_active":"2026-02-23T13:09:16.637344+0000","last_peered":"2026-02-23T13:09:16.637344+0000","last_clean":"2026-02-23T13:09:16.637344+0000","last_became_active":"2026-02-23T13:08:59.785780+0000","last_became_peered":"2026-02-23T13:08:59.785780+0000","last_unstale":"2026-02-23T13:09:16.637344+0000","last_undegraded":"2026-02-23T13:09:16.637344+0000","last_fullsized":"2026-02-23T13:09:16.637344+0000","mapping_epoch":62,"log_start":"65'8082","ondisk_log_start":"65'8082","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:01.263222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":529858560,"num_objects":8085,"num_object_clones":0,"num_object_copies":24255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8085,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8085,"num_write_kb":517440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"65'8075","reported_seq":8092,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:16.636066+0000","last_change":"2026-02-23T13:08:59.784416+0000","last_active":"2026-02-23T13:09:16.636066+0000","last_peered":"2026-02-23T13:09:16.636066+0000","last_clean":"2026-02-23T13:09:16.636066+0000","last_became_active":"2026-02-23T13:08:59.783982+0000","last_became_peered":"2026-02-23T13:08:59.783982+0000","last_unstale":"2026-02-23T13:09:16.636066+0000","last_undegraded":"2026-02-23T13:09:16.636066+0000","last_fullsized":"2026-02-23T13:09:16.636066+0000","mapping_epoch":62,"log_start":"65'8072","ondisk_log_start":"65'8072","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:19.759236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":529203200,"num_objects":8075,"num_object_clones":0,"num_object_copies":24225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8075,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8075,"num_write_kb":516800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"65'8177","reported_seq":8194,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:16.625569+0000","last_change":"2026-02-23T13:08:59.784919+0000","last_active":"2026-02-23T13:09:16.625569+0000","last_peered":"2026-02-23T13:09:16.625569+0000","last_clean":"2026-02-23T13:09:16.625569+0000","last_became_active":"2026-02-23T13:08:59.784710+0000","last_became_peered":"2026-02-23T13:08:59.784710+0000","last_unstale":"2026-02-23T13:09:16.625569+0000","last_undegraded":"2026-02-23T13:09:16.625569+0000","last_fullsized":"2026-02-23T13:09:16.625569+0000","mapping_epoch":62,"log_start":"65'8174","ondisk_log_start":"65'8174","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:22.287957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":535887872,"num_objects":8177,"num_object_clones":0,"num_object_copies":24531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8177,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8177,"num_write_kb":523328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"65'8278","reported_seq":8295,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:16.635387+0000","last_change":"2026-02-23T13:08:59.784739+0000","last_active":"2026-02-23T13:09:16.635387+0000","last_peered":"2026-02-23T13:09:16.635387+0000","last_clean":"2026-02-23T13:09:16.635387+0000","last_became_active":"2026-02-23T13:08:59.784218+0000","last_became_peered":"2026-02-23T13:08:59.784218+0000","last_unstale":"2026-02-23T13:09:16.635387+0000","last_undegraded":"2026-02-23T13:09:16.635387+0000","last_fullsized":"2026-02-23T13:09:16.635387+0000","mapping_epoch":62,"log_start":"65'8275","ondisk_log_start":"65'8275","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:25.462760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":542507008,"num_objects":8278,"num_object_clones":0,"num_object_copies":24834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8278,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8278,"num_write_kb":529792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"65'8143","reported_seq":8160,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:16.629698+0000","last_change":"2026-02-23T13:08:59.784708+0000","last_active":"2026-02-23T13:09:16.629698+0000","last_peered":"2026-02-23T13:09:16.629698+0000","last_clean":"2026-02-23T13:09:16.629698+0000","last_became_active":"2026-02-23T13:08:59.784210+0000","last_became_peered":"2026-02-23T13:08:59.784210+0000","last_unstale":"2026-02-23T13:09:16.629698+0000","last_undegraded":"2026-02-23T13:09:16.629698+0000","last_fullsized":"2026-02-23T13:09:16.629698+0000","mapping_epoch":62,"log_start":"65'8140","ondisk_log_start":"65'8140","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:01.093732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":533659648,"num_objects":8143,"num_object_clones":0,"num_object_copies":24429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8143,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8143,"num_write_kb":521152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"65'8033","reported_seq":8050,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:16.635680+0000","last_change":"2026-02-23T13:08:59.785913+0000","last_active":"2026-02-23T13:09:16.635680+0000","last_peered":"2026-02-23T13:09:16.635680+0000","last_clean":"2026-02-23T13:09:16.635680+0000","last_became_active":"2026-02-23T13:08:59.785359+0000","last_became_peered":"2026-02-23T13:08:59.785359+0000","last_unstale":"2026-02-23T13:09:16.635680+0000","last_undegraded":"2026-02-23T13:09:16.635680+0000","last_fullsized":"2026-02-23T13:09:16.635680+0000","mapping_epoch":62,"log_start":"65'8030","ondisk_log_start":"65'8030","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:18.876316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526450688,"num_objects":8033,"num_object_clones":0,"num_object_copies":24099,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8033,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8033,"num_write_kb":514112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"65'8183","reported_seq":8200,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:16.738743+0000","last_change":"2026-02-23T13:08:59.786387+0000","last_active":"2026-02-23T13:09:16.738743+0000","last_peered":"2026-02-23T13:09:16.738743+0000","last_clean":"2026-02-23T13:09:16.738743+0000","last_became_active":"2026-02-23T13:08:59.785106+0000","last_became_peered":"2026-02-23T13:08:59.785106+0000","last_unstale":"2026-02-23T13:09:16.738743+0000","last_undegraded":"2026-02-23T13:09:16.738743+0000","last_fullsized":"2026-02-23T13:09:16.738743+0000","mapping_epoch":62,"log_start":"65'8180","ondisk_log_start":"65'8180","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:27.939858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":536281088,"num_objects":8183,"num_object_clones":0,"num_object_copies":24549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8183,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8183,"num_write_kb":523712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"65'8009","reported_seq":8026,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:16.624834+0000","last_change":"2026-02-23T13:08:59.784789+0000","last_active":"2026-02-23T13:09:16.624834+0000","last_peered":"2026-02-23T13:09:16.624834+0000","last_clean":"2026-02-23T13:09:16.624834+0000","last_became_active":"2026-02-23T13:08:59.784457+0000","last_became_peered":"2026-02-23T13:08:59.784457+0000","last_unstale":"2026-02-23T13:09:16.624834+0000","last_undegraded":"2026-02-23T13:09:16.624834+0000","last_fullsized":"2026-02-23T13:09:16.624834+0000","mapping_epoch":62,"log_start":"65'8006","ondisk_log_start":"65'8006","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:10.735235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524877824,"num_objects":8009,"num_object_clones":0,"num_object_copies":24027,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8009,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8009,"num_write_kb":512576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"65'8154","reported_seq":8171,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:16.737327+0000","last_change":"2026-02-23T13:08:59.784450+0000","last_active":"2026-02-23T13:09:16.737327+0000","last_peered":"2026-02-23T13:09:16.737327+0000","last_clean":"2026-02-23T13:09:16.737327+0000","last_became_active":"2026-02-23T13:08:59.784235+0000","last_became_peered":"2026-02-23T13:08:59.784235+0000","last_unstale":"2026-02-23T13:09:16.737327+0000","last_undegraded":"2026-02-23T13:09:16.737327+0000","last_fullsized":"2026-02-23T13:09:16.737327+0000","mapping_epoch":62,"log_start":"65'8151","ondisk_log_start":"65'8151","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:12.986395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":534380544,"num_objects":8154,"num_object_clones":0,"num_object_copies":24462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8154,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8154,"num_write_kb":521856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"65'8138","reported_seq":8155,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:16.625294+0000","last_change":"2026-02-23T13:08:59.784582+0000","last_active":"2026-02-23T13:09:16.625294+0000","last_peered":"2026-02-23T13:09:16.625294+0000","last_clean":"2026-02-23T13:09:16.625294+0000","last_became_active":"2026-02-23T13:08:59.784318+0000","last_became_peered":"2026-02-23T13:08:59.784318+0000","last_unstale":"2026-02-23T13:09:16.625294+0000","last_undegraded":"2026-02-23T13:09:16.625294+0000","last_fullsized":"2026-02-23T13:09:16.625294+0000","mapping_epoch":62,"log_start":"65'8135","ondisk_log_start":"65'8135","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:59.400673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":533331968,"num_objects":8138,"num_object_clones":0,"num_object_copies":24414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8138,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8138,"num_write_kb":520832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"65'8253","reported_seq":8270,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:16.733564+0000","last_change":"2026-02-23T13:08:59.784710+0000","last_active":"2026-02-23T13:09:16.733564+0000","last_peered":"2026-02-23T13:09:16.733564+0000","last_clean":"2026-02-23T13:09:16.733564+0000","last_became_active":"2026-02-23T13:08:59.784463+0000","last_became_peered":"2026-02-23T13:08:59.784463+0000","last_unstale":"2026-02-23T13:09:16.733564+0000","last_undegraded":"2026-02-23T13:09:16.733564+0000","last_fullsized":"2026-02-23T13:09:16.733564+0000","mapping_epoch":62,"log_start":"65'8250","ondisk_log_start":"65'8250","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:08.630348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540868608,"num_objects":8253,"num_object_clones":0,"num_object_copies":24759,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8253,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8253,"num_write_kb":528192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"65'8175","reported_seq":8192,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:16.633504+0000","last_change":"2026-02-23T13:08:59.784910+0000","last_active":"2026-02-23T13:09:16.633504+0000","last_peered":"2026-02-23T13:09:16.633504+0000","last_clean":"2026-02-23T13:09:16.633504+0000","last_became_active":"2026-02-23T13:08:59.784436+0000","last_became_peered":"2026-02-23T13:08:59.784436+0000","last_unstale":"2026-02-23T13:09:16.633504+0000","last_undegraded":"2026-02-23T13:09:16.633504+0000","last_fullsized":"2026-02-23T13:09:16.633504+0000","mapping_epoch":62,"log_start":"65'8172","ondisk_log_start":"65'8172","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:02.594318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":535756800,"num_objects":8175,"num_object_clones":0,"num_object_copies":24525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8175,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8175,"num_write_kb":523200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"65'8200","reported_seq":8217,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:16.626851+0000","last_change":"2026-02-23T13:08:59.784689+0000","last_active":"2026-02-23T13:09:16.626851+0000","last_peered":"2026-02-23T13:09:16.626851+0000","last_clean":"2026-02-23T13:09:16.626851+0000","last_became_active":"2026-02-23T13:08:59.784290+0000","last_became_peered":"2026-02-23T13:08:59.784290+0000","last_unstale":"2026-02-23T13:09:16.626851+0000","last_undegraded":"2026-02-23T13:09:16.626851+0000","last_fullsized":"2026-02-23T13:09:16.626851+0000","mapping_epoch":62,"log_start":"65'8197","ondisk_log_start":"65'8197","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:25.847402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":537395200,"num_objects":8200,"num_object_clones":0,"num_object_copies":24600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8200,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8200,"num_write_kb":524800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"65'8190","reported_seq":8207,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:16.638084+0000","last_change":"2026-02-23T13:08:59.786106+0000","last_active":"2026-02-23T13:09:16.638084+0000","last_peered":"2026-02-23T13:09:16.638084+0000","last_clean":"2026-02-23T13:09:16.638084+0000","last_became_active":"2026-02-23T13:08:59.785634+0000","last_became_peered":"2026-02-23T13:08:59.785634+0000","last_unstale":"2026-02-23T13:09:16.638084+0000","last_undegraded":"2026-02-23T13:09:16.638084+0000","last_fullsized":"2026-02-23T13:09:16.638084+0000","mapping_epoch":62,"log_start":"65'8187","ondisk_log_start":"65'8187","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:01.725790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":536739840,"num_objects":8190,"num_object_clones":0,"num_object_copies":24570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8190,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8190,"num_write_kb":524160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":301,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:15.445539+0000","last_change":"2026-02-23T13:09:15.445539+0000","last_active":"2026-02-23T13:09:15.445539+0000","last_peered":"2026-02-23T13:09:15.445539+0000","last_clean":"2026-02-23T13:09:15.445539+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:09:15.445539+0000","last_undegraded":"2026-02-23T13:09:15.445539+0000","last_fullsized":"2026-02-23T13:09:15.445539+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:09:15.445510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:09:15.445510+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:37.194057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":8549629952,"num_objects":130457,"num_object_clones":0,"num_object_copies":391371,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130457,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130457,"num_write_kb":8349248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":25643057152,"data_stored":25643057152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247886,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":7291456,"kb_used_data":6175660,"kb_used_omap":12,"kb_used_meta":1115763,"kb_avail":726711744,"statfs":{"total":751619276800,"available":744152825856,"internally_reserved":0,"allocated":6323875840,"data_stored":6323427855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12707,"internal_metadata":1142541917},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444113,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":7919744,"kb_used_data":7001772,"kb_used_omap":12,"kb_used_meta":917939,"kb_avail":726083456,"statfs":{"total":751619276800,"available":743509458944,"internally_reserved":0,"allocated":7169814528,"data_stored":7169366543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12632,"internal_metadata":939970216},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5753276,"kb_used_data":5054824,"kb_used_omap":10,"kb_used_meta":698357,"kb_avail":728249924,"statfs":{"total":751619276800,"available":745727922176,"internally_reserved":0,"allocated":5176139776,"data_stored":5175695343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10872,"internal_metadata":715117960},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705748,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6682624,"kb_used_data":5939244,"kb_used_omap":7,"kb_used_meta":743352,"kb_avail":727320576,"statfs":{"total":751619276800,"available":744776269824,"internally_reserved":0,"allocated":6081785856,"data_stored":6081337871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8050,"internal_metadata":761192590},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6392184832,"data_stored":6392184832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5372575744,"data_stored":5372575744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7468285952,"data_stored":7468285952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6410010624,"data_stored":6410010624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:09:20.281 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:09:20.281 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_2 pg_num 26 2026-02-23T13:09:20.433 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:20.818 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:20 trial046 ceph-mon[38575]: from='client.14926 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:09:20.819 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:20.764+0000 7f08b079e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:20.819 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:20.764+0000 7f08b079e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:20.875 INFO:tasks.radosbench.radosbench.0.trial046.stdout:2026-02-23T13:09:20.874455+0000 min lat: 0.000698614 max lat: 0.0414823 avg lat: 0.00201653 2026-02-23T13:09:20.875 INFO:tasks.radosbench.radosbench.0.trial046.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-23T13:09:20.875 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 20 16 158611 158595 495.572 427.25 0.00136936 0.00201653 2026-02-23T13:09:20.905 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:09:21.023 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:09:21.271 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:21.276 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:09:21.393 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:21.391+0000 7f0d724f2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:21.394 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:21.391+0000 7f0d724f2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:21.408 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:09:21.409 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:09:21.423 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:09:21.424 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:09:21.438 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:09:21.438 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:09:21.451 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:09:21.451 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:09:21.875 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 21 16 165797 165781 493.358 449.125 0.00229073 0.00202562 2026-02-23T13:09:22.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:21 trial046 ceph-mon[38575]: pgmap v231: 17 pgs: 17 active+clean; 8.0 GiB data, 26 GiB used, 2.7 TiB / 2.7 TiB avail; 438 MiB/s wr, 7.01k op/s 2026-02-23T13:09:22.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:21 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2334225164' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_2", "var": "pg_num", "val": "26"} : dispatch 2026-02-23T13:09:22.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:21 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/615399258' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:09:22.875 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 22 15 174052 174037 494.385 516 0.00111645 0.00202142 2026-02-23T13:09:23.496 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:09:23.641 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:23.767 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:23.765+0000 7f6f537d9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:23.767 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:23.766+0000 7f6f537d9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:23.782 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:09:23.782 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:09:23.782 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:23 trial046 ceph-mon[38575]: pgmap v232: 17 pgs: 17 active+clean; 10 GiB data, 33 GiB used, 2.7 TiB / 2.7 TiB avail; 613 MiB/s wr, 9.80k op/s 2026-02-23T13:09:23.794 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:09:23.795 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:09:23.808 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:09:23.809 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:09:23.822 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:09:23.822 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:09:23.875 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 23 16 182326 182310 495.369 517.062 0.00164307 0.0020174 2026-02-23T13:09:24.875 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 24 16 191005 190989 497.329 542.438 0.00165214 0.00200946 2026-02-23T13:09:25.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:24 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2339964905' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:09:25.869 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:09:25.875 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 25 16 199400 199384 498.421 524.688 0.00243632 0.002005 2026-02-23T13:09:26.018 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:26.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:25 trial046 ceph-mon[38575]: pgmap v233: 17 pgs: 17 active+clean; 10 GiB data, 33 GiB used, 2.7 TiB / 2.7 TiB avail; 394 MiB/s wr, 6.31k op/s 2026-02-23T13:09:26.161 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:26.158+0000 7fbd28d85640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:26.161 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:26.158+0000 7fbd28d85640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:26.177 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:09:26.177 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:09:26.191 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:09:26.191 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:09:26.204 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:09:26.205 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:09:26.218 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:09:26.219 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:09:26.277 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:09:26.277 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:09:26.277 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-23T13:09:26.278 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:09:26.304 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:09:26 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:09:26] "GET /metrics HTTP/1.1" 200 4211 "" "Prometheus/3.6.0" 2026-02-23T13:09:26.425 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:26.552 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:26.549+0000 7f03f8b59640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:26.552 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:26.549+0000 7f03f8b59640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:26.561 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:09:26 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:09:26.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:09:26.703 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:09:26.704 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:09:26.755 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":234,"stamp":"2026-02-23T13:09:26.641602+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":12798919200,"num_objects":195289,"num_object_clones":0,"num_object_copies":585867,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195289,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":195422,"num_write_kb":12500518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":41305980,"kb_used_data":37036204,"kb_used_omap":43,"kb_used_meta":4269588,"kb_avail":2894706820,"statfs":{"total":3006477107200,"available":2964179783680,"internally_reserved":0,"allocated":37925072896,"data_stored":37923284508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44261,"internal_metadata":4372058907},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7007305728,"num_objects":106923,"num_object_clones":0,"num_object_copies":320769,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106923,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106923,"num_write_kb":6843072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001687"},"pg_stats":[{"pgid":"4.f","version":"65'10355","reported_seq":10372,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:21.737477+0000","last_change":"2026-02-23T13:08:59.785158+0000","last_active":"2026-02-23T13:09:21.737477+0000","last_peered":"2026-02-23T13:09:21.737477+0000","last_clean":"2026-02-23T13:09:21.737477+0000","last_became_active":"2026-02-23T13:08:59.784888+0000","last_became_peered":"2026-02-23T13:08:59.784888+0000","last_unstale":"2026-02-23T13:09:21.737477+0000","last_undegraded":"2026-02-23T13:09:21.737477+0000","last_fullsized":"2026-02-23T13:09:21.737477+0000","mapping_epoch":62,"log_start":"65'10352","ondisk_log_start":"65'10352","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:14.965697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":678625280,"num_objects":10355,"num_object_clones":0,"num_object_copies":31065,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10355,"num_write_kb":662720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"65'12702","reported_seq":12719,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:26.634647+0000","last_change":"2026-02-23T13:08:59.785686+0000","last_active":"2026-02-23T13:09:26.634647+0000","last_peered":"2026-02-23T13:09:26.634647+0000","last_clean":"2026-02-23T13:09:26.634647+0000","last_became_active":"2026-02-23T13:08:59.785397+0000","last_became_peered":"2026-02-23T13:08:59.785397+0000","last_unstale":"2026-02-23T13:09:26.634647+0000","last_undegraded":"2026-02-23T13:09:26.634647+0000","last_fullsized":"2026-02-23T13:09:26.634647+0000","mapping_epoch":62,"log_start":"65'12699","ondisk_log_start":"65'12699","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:19.572572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":832438272,"num_objects":12702,"num_object_clones":0,"num_object_copies":38106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12702,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12702,"num_write_kb":812928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"65'12851","reported_seq":12868,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:26.639201+0000","last_change":"2026-02-23T13:08:59.786322+0000","last_active":"2026-02-23T13:09:26.639201+0000","last_peered":"2026-02-23T13:09:26.639201+0000","last_clean":"2026-02-23T13:09:26.639201+0000","last_became_active":"2026-02-23T13:08:59.785780+0000","last_became_peered":"2026-02-23T13:08:59.785780+0000","last_unstale":"2026-02-23T13:09:26.639201+0000","last_undegraded":"2026-02-23T13:09:26.639201+0000","last_fullsized":"2026-02-23T13:09:26.639201+0000","mapping_epoch":62,"log_start":"65'12848","ondisk_log_start":"65'12848","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:01.263222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":842203136,"num_objects":12851,"num_object_clones":0,"num_object_copies":38553,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12851,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12851,"num_write_kb":822464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"65'12795","reported_seq":12812,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:26.635243+0000","last_change":"2026-02-23T13:08:59.784416+0000","last_active":"2026-02-23T13:09:26.635243+0000","last_peered":"2026-02-23T13:09:26.635243+0000","last_clean":"2026-02-23T13:09:26.635243+0000","last_became_active":"2026-02-23T13:08:59.783982+0000","last_became_peered":"2026-02-23T13:08:59.783982+0000","last_unstale":"2026-02-23T13:09:26.635243+0000","last_undegraded":"2026-02-23T13:09:26.635243+0000","last_fullsized":"2026-02-23T13:09:26.635243+0000","mapping_epoch":62,"log_start":"65'12792","ondisk_log_start":"65'12792","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:19.759236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838533120,"num_objects":12795,"num_object_clones":0,"num_object_copies":38385,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12795,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12795,"num_write_kb":818880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"65'12840","reported_seq":12857,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:26.627010+0000","last_change":"2026-02-23T13:08:59.784919+0000","last_active":"2026-02-23T13:09:26.627010+0000","last_peered":"2026-02-23T13:09:26.627010+0000","last_clean":"2026-02-23T13:09:26.627010+0000","last_became_active":"2026-02-23T13:08:59.784710+0000","last_became_peered":"2026-02-23T13:08:59.784710+0000","last_unstale":"2026-02-23T13:09:26.627010+0000","last_undegraded":"2026-02-23T13:09:26.627010+0000","last_fullsized":"2026-02-23T13:09:26.627010+0000","mapping_epoch":62,"log_start":"65'12837","ondisk_log_start":"65'12837","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:22.287957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841482240,"num_objects":12840,"num_object_clones":0,"num_object_copies":38520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12840,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12840,"num_write_kb":821760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"65'12966","reported_seq":12983,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:26.639047+0000","last_change":"2026-02-23T13:08:59.784739+0000","last_active":"2026-02-23T13:09:26.639047+0000","last_peered":"2026-02-23T13:09:26.639047+0000","last_clean":"2026-02-23T13:09:26.639047+0000","last_became_active":"2026-02-23T13:08:59.784218+0000","last_became_peered":"2026-02-23T13:08:59.784218+0000","last_unstale":"2026-02-23T13:09:26.639047+0000","last_undegraded":"2026-02-23T13:09:26.639047+0000","last_fullsized":"2026-02-23T13:09:26.639047+0000","mapping_epoch":62,"log_start":"65'12963","ondisk_log_start":"65'12963","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:25.462760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":849739776,"num_objects":12966,"num_object_clones":0,"num_object_copies":38898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12966,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12966,"num_write_kb":829824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"65'12793","reported_seq":12810,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:26.639538+0000","last_change":"2026-02-23T13:08:59.784708+0000","last_active":"2026-02-23T13:09:26.639538+0000","last_peered":"2026-02-23T13:09:26.639538+0000","last_clean":"2026-02-23T13:09:26.639538+0000","last_became_active":"2026-02-23T13:08:59.784210+0000","last_became_peered":"2026-02-23T13:08:59.784210+0000","last_unstale":"2026-02-23T13:09:26.639538+0000","last_undegraded":"2026-02-23T13:09:26.639538+0000","last_fullsized":"2026-02-23T13:09:26.639538+0000","mapping_epoch":62,"log_start":"65'12790","ondisk_log_start":"65'12790","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:01.093732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838402048,"num_objects":12793,"num_object_clones":0,"num_object_copies":38379,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12793,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12793,"num_write_kb":818752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"65'12633","reported_seq":12648,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:26.640736+0000","last_change":"2026-02-23T13:08:59.785913+0000","last_active":"2026-02-23T13:09:26.640736+0000","last_peered":"2026-02-23T13:09:26.640736+0000","last_clean":"2026-02-23T13:09:26.640736+0000","last_became_active":"2026-02-23T13:08:59.785359+0000","last_became_peered":"2026-02-23T13:08:59.785359+0000","last_unstale":"2026-02-23T13:09:26.640736+0000","last_undegraded":"2026-02-23T13:09:26.640736+0000","last_fullsized":"2026-02-23T13:09:26.640736+0000","mapping_epoch":62,"log_start":"65'12629","ondisk_log_start":"65'12629","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:18.876316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":827916288,"num_objects":12633,"num_object_clones":0,"num_object_copies":37899,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12633,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12633,"num_write_kb":808512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"65'10344","reported_seq":10361,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:21.732730+0000","last_change":"2026-02-23T13:08:59.786387+0000","last_active":"2026-02-23T13:09:21.732730+0000","last_peered":"2026-02-23T13:09:21.732730+0000","last_clean":"2026-02-23T13:09:21.732730+0000","last_became_active":"2026-02-23T13:08:59.785106+0000","last_became_peered":"2026-02-23T13:08:59.785106+0000","last_unstale":"2026-02-23T13:09:21.732730+0000","last_undegraded":"2026-02-23T13:09:21.732730+0000","last_fullsized":"2026-02-23T13:09:21.732730+0000","mapping_epoch":62,"log_start":"65'10341","ondisk_log_start":"65'10341","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:27.939858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":677904384,"num_objects":10344,"num_object_clones":0,"num_object_copies":31032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10344,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10344,"num_write_kb":662016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"65'12741","reported_seq":12758,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:26.626130+0000","last_change":"2026-02-23T13:08:59.784789+0000","last_active":"2026-02-23T13:09:26.626130+0000","last_peered":"2026-02-23T13:09:26.626130+0000","last_clean":"2026-02-23T13:09:26.626130+0000","last_became_active":"2026-02-23T13:08:59.784457+0000","last_became_peered":"2026-02-23T13:08:59.784457+0000","last_unstale":"2026-02-23T13:09:26.626130+0000","last_undegraded":"2026-02-23T13:09:26.626130+0000","last_fullsized":"2026-02-23T13:09:26.626130+0000","mapping_epoch":62,"log_start":"65'12738","ondisk_log_start":"65'12738","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:10.735235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":834994176,"num_objects":12741,"num_object_clones":0,"num_object_copies":38223,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12741,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12741,"num_write_kb":815424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"65'10291","reported_seq":10308,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:21.737364+0000","last_change":"2026-02-23T13:08:59.784450+0000","last_active":"2026-02-23T13:09:21.737364+0000","last_peered":"2026-02-23T13:09:21.737364+0000","last_clean":"2026-02-23T13:09:21.737364+0000","last_became_active":"2026-02-23T13:08:59.784235+0000","last_became_peered":"2026-02-23T13:08:59.784235+0000","last_unstale":"2026-02-23T13:09:21.737364+0000","last_undegraded":"2026-02-23T13:09:21.737364+0000","last_fullsized":"2026-02-23T13:09:21.737364+0000","mapping_epoch":62,"log_start":"65'10288","ondisk_log_start":"65'10288","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:12.986395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":674430976,"num_objects":10291,"num_object_clones":0,"num_object_copies":30873,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10291,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10291,"num_write_kb":658624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"65'12961","reported_seq":12978,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:26.625445+0000","last_change":"2026-02-23T13:08:59.784582+0000","last_active":"2026-02-23T13:09:26.625445+0000","last_peered":"2026-02-23T13:09:26.625445+0000","last_clean":"2026-02-23T13:09:26.625445+0000","last_became_active":"2026-02-23T13:08:59.784318+0000","last_became_peered":"2026-02-23T13:08:59.784318+0000","last_unstale":"2026-02-23T13:09:26.625445+0000","last_undegraded":"2026-02-23T13:09:26.625445+0000","last_fullsized":"2026-02-23T13:09:26.625445+0000","mapping_epoch":62,"log_start":"65'12958","ondisk_log_start":"65'12958","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:59.400673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":849412096,"num_objects":12961,"num_object_clones":0,"num_object_copies":38883,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12961,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12961,"num_write_kb":829504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"65'10328","reported_seq":10345,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:21.726437+0000","last_change":"2026-02-23T13:08:59.784710+0000","last_active":"2026-02-23T13:09:21.726437+0000","last_peered":"2026-02-23T13:09:21.726437+0000","last_clean":"2026-02-23T13:09:21.726437+0000","last_became_active":"2026-02-23T13:08:59.784463+0000","last_became_peered":"2026-02-23T13:08:59.784463+0000","last_unstale":"2026-02-23T13:09:21.726437+0000","last_undegraded":"2026-02-23T13:09:21.726437+0000","last_fullsized":"2026-02-23T13:09:21.726437+0000","mapping_epoch":62,"log_start":"65'10325","ondisk_log_start":"65'10325","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:08.630348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":676855808,"num_objects":10328,"num_object_clones":0,"num_object_copies":30984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10328,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10328,"num_write_kb":660992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"65'12982","reported_seq":12999,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:26.630757+0000","last_change":"2026-02-23T13:08:59.784910+0000","last_active":"2026-02-23T13:09:26.630757+0000","last_peered":"2026-02-23T13:09:26.630757+0000","last_clean":"2026-02-23T13:09:26.630757+0000","last_became_active":"2026-02-23T13:08:59.784436+0000","last_became_peered":"2026-02-23T13:08:59.784436+0000","last_unstale":"2026-02-23T13:09:26.630757+0000","last_undegraded":"2026-02-23T13:09:26.630757+0000","last_fullsized":"2026-02-23T13:09:26.630757+0000","mapping_epoch":62,"log_start":"65'12979","ondisk_log_start":"65'12979","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:02.594318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":850788352,"num_objects":12982,"num_object_clones":0,"num_object_copies":38946,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12982,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12982,"num_write_kb":830848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"65'12911","reported_seq":12928,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:26.626617+0000","last_change":"2026-02-23T13:08:59.784689+0000","last_active":"2026-02-23T13:09:26.626617+0000","last_peered":"2026-02-23T13:09:26.626617+0000","last_clean":"2026-02-23T13:09:26.626617+0000","last_became_active":"2026-02-23T13:08:59.784290+0000","last_became_peered":"2026-02-23T13:08:59.784290+0000","last_unstale":"2026-02-23T13:09:26.626617+0000","last_undegraded":"2026-02-23T13:09:26.626617+0000","last_fullsized":"2026-02-23T13:09:26.626617+0000","mapping_epoch":62,"log_start":"65'12908","ondisk_log_start":"65'12908","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:25.847402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":846135296,"num_objects":12911,"num_object_clones":0,"num_object_copies":38733,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12911,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12911,"num_write_kb":826304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"65'12794","reported_seq":12811,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:26.639363+0000","last_change":"2026-02-23T13:08:59.786106+0000","last_active":"2026-02-23T13:09:26.639363+0000","last_peered":"2026-02-23T13:09:26.639363+0000","last_clean":"2026-02-23T13:09:26.639363+0000","last_became_active":"2026-02-23T13:08:59.785634+0000","last_became_peered":"2026-02-23T13:08:59.785634+0000","last_unstale":"2026-02-23T13:09:26.639363+0000","last_undegraded":"2026-02-23T13:09:26.639363+0000","last_fullsized":"2026-02-23T13:09:26.639363+0000","mapping_epoch":62,"log_start":"65'12791","ondisk_log_start":"65'12791","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:01.725790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838467584,"num_objects":12794,"num_object_clones":0,"num_object_copies":38382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12794,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12794,"num_write_kb":818816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":301,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:15.445539+0000","last_change":"2026-02-23T13:09:15.445539+0000","last_active":"2026-02-23T13:09:15.445539+0000","last_peered":"2026-02-23T13:09:15.445539+0000","last_clean":"2026-02-23T13:09:15.445539+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:09:15.445539+0000","last_undegraded":"2026-02-23T13:09:15.445539+0000","last_fullsized":"2026-02-23T13:09:15.445539+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:09:15.445510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:09:15.445510+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:37.194057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":12798328832,"num_objects":195287,"num_object_clones":0,"num_object_copies":585861,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195287,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":195287,"num_write_kb":12498368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38735708160,"data_stored":38735708160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247888,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":11188800,"kb_used_data":9820268,"kb_used_omap":12,"kb_used_meta":1368499,"kb_avail":722814400,"statfs":{"total":751619276800,"available":740161945600,"internally_reserved":0,"allocated":10055954432,"data_stored":10055506447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12707,"internal_metadata":1401343581},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444115,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":12384704,"kb_used_data":11250156,"kb_used_omap":12,"kb_used_meta":1134515,"kb_avail":721618496,"statfs":{"total":751619276800,"available":738937339904,"internally_reserved":0,"allocated":11520159744,"data_stored":11519711759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12632,"internal_metadata":1161744040},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":7222076,"kb_used_data":6415336,"kb_used_omap":10,"kb_used_meta":806645,"kb_avail":726781124,"statfs":{"total":751619276800,"available":744223870976,"internally_reserved":0,"allocated":6569304064,"data_stored":6568859631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10872,"internal_metadata":826004872},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705750,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":10510400,"kb_used_data":9550444,"kb_used_omap":7,"kb_used_meta":959928,"kb_avail":723492800,"statfs":{"total":751619276800,"available":740856627200,"internally_reserved":0,"allocated":9779654656,"data_stored":9779206671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8050,"internal_metadata":982966414},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10100604928,"data_stored":10100604928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6741229568,"data_stored":6741229568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11784945664,"data_stored":11784945664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10108928000,"data_stored":10108928000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:09:26.757 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 161 2026-02-23T13:09:26.875 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 26 16 207591 207575 498.94 511.938 0.00160008 0.00200296 2026-02-23T13:09:26.936 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:26.965 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:26 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1357770598' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:09:27.068 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:27.066+0000 7fccaf2d6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:27.068 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:27.066+0000 7fccaf2d6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:27.208 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-23T13:09:27.252 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:09:27.875 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 27 16 215734 215718 499.309 508.938 0.00135411 0.00200149 2026-02-23T13:09:28.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:27 trial046 ceph-mon[38575]: pgmap v234: 17 pgs: 17 active+clean; 12 GiB data, 39 GiB used, 2.7 TiB / 2.7 TiB avail; 557 MiB/s wr, 8.91k op/s 2026-02-23T13:09:28.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:27 trial046 ceph-mon[38575]: from='client.14936 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:09:28.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:27 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3952809054' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "161"} : dispatch 2026-02-23T13:09:28.280 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:09:28.426 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:28.553 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:28.550+0000 7f6696f47640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:28.553 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:28.550+0000 7f6696f47640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:28.567 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:09:28.567 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:09:28.582 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:09:28.582 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:09:28.595 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:09:28.595 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:09:28.610 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:09:28.610 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:09:28.875 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 28 16 224027 224011 499.986 518.312 0.00119213 0.00199878 2026-02-23T13:09:29.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:28 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1559712584' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:09:29.875 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 29 15 232331 232316 500.642 519.062 0.00220633 0.00199616 2026-02-23T13:09:30.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:29 trial046 ceph-mon[38575]: pgmap v235: 17 pgs: 17 active+clean; 13 GiB data, 41 GiB used, 2.7 TiB / 2.7 TiB avail; 448 MiB/s wr, 7.17k op/s 2026-02-23T13:09:30.655 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:09:30.803 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:30.875 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 30 16 240562 240546 501.099 514.375 0.00219197 0.00199433 2026-02-23T13:09:30.933 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:30.931+0000 7ff39b9f6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:30.933 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:30.931+0000 7ff39b9f6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:30.949 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:09:30.950 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:09:30.964 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:09:30.964 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:09:30.978 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:09:30.978 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:09:30.992 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:09:30.992 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:09:31.876 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 31 16 248906 248890 501.756 521.5 0.00130174 0.00199169 2026-02-23T13:09:32.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:31 trial046 ceph-mon[38575]: pgmap v236: 17 pgs: 17 active+clean; 13 GiB data, 41 GiB used, 2.7 TiB / 2.7 TiB avail; 392 MiB/s wr, 6.27k op/s 2026-02-23T13:09:32.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:31 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:09:32.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:31 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/872096982' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:09:32.253 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:09:32.253 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:09:32.253 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-23T13:09:32.253 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:09:32.400 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:32.754 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:32.749+0000 7ffb2902e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:32.754 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:32.749+0000 7ffb2902e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:32.875 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 32 16 256631 256615 501.163 482.812 0.00187727 0.00199409 2026-02-23T13:09:32.903 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:09:32.904 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:09:33.039 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:09:33.590 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":237,"stamp":"2026-02-23T13:09:32.642381+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16198992416,"num_objects":247170,"num_object_clones":0,"num_object_copies":741510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":247170,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":247303,"num_write_kb":15820902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":51531644,"kb_used_data":46648300,"kb_used_omap":43,"kb_used_meta":4883220,"kb_avail":2884481156,"statfs":{"total":3006477107200,"available":2953708703744,"internally_reserved":0,"allocated":47767859200,"data_stored":47766070812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44261,"internal_metadata":5000418075},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[12,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7648772096,"num_objects":116711,"num_object_clones":0,"num_object_copies":350133,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":116711,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116711,"num_write_kb":7469504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001568"},"pg_stats":[{"pgid":"4.f","version":"65'15539","reported_seq":15556,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:31.736239+0000","last_change":"2026-02-23T13:08:59.785158+0000","last_active":"2026-02-23T13:09:31.736239+0000","last_peered":"2026-02-23T13:09:31.736239+0000","last_clean":"2026-02-23T13:09:31.736239+0000","last_became_active":"2026-02-23T13:08:59.784888+0000","last_became_peered":"2026-02-23T13:08:59.784888+0000","last_unstale":"2026-02-23T13:09:31.736239+0000","last_undegraded":"2026-02-23T13:09:31.736239+0000","last_fullsized":"2026-02-23T13:09:31.736239+0000","mapping_epoch":62,"log_start":"65'15536","ondisk_log_start":"65'15536","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:14.965697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1018363904,"num_objects":15539,"num_object_clones":0,"num_object_copies":46617,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15539,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15539,"num_write_kb":994496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"65'15198","reported_seq":15215,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:31.636395+0000","last_change":"2026-02-23T13:08:59.785686+0000","last_active":"2026-02-23T13:09:31.636395+0000","last_peered":"2026-02-23T13:09:31.636395+0000","last_clean":"2026-02-23T13:09:31.636395+0000","last_became_active":"2026-02-23T13:08:59.785397+0000","last_became_peered":"2026-02-23T13:08:59.785397+0000","last_unstale":"2026-02-23T13:09:31.636395+0000","last_undegraded":"2026-02-23T13:09:31.636395+0000","last_fullsized":"2026-02-23T13:09:31.636395+0000","mapping_epoch":62,"log_start":"65'15195","ondisk_log_start":"65'15195","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:19.572572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":996016128,"num_objects":15198,"num_object_clones":0,"num_object_copies":45594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15198,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15198,"num_write_kb":972672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"65'15423","reported_seq":15440,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:31.638308+0000","last_change":"2026-02-23T13:08:59.786322+0000","last_active":"2026-02-23T13:09:31.638308+0000","last_peered":"2026-02-23T13:09:31.638308+0000","last_clean":"2026-02-23T13:09:31.638308+0000","last_became_active":"2026-02-23T13:08:59.785780+0000","last_became_peered":"2026-02-23T13:08:59.785780+0000","last_unstale":"2026-02-23T13:09:31.638308+0000","last_undegraded":"2026-02-23T13:09:31.638308+0000","last_fullsized":"2026-02-23T13:09:31.638308+0000","mapping_epoch":62,"log_start":"65'15420","ondisk_log_start":"65'15420","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:01.263222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1010761728,"num_objects":15423,"num_object_clones":0,"num_object_copies":46269,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15423,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15423,"num_write_kb":987072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"65'15517","reported_seq":15534,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:31.630680+0000","last_change":"2026-02-23T13:08:59.784416+0000","last_active":"2026-02-23T13:09:31.630680+0000","last_peered":"2026-02-23T13:09:31.630680+0000","last_clean":"2026-02-23T13:09:31.630680+0000","last_became_active":"2026-02-23T13:08:59.783982+0000","last_became_peered":"2026-02-23T13:08:59.783982+0000","last_unstale":"2026-02-23T13:09:31.630680+0000","last_undegraded":"2026-02-23T13:09:31.630680+0000","last_fullsized":"2026-02-23T13:09:31.630680+0000","mapping_epoch":62,"log_start":"65'15514","ondisk_log_start":"65'15514","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:19.759236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1016922112,"num_objects":15517,"num_object_clones":0,"num_object_copies":46551,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15517,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15517,"num_write_kb":993088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"65'15421","reported_seq":15438,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:31.627076+0000","last_change":"2026-02-23T13:08:59.784919+0000","last_active":"2026-02-23T13:09:31.627076+0000","last_peered":"2026-02-23T13:09:31.627076+0000","last_clean":"2026-02-23T13:09:31.627076+0000","last_became_active":"2026-02-23T13:08:59.784710+0000","last_became_peered":"2026-02-23T13:08:59.784710+0000","last_unstale":"2026-02-23T13:09:31.627076+0000","last_undegraded":"2026-02-23T13:09:31.627076+0000","last_fullsized":"2026-02-23T13:09:31.627076+0000","mapping_epoch":62,"log_start":"65'15418","ondisk_log_start":"65'15418","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:22.287957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1010630656,"num_objects":15421,"num_object_clones":0,"num_object_copies":46263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15421,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15421,"num_write_kb":986944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"65'15601","reported_seq":15616,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:31.640430+0000","last_change":"2026-02-23T13:08:59.784739+0000","last_active":"2026-02-23T13:09:31.640430+0000","last_peered":"2026-02-23T13:09:31.640430+0000","last_clean":"2026-02-23T13:09:31.640430+0000","last_became_active":"2026-02-23T13:08:59.784218+0000","last_became_peered":"2026-02-23T13:08:59.784218+0000","last_unstale":"2026-02-23T13:09:31.640430+0000","last_undegraded":"2026-02-23T13:09:31.640430+0000","last_fullsized":"2026-02-23T13:09:31.640430+0000","mapping_epoch":62,"log_start":"65'15597","ondisk_log_start":"65'15597","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:25.462760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1022427136,"num_objects":15601,"num_object_clones":0,"num_object_copies":46803,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15601,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15601,"num_write_kb":998464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"65'15364","reported_seq":15381,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:31.638594+0000","last_change":"2026-02-23T13:08:59.784708+0000","last_active":"2026-02-23T13:09:31.638594+0000","last_peered":"2026-02-23T13:09:31.638594+0000","last_clean":"2026-02-23T13:09:31.638594+0000","last_became_active":"2026-02-23T13:08:59.784210+0000","last_became_peered":"2026-02-23T13:08:59.784210+0000","last_unstale":"2026-02-23T13:09:31.638594+0000","last_undegraded":"2026-02-23T13:09:31.638594+0000","last_fullsized":"2026-02-23T13:09:31.638594+0000","mapping_epoch":62,"log_start":"65'15361","ondisk_log_start":"65'15361","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:01.093732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1006895104,"num_objects":15364,"num_object_clones":0,"num_object_copies":46092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15364,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15364,"num_write_kb":983296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"65'15249","reported_seq":15266,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:31.637252+0000","last_change":"2026-02-23T13:08:59.785913+0000","last_active":"2026-02-23T13:09:31.637252+0000","last_peered":"2026-02-23T13:09:31.637252+0000","last_clean":"2026-02-23T13:09:31.637252+0000","last_became_active":"2026-02-23T13:08:59.785359+0000","last_became_peered":"2026-02-23T13:08:59.785359+0000","last_unstale":"2026-02-23T13:09:31.637252+0000","last_undegraded":"2026-02-23T13:09:31.637252+0000","last_fullsized":"2026-02-23T13:09:31.637252+0000","mapping_epoch":62,"log_start":"65'15246","ondisk_log_start":"65'15246","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:18.876316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":999358464,"num_objects":15249,"num_object_clones":0,"num_object_copies":45747,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15249,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15249,"num_write_kb":975936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"65'15584","reported_seq":15601,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:31.735525+0000","last_change":"2026-02-23T13:08:59.786387+0000","last_active":"2026-02-23T13:09:31.735525+0000","last_peered":"2026-02-23T13:09:31.735525+0000","last_clean":"2026-02-23T13:09:31.735525+0000","last_became_active":"2026-02-23T13:08:59.785106+0000","last_became_peered":"2026-02-23T13:08:59.785106+0000","last_unstale":"2026-02-23T13:09:31.735525+0000","last_undegraded":"2026-02-23T13:09:31.735525+0000","last_fullsized":"2026-02-23T13:09:31.735525+0000","mapping_epoch":62,"log_start":"65'15581","ondisk_log_start":"65'15581","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:27.939858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1021313024,"num_objects":15584,"num_object_clones":0,"num_object_copies":46752,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15584,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15584,"num_write_kb":997376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"65'15446","reported_seq":15463,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:31.622508+0000","last_change":"2026-02-23T13:08:59.784789+0000","last_active":"2026-02-23T13:09:31.622508+0000","last_peered":"2026-02-23T13:09:31.622508+0000","last_clean":"2026-02-23T13:09:31.622508+0000","last_became_active":"2026-02-23T13:08:59.784457+0000","last_became_peered":"2026-02-23T13:08:59.784457+0000","last_unstale":"2026-02-23T13:09:31.622508+0000","last_undegraded":"2026-02-23T13:09:31.622508+0000","last_fullsized":"2026-02-23T13:09:31.622508+0000","mapping_epoch":62,"log_start":"65'15443","ondisk_log_start":"65'15443","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:10.735235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012269056,"num_objects":15446,"num_object_clones":0,"num_object_copies":46338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15446,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15446,"num_write_kb":988544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"65'15469","reported_seq":15484,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:31.739349+0000","last_change":"2026-02-23T13:08:59.784450+0000","last_active":"2026-02-23T13:09:31.739349+0000","last_peered":"2026-02-23T13:09:31.739349+0000","last_clean":"2026-02-23T13:09:31.739349+0000","last_became_active":"2026-02-23T13:08:59.784235+0000","last_became_peered":"2026-02-23T13:08:59.784235+0000","last_unstale":"2026-02-23T13:09:31.739349+0000","last_undegraded":"2026-02-23T13:09:31.739349+0000","last_fullsized":"2026-02-23T13:09:31.739349+0000","mapping_epoch":62,"log_start":"65'15466","ondisk_log_start":"65'15466","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:12.986395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013776384,"num_objects":15469,"num_object_clones":0,"num_object_copies":46407,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15469,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15469,"num_write_kb":990016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"65'15514","reported_seq":15530,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:31.629267+0000","last_change":"2026-02-23T13:08:59.784582+0000","last_active":"2026-02-23T13:09:31.629267+0000","last_peered":"2026-02-23T13:09:31.629267+0000","last_clean":"2026-02-23T13:09:31.629267+0000","last_became_active":"2026-02-23T13:08:59.784318+0000","last_became_peered":"2026-02-23T13:08:59.784318+0000","last_unstale":"2026-02-23T13:09:31.629267+0000","last_undegraded":"2026-02-23T13:09:31.629267+0000","last_fullsized":"2026-02-23T13:09:31.629267+0000","mapping_epoch":62,"log_start":"65'15511","ondisk_log_start":"65'15511","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:59.400673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1016725504,"num_objects":15514,"num_object_clones":0,"num_object_copies":46542,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15514,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15514,"num_write_kb":992896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"65'15564","reported_seq":15581,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:31.736419+0000","last_change":"2026-02-23T13:08:59.784710+0000","last_active":"2026-02-23T13:09:31.736419+0000","last_peered":"2026-02-23T13:09:31.736419+0000","last_clean":"2026-02-23T13:09:31.736419+0000","last_became_active":"2026-02-23T13:08:59.784463+0000","last_became_peered":"2026-02-23T13:08:59.784463+0000","last_unstale":"2026-02-23T13:09:31.736419+0000","last_undegraded":"2026-02-23T13:09:31.736419+0000","last_fullsized":"2026-02-23T13:09:31.736419+0000","mapping_epoch":62,"log_start":"65'15561","ondisk_log_start":"65'15561","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:08.630348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1020002304,"num_objects":15564,"num_object_clones":0,"num_object_copies":46692,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15564,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15564,"num_write_kb":996096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"65'15607","reported_seq":15624,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:31.636496+0000","last_change":"2026-02-23T13:08:59.784910+0000","last_active":"2026-02-23T13:09:31.636496+0000","last_peered":"2026-02-23T13:09:31.636496+0000","last_clean":"2026-02-23T13:09:31.636496+0000","last_became_active":"2026-02-23T13:08:59.784436+0000","last_became_peered":"2026-02-23T13:08:59.784436+0000","last_unstale":"2026-02-23T13:09:31.636496+0000","last_undegraded":"2026-02-23T13:09:31.636496+0000","last_fullsized":"2026-02-23T13:09:31.636496+0000","mapping_epoch":62,"log_start":"65'15604","ondisk_log_start":"65'15604","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:02.594318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1022820352,"num_objects":15607,"num_object_clones":0,"num_object_copies":46821,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15607,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15607,"num_write_kb":998848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"65'15424","reported_seq":15441,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:31.626889+0000","last_change":"2026-02-23T13:08:59.784689+0000","last_active":"2026-02-23T13:09:31.626889+0000","last_peered":"2026-02-23T13:09:31.626889+0000","last_clean":"2026-02-23T13:09:31.626889+0000","last_became_active":"2026-02-23T13:08:59.784290+0000","last_became_peered":"2026-02-23T13:08:59.784290+0000","last_unstale":"2026-02-23T13:09:31.626889+0000","last_undegraded":"2026-02-23T13:09:31.626889+0000","last_fullsized":"2026-02-23T13:09:31.626889+0000","mapping_epoch":62,"log_start":"65'15421","ondisk_log_start":"65'15421","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:25.847402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1010827264,"num_objects":15424,"num_object_clones":0,"num_object_copies":46272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15424,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15424,"num_write_kb":987136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"65'15248","reported_seq":15264,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:31.639697+0000","last_change":"2026-02-23T13:08:59.786106+0000","last_active":"2026-02-23T13:09:31.639697+0000","last_peered":"2026-02-23T13:09:31.639697+0000","last_clean":"2026-02-23T13:09:31.639697+0000","last_became_active":"2026-02-23T13:08:59.785634+0000","last_became_peered":"2026-02-23T13:08:59.785634+0000","last_unstale":"2026-02-23T13:09:31.639697+0000","last_undegraded":"2026-02-23T13:09:31.639697+0000","last_fullsized":"2026-02-23T13:09:31.639697+0000","mapping_epoch":62,"log_start":"65'15245","ondisk_log_start":"65'15245","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:01.725790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":999292928,"num_objects":15248,"num_object_clones":0,"num_object_copies":45744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15248,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15248,"num_write_kb":975872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":301,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:15.445539+0000","last_change":"2026-02-23T13:09:15.445539+0000","last_active":"2026-02-23T13:09:15.445539+0000","last_peered":"2026-02-23T13:09:15.445539+0000","last_clean":"2026-02-23T13:09:15.445539+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:09:15.445539+0000","last_undegraded":"2026-02-23T13:09:15.445539+0000","last_fullsized":"2026-02-23T13:09:15.445539+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:09:15.445510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:09:15.445510+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:37.194057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":16198402048,"num_objects":247168,"num_object_clones":0,"num_object_copies":741504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":247168,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":247168,"num_write_kb":15818752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":48585506816,"data_stored":48585506816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247889,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":13304128,"kb_used_data":11827308,"kb_used_omap":12,"kb_used_meta":1476787,"kb_avail":720699072,"statfs":{"total":751619276800,"available":737995849728,"internally_reserved":0,"allocated":12111163392,"data_stored":12110715407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12707,"internal_metadata":1512230493},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444116,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":14871680,"kb_used_data":13556652,"kb_used_omap":12,"kb_used_meta":1314995,"kb_avail":719131520,"statfs":{"total":751619276800,"available":736390676480,"internally_reserved":0,"allocated":13882011648,"data_stored":13881563663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12632,"internal_metadata":1346555560},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":10747324,"kb_used_data":9760168,"kb_used_omap":10,"kb_used_meta":987125,"kb_avail":723255876,"statfs":{"total":751619276800,"available":740614017024,"internally_reserved":0,"allocated":9994412032,"data_stored":9993967599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10872,"internal_metadata":1010816392},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705751,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":12608512,"kb_used_data":11504172,"kb_used_omap":7,"kb_used_meta":1104312,"kb_avail":721394688,"statfs":{"total":751619276800,"available":738708160512,"internally_reserved":0,"allocated":11780272128,"data_stored":11779824143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8050,"internal_metadata":1130815630},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12130910208,"data_stored":12130910208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10159325184,"data_stored":10159325184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14158462976,"data_stored":14158462976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12136808448,"data_stored":12136808448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:09:33.592 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 161 2026-02-23T13:09:33.612 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:33.740 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:33.740 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:33.738+0000 7fb0ced21640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:33.740 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:33.738+0000 7fb0ced21640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:33.759 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:09:33.759 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:09:33.774 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:09:33.774 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:09:33.787 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:09:33.787 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:09:33.801 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:09:33.801 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:09:33.819 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:33 trial046 ceph-mon[38575]: pgmap v237: 17 pgs: 17 active+clean; 15 GiB data, 49 GiB used, 2.7 TiB / 2.7 TiB avail; 608 MiB/s wr, 9.72k op/s 2026-02-23T13:09:33.870 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:33.868+0000 7fc475fa5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:33.870 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:33.869+0000 7fc475fa5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:33.875 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 33 16 263033 263017 498.1 400.125 0.00214571 0.00200635 2026-02-23T13:09:34.022 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-23T13:09:34.062 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:09:34.876 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 34 16 271309 271293 498.662 517.25 0.00178683 0.00200411 2026-02-23T13:09:35.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:34 trial046 ceph-mon[38575]: from='client.14944 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:09:35.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:34 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/338741050' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:09:35.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:34 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2600362948' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "161"} : dispatch 2026-02-23T13:09:35.845 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:09:35.876 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 35 16 279958 279942 499.858 540.562 0.00131478 0.00199933 2026-02-23T13:09:35.998 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:36.024 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:35 trial046 ceph-mon[38575]: pgmap v238: 17 pgs: 17 active+clean; 15 GiB data, 49 GiB used, 2.7 TiB / 2.7 TiB avail; 433 MiB/s wr, 6.92k op/s 2026-02-23T13:09:36.131 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:36.129+0000 7ff43e237640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:36.131 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:36.129+0000 7ff43e237640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:36.146 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:09:36.147 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:09:36.160 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:09:36.161 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:09:36.174 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:09:36.174 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:09:36.187 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:09:36.187 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:09:36.289 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:09:36 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:09:36] "GET /metrics HTTP/1.1" 200 4195 "" "Prometheus/3.6.0" 2026-02-23T13:09:36.561 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:09:36 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:09:36.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:09:36.876 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 36 16 288273 288257 500.408 519.688 0.0024459 0.00199711 2026-02-23T13:09:37.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:36 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2771087804' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:09:37.876 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 37 16 296759 296743 501.216 530.375 0.00207928 0.0019939 2026-02-23T13:09:38.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:37 trial046 ceph-mon[38575]: pgmap v239: 17 pgs: 17 active+clean; 17 GiB data, 55 GiB used, 2.7 TiB / 2.7 TiB avail; 587 MiB/s wr, 9.38k op/s 2026-02-23T13:09:38.237 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:09:38.382 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:38.794 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:38.747+0000 7f4afbc19640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:38.794 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:38.747+0000 7f4afbc19640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:38.794 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:09:38.794 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:09:38.795 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:09:38.795 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:09:38.795 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:09:38.795 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:09:38.807 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:09:38.807 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:09:38.876 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 38 16 303673 303657 499.397 432.125 0.00151333 0.00199987 2026-02-23T13:09:39.063 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:09:39.063 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:09:39.063 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_2 2026-02-23T13:09:39.064 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:09:39.331 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:39.746 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:39.725+0000 7f55c3ecc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:39.746 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:39.726+0000 7f55c3ecc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:39.871 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:09:39.872 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:09:39.876 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 39 16 309388 309372 495.75 357.188 0.00217941 0.00201589 2026-02-23T13:09:40.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:39 trial046 ceph-mon[38575]: pgmap v240: 17 pgs: 17 active+clean; 17 GiB data, 56 GiB used, 2.7 TiB / 2.7 TiB avail; 475 MiB/s wr, 7.60k op/s 2026-02-23T13:09:40.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:39 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/210540232' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:09:40.198 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":240,"stamp":"2026-02-23T13:09:38.643269+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":18776654368,"num_objects":286502,"num_object_clones":0,"num_object_copies":859506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":286502,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":286635,"num_write_kb":18338150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":59000444,"kb_used_data":53774316,"kb_used_omap":43,"kb_used_meta":5226004,"kb_avail":2877012356,"statfs":{"total":3006477107200,"available":2946060652544,"internally_reserved":0,"allocated":55064899584,"data_stored":55063111196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44261,"internal_metadata":5351428891},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,3,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5977735168,"num_objects":91213,"num_object_clones":0,"num_object_copies":273639,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91213,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91213,"num_write_kb":5837632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001667"},"pg_stats":[{"pgid":"4.f","version":"65'17994","reported_seq":18010,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:36.740368+0000","last_change":"2026-02-23T13:08:59.785158+0000","last_active":"2026-02-23T13:09:36.740368+0000","last_peered":"2026-02-23T13:09:36.740368+0000","last_clean":"2026-02-23T13:09:36.740368+0000","last_became_active":"2026-02-23T13:08:59.784888+0000","last_became_peered":"2026-02-23T13:08:59.784888+0000","last_unstale":"2026-02-23T13:09:36.740368+0000","last_undegraded":"2026-02-23T13:09:36.740368+0000","last_fullsized":"2026-02-23T13:09:36.740368+0000","mapping_epoch":62,"log_start":"65'17991","ondisk_log_start":"65'17991","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:14.965697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179254784,"num_objects":17994,"num_object_clones":0,"num_object_copies":53982,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17994,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17994,"num_write_kb":1151616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"65'17637","reported_seq":17654,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:36.637945+0000","last_change":"2026-02-23T13:08:59.785686+0000","last_active":"2026-02-23T13:09:36.637945+0000","last_peered":"2026-02-23T13:09:36.637945+0000","last_clean":"2026-02-23T13:09:36.637945+0000","last_became_active":"2026-02-23T13:08:59.785397+0000","last_became_peered":"2026-02-23T13:08:59.785397+0000","last_unstale":"2026-02-23T13:09:36.637945+0000","last_undegraded":"2026-02-23T13:09:36.637945+0000","last_fullsized":"2026-02-23T13:09:36.637945+0000","mapping_epoch":62,"log_start":"65'17634","ondisk_log_start":"65'17634","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:19.572572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1155858432,"num_objects":17637,"num_object_clones":0,"num_object_copies":52911,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17637,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17637,"num_write_kb":1128768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"65'17889","reported_seq":17906,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:36.639025+0000","last_change":"2026-02-23T13:08:59.786322+0000","last_active":"2026-02-23T13:09:36.639025+0000","last_peered":"2026-02-23T13:09:36.639025+0000","last_clean":"2026-02-23T13:09:36.639025+0000","last_became_active":"2026-02-23T13:08:59.785780+0000","last_became_peered":"2026-02-23T13:08:59.785780+0000","last_unstale":"2026-02-23T13:09:36.639025+0000","last_undegraded":"2026-02-23T13:09:36.639025+0000","last_fullsized":"2026-02-23T13:09:36.639025+0000","mapping_epoch":62,"log_start":"65'17886","ondisk_log_start":"65'17886","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:01.263222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1172373504,"num_objects":17889,"num_object_clones":0,"num_object_copies":53667,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17889,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17889,"num_write_kb":1144896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"65'17977","reported_seq":17994,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:36.639059+0000","last_change":"2026-02-23T13:08:59.784416+0000","last_active":"2026-02-23T13:09:36.639059+0000","last_peered":"2026-02-23T13:09:36.639059+0000","last_clean":"2026-02-23T13:09:36.639059+0000","last_became_active":"2026-02-23T13:08:59.783982+0000","last_became_peered":"2026-02-23T13:08:59.783982+0000","last_unstale":"2026-02-23T13:09:36.639059+0000","last_undegraded":"2026-02-23T13:09:36.639059+0000","last_fullsized":"2026-02-23T13:09:36.639059+0000","mapping_epoch":62,"log_start":"65'17974","ondisk_log_start":"65'17974","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:19.759236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1178140672,"num_objects":17977,"num_object_clones":0,"num_object_copies":53931,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17977,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17977,"num_write_kb":1150528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"65'17882","reported_seq":17899,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:36.629904+0000","last_change":"2026-02-23T13:08:59.784919+0000","last_active":"2026-02-23T13:09:36.629904+0000","last_peered":"2026-02-23T13:09:36.629904+0000","last_clean":"2026-02-23T13:09:36.629904+0000","last_became_active":"2026-02-23T13:08:59.784710+0000","last_became_peered":"2026-02-23T13:08:59.784710+0000","last_unstale":"2026-02-23T13:09:36.629904+0000","last_undegraded":"2026-02-23T13:09:36.629904+0000","last_fullsized":"2026-02-23T13:09:36.629904+0000","mapping_epoch":62,"log_start":"65'17879","ondisk_log_start":"65'17879","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:22.287957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1171914752,"num_objects":17882,"num_object_clones":0,"num_object_copies":53646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17882,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17882,"num_write_kb":1144448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"65'17986","reported_seq":18003,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:36.639306+0000","last_change":"2026-02-23T13:08:59.784739+0000","last_active":"2026-02-23T13:09:36.639306+0000","last_peered":"2026-02-23T13:09:36.639306+0000","last_clean":"2026-02-23T13:09:36.639306+0000","last_became_active":"2026-02-23T13:08:59.784218+0000","last_became_peered":"2026-02-23T13:08:59.784218+0000","last_unstale":"2026-02-23T13:09:36.639306+0000","last_undegraded":"2026-02-23T13:09:36.639306+0000","last_fullsized":"2026-02-23T13:09:36.639306+0000","mapping_epoch":62,"log_start":"65'17983","ondisk_log_start":"65'17983","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:25.462760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1178730496,"num_objects":17986,"num_object_clones":0,"num_object_copies":53958,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17986,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17986,"num_write_kb":1151104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"65'17746","reported_seq":17763,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:36.637888+0000","last_change":"2026-02-23T13:08:59.784708+0000","last_active":"2026-02-23T13:09:36.637888+0000","last_peered":"2026-02-23T13:09:36.637888+0000","last_clean":"2026-02-23T13:09:36.637888+0000","last_became_active":"2026-02-23T13:08:59.784210+0000","last_became_peered":"2026-02-23T13:08:59.784210+0000","last_unstale":"2026-02-23T13:09:36.637888+0000","last_undegraded":"2026-02-23T13:09:36.637888+0000","last_fullsized":"2026-02-23T13:09:36.637888+0000","mapping_epoch":62,"log_start":"65'17743","ondisk_log_start":"65'17743","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:01.093732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1163001856,"num_objects":17746,"num_object_clones":0,"num_object_copies":53238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17746,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17746,"num_write_kb":1135744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"65'17722","reported_seq":17738,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:36.640791+0000","last_change":"2026-02-23T13:08:59.785913+0000","last_active":"2026-02-23T13:09:36.640791+0000","last_peered":"2026-02-23T13:09:36.640791+0000","last_clean":"2026-02-23T13:09:36.640791+0000","last_became_active":"2026-02-23T13:08:59.785359+0000","last_became_peered":"2026-02-23T13:08:59.785359+0000","last_unstale":"2026-02-23T13:09:36.640791+0000","last_undegraded":"2026-02-23T13:09:36.640791+0000","last_fullsized":"2026-02-23T13:09:36.640791+0000","mapping_epoch":62,"log_start":"65'17719","ondisk_log_start":"65'17719","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:18.876316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1161428992,"num_objects":17722,"num_object_clones":0,"num_object_copies":53166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17722,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17722,"num_write_kb":1134208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"65'18028","reported_seq":18045,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:36.740087+0000","last_change":"2026-02-23T13:08:59.786387+0000","last_active":"2026-02-23T13:09:36.740087+0000","last_peered":"2026-02-23T13:09:36.740087+0000","last_clean":"2026-02-23T13:09:36.740087+0000","last_became_active":"2026-02-23T13:08:59.785106+0000","last_became_peered":"2026-02-23T13:08:59.785106+0000","last_unstale":"2026-02-23T13:09:36.740087+0000","last_undegraded":"2026-02-23T13:09:36.740087+0000","last_fullsized":"2026-02-23T13:09:36.740087+0000","mapping_epoch":62,"log_start":"65'18025","ondisk_log_start":"65'18025","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:27.939858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1181483008,"num_objects":18028,"num_object_clones":0,"num_object_copies":54084,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18028,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18028,"num_write_kb":1153792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"65'17938","reported_seq":17954,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:36.630948+0000","last_change":"2026-02-23T13:08:59.784789+0000","last_active":"2026-02-23T13:09:36.630948+0000","last_peered":"2026-02-23T13:09:36.630948+0000","last_clean":"2026-02-23T13:09:36.630948+0000","last_became_active":"2026-02-23T13:08:59.784457+0000","last_became_peered":"2026-02-23T13:08:59.784457+0000","last_unstale":"2026-02-23T13:09:36.630948+0000","last_undegraded":"2026-02-23T13:09:36.630948+0000","last_fullsized":"2026-02-23T13:09:36.630948+0000","mapping_epoch":62,"log_start":"65'17935","ondisk_log_start":"65'17935","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:10.735235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1175584768,"num_objects":17938,"num_object_clones":0,"num_object_copies":53814,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17938,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17938,"num_write_kb":1148032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"65'17878","reported_seq":17894,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:36.739716+0000","last_change":"2026-02-23T13:08:59.784450+0000","last_active":"2026-02-23T13:09:36.739716+0000","last_peered":"2026-02-23T13:09:36.739716+0000","last_clean":"2026-02-23T13:09:36.739716+0000","last_became_active":"2026-02-23T13:08:59.784235+0000","last_became_peered":"2026-02-23T13:08:59.784235+0000","last_unstale":"2026-02-23T13:09:36.739716+0000","last_undegraded":"2026-02-23T13:09:36.739716+0000","last_fullsized":"2026-02-23T13:09:36.739716+0000","mapping_epoch":62,"log_start":"65'17875","ondisk_log_start":"65'17875","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:12.986395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1171652608,"num_objects":17878,"num_object_clones":0,"num_object_copies":53634,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17878,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17878,"num_write_kb":1144192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"65'18026","reported_seq":18042,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:36.628867+0000","last_change":"2026-02-23T13:08:59.784582+0000","last_active":"2026-02-23T13:09:36.628867+0000","last_peered":"2026-02-23T13:09:36.628867+0000","last_clean":"2026-02-23T13:09:36.628867+0000","last_became_active":"2026-02-23T13:08:59.784318+0000","last_became_peered":"2026-02-23T13:08:59.784318+0000","last_unstale":"2026-02-23T13:09:36.628867+0000","last_undegraded":"2026-02-23T13:09:36.628867+0000","last_fullsized":"2026-02-23T13:09:36.628867+0000","mapping_epoch":62,"log_start":"65'18023","ondisk_log_start":"65'18023","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:59.400673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1181351936,"num_objects":18026,"num_object_clones":0,"num_object_copies":54078,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18026,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18026,"num_write_kb":1153664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"65'18066","reported_seq":18083,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:36.738406+0000","last_change":"2026-02-23T13:08:59.784710+0000","last_active":"2026-02-23T13:09:36.738406+0000","last_peered":"2026-02-23T13:09:36.738406+0000","last_clean":"2026-02-23T13:09:36.738406+0000","last_became_active":"2026-02-23T13:08:59.784463+0000","last_became_peered":"2026-02-23T13:08:59.784463+0000","last_unstale":"2026-02-23T13:09:36.738406+0000","last_undegraded":"2026-02-23T13:09:36.738406+0000","last_fullsized":"2026-02-23T13:09:36.738406+0000","mapping_epoch":62,"log_start":"65'18063","ondisk_log_start":"65'18063","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:08.630348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1183973376,"num_objects":18066,"num_object_clones":0,"num_object_copies":54198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18066,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18066,"num_write_kb":1156224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"65'18091","reported_seq":18108,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:36.636993+0000","last_change":"2026-02-23T13:08:59.784910+0000","last_active":"2026-02-23T13:09:36.636993+0000","last_peered":"2026-02-23T13:09:36.636993+0000","last_clean":"2026-02-23T13:09:36.636993+0000","last_became_active":"2026-02-23T13:08:59.784436+0000","last_became_peered":"2026-02-23T13:08:59.784436+0000","last_unstale":"2026-02-23T13:09:36.636993+0000","last_undegraded":"2026-02-23T13:09:36.636993+0000","last_fullsized":"2026-02-23T13:09:36.636993+0000","mapping_epoch":62,"log_start":"65'18088","ondisk_log_start":"65'18088","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:02.594318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1185611776,"num_objects":18091,"num_object_clones":0,"num_object_copies":54273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18091,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18091,"num_write_kb":1157824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"65'17872","reported_seq":17889,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:36.625283+0000","last_change":"2026-02-23T13:08:59.784689+0000","last_active":"2026-02-23T13:09:36.625283+0000","last_peered":"2026-02-23T13:09:36.625283+0000","last_clean":"2026-02-23T13:09:36.625283+0000","last_became_active":"2026-02-23T13:08:59.784290+0000","last_became_peered":"2026-02-23T13:08:59.784290+0000","last_unstale":"2026-02-23T13:09:36.625283+0000","last_undegraded":"2026-02-23T13:09:36.625283+0000","last_fullsized":"2026-02-23T13:09:36.625283+0000","mapping_epoch":62,"log_start":"65'17869","ondisk_log_start":"65'17869","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:25.847402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1171259392,"num_objects":17872,"num_object_clones":0,"num_object_copies":53616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17872,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17872,"num_write_kb":1143808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"65'17768","reported_seq":17785,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:36.639068+0000","last_change":"2026-02-23T13:08:59.786106+0000","last_active":"2026-02-23T13:09:36.639068+0000","last_peered":"2026-02-23T13:09:36.639068+0000","last_clean":"2026-02-23T13:09:36.639068+0000","last_became_active":"2026-02-23T13:08:59.785634+0000","last_became_peered":"2026-02-23T13:08:59.785634+0000","last_unstale":"2026-02-23T13:09:36.639068+0000","last_undegraded":"2026-02-23T13:09:36.639068+0000","last_fullsized":"2026-02-23T13:09:36.639068+0000","mapping_epoch":62,"log_start":"65'17765","ondisk_log_start":"65'17765","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:01.725790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1164443648,"num_objects":17768,"num_object_clones":0,"num_object_copies":53304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17768,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17768,"num_write_kb":1137152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":301,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:15.445539+0000","last_change":"2026-02-23T13:09:15.445539+0000","last_active":"2026-02-23T13:09:15.445539+0000","last_peered":"2026-02-23T13:09:15.445539+0000","last_clean":"2026-02-23T13:09:15.445539+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:09:15.445539+0000","last_undegraded":"2026-02-23T13:09:15.445539+0000","last_fullsized":"2026-02-23T13:09:15.445539+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:09:15.445510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:09:15.445510+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:37.194057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":18776064000,"num_objects":286500,"num_object_clones":0,"num_object_copies":859500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":286500,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":286500,"num_write_kb":18336000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":56323538944,"data_stored":56323538944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247890,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":14889152,"kb_used_data":13340140,"kb_used_omap":12,"kb_used_meta":1548979,"kb_avail":719114048,"statfs":{"total":751619276800,"available":736372785152,"internally_reserved":0,"allocated":13660303360,"data_stored":13659855375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12707,"internal_metadata":1586155101},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,3],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444117,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":17208512,"kb_used_data":15785196,"kb_used_omap":12,"kb_used_meta":1423283,"kb_avail":716794688,"statfs":{"total":751619276800,"available":733997760512,"internally_reserved":0,"allocated":16164040704,"data_stored":16163592719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12632,"internal_metadata":1457442472},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":12340412,"kb_used_data":11281192,"kb_used_omap":10,"kb_used_meta":1059189,"kb_avail":721662788,"statfs":{"total":751619276800,"available":738982694912,"internally_reserved":0,"allocated":11551940608,"data_stored":11551496175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10872,"internal_metadata":1084609928},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705752,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":14562368,"kb_used_data":13367788,"kb_used_omap":7,"kb_used_meta":1194552,"kb_avail":719440832,"statfs":{"total":751619276800,"available":736707411968,"internally_reserved":0,"allocated":13688614912,"data_stored":13688166927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8050,"internal_metadata":1223221390},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14072938496,"data_stored":14072938496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11760238592,"data_stored":11760238592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16414474240,"data_stored":16414474240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14075887616,"data_stored":14075887616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:09:40.200 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:09:40.200 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_2 pg_num 36 2026-02-23T13:09:40.346 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:40.481 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:40.480+0000 7f77d2ae4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:40.481 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:40.480+0000 7f77d2ae4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:40.632 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:09:40.678 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:09:40.876 INFO:tasks.radosbench.radosbench.0.trial046.stdout:2026-02-23T13:09:40.876004+0000 min lat: 0.000698614 max lat: 0.0535382 avg lat: 0.00201761 2026-02-23T13:09:40.876 INFO:tasks.radosbench.radosbench.0.trial046.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-23T13:09:40.876 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 40 16 317048 317032 495.324 478.75 0.00136461 0.00201761 2026-02-23T13:09:41.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:40 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2679924463' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_2", "var": "pg_num", "val": "36"} : dispatch 2026-02-23T13:09:41.411 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:09:41.555 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:41.682 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:41.681+0000 7feeafaf3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:41.683 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:41.681+0000 7feeafaf3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:41.699 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:09:41.699 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:09:41.714 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:09:41.714 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:09:41.730 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:09:41.730 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:09:41.743 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:09:41.743 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:09:41.876 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 41 15 325557 325542 496.215 531.875 0.0018114 0.002014 2026-02-23T13:09:42.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:41 trial046 ceph-mon[38575]: from='client.14954 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:09:42.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:41 trial046 ceph-mon[38575]: pgmap v241: 17 pgs: 17 active+clean; 17 GiB data, 56 GiB used, 2.7 TiB / 2.7 TiB avail; 421 MiB/s wr, 6.73k op/s 2026-02-23T13:09:42.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:41 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1256588143' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:09:42.876 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 42 16 334257 334241 497.344 543.688 0.00232658 0.00200944 2026-02-23T13:09:43.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:42 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:09:43.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:42 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:09:43.790 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:09:43.876 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 43 16 342869 342853 498.294 538.25 0.00194115 0.00200559 2026-02-23T13:09:43.949 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:44.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:43 trial046 ceph-mon[38575]: pgmap v242: 17 pgs: 17 active+clean; 20 GiB data, 64 GiB used, 2.7 TiB / 2.7 TiB avail; 614 MiB/s wr, 9.82k op/s 2026-02-23T13:09:44.182 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:44.180+0000 7fc0e5392640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:44.182 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:44.180+0000 7fc0e5392640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:44.196 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:09:44.197 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:09:44.209 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:09:44.210 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:09:44.223 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:09:44.223 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:09:44.238 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:09:44.239 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:09:44.877 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 44 16 351214 351198 498.822 521.562 0.00154455 0.00200346 2026-02-23T13:09:45.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:44 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1932085001' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:09:45.680 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:09:45.680 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:09:45.680 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_2 2026-02-23T13:09:45.680 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:09:45.830 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:45.876 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 45 15 359639 359624 499.439 526.625 0.00126574 0.00200098 2026-02-23T13:09:45.965 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:45.964+0000 7fa41350c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:45.965 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:45.964+0000 7fa41350c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:45.966 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:45 trial046 ceph-mon[38575]: pgmap v243: 17 pgs: 17 active+clean; 20 GiB data, 64 GiB used, 2.7 TiB / 2.7 TiB avail; 398 MiB/s wr, 6.37k op/s 2026-02-23T13:09:46.105 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:09:46.106 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:09:46.162 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":243,"stamp":"2026-02-23T13:09:44.644108+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":21210399264,"num_objects":323638,"num_object_clones":0,"num_object_copies":970914,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":323638,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":323771,"num_write_kb":20714854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":66995772,"kb_used_data":61282348,"kb_used_omap":43,"kb_used_meta":5713300,"kb_avail":2869017028,"statfs":{"total":3006477107200,"available":2937873436672,"internally_reserved":0,"allocated":62753124352,"data_stored":62751335964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44261,"internal_metadata":5850419995},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,3],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5011406848,"num_objects":76468,"num_object_clones":0,"num_object_copies":229404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76468,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76468,"num_write_kb":4893952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001727"},"pg_stats":[{"pgid":"4.f","version":"65'20305","reported_seq":20319,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:41.741605+0000","last_change":"2026-02-23T13:08:59.785158+0000","last_active":"2026-02-23T13:09:41.741605+0000","last_peered":"2026-02-23T13:09:41.741605+0000","last_clean":"2026-02-23T13:09:41.741605+0000","last_became_active":"2026-02-23T13:08:59.784888+0000","last_became_peered":"2026-02-23T13:08:59.784888+0000","last_unstale":"2026-02-23T13:09:41.741605+0000","last_undegraded":"2026-02-23T13:09:41.741605+0000","last_fullsized":"2026-02-23T13:09:41.741605+0000","mapping_epoch":62,"log_start":"65'20301","ondisk_log_start":"65'20301","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:14.965697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1330708480,"num_objects":20305,"num_object_clones":0,"num_object_copies":60915,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20305,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20305,"num_write_kb":1299520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"65'19963","reported_seq":19979,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:41.641608+0000","last_change":"2026-02-23T13:08:59.785686+0000","last_active":"2026-02-23T13:09:41.641608+0000","last_peered":"2026-02-23T13:09:41.641608+0000","last_clean":"2026-02-23T13:09:41.641608+0000","last_became_active":"2026-02-23T13:08:59.785397+0000","last_became_peered":"2026-02-23T13:08:59.785397+0000","last_unstale":"2026-02-23T13:09:41.641608+0000","last_undegraded":"2026-02-23T13:09:41.641608+0000","last_fullsized":"2026-02-23T13:09:41.641608+0000","mapping_epoch":62,"log_start":"65'19960","ondisk_log_start":"65'19960","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:19.572572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1308295168,"num_objects":19963,"num_object_clones":0,"num_object_copies":59889,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19963,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19963,"num_write_kb":1277632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"65'20195","reported_seq":20212,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:41.631541+0000","last_change":"2026-02-23T13:08:59.786322+0000","last_active":"2026-02-23T13:09:41.631541+0000","last_peered":"2026-02-23T13:09:41.631541+0000","last_clean":"2026-02-23T13:09:41.631541+0000","last_became_active":"2026-02-23T13:08:59.785780+0000","last_became_peered":"2026-02-23T13:08:59.785780+0000","last_unstale":"2026-02-23T13:09:41.631541+0000","last_undegraded":"2026-02-23T13:09:41.631541+0000","last_fullsized":"2026-02-23T13:09:41.631541+0000","mapping_epoch":62,"log_start":"65'20192","ondisk_log_start":"65'20192","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:01.263222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1323499520,"num_objects":20195,"num_object_clones":0,"num_object_copies":60585,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20195,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20195,"num_write_kb":1292480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"65'20412","reported_seq":20429,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:41.633339+0000","last_change":"2026-02-23T13:08:59.784416+0000","last_active":"2026-02-23T13:09:41.633339+0000","last_peered":"2026-02-23T13:09:41.633339+0000","last_clean":"2026-02-23T13:09:41.633339+0000","last_became_active":"2026-02-23T13:08:59.783982+0000","last_became_peered":"2026-02-23T13:08:59.783982+0000","last_unstale":"2026-02-23T13:09:41.633339+0000","last_undegraded":"2026-02-23T13:09:41.633339+0000","last_fullsized":"2026-02-23T13:09:41.633339+0000","mapping_epoch":62,"log_start":"65'20409","ondisk_log_start":"65'20409","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:19.759236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1337720832,"num_objects":20412,"num_object_clones":0,"num_object_copies":61236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20412,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20412,"num_write_kb":1306368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"65'20155","reported_seq":20170,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:41.630362+0000","last_change":"2026-02-23T13:08:59.784919+0000","last_active":"2026-02-23T13:09:41.630362+0000","last_peered":"2026-02-23T13:09:41.630362+0000","last_clean":"2026-02-23T13:09:41.630362+0000","last_became_active":"2026-02-23T13:08:59.784710+0000","last_became_peered":"2026-02-23T13:08:59.784710+0000","last_unstale":"2026-02-23T13:09:41.630362+0000","last_undegraded":"2026-02-23T13:09:41.630362+0000","last_fullsized":"2026-02-23T13:09:41.630362+0000","mapping_epoch":62,"log_start":"65'20152","ondisk_log_start":"65'20152","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:22.287957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1320878080,"num_objects":20155,"num_object_clones":0,"num_object_copies":60465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20155,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20155,"num_write_kb":1289920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"65'20278","reported_seq":20295,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:41.636521+0000","last_change":"2026-02-23T13:08:59.784739+0000","last_active":"2026-02-23T13:09:41.636521+0000","last_peered":"2026-02-23T13:09:41.636521+0000","last_clean":"2026-02-23T13:09:41.636521+0000","last_became_active":"2026-02-23T13:08:59.784218+0000","last_became_peered":"2026-02-23T13:08:59.784218+0000","last_unstale":"2026-02-23T13:09:41.636521+0000","last_undegraded":"2026-02-23T13:09:41.636521+0000","last_fullsized":"2026-02-23T13:09:41.636521+0000","mapping_epoch":62,"log_start":"65'20275","ondisk_log_start":"65'20275","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:25.462760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1328939008,"num_objects":20278,"num_object_clones":0,"num_object_copies":60834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20278,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20278,"num_write_kb":1297792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"65'20132","reported_seq":20148,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:41.640623+0000","last_change":"2026-02-23T13:08:59.784708+0000","last_active":"2026-02-23T13:09:41.640623+0000","last_peered":"2026-02-23T13:09:41.640623+0000","last_clean":"2026-02-23T13:09:41.640623+0000","last_became_active":"2026-02-23T13:08:59.784210+0000","last_became_peered":"2026-02-23T13:08:59.784210+0000","last_unstale":"2026-02-23T13:09:41.640623+0000","last_undegraded":"2026-02-23T13:09:41.640623+0000","last_fullsized":"2026-02-23T13:09:41.640623+0000","mapping_epoch":62,"log_start":"65'20129","ondisk_log_start":"65'20129","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:01.093732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1319370752,"num_objects":20132,"num_object_clones":0,"num_object_copies":60396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20132,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20132,"num_write_kb":1288448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"65'20112","reported_seq":20128,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:41.641289+0000","last_change":"2026-02-23T13:08:59.785913+0000","last_active":"2026-02-23T13:09:41.641289+0000","last_peered":"2026-02-23T13:09:41.641289+0000","last_clean":"2026-02-23T13:09:41.641289+0000","last_became_active":"2026-02-23T13:08:59.785359+0000","last_became_peered":"2026-02-23T13:08:59.785359+0000","last_unstale":"2026-02-23T13:09:41.641289+0000","last_undegraded":"2026-02-23T13:09:41.641289+0000","last_fullsized":"2026-02-23T13:09:41.641289+0000","mapping_epoch":62,"log_start":"65'20109","ondisk_log_start":"65'20109","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:18.876316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1318060032,"num_objects":20112,"num_object_clones":0,"num_object_copies":60336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20112,"num_write_kb":1287168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"65'20289","reported_seq":20306,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:41.741269+0000","last_change":"2026-02-23T13:08:59.786387+0000","last_active":"2026-02-23T13:09:41.741269+0000","last_peered":"2026-02-23T13:09:41.741269+0000","last_clean":"2026-02-23T13:09:41.741269+0000","last_became_active":"2026-02-23T13:08:59.785106+0000","last_became_peered":"2026-02-23T13:08:59.785106+0000","last_unstale":"2026-02-23T13:09:41.741269+0000","last_undegraded":"2026-02-23T13:09:41.741269+0000","last_fullsized":"2026-02-23T13:09:41.741269+0000","mapping_epoch":62,"log_start":"65'20286","ondisk_log_start":"65'20286","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:27.939858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1329659904,"num_objects":20289,"num_object_clones":0,"num_object_copies":60867,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20289,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20289,"num_write_kb":1298496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"65'20285","reported_seq":20302,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:41.627434+0000","last_change":"2026-02-23T13:08:59.784789+0000","last_active":"2026-02-23T13:09:41.627434+0000","last_peered":"2026-02-23T13:09:41.627434+0000","last_clean":"2026-02-23T13:09:41.627434+0000","last_became_active":"2026-02-23T13:08:59.784457+0000","last_became_peered":"2026-02-23T13:08:59.784457+0000","last_unstale":"2026-02-23T13:09:41.627434+0000","last_undegraded":"2026-02-23T13:09:41.627434+0000","last_fullsized":"2026-02-23T13:09:41.627434+0000","mapping_epoch":62,"log_start":"65'20282","ondisk_log_start":"65'20282","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:10.735235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1329397760,"num_objects":20285,"num_object_clones":0,"num_object_copies":60855,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20285,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20285,"num_write_kb":1298240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"65'20220","reported_seq":20237,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:41.740987+0000","last_change":"2026-02-23T13:08:59.784450+0000","last_active":"2026-02-23T13:09:41.740987+0000","last_peered":"2026-02-23T13:09:41.740987+0000","last_clean":"2026-02-23T13:09:41.740987+0000","last_became_active":"2026-02-23T13:08:59.784235+0000","last_became_peered":"2026-02-23T13:08:59.784235+0000","last_unstale":"2026-02-23T13:09:41.740987+0000","last_undegraded":"2026-02-23T13:09:41.740987+0000","last_fullsized":"2026-02-23T13:09:41.740987+0000","mapping_epoch":62,"log_start":"65'20217","ondisk_log_start":"65'20217","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:12.986395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1325137920,"num_objects":20220,"num_object_clones":0,"num_object_copies":60660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20220,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20220,"num_write_kb":1294080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"65'20323","reported_seq":20340,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:41.623249+0000","last_change":"2026-02-23T13:08:59.784582+0000","last_active":"2026-02-23T13:09:41.623249+0000","last_peered":"2026-02-23T13:09:41.623249+0000","last_clean":"2026-02-23T13:09:41.623249+0000","last_became_active":"2026-02-23T13:08:59.784318+0000","last_became_peered":"2026-02-23T13:08:59.784318+0000","last_unstale":"2026-02-23T13:09:41.623249+0000","last_undegraded":"2026-02-23T13:09:41.623249+0000","last_fullsized":"2026-02-23T13:09:41.623249+0000","mapping_epoch":62,"log_start":"65'20320","ondisk_log_start":"65'20320","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:59.400673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1331888128,"num_objects":20323,"num_object_clones":0,"num_object_copies":60969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20323,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20323,"num_write_kb":1300672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"65'20361","reported_seq":20378,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:41.737680+0000","last_change":"2026-02-23T13:08:59.784710+0000","last_active":"2026-02-23T13:09:41.737680+0000","last_peered":"2026-02-23T13:09:41.737680+0000","last_clean":"2026-02-23T13:09:41.737680+0000","last_became_active":"2026-02-23T13:08:59.784463+0000","last_became_peered":"2026-02-23T13:08:59.784463+0000","last_unstale":"2026-02-23T13:09:41.737680+0000","last_undegraded":"2026-02-23T13:09:41.737680+0000","last_fullsized":"2026-02-23T13:09:41.737680+0000","mapping_epoch":62,"log_start":"65'20358","ondisk_log_start":"65'20358","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:08.630348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1334378496,"num_objects":20361,"num_object_clones":0,"num_object_copies":61083,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20361,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20361,"num_write_kb":1303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"65'20354","reported_seq":20371,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:41.639651+0000","last_change":"2026-02-23T13:08:59.784910+0000","last_active":"2026-02-23T13:09:41.639651+0000","last_peered":"2026-02-23T13:09:41.639651+0000","last_clean":"2026-02-23T13:09:41.639651+0000","last_became_active":"2026-02-23T13:08:59.784436+0000","last_became_peered":"2026-02-23T13:08:59.784436+0000","last_unstale":"2026-02-23T13:09:41.639651+0000","last_undegraded":"2026-02-23T13:09:41.639651+0000","last_fullsized":"2026-02-23T13:09:41.639651+0000","mapping_epoch":62,"log_start":"65'20351","ondisk_log_start":"65'20351","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:02.594318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1333919744,"num_objects":20354,"num_object_clones":0,"num_object_copies":61062,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20354,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20354,"num_write_kb":1302656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"65'20212","reported_seq":20228,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:41.631021+0000","last_change":"2026-02-23T13:08:59.784689+0000","last_active":"2026-02-23T13:09:41.631021+0000","last_peered":"2026-02-23T13:09:41.631021+0000","last_clean":"2026-02-23T13:09:41.631021+0000","last_became_active":"2026-02-23T13:08:59.784290+0000","last_became_peered":"2026-02-23T13:08:59.784290+0000","last_unstale":"2026-02-23T13:09:41.631021+0000","last_undegraded":"2026-02-23T13:09:41.631021+0000","last_fullsized":"2026-02-23T13:09:41.631021+0000","mapping_epoch":62,"log_start":"65'20209","ondisk_log_start":"65'20209","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:25.847402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1324613632,"num_objects":20212,"num_object_clones":0,"num_object_copies":60636,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20212,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20212,"num_write_kb":1293568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"65'20040","reported_seq":20057,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:41.638182+0000","last_change":"2026-02-23T13:08:59.786106+0000","last_active":"2026-02-23T13:09:41.638182+0000","last_peered":"2026-02-23T13:09:41.638182+0000","last_clean":"2026-02-23T13:09:41.638182+0000","last_became_active":"2026-02-23T13:08:59.785634+0000","last_became_peered":"2026-02-23T13:08:59.785634+0000","last_unstale":"2026-02-23T13:09:41.638182+0000","last_undegraded":"2026-02-23T13:09:41.638182+0000","last_fullsized":"2026-02-23T13:09:41.638182+0000","mapping_epoch":62,"log_start":"65'20037","ondisk_log_start":"65'20037","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:01.725790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1313341440,"num_objects":20040,"num_object_clones":0,"num_object_copies":60120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20040,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20040,"num_write_kb":1282560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":301,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:15.445539+0000","last_change":"2026-02-23T13:09:15.445539+0000","last_active":"2026-02-23T13:09:15.445539+0000","last_peered":"2026-02-23T13:09:15.445539+0000","last_clean":"2026-02-23T13:09:15.445539+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:09:15.445539+0000","last_undegraded":"2026-02-23T13:09:15.445539+0000","last_fullsized":"2026-02-23T13:09:15.445539+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:09:15.445510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:09:15.445510+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:37.194057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":21209808896,"num_objects":323636,"num_object_clones":0,"num_object_copies":970908,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":323636,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323636,"num_write_kb":20712704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":63622348800,"data_stored":63622348800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247891,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":17206272,"kb_used_data":15512876,"kb_used_omap":12,"kb_used_meta":1693363,"kb_avail":716796928,"statfs":{"total":751619276800,"available":734000054272,"internally_reserved":0,"allocated":15885185024,"data_stored":15884737039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12707,"internal_metadata":1734004317},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444118,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":19340288,"kb_used_data":17808684,"kb_used_omap":12,"kb_used_meta":1531571,"kb_avail":714662912,"statfs":{"total":751619276800,"available":731814821888,"internally_reserved":0,"allocated":18236092416,"data_stored":18235644431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12632,"internal_metadata":1568329384},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":13989372,"kb_used_data":12785768,"kb_used_omap":10,"kb_used_meta":1203573,"kb_avail":720013828,"statfs":{"total":751619276800,"available":737294159872,"internally_reserved":0,"allocated":13092626432,"data_stored":13092181999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10872,"internal_metadata":1232459144},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705753,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":16459840,"kb_used_data":15175020,"kb_used_omap":7,"kb_used_meta":1284792,"kb_avail":717543360,"statfs":{"total":751619276800,"available":734764400640,"internally_reserved":0,"allocated":15539220480,"data_stored":15538772495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8050,"internal_metadata":1315627150},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15890513920,"data_stored":15890513920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13286572032,"data_stored":13286572032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18545049600,"data_stored":18545049600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15900213248,"data_stored":15900213248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:09:46.165 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:09:46.165 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_2 pg_num 46 2026-02-23T13:09:46.285 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:09:46.289 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:09:46 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:09:46] "GET /metrics HTTP/1.1" 200 4206 "" "Prometheus/3.6.0" 2026-02-23T13:09:46.316 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:46.433 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:46.452 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:46.451+0000 7fb6120de640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:46.452 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:46.451+0000 7fb6120de640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:46.468 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:09:46 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:09:46.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:09:46.562 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:46.561+0000 7f8e5f927640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:46.562 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:46.561+0000 7f8e5f927640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:46.577 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:09:46.577 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:09:46.590 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:09:46.590 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:09:46.604 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:09:46.605 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:09:46.609 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:09:46.618 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:09:46.618 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:09:46.656 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:09:46.860 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:46 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:09:46.860 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:46 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3583407146' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:09:46.860 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:46 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/144870043' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_2", "var": "pg_num", "val": "46"} : dispatch 2026-02-23T13:09:46.876 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 46 16 368186 368170 500.193 534.125 0.00133929 0.00199797 2026-02-23T13:09:47.877 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 47 16 376682 376666 500.847 531 0.00145883 0.00199537 2026-02-23T13:09:48.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:47 trial046 ceph-mon[38575]: from='client.14962 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:09:48.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:47 trial046 ceph-mon[38575]: pgmap v244: 17 pgs: 17 active+clean; 22 GiB data, 70 GiB used, 2.7 TiB / 2.7 TiB avail; 564 MiB/s wr, 9.03k op/s 2026-02-23T13:09:48.662 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:09:48.815 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:48.877 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 48 16 385323 385307 501.663 540.062 0.00203579 0.00199213 2026-02-23T13:09:48.959 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:48.957+0000 7f37d7fff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:48.959 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:48.958+0000 7f37d7fff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:48.960 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:48 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:09:48.960 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:48 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:09:48.973 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:09:48.973 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:09:48.987 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:09:48.987 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:09:49.000 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:09:49.001 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:09:49.015 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:09:49.015 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:09:49.877 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 49 16 393655 393639 502.052 520.75 0.00242921 0.00199058 2026-02-23T13:09:50.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:49 trial046 ceph-mon[38575]: pgmap v245: 17 pgs: 17 active+clean; 22 GiB data, 72 GiB used, 2.7 TiB / 2.7 TiB avail; 467 MiB/s wr, 7.47k op/s 2026-02-23T13:09:50.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:49 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/157897242' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:09:50.877 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 50 15 401955 401940 502.386 518.812 0.0020016 0.00198925 2026-02-23T13:09:51.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:50 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:09:51.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:50 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:09:51.061 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:09:51.209 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:51.648 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:09:51.648 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:09:51.648 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:09:51.649 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:51.592+0000 7f37b71b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:51.649 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:51.592+0000 7f37b71b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:51.649 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:09:51.649 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:09:51.649 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:09:51.654 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:09:51.654 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:09:51.658 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:09:51.658 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:09:51.658 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:09:51.869 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:51 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:09:51.869 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:51 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:09:51.869 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:51 trial046 ceph-mon[38575]: pgmap v246: 17 pgs: 17 active+clean; 22 GiB data, 72 GiB used, 2.7 TiB / 2.7 TiB avail; 416 MiB/s wr, 6.65k op/s 2026-02-23T13:09:51.869 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:51 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1532891166' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:09:51.877 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 51 16 408864 408848 501 431.75 0.00226612 0.00199477 2026-02-23T13:09:52.223 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:52.620 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:52.566+0000 7f9ba7fff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:52.620 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:52.567+0000 7f9ba7fff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:52.714 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:09:52.715 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:09:52.877 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 52 16 414995 414979 498.734 383.188 0.00196409 0.00200383 2026-02-23T13:09:53.142 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":247,"stamp":"2026-02-23T13:09:52.645236+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26712277536,"num_objects":407590,"num_object_clones":0,"num_object_copies":1222770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":407590,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":407723,"num_write_kb":26087782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53,"ondisk_log_size":53,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":83437052,"kb_used_data":77249324,"kb_used_omap":45,"kb_used_meta":6187602,"kb_avail":2852575748,"statfs":{"total":3006477107200,"available":2921037565952,"internally_reserved":0,"allocated":79103307776,"data_stored":79101519388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46863,"internal_metadata":6336104689},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,4,0,0,4],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7935623168,"num_objects":121088,"num_object_clones":0,"num_object_copies":363264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121088,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121088,"num_write_kb":7749632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001685"},"pg_stats":[{"pgid":"4.f","version":"65'25611","reported_seq":25628,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:51.726468+0000","last_change":"2026-02-23T13:08:59.785158+0000","last_active":"2026-02-23T13:09:51.726468+0000","last_peered":"2026-02-23T13:09:51.726468+0000","last_clean":"2026-02-23T13:09:51.726468+0000","last_became_active":"2026-02-23T13:08:59.784888+0000","last_became_peered":"2026-02-23T13:08:59.784888+0000","last_unstale":"2026-02-23T13:09:51.726468+0000","last_undegraded":"2026-02-23T13:09:51.726468+0000","last_fullsized":"2026-02-23T13:09:51.726468+0000","mapping_epoch":62,"log_start":"65'25608","ondisk_log_start":"65'25608","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:14.965697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1678442496,"num_objects":25611,"num_object_clones":0,"num_object_copies":76833,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25611,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25611,"num_write_kb":1639104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"65'25204","reported_seq":25221,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:51.637957+0000","last_change":"2026-02-23T13:08:59.785686+0000","last_active":"2026-02-23T13:09:51.637957+0000","last_peered":"2026-02-23T13:09:51.637957+0000","last_clean":"2026-02-23T13:09:51.637957+0000","last_became_active":"2026-02-23T13:08:59.785397+0000","last_became_peered":"2026-02-23T13:08:59.785397+0000","last_unstale":"2026-02-23T13:09:51.637957+0000","last_undegraded":"2026-02-23T13:09:51.637957+0000","last_fullsized":"2026-02-23T13:09:51.637957+0000","mapping_epoch":62,"log_start":"65'25201","ondisk_log_start":"65'25201","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:19.572572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1651769344,"num_objects":25204,"num_object_clones":0,"num_object_copies":75612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25204,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25204,"num_write_kb":1613056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"65'25401","reported_seq":25417,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:51.642517+0000","last_change":"2026-02-23T13:08:59.786322+0000","last_active":"2026-02-23T13:09:51.642517+0000","last_peered":"2026-02-23T13:09:51.642517+0000","last_clean":"2026-02-23T13:09:51.642517+0000","last_became_active":"2026-02-23T13:08:59.785780+0000","last_became_peered":"2026-02-23T13:08:59.785780+0000","last_unstale":"2026-02-23T13:09:51.642517+0000","last_undegraded":"2026-02-23T13:09:51.642517+0000","last_fullsized":"2026-02-23T13:09:51.642517+0000","mapping_epoch":62,"log_start":"65'25398","ondisk_log_start":"65'25398","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:01.263222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1664679936,"num_objects":25401,"num_object_clones":0,"num_object_copies":76203,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25401,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25401,"num_write_kb":1625664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"65'25636","reported_seq":25653,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:51.639985+0000","last_change":"2026-02-23T13:08:59.784416+0000","last_active":"2026-02-23T13:09:51.639985+0000","last_peered":"2026-02-23T13:09:51.639985+0000","last_clean":"2026-02-23T13:09:51.639985+0000","last_became_active":"2026-02-23T13:08:59.783982+0000","last_became_peered":"2026-02-23T13:08:59.783982+0000","last_unstale":"2026-02-23T13:09:51.639985+0000","last_undegraded":"2026-02-23T13:09:51.639985+0000","last_fullsized":"2026-02-23T13:09:51.639985+0000","mapping_epoch":62,"log_start":"65'25633","ondisk_log_start":"65'25633","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:19.759236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1680080896,"num_objects":25636,"num_object_clones":0,"num_object_copies":76908,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25636,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25636,"num_write_kb":1640704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"65'25389","reported_seq":25405,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:51.631022+0000","last_change":"2026-02-23T13:08:59.784919+0000","last_active":"2026-02-23T13:09:51.631022+0000","last_peered":"2026-02-23T13:09:51.631022+0000","last_clean":"2026-02-23T13:09:51.631022+0000","last_became_active":"2026-02-23T13:08:59.784710+0000","last_became_peered":"2026-02-23T13:08:59.784710+0000","last_unstale":"2026-02-23T13:09:51.631022+0000","last_undegraded":"2026-02-23T13:09:51.631022+0000","last_fullsized":"2026-02-23T13:09:51.631022+0000","mapping_epoch":62,"log_start":"65'25386","ondisk_log_start":"65'25386","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:22.287957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1663893504,"num_objects":25389,"num_object_clones":0,"num_object_copies":76167,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25389,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25389,"num_write_kb":1624896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"65'25576","reported_seq":25593,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:51.640828+0000","last_change":"2026-02-23T13:08:59.784739+0000","last_active":"2026-02-23T13:09:51.640828+0000","last_peered":"2026-02-23T13:09:51.640828+0000","last_clean":"2026-02-23T13:09:51.640828+0000","last_became_active":"2026-02-23T13:08:59.784218+0000","last_became_peered":"2026-02-23T13:08:59.784218+0000","last_unstale":"2026-02-23T13:09:51.640828+0000","last_undegraded":"2026-02-23T13:09:51.640828+0000","last_fullsized":"2026-02-23T13:09:51.640828+0000","mapping_epoch":62,"log_start":"65'25573","ondisk_log_start":"65'25573","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:25.462760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1676148736,"num_objects":25576,"num_object_clones":0,"num_object_copies":76728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25576,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25576,"num_write_kb":1636864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"65'25365","reported_seq":25382,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:51.642098+0000","last_change":"2026-02-23T13:08:59.784708+0000","last_active":"2026-02-23T13:09:51.642098+0000","last_peered":"2026-02-23T13:09:51.642098+0000","last_clean":"2026-02-23T13:09:51.642098+0000","last_became_active":"2026-02-23T13:08:59.784210+0000","last_became_peered":"2026-02-23T13:08:59.784210+0000","last_unstale":"2026-02-23T13:09:51.642098+0000","last_undegraded":"2026-02-23T13:09:51.642098+0000","last_fullsized":"2026-02-23T13:09:51.642098+0000","mapping_epoch":62,"log_start":"65'25362","ondisk_log_start":"65'25362","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:01.093732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1662320640,"num_objects":25365,"num_object_clones":0,"num_object_copies":76095,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25365,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25365,"num_write_kb":1623360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"65'25218","reported_seq":25235,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:51.634956+0000","last_change":"2026-02-23T13:08:59.785913+0000","last_active":"2026-02-23T13:09:51.634956+0000","last_peered":"2026-02-23T13:09:51.634956+0000","last_clean":"2026-02-23T13:09:51.634956+0000","last_became_active":"2026-02-23T13:08:59.785359+0000","last_became_peered":"2026-02-23T13:08:59.785359+0000","last_unstale":"2026-02-23T13:09:51.634956+0000","last_undegraded":"2026-02-23T13:09:51.634956+0000","last_fullsized":"2026-02-23T13:09:51.634956+0000","mapping_epoch":62,"log_start":"65'25215","ondisk_log_start":"65'25215","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:18.876316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1652686848,"num_objects":25218,"num_object_clones":0,"num_object_copies":75654,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25218,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25218,"num_write_kb":1613952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"65'25560","reported_seq":25577,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:51.724392+0000","last_change":"2026-02-23T13:08:59.786387+0000","last_active":"2026-02-23T13:09:51.724392+0000","last_peered":"2026-02-23T13:09:51.724392+0000","last_clean":"2026-02-23T13:09:51.724392+0000","last_became_active":"2026-02-23T13:08:59.785106+0000","last_became_peered":"2026-02-23T13:08:59.785106+0000","last_unstale":"2026-02-23T13:09:51.724392+0000","last_undegraded":"2026-02-23T13:09:51.724392+0000","last_fullsized":"2026-02-23T13:09:51.724392+0000","mapping_epoch":62,"log_start":"65'25557","ondisk_log_start":"65'25557","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:27.939858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1675100160,"num_objects":25560,"num_object_clones":0,"num_object_copies":76680,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25560,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25560,"num_write_kb":1635840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"65'25656","reported_seq":25672,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:51.630802+0000","last_change":"2026-02-23T13:08:59.784789+0000","last_active":"2026-02-23T13:09:51.630802+0000","last_peered":"2026-02-23T13:09:51.630802+0000","last_clean":"2026-02-23T13:09:51.630802+0000","last_became_active":"2026-02-23T13:08:59.784457+0000","last_became_peered":"2026-02-23T13:08:59.784457+0000","last_unstale":"2026-02-23T13:09:51.630802+0000","last_undegraded":"2026-02-23T13:09:51.630802+0000","last_fullsized":"2026-02-23T13:09:51.630802+0000","mapping_epoch":62,"log_start":"65'25653","ondisk_log_start":"65'25653","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:10.735235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1681391616,"num_objects":25656,"num_object_clones":0,"num_object_copies":76968,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25656,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25656,"num_write_kb":1641984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"65'25485","reported_seq":25502,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:51.724586+0000","last_change":"2026-02-23T13:08:59.784450+0000","last_active":"2026-02-23T13:09:51.724586+0000","last_peered":"2026-02-23T13:09:51.724586+0000","last_clean":"2026-02-23T13:09:51.724586+0000","last_became_active":"2026-02-23T13:08:59.784235+0000","last_became_peered":"2026-02-23T13:08:59.784235+0000","last_unstale":"2026-02-23T13:09:51.724586+0000","last_undegraded":"2026-02-23T13:09:51.724586+0000","last_fullsized":"2026-02-23T13:09:51.724586+0000","mapping_epoch":62,"log_start":"65'25480","ondisk_log_start":"65'25480","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:12.986395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1670184960,"num_objects":25485,"num_object_clones":0,"num_object_copies":76455,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25485,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25485,"num_write_kb":1631040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"65'25530","reported_seq":25547,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:51.627079+0000","last_change":"2026-02-23T13:08:59.784582+0000","last_active":"2026-02-23T13:09:51.627079+0000","last_peered":"2026-02-23T13:09:51.627079+0000","last_clean":"2026-02-23T13:09:51.627079+0000","last_became_active":"2026-02-23T13:08:59.784318+0000","last_became_peered":"2026-02-23T13:08:59.784318+0000","last_unstale":"2026-02-23T13:09:51.627079+0000","last_undegraded":"2026-02-23T13:09:51.627079+0000","last_fullsized":"2026-02-23T13:09:51.627079+0000","mapping_epoch":62,"log_start":"65'25527","ondisk_log_start":"65'25527","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:59.400673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1673134080,"num_objects":25530,"num_object_clones":0,"num_object_copies":76590,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25530,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25530,"num_write_kb":1633920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"65'25665","reported_seq":25682,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:51.722064+0000","last_change":"2026-02-23T13:08:59.784710+0000","last_active":"2026-02-23T13:09:51.722064+0000","last_peered":"2026-02-23T13:09:51.722064+0000","last_clean":"2026-02-23T13:09:51.722064+0000","last_became_active":"2026-02-23T13:08:59.784463+0000","last_became_peered":"2026-02-23T13:08:59.784463+0000","last_unstale":"2026-02-23T13:09:51.722064+0000","last_undegraded":"2026-02-23T13:09:51.722064+0000","last_fullsized":"2026-02-23T13:09:51.722064+0000","mapping_epoch":62,"log_start":"65'25662","ondisk_log_start":"65'25662","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:08.630348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1681981440,"num_objects":25665,"num_object_clones":0,"num_object_copies":76995,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25665,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25665,"num_write_kb":1642560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"65'25525","reported_seq":25542,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:51.642224+0000","last_change":"2026-02-23T13:08:59.784910+0000","last_active":"2026-02-23T13:09:51.642224+0000","last_peered":"2026-02-23T13:09:51.642224+0000","last_clean":"2026-02-23T13:09:51.642224+0000","last_became_active":"2026-02-23T13:08:59.784436+0000","last_became_peered":"2026-02-23T13:08:59.784436+0000","last_unstale":"2026-02-23T13:09:51.642224+0000","last_undegraded":"2026-02-23T13:09:51.642224+0000","last_fullsized":"2026-02-23T13:09:51.642224+0000","mapping_epoch":62,"log_start":"65'25522","ondisk_log_start":"65'25522","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:02.594318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1672806400,"num_objects":25525,"num_object_clones":0,"num_object_copies":76575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25525,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25525,"num_write_kb":1633600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"65'25504","reported_seq":25521,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:51.625465+0000","last_change":"2026-02-23T13:08:59.784689+0000","last_active":"2026-02-23T13:09:51.625465+0000","last_peered":"2026-02-23T13:09:51.625465+0000","last_clean":"2026-02-23T13:09:51.625465+0000","last_became_active":"2026-02-23T13:08:59.784290+0000","last_became_peered":"2026-02-23T13:08:59.784290+0000","last_unstale":"2026-02-23T13:09:51.625465+0000","last_undegraded":"2026-02-23T13:09:51.625465+0000","last_fullsized":"2026-02-23T13:09:51.625465+0000","mapping_epoch":62,"log_start":"65'25501","ondisk_log_start":"65'25501","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:25.847402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1671430144,"num_objects":25504,"num_object_clones":0,"num_object_copies":76512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25504,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25504,"num_write_kb":1632256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"65'25263","reported_seq":25280,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:51.627742+0000","last_change":"2026-02-23T13:08:59.786106+0000","last_active":"2026-02-23T13:09:51.627742+0000","last_peered":"2026-02-23T13:09:51.627742+0000","last_clean":"2026-02-23T13:09:51.627742+0000","last_became_active":"2026-02-23T13:08:59.785634+0000","last_became_peered":"2026-02-23T13:08:59.785634+0000","last_unstale":"2026-02-23T13:09:51.627742+0000","last_undegraded":"2026-02-23T13:09:51.627742+0000","last_fullsized":"2026-02-23T13:09:51.627742+0000","mapping_epoch":62,"log_start":"65'25260","ondisk_log_start":"65'25260","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:01.725790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655635968,"num_objects":25263,"num_object_clones":0,"num_object_copies":75789,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25263,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25263,"num_write_kb":1616832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":301,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:15.445539+0000","last_change":"2026-02-23T13:09:15.445539+0000","last_active":"2026-02-23T13:09:15.445539+0000","last_peered":"2026-02-23T13:09:15.445539+0000","last_clean":"2026-02-23T13:09:15.445539+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:09:15.445539+0000","last_undegraded":"2026-02-23T13:09:15.445539+0000","last_fullsized":"2026-02-23T13:09:15.445539+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:09:15.445510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:09:15.445510+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:37.194057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":26711687168,"num_objects":407588,"num_object_clones":0,"num_object_copies":1222764,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":407588,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":407588,"num_write_kb":26085632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":80132767744,"data_stored":80132767744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":50,"ondisk_log_size":50,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247893,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":20600640,"kb_used_data":19209004,"kb_used_omap":13,"kb_used_meta":1391602,"kb_avail":713402560,"statfs":{"total":751619276800,"available":730524221440,"internally_reserved":0,"allocated":19670020096,"data_stored":19669572111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13353,"internal_metadata":1425001431},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,4],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444120,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":24417600,"kb_used_data":22579180,"kb_used_omap":12,"kb_used_meta":1838387,"kb_avail":709585600,"statfs":{"total":751619276800,"available":726615654400,"internally_reserved":0,"allocated":23121080320,"data_stored":23120632335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13284,"internal_metadata":1882508316},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":17598204,"kb_used_data":16214120,"kb_used_omap":11,"kb_used_meta":1384052,"kb_avail":716404996,"statfs":{"total":751619276800,"available":733598715904,"internally_reserved":0,"allocated":16603258880,"data_stored":16602814447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11524,"internal_metadata":1417270012},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705755,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":20820608,"kb_used_data":19247020,"kb_used_omap":8,"kb_used_meta":1573559,"kb_avail":713182592,"statfs":{"total":751619276800,"available":730298974208,"internally_reserved":0,"allocated":19708948480,"data_stored":19708500495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8702,"internal_metadata":1611324930},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20016332800,"data_stored":20016332800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16735666176,"data_stored":16735666176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23357947904,"data_stored":23357947904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20022820864,"data_stored":20022820864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:09:53.877 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 53 16 422720 422704 498.433 482.812 0.00141426 0.00200504 2026-02-23T13:09:54.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:53 trial046 ceph-mon[38575]: pgmap v247: 17 pgs: 17 active+clean; 25 GiB data, 80 GiB used, 2.7 TiB / 2.7 TiB avail; 631 MiB/s wr, 10.09k op/s 2026-02-23T13:09:54.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:53 trial046 ceph-mon[38575]: from='client.14972 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:09:54.195 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:09:54.338 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:54.467 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:54.466+0000 7fcf082ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:54.467 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:54.466+0000 7fcf082ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:54.482 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:09:54.482 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:09:54.496 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:09:54.496 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:09:54.510 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:09:54.510 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:09:54.523 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:09:54.523 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:09:54.877 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 54 16 430954 430938 498.732 514.625 0.00213618 0.00200383 2026-02-23T13:09:55.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:54 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2451074003' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:09:55.877 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 55 15 438871 438856 498.661 494.875 0.00144429 0.00200414 2026-02-23T13:09:56.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:55 trial046 ceph-mon[38575]: pgmap v248: 17 pgs: 17 active+clean; 25 GiB data, 80 GiB used, 2.7 TiB / 2.7 TiB avail; 437 MiB/s wr, 6.99k op/s 2026-02-23T13:09:56.539 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:09:56 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:09:56] "GET /metrics HTTP/1.1" 200 4206 "" "Prometheus/3.6.0" 2026-02-23T13:09:56.561 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:09:56 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:09:56.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:09:56.566 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:09:56.713 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:56.877 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 56 16 446752 446736 498.551 492.5 0.00235832 0.00200456 2026-02-23T13:09:56.930 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:56.929+0000 7fd40f833640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:56.931 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:56.929+0000 7fd40f833640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:56.946 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:09:56.946 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:09:56.960 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:09:56.960 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:09:56.974 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:09:56.974 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:09:56.987 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:09:56.987 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:09:57.877 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 57 16 454835 454819 498.666 505.188 0.00220666 0.00200412 2026-02-23T13:09:58.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:57 trial046 ceph-mon[38575]: pgmap v249: 17 pgs: 17 active+clean; 27 GiB data, 85 GiB used, 2.7 TiB / 2.7 TiB avail; 584 MiB/s wr, 9.34k op/s 2026-02-23T13:09:58.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:57 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/326529093' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:09:58.144 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:09:58.144 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:09:58.145 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:09:58.145 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:09:58.295 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:58.692 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:58.637+0000 7f567ee5e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:58.693 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:58.637+0000 7f567ee5e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:58.792 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:09:58.792 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:09:58.877 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 58 16 462021 462005 497.811 449.125 0.00162148 0.00200757 2026-02-23T13:09:59.080 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":250,"stamp":"2026-02-23T13:09:58.646121+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29169615392,"num_objects":445086,"num_object_clones":0,"num_object_copies":1335258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":445086,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":445219,"num_write_kb":28487526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53,"ondisk_log_size":53,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":90865852,"kb_used_data":84353196,"kb_used_omap":46,"kb_used_meta":6512529,"kb_avail":2845146948,"statfs":{"total":3006477107200,"available":2913430474752,"internally_reserved":0,"allocated":86377672704,"data_stored":86375884316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47848,"internal_metadata":6668829976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,7],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5870190592,"num_objects":89572,"num_object_clones":0,"num_object_copies":268716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89572,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89572,"num_write_kb":5732608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001758"},"pg_stats":[{"pgid":"4.f","version":"65'27918","reported_seq":27935,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:56.741127+0000","last_change":"2026-02-23T13:08:59.785158+0000","last_active":"2026-02-23T13:09:56.741127+0000","last_peered":"2026-02-23T13:09:56.741127+0000","last_clean":"2026-02-23T13:09:56.741127+0000","last_became_active":"2026-02-23T13:08:59.784888+0000","last_became_peered":"2026-02-23T13:08:59.784888+0000","last_unstale":"2026-02-23T13:09:56.741127+0000","last_undegraded":"2026-02-23T13:09:56.741127+0000","last_fullsized":"2026-02-23T13:09:56.741127+0000","mapping_epoch":62,"log_start":"65'27915","ondisk_log_start":"65'27915","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:14.965697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1829634048,"num_objects":27918,"num_object_clones":0,"num_object_copies":83754,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27918,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27918,"num_write_kb":1786752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"65'27539","reported_seq":27556,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:56.639037+0000","last_change":"2026-02-23T13:08:59.785686+0000","last_active":"2026-02-23T13:09:56.639037+0000","last_peered":"2026-02-23T13:09:56.639037+0000","last_clean":"2026-02-23T13:09:56.639037+0000","last_became_active":"2026-02-23T13:08:59.785397+0000","last_became_peered":"2026-02-23T13:08:59.785397+0000","last_unstale":"2026-02-23T13:09:56.639037+0000","last_undegraded":"2026-02-23T13:09:56.639037+0000","last_fullsized":"2026-02-23T13:09:56.639037+0000","mapping_epoch":62,"log_start":"65'27536","ondisk_log_start":"65'27536","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:19.572572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1804795904,"num_objects":27539,"num_object_clones":0,"num_object_copies":82617,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27539,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27539,"num_write_kb":1762496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"65'27746","reported_seq":27763,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:56.640827+0000","last_change":"2026-02-23T13:08:59.786322+0000","last_active":"2026-02-23T13:09:56.640827+0000","last_peered":"2026-02-23T13:09:56.640827+0000","last_clean":"2026-02-23T13:09:56.640827+0000","last_became_active":"2026-02-23T13:08:59.785780+0000","last_became_peered":"2026-02-23T13:08:59.785780+0000","last_unstale":"2026-02-23T13:09:56.640827+0000","last_undegraded":"2026-02-23T13:09:56.640827+0000","last_fullsized":"2026-02-23T13:09:56.640827+0000","mapping_epoch":62,"log_start":"65'27743","ondisk_log_start":"65'27743","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:01.263222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1818361856,"num_objects":27746,"num_object_clones":0,"num_object_copies":83238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27746,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27746,"num_write_kb":1775744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"65'28035","reported_seq":28052,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:56.641959+0000","last_change":"2026-02-23T13:08:59.784416+0000","last_active":"2026-02-23T13:09:56.641959+0000","last_peered":"2026-02-23T13:09:56.641959+0000","last_clean":"2026-02-23T13:09:56.641959+0000","last_became_active":"2026-02-23T13:08:59.783982+0000","last_became_peered":"2026-02-23T13:08:59.783982+0000","last_unstale":"2026-02-23T13:09:56.641959+0000","last_undegraded":"2026-02-23T13:09:56.641959+0000","last_fullsized":"2026-02-23T13:09:56.641959+0000","mapping_epoch":62,"log_start":"65'28032","ondisk_log_start":"65'28032","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:19.759236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1837301760,"num_objects":28035,"num_object_clones":0,"num_object_copies":84105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28035,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28035,"num_write_kb":1794240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"65'27717","reported_seq":27733,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:56.632957+0000","last_change":"2026-02-23T13:08:59.784919+0000","last_active":"2026-02-23T13:09:56.632957+0000","last_peered":"2026-02-23T13:09:56.632957+0000","last_clean":"2026-02-23T13:09:56.632957+0000","last_became_active":"2026-02-23T13:08:59.784710+0000","last_became_peered":"2026-02-23T13:08:59.784710+0000","last_unstale":"2026-02-23T13:09:56.632957+0000","last_undegraded":"2026-02-23T13:09:56.632957+0000","last_fullsized":"2026-02-23T13:09:56.632957+0000","mapping_epoch":62,"log_start":"65'27714","ondisk_log_start":"65'27714","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:22.287957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1816461312,"num_objects":27717,"num_object_clones":0,"num_object_copies":83151,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27717,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27717,"num_write_kb":1773888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"65'27964","reported_seq":27981,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:56.642462+0000","last_change":"2026-02-23T13:08:59.784739+0000","last_active":"2026-02-23T13:09:56.642462+0000","last_peered":"2026-02-23T13:09:56.642462+0000","last_clean":"2026-02-23T13:09:56.642462+0000","last_became_active":"2026-02-23T13:08:59.784218+0000","last_became_peered":"2026-02-23T13:08:59.784218+0000","last_unstale":"2026-02-23T13:09:56.642462+0000","last_undegraded":"2026-02-23T13:09:56.642462+0000","last_fullsized":"2026-02-23T13:09:56.642462+0000","mapping_epoch":62,"log_start":"65'27961","ondisk_log_start":"65'27961","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:25.462760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1832648704,"num_objects":27964,"num_object_clones":0,"num_object_copies":83892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27964,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27964,"num_write_kb":1789696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"65'27686","reported_seq":27703,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:56.639508+0000","last_change":"2026-02-23T13:08:59.784708+0000","last_active":"2026-02-23T13:09:56.639508+0000","last_peered":"2026-02-23T13:09:56.639508+0000","last_clean":"2026-02-23T13:09:56.639508+0000","last_became_active":"2026-02-23T13:08:59.784210+0000","last_became_peered":"2026-02-23T13:08:59.784210+0000","last_unstale":"2026-02-23T13:09:56.639508+0000","last_undegraded":"2026-02-23T13:09:56.639508+0000","last_fullsized":"2026-02-23T13:09:56.639508+0000","mapping_epoch":62,"log_start":"65'27683","ondisk_log_start":"65'27683","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:01.093732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1814429696,"num_objects":27686,"num_object_clones":0,"num_object_copies":83058,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27686,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27686,"num_write_kb":1771904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"65'27536","reported_seq":27551,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:56.642393+0000","last_change":"2026-02-23T13:08:59.785913+0000","last_active":"2026-02-23T13:09:56.642393+0000","last_peered":"2026-02-23T13:09:56.642393+0000","last_clean":"2026-02-23T13:09:56.642393+0000","last_became_active":"2026-02-23T13:08:59.785359+0000","last_became_peered":"2026-02-23T13:08:59.785359+0000","last_unstale":"2026-02-23T13:09:56.642393+0000","last_undegraded":"2026-02-23T13:09:56.642393+0000","last_fullsized":"2026-02-23T13:09:56.642393+0000","mapping_epoch":62,"log_start":"65'27533","ondisk_log_start":"65'27533","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:18.876316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1804599296,"num_objects":27536,"num_object_clones":0,"num_object_copies":82608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27536,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27536,"num_write_kb":1762304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"65'27938","reported_seq":27955,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:56.739779+0000","last_change":"2026-02-23T13:08:59.786387+0000","last_active":"2026-02-23T13:09:56.739779+0000","last_peered":"2026-02-23T13:09:56.739779+0000","last_clean":"2026-02-23T13:09:56.739779+0000","last_became_active":"2026-02-23T13:08:59.785106+0000","last_became_peered":"2026-02-23T13:08:59.785106+0000","last_unstale":"2026-02-23T13:09:56.739779+0000","last_undegraded":"2026-02-23T13:09:56.739779+0000","last_fullsized":"2026-02-23T13:09:56.739779+0000","mapping_epoch":62,"log_start":"65'27935","ondisk_log_start":"65'27935","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:27.939858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1830944768,"num_objects":27938,"num_object_clones":0,"num_object_copies":83814,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27938,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27938,"num_write_kb":1788032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"65'27940","reported_seq":27957,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:56.619695+0000","last_change":"2026-02-23T13:08:59.784789+0000","last_active":"2026-02-23T13:09:56.619695+0000","last_peered":"2026-02-23T13:09:56.619695+0000","last_clean":"2026-02-23T13:09:56.619695+0000","last_became_active":"2026-02-23T13:08:59.784457+0000","last_became_peered":"2026-02-23T13:08:59.784457+0000","last_unstale":"2026-02-23T13:09:56.619695+0000","last_undegraded":"2026-02-23T13:09:56.619695+0000","last_fullsized":"2026-02-23T13:09:56.619695+0000","mapping_epoch":62,"log_start":"65'27937","ondisk_log_start":"65'27937","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:10.735235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1831075840,"num_objects":27940,"num_object_clones":0,"num_object_copies":83820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27940,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27940,"num_write_kb":1788160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"65'27847","reported_seq":27864,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:56.738434+0000","last_change":"2026-02-23T13:08:59.784450+0000","last_active":"2026-02-23T13:09:56.738434+0000","last_peered":"2026-02-23T13:09:56.738434+0000","last_clean":"2026-02-23T13:09:56.738434+0000","last_became_active":"2026-02-23T13:08:59.784235+0000","last_became_peered":"2026-02-23T13:08:59.784235+0000","last_unstale":"2026-02-23T13:09:56.738434+0000","last_undegraded":"2026-02-23T13:09:56.738434+0000","last_fullsized":"2026-02-23T13:09:56.738434+0000","mapping_epoch":62,"log_start":"65'27844","ondisk_log_start":"65'27844","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:12.986395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1824980992,"num_objects":27847,"num_object_clones":0,"num_object_copies":83541,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27847,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27847,"num_write_kb":1782208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"65'27930","reported_seq":27947,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:56.630507+0000","last_change":"2026-02-23T13:08:59.784582+0000","last_active":"2026-02-23T13:09:56.630507+0000","last_peered":"2026-02-23T13:09:56.630507+0000","last_clean":"2026-02-23T13:09:56.630507+0000","last_became_active":"2026-02-23T13:08:59.784318+0000","last_became_peered":"2026-02-23T13:08:59.784318+0000","last_unstale":"2026-02-23T13:09:56.630507+0000","last_undegraded":"2026-02-23T13:09:56.630507+0000","last_fullsized":"2026-02-23T13:09:56.630507+0000","mapping_epoch":62,"log_start":"65'27925","ondisk_log_start":"65'27925","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:09:59.400673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1830420480,"num_objects":27930,"num_object_clones":0,"num_object_copies":83790,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27930,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27930,"num_write_kb":1787520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"65'27986","reported_seq":28003,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:56.735393+0000","last_change":"2026-02-23T13:08:59.784710+0000","last_active":"2026-02-23T13:09:56.735393+0000","last_peered":"2026-02-23T13:09:56.735393+0000","last_clean":"2026-02-23T13:09:56.735393+0000","last_became_active":"2026-02-23T13:08:59.784463+0000","last_became_peered":"2026-02-23T13:08:59.784463+0000","last_unstale":"2026-02-23T13:09:56.735393+0000","last_undegraded":"2026-02-23T13:09:56.735393+0000","last_fullsized":"2026-02-23T13:09:56.735393+0000","mapping_epoch":62,"log_start":"65'27983","ondisk_log_start":"65'27983","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:08.630348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1834090496,"num_objects":27986,"num_object_clones":0,"num_object_copies":83958,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27986,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27986,"num_write_kb":1791104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"65'27891","reported_seq":27908,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:56.633138+0000","last_change":"2026-02-23T13:08:59.784910+0000","last_active":"2026-02-23T13:09:56.633138+0000","last_peered":"2026-02-23T13:09:56.633138+0000","last_clean":"2026-02-23T13:09:56.633138+0000","last_became_active":"2026-02-23T13:08:59.784436+0000","last_became_peered":"2026-02-23T13:08:59.784436+0000","last_unstale":"2026-02-23T13:09:56.633138+0000","last_undegraded":"2026-02-23T13:09:56.633138+0000","last_fullsized":"2026-02-23T13:09:56.633138+0000","mapping_epoch":62,"log_start":"65'27888","ondisk_log_start":"65'27888","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:02.594318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1827864576,"num_objects":27891,"num_object_clones":0,"num_object_copies":83673,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27891,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27891,"num_write_kb":1785024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"65'27806","reported_seq":27823,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:56.627942+0000","last_change":"2026-02-23T13:08:59.784689+0000","last_active":"2026-02-23T13:09:56.627942+0000","last_peered":"2026-02-23T13:09:56.627942+0000","last_clean":"2026-02-23T13:09:56.627942+0000","last_became_active":"2026-02-23T13:08:59.784290+0000","last_became_peered":"2026-02-23T13:08:59.784290+0000","last_unstale":"2026-02-23T13:09:56.627942+0000","last_undegraded":"2026-02-23T13:09:56.627942+0000","last_fullsized":"2026-02-23T13:09:56.627942+0000","mapping_epoch":62,"log_start":"65'27803","ondisk_log_start":"65'27803","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:25.847402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1822294016,"num_objects":27806,"num_object_clones":0,"num_object_copies":83418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27806,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27806,"num_write_kb":1779584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"65'27605","reported_seq":27622,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:56.640898+0000","last_change":"2026-02-23T13:08:59.786106+0000","last_active":"2026-02-23T13:09:56.640898+0000","last_peered":"2026-02-23T13:09:56.640898+0000","last_clean":"2026-02-23T13:09:56.640898+0000","last_became_active":"2026-02-23T13:08:59.785634+0000","last_became_peered":"2026-02-23T13:08:59.785634+0000","last_unstale":"2026-02-23T13:09:56.640898+0000","last_undegraded":"2026-02-23T13:09:56.640898+0000","last_fullsized":"2026-02-23T13:09:56.640898+0000","mapping_epoch":62,"log_start":"65'27602","ondisk_log_start":"65'27602","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:01.725790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1809121280,"num_objects":27605,"num_object_clones":0,"num_object_copies":82815,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27605,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27605,"num_write_kb":1766720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":301,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:15.445539+0000","last_change":"2026-02-23T13:09:15.445539+0000","last_active":"2026-02-23T13:09:15.445539+0000","last_peered":"2026-02-23T13:09:15.445539+0000","last_clean":"2026-02-23T13:09:15.445539+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:09:15.445539+0000","last_undegraded":"2026-02-23T13:09:15.445539+0000","last_fullsized":"2026-02-23T13:09:15.445539+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:09:15.445510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:09:15.445510+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:37.194057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":29169025024,"num_objects":445084,"num_object_clones":0,"num_object_copies":1335252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":445084,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":445084,"num_write_kb":28485376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":87505305600,"data_stored":87505305600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":50,"ondisk_log_size":50,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247894,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":22508032,"kb_used_data":21008108,"kb_used_omap":13,"kb_used_meta":1499890,"kb_avail":711495168,"statfs":{"total":751619276800,"available":728571052032,"internally_reserved":0,"allocated":21512302592,"data_stored":21511854607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13353,"internal_metadata":1535888343},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,3],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444121,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":26570176,"kb_used_data":24677548,"kb_used_omap":13,"kb_used_meta":1892594,"kb_avail":707433024,"statfs":{"total":751619276800,"available":724411416576,"internally_reserved":0,"allocated":25269809152,"data_stored":25269361167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14269,"internal_metadata":1938016323},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574939,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":19121404,"kb_used_data":17665128,"kb_used_omap":11,"kb_used_meta":1456244,"kb_avail":714881796,"statfs":{"total":751619276800,"available":732038959104,"internally_reserved":0,"allocated":18089091072,"data_stored":18088646639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11524,"internal_metadata":1491194620},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705756,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":22666240,"kb_used_data":21002412,"kb_used_omap":8,"kb_used_meta":1663799,"kb_avail":711336960,"statfs":{"total":751619276800,"available":728409047040,"internally_reserved":0,"allocated":21506469888,"data_stored":21506021903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8702,"internal_metadata":1703730690},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,4],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21853044736,"data_stored":21853044736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":18276810752,"data_stored":18276810752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25506480128,"data_stored":25506480128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21868969984,"data_stored":21868969984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:09:59.081 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:09:59.081 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 171 2026-02-23T13:09:59.101 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:09:59.234 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:59.267 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:09:59.362 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:59.360+0000 7fa177c5b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:59.362 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:59.360+0000 7fa177c5b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:59.376 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:59.374+0000 7f330c9fb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:59.376 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:09:59.375+0000 7f330c9fb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:09:59.391 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:09:59.391 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:09:59.405 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:09:59.405 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:09:59.419 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:09:59.420 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:09:59.436 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:09:59.436 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:09:59.511 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:09:59.554 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:09:59.877 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 59 16 470338 470322 498.184 519.812 0.00663512 0.00200601 2026-02-23T13:10:00.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:59 trial046 ceph-mon[38575]: pgmap v250: 17 pgs: 17 active+clean; 27 GiB data, 87 GiB used, 2.6 TiB / 2.7 TiB avail; 466 MiB/s wr, 7.46k op/s 2026-02-23T13:10:00.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:59 trial046 ceph-mon[38575]: from='client.14978 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:10:00.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:59 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2874506727' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:10:00.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:09:59 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4044385272' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "171"} : dispatch 2026-02-23T13:10:00.878 INFO:tasks.radosbench.radosbench.0.trial046.stdout:2026-02-23T13:10:00.877603+0000 min lat: 0.000698614 max lat: 0.0535382 avg lat: 0.00200886 2026-02-23T13:10:00.878 INFO:tasks.radosbench.radosbench.0.trial046.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-23T13:10:00.878 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 60 16 477636 477620 497.482 456.125 0.00187528 0.00200886 2026-02-23T13:10:01.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:00 trial046 ceph-mon[38575]: 4.3 scrub starts 2026-02-23T13:10:01.484 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:10:01.639 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:01.761 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:01 trial046 ceph-mon[38575]: pgmap v251: 17 pgs: 17 active+clean; 27 GiB data, 87 GiB used, 2.6 TiB / 2.7 TiB avail; 410 MiB/s wr, 6.56k op/s 2026-02-23T13:10:01.762 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:01 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:10:01.878 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 61 16 484379 484363 496.235 421.438 0.00142576 0.0020139 2026-02-23T13:10:02.120 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:10:02.120 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:10:02.120 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:10:02.120 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:10:02.121 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:02.033+0000 7f9db751f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:02.121 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:02.034+0000 7f9db751f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:02.121 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:10:02.121 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:10:02.121 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:10:02.121 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:10:02.877 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 62 15 490847 490832 494.752 404.312 0.00136056 0.00201998 2026-02-23T13:10:03.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:02 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1024510533' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:10:03.878 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 63 15 498389 498374 494.38 471.375 0.0025702 0.00202149 2026-02-23T13:10:04.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:03 trial046 ceph-mon[38575]: pgmap v252: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 30 GiB data, 94 GiB used, 2.6 TiB / 2.7 TiB avail; 609 MiB/s wr, 9.75k op/s 2026-02-23T13:10:04.163 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:10:04.313 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:04.447 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:04.445+0000 7f29ca57b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:04.447 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:04.445+0000 7f29ca57b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:04.462 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:10:04.463 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:10:04.476 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:10:04.477 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:10:04.489 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:10:04.490 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:10:04.502 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:10:04.502 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:10:04.555 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:10:04.555 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:10:04.556 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_2 2026-02-23T13:10:04.556 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:10:04.705 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:04.836 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:04.834+0000 7fbefe3ee640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:04.837 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:04.834+0000 7fbefe3ee640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:04.878 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 64 15 505871 505856 493.961 467.625 0.00221592 0.00202321 2026-02-23T13:10:04.976 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:10:04.976 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:10:04.985 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:04 trial046 ceph-mon[38575]: 4.3 scrub ok 2026-02-23T13:10:04.986 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:04 trial046 ceph-mon[38575]: 4.9 scrub starts 2026-02-23T13:10:04.986 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:04 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/173370092' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:10:05.024 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":253,"stamp":"2026-02-23T13:10:04.647026+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":31676564000,"num_objects":483339,"num_object_clones":0,"num_object_copies":1450017,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":483339,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":483472,"num_write_kb":30935718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53,"ondisk_log_size":53,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":98847420,"kb_used_data":91829420,"kb_used_omap":46,"kb_used_meta":7017873,"kb_avail":2837165380,"statfs":{"total":3006477107200,"available":2905257349120,"internally_reserved":0,"allocated":94033326080,"data_stored":94031537692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47848,"internal_metadata":7186302232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4964286464,"num_objects":75749,"num_object_clones":0,"num_object_copies":227247,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75749,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75749,"num_write_kb":4847936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001790"},"pg_stats":[{"pgid":"4.f","version":"65'30290","reported_seq":30307,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:01.725767+0000","last_change":"2026-02-23T13:08:59.785158+0000","last_active":"2026-02-23T13:10:01.725767+0000","last_peered":"2026-02-23T13:10:01.725767+0000","last_clean":"2026-02-23T13:10:01.725767+0000","last_became_active":"2026-02-23T13:08:59.784888+0000","last_became_peered":"2026-02-23T13:08:59.784888+0000","last_unstale":"2026-02-23T13:10:01.725767+0000","last_undegraded":"2026-02-23T13:10:01.725767+0000","last_fullsized":"2026-02-23T13:10:01.725767+0000","mapping_epoch":62,"log_start":"65'30287","ondisk_log_start":"65'30287","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:14.965697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1985085440,"num_objects":30290,"num_object_clones":0,"num_object_copies":90870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30290,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30290,"num_write_kb":1938560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"65'29879","reported_seq":29896,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:01.640570+0000","last_change":"2026-02-23T13:08:59.785686+0000","last_active":"2026-02-23T13:10:01.640570+0000","last_peered":"2026-02-23T13:10:01.640570+0000","last_clean":"2026-02-23T13:10:01.640570+0000","last_became_active":"2026-02-23T13:08:59.785397+0000","last_became_peered":"2026-02-23T13:08:59.785397+0000","last_unstale":"2026-02-23T13:10:01.640570+0000","last_undegraded":"2026-02-23T13:10:01.640570+0000","last_fullsized":"2026-02-23T13:10:01.640570+0000","mapping_epoch":62,"log_start":"65'29876","ondisk_log_start":"65'29876","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:19.572572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1958150144,"num_objects":29879,"num_object_clones":0,"num_object_copies":89637,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29879,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29879,"num_write_kb":1912256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"65'30115","reported_seq":30131,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:01.642518+0000","last_change":"2026-02-23T13:08:59.786322+0000","last_active":"2026-02-23T13:10:01.642518+0000","last_peered":"2026-02-23T13:10:01.642518+0000","last_clean":"2026-02-23T13:10:01.642518+0000","last_became_active":"2026-02-23T13:08:59.785780+0000","last_became_peered":"2026-02-23T13:08:59.785780+0000","last_unstale":"2026-02-23T13:10:01.642518+0000","last_undegraded":"2026-02-23T13:10:01.642518+0000","last_fullsized":"2026-02-23T13:10:01.642518+0000","mapping_epoch":62,"log_start":"65'30112","ondisk_log_start":"65'30112","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1973616640,"num_objects":30115,"num_object_clones":0,"num_object_copies":90345,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30115,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30115,"num_write_kb":1927360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"65'30572","reported_seq":30589,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:01.643480+0000","last_change":"2026-02-23T13:08:59.784416+0000","last_active":"2026-02-23T13:10:01.643480+0000","last_peered":"2026-02-23T13:10:01.643480+0000","last_clean":"2026-02-23T13:10:01.643480+0000","last_became_active":"2026-02-23T13:08:59.783982+0000","last_became_peered":"2026-02-23T13:08:59.783982+0000","last_unstale":"2026-02-23T13:10:01.643480+0000","last_undegraded":"2026-02-23T13:10:01.643480+0000","last_fullsized":"2026-02-23T13:10:01.643480+0000","mapping_epoch":62,"log_start":"65'30569","ondisk_log_start":"65'30569","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:19.759236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2003566592,"num_objects":30572,"num_object_clones":0,"num_object_copies":91716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30572,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30572,"num_write_kb":1956608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"65'30106","reported_seq":30123,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:01.628136+0000","last_change":"2026-02-23T13:08:59.784919+0000","last_active":"2026-02-23T13:10:01.628136+0000","last_peered":"2026-02-23T13:10:01.628136+0000","last_clean":"2026-02-23T13:10:01.628136+0000","last_became_active":"2026-02-23T13:08:59.784710+0000","last_became_peered":"2026-02-23T13:08:59.784710+0000","last_unstale":"2026-02-23T13:10:01.628136+0000","last_undegraded":"2026-02-23T13:10:01.628136+0000","last_fullsized":"2026-02-23T13:10:01.628136+0000","mapping_epoch":62,"log_start":"65'30103","ondisk_log_start":"65'30103","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:22.287957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1973026816,"num_objects":30106,"num_object_clones":0,"num_object_copies":90318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30106,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30106,"num_write_kb":1926784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"65'30432","reported_seq":30449,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:01.641507+0000","last_change":"2026-02-23T13:08:59.784739+0000","last_active":"2026-02-23T13:10:01.641507+0000","last_peered":"2026-02-23T13:10:01.641507+0000","last_clean":"2026-02-23T13:10:01.641507+0000","last_became_active":"2026-02-23T13:08:59.784218+0000","last_became_peered":"2026-02-23T13:08:59.784218+0000","last_unstale":"2026-02-23T13:10:01.641507+0000","last_undegraded":"2026-02-23T13:10:01.641507+0000","last_fullsized":"2026-02-23T13:10:01.641507+0000","mapping_epoch":62,"log_start":"65'30429","ondisk_log_start":"65'30429","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:25.462760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1994391552,"num_objects":30432,"num_object_clones":0,"num_object_copies":91296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30432,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30432,"num_write_kb":1947648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"65'30067","reported_seq":30083,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:01.642472+0000","last_change":"2026-02-23T13:08:59.784708+0000","last_active":"2026-02-23T13:10:01.642472+0000","last_peered":"2026-02-23T13:10:01.642472+0000","last_clean":"2026-02-23T13:10:01.642472+0000","last_became_active":"2026-02-23T13:08:59.784210+0000","last_became_peered":"2026-02-23T13:08:59.784210+0000","last_unstale":"2026-02-23T13:10:01.642472+0000","last_undegraded":"2026-02-23T13:10:01.642472+0000","last_fullsized":"2026-02-23T13:10:01.642472+0000","mapping_epoch":62,"log_start":"65'30064","ondisk_log_start":"65'30064","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1970470912,"num_objects":30067,"num_object_clones":0,"num_object_copies":90201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30067,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30067,"num_write_kb":1924288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"65'29938","reported_seq":29955,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:01.642100+0000","last_change":"2026-02-23T13:08:59.785913+0000","last_active":"2026-02-23T13:10:01.642100+0000","last_peered":"2026-02-23T13:10:01.642100+0000","last_clean":"2026-02-23T13:10:01.642100+0000","last_became_active":"2026-02-23T13:08:59.785359+0000","last_became_peered":"2026-02-23T13:08:59.785359+0000","last_unstale":"2026-02-23T13:10:01.642100+0000","last_undegraded":"2026-02-23T13:10:01.642100+0000","last_fullsized":"2026-02-23T13:10:01.642100+0000","mapping_epoch":62,"log_start":"65'29935","ondisk_log_start":"65'29935","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:18.876316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1962016768,"num_objects":29938,"num_object_clones":0,"num_object_copies":89814,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29938,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29938,"num_write_kb":1916032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"65'30243","reported_seq":30260,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:01.730151+0000","last_change":"2026-02-23T13:08:59.786387+0000","last_active":"2026-02-23T13:10:01.730151+0000","last_peered":"2026-02-23T13:10:01.730151+0000","last_clean":"2026-02-23T13:10:01.730151+0000","last_became_active":"2026-02-23T13:08:59.785106+0000","last_became_peered":"2026-02-23T13:08:59.785106+0000","last_unstale":"2026-02-23T13:10:01.730151+0000","last_undegraded":"2026-02-23T13:10:01.730151+0000","last_fullsized":"2026-02-23T13:10:01.730151+0000","mapping_epoch":62,"log_start":"65'30240","ondisk_log_start":"65'30240","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:27.939858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1982005248,"num_objects":30243,"num_object_clones":0,"num_object_copies":90729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30243,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30243,"num_write_kb":1935552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"65'30351","reported_seq":30368,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:01.625635+0000","last_change":"2026-02-23T13:08:59.784789+0000","last_active":"2026-02-23T13:10:01.625635+0000","last_peered":"2026-02-23T13:10:01.625635+0000","last_clean":"2026-02-23T13:10:01.625635+0000","last_became_active":"2026-02-23T13:08:59.784457+0000","last_became_peered":"2026-02-23T13:08:59.784457+0000","last_unstale":"2026-02-23T13:10:01.625635+0000","last_undegraded":"2026-02-23T13:10:01.625635+0000","last_fullsized":"2026-02-23T13:10:01.625635+0000","mapping_epoch":62,"log_start":"65'30348","ondisk_log_start":"65'30348","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:10.735235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1989083136,"num_objects":30351,"num_object_clones":0,"num_object_copies":91053,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30351,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30351,"num_write_kb":1942464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"65'30177","reported_seq":30194,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:01.731495+0000","last_change":"2026-02-23T13:08:59.784450+0000","last_active":"2026-02-23T13:10:01.731495+0000","last_peered":"2026-02-23T13:10:01.731495+0000","last_clean":"2026-02-23T13:10:01.731495+0000","last_became_active":"2026-02-23T13:08:59.784235+0000","last_became_peered":"2026-02-23T13:08:59.784235+0000","last_unstale":"2026-02-23T13:10:01.731495+0000","last_undegraded":"2026-02-23T13:10:01.731495+0000","last_fullsized":"2026-02-23T13:10:01.731495+0000","mapping_epoch":62,"log_start":"65'30174","ondisk_log_start":"65'30174","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:12.986395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1977679872,"num_objects":30177,"num_object_clones":0,"num_object_copies":90531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30177,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30177,"num_write_kb":1931328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"65'30326","reported_seq":30530,"reported_epoch":65,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:10:01.632289+0000","last_change":"2026-02-23T13:09:59.720004+0000","last_active":"2026-02-23T13:10:01.632289+0000","last_peered":"2026-02-23T13:10:01.632289+0000","last_clean":"2026-02-23T13:10:01.632289+0000","last_became_active":"2026-02-23T13:08:59.784318+0000","last_became_peered":"2026-02-23T13:08:59.784318+0000","last_unstale":"2026-02-23T13:10:01.632289+0000","last_undegraded":"2026-02-23T13:10:01.632289+0000","last_fullsized":"2026-02-23T13:10:01.632289+0000","mapping_epoch":62,"log_start":"65'30321","ondisk_log_start":"65'30321","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":18299,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1987444736,"num_objects":30326,"num_object_clones":0,"num_object_copies":90978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30326,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30326,"num_write_kb":1940864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"65'30364","reported_seq":30380,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:01.740612+0000","last_change":"2026-02-23T13:08:59.784710+0000","last_active":"2026-02-23T13:10:01.740612+0000","last_peered":"2026-02-23T13:10:01.740612+0000","last_clean":"2026-02-23T13:10:01.740612+0000","last_became_active":"2026-02-23T13:08:59.784463+0000","last_became_peered":"2026-02-23T13:08:59.784463+0000","last_unstale":"2026-02-23T13:10:01.740612+0000","last_undegraded":"2026-02-23T13:10:01.740612+0000","last_fullsized":"2026-02-23T13:10:01.740612+0000","mapping_epoch":62,"log_start":"65'30361","ondisk_log_start":"65'30361","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:08.630348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1989935104,"num_objects":30364,"num_object_clones":0,"num_object_copies":91092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30364,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30364,"num_write_kb":1943296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"65'30236","reported_seq":30253,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:01.637310+0000","last_change":"2026-02-23T13:08:59.784910+0000","last_active":"2026-02-23T13:10:01.637310+0000","last_peered":"2026-02-23T13:10:01.637310+0000","last_clean":"2026-02-23T13:10:01.637310+0000","last_became_active":"2026-02-23T13:08:59.784436+0000","last_became_peered":"2026-02-23T13:08:59.784436+0000","last_unstale":"2026-02-23T13:10:01.637310+0000","last_undegraded":"2026-02-23T13:10:01.637310+0000","last_fullsized":"2026-02-23T13:10:01.637310+0000","mapping_epoch":62,"log_start":"65'30233","ondisk_log_start":"65'30233","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:02.594318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1981546496,"num_objects":30236,"num_object_clones":0,"num_object_copies":90708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30236,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30236,"num_write_kb":1935104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"65'30197","reported_seq":30214,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:01.638039+0000","last_change":"2026-02-23T13:08:59.784689+0000","last_active":"2026-02-23T13:10:01.638039+0000","last_peered":"2026-02-23T13:10:01.638039+0000","last_clean":"2026-02-23T13:10:01.638039+0000","last_became_active":"2026-02-23T13:08:59.784290+0000","last_became_peered":"2026-02-23T13:08:59.784290+0000","last_unstale":"2026-02-23T13:10:01.638039+0000","last_undegraded":"2026-02-23T13:10:01.638039+0000","last_fullsized":"2026-02-23T13:10:01.638039+0000","mapping_epoch":62,"log_start":"65'30194","ondisk_log_start":"65'30194","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:25.847402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1978990592,"num_objects":30197,"num_object_clones":0,"num_object_copies":90591,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30197,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30197,"num_write_kb":1932608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"65'30044","reported_seq":30061,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:01.640055+0000","last_change":"2026-02-23T13:08:59.786106+0000","last_active":"2026-02-23T13:10:01.640055+0000","last_peered":"2026-02-23T13:10:01.640055+0000","last_clean":"2026-02-23T13:10:01.640055+0000","last_became_active":"2026-02-23T13:08:59.785634+0000","last_became_peered":"2026-02-23T13:08:59.785634+0000","last_unstale":"2026-02-23T13:10:01.640055+0000","last_undegraded":"2026-02-23T13:10:01.640055+0000","last_fullsized":"2026-02-23T13:10:01.640055+0000","mapping_epoch":62,"log_start":"65'30041","ondisk_log_start":"65'30041","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:01.725790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1968963584,"num_objects":30044,"num_object_clones":0,"num_object_copies":90132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30044,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30044,"num_write_kb":1922816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":301,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:15.445539+0000","last_change":"2026-02-23T13:09:15.445539+0000","last_active":"2026-02-23T13:09:15.445539+0000","last_peered":"2026-02-23T13:09:15.445539+0000","last_clean":"2026-02-23T13:09:15.445539+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:09:15.445539+0000","last_undegraded":"2026-02-23T13:09:15.445539+0000","last_fullsized":"2026-02-23T13:09:15.445539+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:09:15.445510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:09:15.445510+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:37.194057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":31675973632,"num_objects":483337,"num_object_clones":0,"num_object_copies":1450011,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":483337,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":483337,"num_write_kb":30933568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95022678016,"data_stored":95022678016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":50,"ondisk_log_size":50,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247895,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":24524352,"kb_used_data":22916140,"kb_used_omap":13,"kb_used_meta":1608178,"kb_avail":709478848,"statfs":{"total":751619276800,"available":726506340352,"internally_reserved":0,"allocated":23466127360,"data_stored":23465679375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13353,"internal_metadata":1646775255},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444122,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28822656,"kb_used_data":26821740,"kb_used_omap":13,"kb_used_meta":2000882,"kb_avail":705180544,"statfs":{"total":751619276800,"available":722104877056,"internally_reserved":0,"allocated":27465461760,"data_stored":27465013775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14269,"internal_metadata":2048903235},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":20816188,"kb_used_data":19233576,"kb_used_omap":11,"kb_used_meta":1582580,"kb_avail":713187012,"statfs":{"total":751619276800,"available":730303500288,"internally_reserved":0,"allocated":19695181824,"data_stored":19694737391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11524,"internal_metadata":1620562684},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705757,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":24684224,"kb_used_data":22857964,"kb_used_omap":8,"kb_used_meta":1826231,"kb_avail":709318976,"statfs":{"total":751619276800,"available":726342631424,"internally_reserved":0,"allocated":23406555136,"data_stored":23406107151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8702,"internal_metadata":1870061058},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23724883968,"data_stored":23724883968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19839057920,"data_stored":19839057920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27704492032,"data_stored":27704492032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":23754244096,"data_stored":23754244096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:10:05.026 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:10:05.027 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_2 pg_num 56 2026-02-23T13:10:05.167 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:05.294 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:05.291+0000 7fb8cd0f2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:05.294 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:05.291+0000 7fb8cd0f2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:05.426 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:10:05.470 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:10:05.878 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 65 16 512269 512253 492.513 399.812 0.00159664 0.00202915 2026-02-23T13:10:06.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:05 trial046 ceph-mon[38575]: pgmap v253: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 30 GiB data, 94 GiB used, 2.6 TiB / 2.7 TiB avail; 394 MiB/s wr, 6.31k op/s 2026-02-23T13:10:06.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:05 trial046 ceph-mon[38575]: 4.d scrub starts 2026-02-23T13:10:06.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:05 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2439047370' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_2", "var": "pg_num", "val": "56"} : dispatch 2026-02-23T13:10:06.539 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:10:06 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:10:06] "GET /metrics HTTP/1.1" 200 4208 "" "Prometheus/3.6.0" 2026-02-23T13:10:06.551 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:10:06.560 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:10:06 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:10:06.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:10:06.691 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:06.822 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:06.819+0000 7f13e2635640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:06.822 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:06.820+0000 7f13e2635640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:06.838 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:10:06.838 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:10:06.838 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:06 trial046 ceph-mon[38575]: from='client.14988 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:10:06.852 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:10:06.852 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:10:06.868 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:10:06.868 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:10:06.878 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 66 16 518866 518850 491.297 412.312 0.00155116 0.00203419 2026-02-23T13:10:06.883 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:10:06.883 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:10:07.878 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 67 16 525490 525474 490.143 414 0.00156844 0.00203894 2026-02-23T13:10:08.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:07 trial046 ceph-mon[38575]: 4.9 scrub ok 2026-02-23T13:10:08.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:07 trial046 ceph-mon[38575]: pgmap v254: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 31 GiB data, 99 GiB used, 2.6 TiB / 2.7 TiB avail; 528 MiB/s wr, 8.44k op/s 2026-02-23T13:10:08.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:07 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1018022935' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:10:08.878 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 68 16 532915 532899 489.759 464.062 0.00152132 0.00204057 2026-02-23T13:10:08.926 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:10:09.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:08 trial046 ceph-mon[38575]: 4.1 scrub starts 2026-02-23T13:10:09.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:08 trial046 ceph-mon[38575]: 4.d scrub ok 2026-02-23T13:10:09.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:08 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-23T13:10:09.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:08 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:10:09.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:08 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-23T13:10:09.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:08 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:10:09.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:08 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-23T13:10:09.067 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:09.488 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:10:09.489 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:10:09.489 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:10:09.489 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:10:09.489 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:09.405+0000 7fa0ba9bf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:09.489 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:09.405+0000 7fa0ba9bf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:09.489 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:10:09.489 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:10:09.490 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:10:09.490 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:10:09.878 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 69 16 538362 538346 487.594 340.438 0.00577217 0.00204957 2026-02-23T13:10:10.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:09 trial046 ceph-mon[38575]: pgmap v255: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 32 GiB data, 101 GiB used, 2.6 TiB / 2.7 TiB avail; 426 MiB/s wr, 6.81k op/s 2026-02-23T13:10:10.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:09 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3379974817' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:10:10.472 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:10:10.472 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:10:10.472 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:10:10.612 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:10.878 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 70 16 543450 543434 485.169 318 0.00150845 0.00205987 2026-02-23T13:10:11.006 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:10 trial046 ceph-mon[38575]: 4.5 scrub starts 2026-02-23T13:10:11.057 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:11.004+0000 7f80e69a0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:11.057 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:11.004+0000 7f80e69a0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:11.149 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:10:11.150 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:10:11.266 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":256,"stamp":"2026-02-23T13:10:10.647823+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":33915535904,"num_objects":517503,"num_object_clones":0,"num_object_copies":1552509,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":517503,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":517636,"num_write_kb":33122214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":105775612,"kb_used_data":98466476,"kb_used_omap":47,"kb_used_meta":7309008,"kb_avail":2830237188,"statfs":{"total":3006477107200,"available":2898162880512,"internally_reserved":0,"allocated":100829671424,"data_stored":100827883036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":48928,"internal_metadata":7484424416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4745920512,"num_objects":72417,"num_object_clones":0,"num_object_copies":217251,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72417,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72417,"num_write_kb":4634688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001701"},"pg_stats":[{"pgid":"4.f","version":"65'32420","reported_seq":32436,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:06.759810+0000","last_change":"2026-02-23T13:08:59.785158+0000","last_active":"2026-02-23T13:10:06.759810+0000","last_peered":"2026-02-23T13:10:06.759810+0000","last_clean":"2026-02-23T13:10:06.759810+0000","last_became_active":"2026-02-23T13:08:59.784888+0000","last_became_peered":"2026-02-23T13:08:59.784888+0000","last_unstale":"2026-02-23T13:10:06.759810+0000","last_undegraded":"2026-02-23T13:10:06.759810+0000","last_fullsized":"2026-02-23T13:10:06.759810+0000","mapping_epoch":62,"log_start":"65'32417","ondisk_log_start":"65'32417","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:14.965697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2124677120,"num_objects":32420,"num_object_clones":0,"num_object_copies":97260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32420,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32420,"num_write_kb":2074880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"65'31934","reported_seq":31951,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:06.642030+0000","last_change":"2026-02-23T13:08:59.785686+0000","last_active":"2026-02-23T13:10:06.642030+0000","last_peered":"2026-02-23T13:10:06.642030+0000","last_clean":"2026-02-23T13:10:06.642030+0000","last_became_active":"2026-02-23T13:08:59.785397+0000","last_became_peered":"2026-02-23T13:08:59.785397+0000","last_unstale":"2026-02-23T13:10:06.642030+0000","last_undegraded":"2026-02-23T13:10:06.642030+0000","last_fullsized":"2026-02-23T13:10:06.642030+0000","mapping_epoch":62,"log_start":"65'31931","ondisk_log_start":"65'31931","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:19.572572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2092826624,"num_objects":31934,"num_object_clones":0,"num_object_copies":95802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31934,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31934,"num_write_kb":2043776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"65'32246","reported_seq":32459,"reported_epoch":65,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:10:06.646001+0000","last_change":"2026-02-23T13:10:04.835581+0000","last_active":"2026-02-23T13:10:06.646001+0000","last_peered":"2026-02-23T13:10:06.646001+0000","last_clean":"2026-02-23T13:10:06.646001+0000","last_became_active":"2026-02-23T13:08:59.785780+0000","last_became_peered":"2026-02-23T13:08:59.785780+0000","last_unstale":"2026-02-23T13:10:06.646001+0000","last_undegraded":"2026-02-23T13:10:06.646001+0000","last_fullsized":"2026-02-23T13:10:06.646001+0000","mapping_epoch":62,"log_start":"65'32243","ondisk_log_start":"65'32243","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":19299,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2113273856,"num_objects":32246,"num_object_clones":0,"num_object_copies":96738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32246,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32246,"num_write_kb":2063744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"65'32770","reported_seq":32787,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:06.643007+0000","last_change":"2026-02-23T13:08:59.784416+0000","last_active":"2026-02-23T13:10:06.643007+0000","last_peered":"2026-02-23T13:10:06.643007+0000","last_clean":"2026-02-23T13:10:06.643007+0000","last_became_active":"2026-02-23T13:08:59.783982+0000","last_became_peered":"2026-02-23T13:08:59.783982+0000","last_unstale":"2026-02-23T13:10:06.643007+0000","last_undegraded":"2026-02-23T13:10:06.643007+0000","last_fullsized":"2026-02-23T13:10:06.643007+0000","mapping_epoch":62,"log_start":"65'32767","ondisk_log_start":"65'32767","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:19.759236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2147614720,"num_objects":32770,"num_object_clones":0,"num_object_copies":98310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32770,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32770,"num_write_kb":2097280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"65'32220","reported_seq":32237,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:06.633052+0000","last_change":"2026-02-23T13:08:59.784919+0000","last_active":"2026-02-23T13:10:06.633052+0000","last_peered":"2026-02-23T13:10:06.633052+0000","last_clean":"2026-02-23T13:10:06.633052+0000","last_became_active":"2026-02-23T13:08:59.784710+0000","last_became_peered":"2026-02-23T13:08:59.784710+0000","last_unstale":"2026-02-23T13:10:06.633052+0000","last_undegraded":"2026-02-23T13:10:06.633052+0000","last_fullsized":"2026-02-23T13:10:06.633052+0000","mapping_epoch":62,"log_start":"65'32217","ondisk_log_start":"65'32217","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:22.287957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2111569920,"num_objects":32220,"num_object_clones":0,"num_object_copies":96660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32220,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32220,"num_write_kb":2062080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"65'32541","reported_seq":32558,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:06.640452+0000","last_change":"2026-02-23T13:08:59.784739+0000","last_active":"2026-02-23T13:10:06.640452+0000","last_peered":"2026-02-23T13:10:06.640452+0000","last_clean":"2026-02-23T13:10:06.640452+0000","last_became_active":"2026-02-23T13:08:59.784218+0000","last_became_peered":"2026-02-23T13:08:59.784218+0000","last_unstale":"2026-02-23T13:10:06.640452+0000","last_undegraded":"2026-02-23T13:10:06.640452+0000","last_fullsized":"2026-02-23T13:10:06.640452+0000","mapping_epoch":62,"log_start":"65'32538","ondisk_log_start":"65'32538","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:25.462760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2132606976,"num_objects":32541,"num_object_clones":0,"num_object_copies":97623,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32541,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32541,"num_write_kb":2082624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"65'32212","reported_seq":32552,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:06.640816+0000","last_change":"2026-02-23T13:10:06.461634+0000","last_active":"2026-02-23T13:10:06.640816+0000","last_peered":"2026-02-23T13:10:06.640816+0000","last_clean":"2026-02-23T13:10:06.640816+0000","last_became_active":"2026-02-23T13:08:59.784210+0000","last_became_peered":"2026-02-23T13:08:59.784210+0000","last_unstale":"2026-02-23T13:10:06.640816+0000","last_undegraded":"2026-02-23T13:10:06.640816+0000","last_fullsized":"2026-02-23T13:10:06.640816+0000","mapping_epoch":62,"log_start":"65'32209","ondisk_log_start":"65'32209","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'32118","last_scrub_stamp":"2026-02-23T13:10:06.461563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:06.461563+0000","objects_scrubbed":31388,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:22.890897+0000","scrub_duration":3366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2111045632,"num_objects":32212,"num_object_clones":0,"num_object_copies":96636,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32212,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32212,"num_write_kb":2061568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"65'32051","reported_seq":32068,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:06.645647+0000","last_change":"2026-02-23T13:08:59.785913+0000","last_active":"2026-02-23T13:10:06.645647+0000","last_peered":"2026-02-23T13:10:06.645647+0000","last_clean":"2026-02-23T13:10:06.645647+0000","last_became_active":"2026-02-23T13:08:59.785359+0000","last_became_peered":"2026-02-23T13:08:59.785359+0000","last_unstale":"2026-02-23T13:10:06.645647+0000","last_undegraded":"2026-02-23T13:10:06.645647+0000","last_fullsized":"2026-02-23T13:10:06.645647+0000","mapping_epoch":62,"log_start":"65'32048","ondisk_log_start":"65'32048","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:18.876316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2100494336,"num_objects":32051,"num_object_clones":0,"num_object_copies":96153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32051,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32051,"num_write_kb":2051264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"65'32452","reported_seq":32469,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:06.757383+0000","last_change":"2026-02-23T13:08:59.786387+0000","last_active":"2026-02-23T13:10:06.757383+0000","last_peered":"2026-02-23T13:10:06.757383+0000","last_clean":"2026-02-23T13:10:06.757383+0000","last_became_active":"2026-02-23T13:08:59.785106+0000","last_became_peered":"2026-02-23T13:08:59.785106+0000","last_unstale":"2026-02-23T13:10:06.757383+0000","last_undegraded":"2026-02-23T13:10:06.757383+0000","last_fullsized":"2026-02-23T13:10:06.757383+0000","mapping_epoch":62,"log_start":"65'32449","ondisk_log_start":"65'32449","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:27.939858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2126774272,"num_objects":32452,"num_object_clones":0,"num_object_copies":97356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32452,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32452,"num_write_kb":2076928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"65'32428","reported_seq":32445,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:06.636151+0000","last_change":"2026-02-23T13:08:59.784789+0000","last_active":"2026-02-23T13:10:06.636151+0000","last_peered":"2026-02-23T13:10:06.636151+0000","last_clean":"2026-02-23T13:10:06.636151+0000","last_became_active":"2026-02-23T13:08:59.784457+0000","last_became_peered":"2026-02-23T13:08:59.784457+0000","last_unstale":"2026-02-23T13:10:06.636151+0000","last_undegraded":"2026-02-23T13:10:06.636151+0000","last_fullsized":"2026-02-23T13:10:06.636151+0000","mapping_epoch":62,"log_start":"65'32425","ondisk_log_start":"65'32425","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:10.735235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2125201408,"num_objects":32428,"num_object_clones":0,"num_object_copies":97284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32428,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32428,"num_write_kb":2075392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"65'32302","reported_seq":32318,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:06.756164+0000","last_change":"2026-02-23T13:08:59.784450+0000","last_active":"2026-02-23T13:10:06.756164+0000","last_peered":"2026-02-23T13:10:06.756164+0000","last_clean":"2026-02-23T13:10:06.756164+0000","last_became_active":"2026-02-23T13:08:59.784235+0000","last_became_peered":"2026-02-23T13:08:59.784235+0000","last_unstale":"2026-02-23T13:10:06.756164+0000","last_undegraded":"2026-02-23T13:10:06.756164+0000","last_fullsized":"2026-02-23T13:10:06.756164+0000","mapping_epoch":62,"log_start":"65'32299","ondisk_log_start":"65'32299","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:12.986395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2116943872,"num_objects":32302,"num_object_clones":0,"num_object_copies":96906,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32302,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32302,"num_write_kb":2067328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"65'32506","reported_seq":32839,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:06.631779+0000","last_change":"2026-02-23T13:10:03.037875+0000","last_active":"2026-02-23T13:10:06.631779+0000","last_peered":"2026-02-23T13:10:06.631779+0000","last_clean":"2026-02-23T13:10:06.631779+0000","last_became_active":"2026-02-23T13:08:59.784318+0000","last_became_peered":"2026-02-23T13:08:59.784318+0000","last_unstale":"2026-02-23T13:10:06.631779+0000","last_undegraded":"2026-02-23T13:10:06.631779+0000","last_fullsized":"2026-02-23T13:10:06.631779+0000","mapping_epoch":62,"log_start":"65'32503","ondisk_log_start":"65'32503","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'30914","last_scrub_stamp":"2026-02-23T13:10:03.037814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:03.037814+0000","objects_scrubbed":30174,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:29.315340+0000","scrub_duration":3318,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2130313216,"num_objects":32506,"num_object_clones":0,"num_object_copies":97518,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32506,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32506,"num_write_kb":2080384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"65'32477","reported_seq":32494,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:06.752858+0000","last_change":"2026-02-23T13:08:59.784710+0000","last_active":"2026-02-23T13:10:06.752858+0000","last_peered":"2026-02-23T13:10:06.752858+0000","last_clean":"2026-02-23T13:10:06.752858+0000","last_became_active":"2026-02-23T13:08:59.784463+0000","last_became_peered":"2026-02-23T13:08:59.784463+0000","last_unstale":"2026-02-23T13:10:06.752858+0000","last_undegraded":"2026-02-23T13:10:06.752858+0000","last_fullsized":"2026-02-23T13:10:06.752858+0000","mapping_epoch":62,"log_start":"65'32474","ondisk_log_start":"65'32474","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:08.630348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2128412672,"num_objects":32477,"num_object_clones":0,"num_object_copies":97431,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32477,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32477,"num_write_kb":2078528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"65'32377","reported_seq":32394,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:06.640718+0000","last_change":"2026-02-23T13:08:59.784910+0000","last_active":"2026-02-23T13:10:06.640718+0000","last_peered":"2026-02-23T13:10:06.640718+0000","last_clean":"2026-02-23T13:10:06.640718+0000","last_became_active":"2026-02-23T13:08:59.784436+0000","last_became_peered":"2026-02-23T13:08:59.784436+0000","last_unstale":"2026-02-23T13:10:06.640718+0000","last_undegraded":"2026-02-23T13:10:06.640718+0000","last_fullsized":"2026-02-23T13:10:06.640718+0000","mapping_epoch":62,"log_start":"65'32374","ondisk_log_start":"65'32374","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2121859072,"num_objects":32377,"num_object_clones":0,"num_object_copies":97131,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32377,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32377,"num_write_kb":2072128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"65'32356","reported_seq":32373,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:06.629942+0000","last_change":"2026-02-23T13:08:59.784689+0000","last_active":"2026-02-23T13:10:06.629942+0000","last_peered":"2026-02-23T13:10:06.629942+0000","last_clean":"2026-02-23T13:10:06.629942+0000","last_became_active":"2026-02-23T13:08:59.784290+0000","last_became_peered":"2026-02-23T13:08:59.784290+0000","last_unstale":"2026-02-23T13:10:06.629942+0000","last_undegraded":"2026-02-23T13:10:06.629942+0000","last_fullsized":"2026-02-23T13:10:06.629942+0000","mapping_epoch":62,"log_start":"65'32353","ondisk_log_start":"65'32353","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:25.847402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2120482816,"num_objects":32356,"num_object_clones":0,"num_object_copies":97068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32356,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32356,"num_write_kb":2070784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"65'32209","reported_seq":32226,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:06.645974+0000","last_change":"2026-02-23T13:08:59.786106+0000","last_active":"2026-02-23T13:10:06.645974+0000","last_peered":"2026-02-23T13:10:06.645974+0000","last_clean":"2026-02-23T13:10:06.645974+0000","last_became_active":"2026-02-23T13:08:59.785634+0000","last_became_peered":"2026-02-23T13:08:59.785634+0000","last_unstale":"2026-02-23T13:10:06.645974+0000","last_undegraded":"2026-02-23T13:10:06.645974+0000","last_fullsized":"2026-02-23T13:10:06.645974+0000","mapping_epoch":62,"log_start":"65'32206","ondisk_log_start":"65'32206","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2110849024,"num_objects":32209,"num_object_clones":0,"num_object_copies":96627,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32209,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32209,"num_write_kb":2061376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":301,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:15.445539+0000","last_change":"2026-02-23T13:09:15.445539+0000","last_active":"2026-02-23T13:09:15.445539+0000","last_peered":"2026-02-23T13:09:15.445539+0000","last_clean":"2026-02-23T13:09:15.445539+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:09:15.445539+0000","last_undegraded":"2026-02-23T13:09:15.445539+0000","last_fullsized":"2026-02-23T13:09:15.445539+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:09:15.445510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:09:15.445510+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:37.194057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":33914945536,"num_objects":517501,"num_object_clones":0,"num_object_copies":1552503,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":517501,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":517501,"num_write_kb":33120064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":101738676224,"data_stored":101738676224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247896,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":26278656,"kb_used_data":24598252,"kb_used_omap":13,"kb_used_meta":1680370,"kb_avail":707724544,"statfs":{"total":751619276800,"available":724709933056,"internally_reserved":0,"allocated":25188610048,"data_stored":25188162063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13353,"internal_metadata":1720699863},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444123,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":30806400,"kb_used_data":28767020,"kb_used_omap":14,"kb_used_meta":2039345,"kb_avail":703196800,"statfs":{"total":751619276800,"available":720073523200,"internally_reserved":0,"allocated":29457428480,"data_stored":29456980495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15349,"internal_metadata":2088289291},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574941,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":22273852,"kb_used_data":20601000,"kb_used_omap":11,"kb_used_meta":1672820,"kb_avail":711729348,"statfs":{"total":751619276800,"available":728810852352,"internally_reserved":0,"allocated":21095424000,"data_stored":21094979567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11524,"internal_metadata":1712968444},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705758,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":26416704,"kb_used_data":24500204,"kb_used_omap":8,"kb_used_meta":1916471,"kb_avail":707586496,"statfs":{"total":751619276800,"available":724568571904,"internally_reserved":0,"allocated":25088208896,"data_stored":25087760911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8702,"internal_metadata":1962466818},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25407193088,"data_stored":25407193088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21233729536,"data_stored":21233729536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29664542720,"data_stored":29664542720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25433210880,"data_stored":25433210880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:10:11.879 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 71 16 549470 549454 483.634 376.25 0.00359523 0.00206641 2026-02-23T13:10:12.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:11 trial046 ceph-mon[38575]: 4.2 scrub starts 2026-02-23T13:10:12.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:11 trial046 ceph-mon[38575]: pgmap v256: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 32 GiB data, 101 GiB used, 2.6 TiB / 2.7 TiB avail; 377 MiB/s wr, 6.03k op/s 2026-02-23T13:10:12.185 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:10:12.334 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:12.462 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:12.460+0000 7fa8e92f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:12.462 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:12.460+0000 7fa8e92f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:12.478 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:10:12.478 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:10:12.491 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:10:12.491 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:10:12.503 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:10:12.504 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:10:12.517 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:10:12.517 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:10:12.879 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 72 16 556043 556027 482.622 410.812 0.00186508 0.00207075 2026-02-23T13:10:13.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:12 trial046 ceph-mon[38575]: from='client.14996 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:10:13.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:12 trial046 ceph-mon[38575]: 4.1 scrub ok 2026-02-23T13:10:13.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:12 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/170809205' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:10:13.879 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 73 16 562494 562478 481.534 403.188 0.00683553 0.00207542 2026-02-23T13:10:14.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:13 trial046 ceph-mon[38575]: pgmap v257: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 33 GiB data, 107 GiB used, 2.6 TiB / 2.7 TiB avail; 537 MiB/s wr, 8.59k op/s 2026-02-23T13:10:14.561 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:10:14.706 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:14.833 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:14.831+0000 7f23331c5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:14.834 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:14.831+0000 7f23331c5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:14.850 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:10:14.850 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:10:14.851 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:14 trial046 ceph-mon[38575]: 4.4 scrub starts 2026-02-23T13:10:14.851 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:14 trial046 ceph-mon[38575]: 4.2 scrub ok 2026-02-23T13:10:14.851 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:14 trial046 ceph-mon[38575]: 4.5 scrub ok 2026-02-23T13:10:14.851 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:14 trial046 ceph-mon[38575]: 4.6 scrub starts 2026-02-23T13:10:14.865 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:10:14.866 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:10:14.879 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 74 15 569320 569305 480.792 426.688 0.00215887 0.00207867 2026-02-23T13:10:14.880 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:10:14.881 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:10:14.893 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:10:14.893 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:10:15.879 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 75 15 575406 575391 479.453 380.375 0.00167034 0.00208446 2026-02-23T13:10:16.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:15 trial046 ceph-mon[38575]: pgmap v258: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 33 GiB data, 107 GiB used, 2.6 TiB / 2.7 TiB avail; 338 MiB/s wr, 5.40k op/s 2026-02-23T13:10:16.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:15 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3332587266' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:10:16.268 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:10:16.269 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:10:16.269 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_2 2026-02-23T13:10:16.269 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:10:16.419 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:16.469 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:10:16 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:10:16.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:10:16.471 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:10:16 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:10:16] "GET /metrics HTTP/1.1" 200 4212 "" "Prometheus/3.6.0" 2026-02-23T13:10:16.581 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:16.578+0000 7fc8b0216640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:16.581 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:16.579+0000 7fc8b0216640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:16.715 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:10:16.716 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:10:16.764 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":259,"stamp":"2026-02-23T13:10:16.648702+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":37493867040,"num_objects":572104,"num_object_clones":0,"num_object_copies":1716312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":572104,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":572237,"num_write_kb":36616678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":117279676,"kb_used_data":109456300,"kb_used_omap":47,"kb_used_meta":7823184,"kb_avail":2818733124,"statfs":{"total":3006477107200,"available":2886382718976,"internally_reserved":0,"allocated":112083251200,"data_stored":112081462812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":48928,"internal_metadata":8010940640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,4,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5817303040,"num_objects":88765,"num_object_clones":0,"num_object_copies":266295,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88765,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88765,"num_write_kb":5680960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001676"},"pg_stats":[{"pgid":"4.f","version":"65'34381","reported_seq":34398,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:11.762397+0000","last_change":"2026-02-23T13:08:59.785158+0000","last_active":"2026-02-23T13:10:11.762397+0000","last_peered":"2026-02-23T13:10:11.762397+0000","last_clean":"2026-02-23T13:10:11.762397+0000","last_became_active":"2026-02-23T13:08:59.784888+0000","last_became_peered":"2026-02-23T13:08:59.784888+0000","last_unstale":"2026-02-23T13:10:11.762397+0000","last_undegraded":"2026-02-23T13:10:11.762397+0000","last_fullsized":"2026-02-23T13:10:11.762397+0000","mapping_epoch":62,"log_start":"65'34378","ondisk_log_start":"65'34378","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:14.965697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2253193216,"num_objects":34381,"num_object_clones":0,"num_object_copies":103143,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34381,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34381,"num_write_kb":2200384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"65'35771","reported_seq":35788,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:16.644767+0000","last_change":"2026-02-23T13:08:59.785686+0000","last_active":"2026-02-23T13:10:16.644767+0000","last_peered":"2026-02-23T13:10:16.644767+0000","last_clean":"2026-02-23T13:10:16.644767+0000","last_became_active":"2026-02-23T13:08:59.785397+0000","last_became_peered":"2026-02-23T13:08:59.785397+0000","last_unstale":"2026-02-23T13:10:16.644767+0000","last_undegraded":"2026-02-23T13:10:16.644767+0000","last_fullsized":"2026-02-23T13:10:16.644767+0000","mapping_epoch":62,"log_start":"65'35768","ondisk_log_start":"65'35768","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:19.572572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2344288256,"num_objects":35771,"num_object_clones":0,"num_object_copies":107313,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35771,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35771,"num_write_kb":2289344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"65'36191","reported_seq":36540,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:16.645165+0000","last_change":"2026-02-23T13:10:07.875495+0000","last_active":"2026-02-23T13:10:16.645165+0000","last_peered":"2026-02-23T13:10:16.645165+0000","last_clean":"2026-02-23T13:10:16.645165+0000","last_became_active":"2026-02-23T13:08:59.785780+0000","last_became_peered":"2026-02-23T13:08:59.785780+0000","last_unstale":"2026-02-23T13:10:16.645165+0000","last_undegraded":"2026-02-23T13:10:16.645165+0000","last_fullsized":"2026-02-23T13:10:16.645165+0000","mapping_epoch":62,"log_start":"65'36188","ondisk_log_start":"65'36188","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'32743","last_scrub_stamp":"2026-02-23T13:10:07.875449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:07.875449+0000","objects_scrubbed":32129,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:15.294906+0000","scrub_duration":3040,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2371813376,"num_objects":36191,"num_object_clones":0,"num_object_copies":108573,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36191,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36191,"num_write_kb":2316224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"65'36647","reported_seq":36664,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:16.643026+0000","last_change":"2026-02-23T13:08:59.784416+0000","last_active":"2026-02-23T13:10:16.643026+0000","last_peered":"2026-02-23T13:10:16.643026+0000","last_clean":"2026-02-23T13:10:16.643026+0000","last_became_active":"2026-02-23T13:08:59.783982+0000","last_became_peered":"2026-02-23T13:08:59.783982+0000","last_unstale":"2026-02-23T13:10:16.643026+0000","last_undegraded":"2026-02-23T13:10:16.643026+0000","last_fullsized":"2026-02-23T13:10:16.643026+0000","mapping_epoch":62,"log_start":"65'36644","ondisk_log_start":"65'36644","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:19.759236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2401697792,"num_objects":36647,"num_object_clones":0,"num_object_copies":109941,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36647,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36647,"num_write_kb":2345408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"65'36204","reported_seq":36221,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:16.633526+0000","last_change":"2026-02-23T13:08:59.784919+0000","last_active":"2026-02-23T13:10:16.633526+0000","last_peered":"2026-02-23T13:10:16.633526+0000","last_clean":"2026-02-23T13:10:16.633526+0000","last_became_active":"2026-02-23T13:08:59.784710+0000","last_became_peered":"2026-02-23T13:08:59.784710+0000","last_unstale":"2026-02-23T13:10:16.633526+0000","last_undegraded":"2026-02-23T13:10:16.633526+0000","last_fullsized":"2026-02-23T13:10:16.633526+0000","mapping_epoch":62,"log_start":"65'36201","ondisk_log_start":"65'36201","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:22.287957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2372665344,"num_objects":36204,"num_object_clones":0,"num_object_copies":108612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36204,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36204,"num_write_kb":2317056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"65'36429","reported_seq":36446,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:16.641124+0000","last_change":"2026-02-23T13:08:59.784739+0000","last_active":"2026-02-23T13:10:16.641124+0000","last_peered":"2026-02-23T13:10:16.641124+0000","last_clean":"2026-02-23T13:10:16.641124+0000","last_became_active":"2026-02-23T13:08:59.784218+0000","last_became_peered":"2026-02-23T13:08:59.784218+0000","last_unstale":"2026-02-23T13:10:16.641124+0000","last_undegraded":"2026-02-23T13:10:16.641124+0000","last_fullsized":"2026-02-23T13:10:16.641124+0000","mapping_epoch":62,"log_start":"65'36426","ondisk_log_start":"65'36426","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:25.462760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2387410944,"num_objects":36429,"num_object_clones":0,"num_object_copies":109287,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36429,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36429,"num_write_kb":2331456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"65'36132","reported_seq":36472,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:16.640032+0000","last_change":"2026-02-23T13:10:06.461634+0000","last_active":"2026-02-23T13:10:16.640032+0000","last_peered":"2026-02-23T13:10:16.640032+0000","last_clean":"2026-02-23T13:10:16.640032+0000","last_became_active":"2026-02-23T13:08:59.784210+0000","last_became_peered":"2026-02-23T13:08:59.784210+0000","last_unstale":"2026-02-23T13:10:16.640032+0000","last_undegraded":"2026-02-23T13:10:16.640032+0000","last_fullsized":"2026-02-23T13:10:16.640032+0000","mapping_epoch":62,"log_start":"65'36129","ondisk_log_start":"65'36129","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'32118","last_scrub_stamp":"2026-02-23T13:10:06.461563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:06.461563+0000","objects_scrubbed":31388,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:22.890897+0000","scrub_duration":3366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2367946752,"num_objects":36132,"num_object_clones":0,"num_object_copies":108396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36132,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36132,"num_write_kb":2312448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"65'35948","reported_seq":35965,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:16.644140+0000","last_change":"2026-02-23T13:08:59.785913+0000","last_active":"2026-02-23T13:10:16.644140+0000","last_peered":"2026-02-23T13:10:16.644140+0000","last_clean":"2026-02-23T13:10:16.644140+0000","last_became_active":"2026-02-23T13:08:59.785359+0000","last_became_peered":"2026-02-23T13:08:59.785359+0000","last_unstale":"2026-02-23T13:10:16.644140+0000","last_undegraded":"2026-02-23T13:10:16.644140+0000","last_fullsized":"2026-02-23T13:10:16.644140+0000","mapping_epoch":62,"log_start":"65'35945","ondisk_log_start":"65'35945","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:18.876316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2355888128,"num_objects":35948,"num_object_clones":0,"num_object_copies":107844,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35948,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35948,"num_write_kb":2300672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"65'34406","reported_seq":34423,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:11.764243+0000","last_change":"2026-02-23T13:08:59.786387+0000","last_active":"2026-02-23T13:10:11.764243+0000","last_peered":"2026-02-23T13:10:11.764243+0000","last_clean":"2026-02-23T13:10:11.764243+0000","last_became_active":"2026-02-23T13:08:59.785106+0000","last_became_peered":"2026-02-23T13:08:59.785106+0000","last_unstale":"2026-02-23T13:10:11.764243+0000","last_undegraded":"2026-02-23T13:10:11.764243+0000","last_fullsized":"2026-02-23T13:10:11.764243+0000","mapping_epoch":62,"log_start":"65'34403","ondisk_log_start":"65'34403","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:27.939858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2254831616,"num_objects":34406,"num_object_clones":0,"num_object_copies":103218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34406,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34406,"num_write_kb":2201984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"65'36393","reported_seq":36712,"reported_epoch":65,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:10:16.643105+0000","last_change":"2026-02-23T13:10:13.691017+0000","last_active":"2026-02-23T13:10:16.643105+0000","last_peered":"2026-02-23T13:10:16.643105+0000","last_clean":"2026-02-23T13:10:16.643105+0000","last_became_active":"2026-02-23T13:08:59.784457+0000","last_became_peered":"2026-02-23T13:08:59.784457+0000","last_unstale":"2026-02-23T13:10:16.643105+0000","last_undegraded":"2026-02-23T13:10:16.643105+0000","last_fullsized":"2026-02-23T13:10:16.643105+0000","mapping_epoch":62,"log_start":"65'36390","ondisk_log_start":"65'36390","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":29599,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 3s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2385051648,"num_objects":36393,"num_object_clones":0,"num_object_copies":109179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36393,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36393,"num_write_kb":2329152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"65'34165","reported_seq":34182,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:11.762038+0000","last_change":"2026-02-23T13:08:59.784450+0000","last_active":"2026-02-23T13:10:11.762038+0000","last_peered":"2026-02-23T13:10:11.762038+0000","last_clean":"2026-02-23T13:10:11.762038+0000","last_became_active":"2026-02-23T13:08:59.784235+0000","last_became_peered":"2026-02-23T13:08:59.784235+0000","last_unstale":"2026-02-23T13:10:11.762038+0000","last_undegraded":"2026-02-23T13:10:11.762038+0000","last_fullsized":"2026-02-23T13:10:11.762038+0000","mapping_epoch":62,"log_start":"65'34162","ondisk_log_start":"65'34162","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:12.986395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2239037440,"num_objects":34165,"num_object_clones":0,"num_object_copies":102495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34165,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34165,"num_write_kb":2186560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"65'36410","reported_seq":36743,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:16.635642+0000","last_change":"2026-02-23T13:10:03.037875+0000","last_active":"2026-02-23T13:10:16.635642+0000","last_peered":"2026-02-23T13:10:16.635642+0000","last_clean":"2026-02-23T13:10:16.635642+0000","last_became_active":"2026-02-23T13:08:59.784318+0000","last_became_peered":"2026-02-23T13:08:59.784318+0000","last_unstale":"2026-02-23T13:10:16.635642+0000","last_undegraded":"2026-02-23T13:10:16.635642+0000","last_fullsized":"2026-02-23T13:10:16.635642+0000","mapping_epoch":62,"log_start":"65'36407","ondisk_log_start":"65'36407","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'30914","last_scrub_stamp":"2026-02-23T13:10:03.037814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:03.037814+0000","objects_scrubbed":30174,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:29.315340+0000","scrub_duration":3318,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2386165760,"num_objects":36410,"num_object_clones":0,"num_object_copies":109230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36410,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36410,"num_write_kb":2330240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"65'34430","reported_seq":34607,"reported_epoch":65,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:10:11.766708+0000","last_change":"2026-02-23T13:10:10.218188+0000","last_active":"2026-02-23T13:10:11.766708+0000","last_peered":"2026-02-23T13:10:11.766708+0000","last_clean":"2026-02-23T13:10:11.766708+0000","last_became_active":"2026-02-23T13:08:59.784463+0000","last_became_peered":"2026-02-23T13:08:59.784463+0000","last_unstale":"2026-02-23T13:10:11.766708+0000","last_undegraded":"2026-02-23T13:10:11.766708+0000","last_fullsized":"2026-02-23T13:10:11.766708+0000","mapping_epoch":62,"log_start":"65'34427","ondisk_log_start":"65'34427","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":15699,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2256404480,"num_objects":34430,"num_object_clones":0,"num_object_copies":103290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34430,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34430,"num_write_kb":2203520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"65'36390","reported_seq":36750,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:16.639973+0000","last_change":"2026-02-23T13:10:11.150558+0000","last_active":"2026-02-23T13:10:16.639973+0000","last_peered":"2026-02-23T13:10:16.639973+0000","last_clean":"2026-02-23T13:10:16.639973+0000","last_became_active":"2026-02-23T13:08:59.784436+0000","last_became_peered":"2026-02-23T13:08:59.784436+0000","last_unstale":"2026-02-23T13:10:16.639973+0000","last_undegraded":"2026-02-23T13:10:16.639973+0000","last_fullsized":"2026-02-23T13:10:16.639973+0000","mapping_epoch":62,"log_start":"65'36387","ondisk_log_start":"65'36387","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'34103","last_scrub_stamp":"2026-02-23T13:10:11.150522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:11.150522+0000","objects_scrubbed":33383,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:36.031575+0000","scrub_duration":3995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2384855040,"num_objects":36390,"num_object_clones":0,"num_object_copies":109170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36390,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36390,"num_write_kb":2328960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"65'36170","reported_seq":36187,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:16.634735+0000","last_change":"2026-02-23T13:08:59.784689+0000","last_active":"2026-02-23T13:10:16.634735+0000","last_peered":"2026-02-23T13:10:16.634735+0000","last_clean":"2026-02-23T13:10:16.634735+0000","last_became_active":"2026-02-23T13:08:59.784290+0000","last_became_peered":"2026-02-23T13:08:59.784290+0000","last_unstale":"2026-02-23T13:10:16.634735+0000","last_undegraded":"2026-02-23T13:10:16.634735+0000","last_fullsized":"2026-02-23T13:10:16.634735+0000","mapping_epoch":62,"log_start":"65'36167","ondisk_log_start":"65'36167","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:25.847402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2370437120,"num_objects":36170,"num_object_clones":0,"num_object_copies":108510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36170,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36170,"num_write_kb":2314880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"65'36035","reported_seq":36402,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:16.640251+0000","last_change":"2026-02-23T13:10:13.394783+0000","last_active":"2026-02-23T13:10:16.640251+0000","last_peered":"2026-02-23T13:10:16.640251+0000","last_clean":"2026-02-23T13:10:16.640251+0000","last_became_active":"2026-02-23T13:08:59.785634+0000","last_became_peered":"2026-02-23T13:08:59.785634+0000","last_unstale":"2026-02-23T13:10:16.640251+0000","last_undegraded":"2026-02-23T13:10:16.640251+0000","last_fullsized":"2026-02-23T13:10:16.640251+0000","mapping_epoch":62,"log_start":"65'36032","ondisk_log_start":"65'36032","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'34740","last_scrub_stamp":"2026-02-23T13:10:13.394732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:13.394732+0000","objects_scrubbed":34037,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:23.660349+0000","scrub_duration":3642,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2361589760,"num_objects":36035,"num_object_clones":0,"num_object_copies":108105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36035,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36035,"num_write_kb":2306240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":301,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:15.445539+0000","last_change":"2026-02-23T13:09:15.445539+0000","last_active":"2026-02-23T13:09:15.445539+0000","last_peered":"2026-02-23T13:09:15.445539+0000","last_clean":"2026-02-23T13:09:15.445539+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:09:15.445539+0000","last_undegraded":"2026-02-23T13:09:15.445539+0000","last_fullsized":"2026-02-23T13:09:15.445539+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:09:15.445510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:09:15.445510+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:37.194057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":37493276672,"num_objects":572102,"num_object_clones":0,"num_object_copies":1716306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":572102,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":572102,"num_write_kb":36614528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":112733978624,"data_stored":112733978624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247898,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":29461248,"kb_used_data":27563948,"kb_used_omap":13,"kb_used_meta":1897202,"kb_avail":704541952,"statfs":{"total":751619276800,"available":721450958848,"internally_reserved":0,"allocated":28225482752,"data_stored":28225034767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13353,"internal_metadata":1942735831},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444125,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":34420288,"kb_used_data":32264812,"kb_used_omap":14,"kb_used_meta":2155441,"kb_avail":699582912,"statfs":{"total":751619276800,"available":716372901888,"internally_reserved":0,"allocated":33039167488,"data_stored":33038719503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15349,"internal_metadata":2207171595},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574942,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":23549820,"kb_used_data":21822824,"kb_used_omap":11,"kb_used_meta":1726964,"kb_avail":710453380,"statfs":{"total":751619276800,"available":727504261120,"internally_reserved":0,"allocated":22346571776,"data_stored":22346127343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11524,"internal_metadata":1768411900},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,4,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705760,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":29848320,"kb_used_data":27804716,"kb_used_omap":8,"kb_used_meta":2043575,"kb_avail":704154880,"statfs":{"total":751619276800,"available":721054597120,"internally_reserved":0,"allocated":28472029184,"data_stored":28471581199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8702,"internal_metadata":2092621314},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28487188480,"data_stored":28487188480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22498836480,"data_stored":22498836480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33252769792,"data_stored":33252769792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28495183872,"data_stored":28495183872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:10:16.766 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:10:16.767 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_2 pg_num 66 2026-02-23T13:10:16.879 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 76 16 581284 581268 477.977 367.312 0.00149723 0.0020909 2026-02-23T13:10:16.910 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:16.942 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:10:16.977 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:16 trial046 ceph-mon[38575]: 4.f scrub starts 2026-02-23T13:10:16.978 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:16 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:10:17.043 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:17.040+0000 7fed5ca25640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:17.043 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:17.040+0000 7fed5ca25640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:17.090 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:17.187 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:10:17.215 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:17.213+0000 7fe96b795640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:17.215 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:17.213+0000 7fe96b795640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:17.230 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:10:17.233 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:10:17.233 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:10:17.246 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:10:17.246 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:10:17.259 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:10:17.259 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:10:17.272 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:10:17.272 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:10:17.879 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 77 16 588217 588201 477.396 433.312 0.0011696 0.00209345 2026-02-23T13:10:18.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:17 trial046 ceph-mon[38575]: pgmap v259: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 35 GiB data, 112 GiB used, 2.6 TiB / 2.7 TiB avail; 462 MiB/s wr, 7.40k op/s 2026-02-23T13:10:18.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:17 trial046 ceph-mon[38575]: from='client.15002 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:10:18.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:17 trial046 ceph-mon[38575]: 4.4 scrub ok 2026-02-23T13:10:18.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:17 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3644345691' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_2", "var": "pg_num", "val": "66"} : dispatch 2026-02-23T13:10:18.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:17 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2892299540' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:10:18.879 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 78 16 595517 595501 477.125 456.25 0.00177298 0.00209465 2026-02-23T13:10:19.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:18 trial046 ceph-mon[38575]: 4.6 scrub ok 2026-02-23T13:10:19.318 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:10:19.462 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:19.583 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:19.580+0000 7f15144cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:19.583 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:19.581+0000 7f15144cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:19.598 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:10:19.599 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:10:19.611 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:10:19.611 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:10:19.623 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:10:19.624 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:10:19.636 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:10:19.637 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:10:19.880 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 79 16 603936 603920 477.745 526.188 0.00202289 0.00209194 2026-02-23T13:10:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:19 trial046 ceph-mon[38575]: pgmap v260: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 35 GiB data, 113 GiB used, 2.6 TiB / 2.7 TiB avail; 370 MiB/s wr, 5.93k op/s 2026-02-23T13:10:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:19 trial046 ceph-mon[38575]: 4.f scrub ok 2026-02-23T13:10:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:19 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4111013966' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:10:20.880 INFO:tasks.radosbench.radosbench.0.trial046.stdout:2026-02-23T13:10:20.879564+0000 min lat: 0.000698614 max lat: 0.0659431 avg lat: 0.00208915 2026-02-23T13:10:20.880 INFO:tasks.radosbench.radosbench.0.trial046.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-23T13:10:20.880 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 80 16 612396 612380 478.382 528.75 0.00196473 0.00208915 2026-02-23T13:10:21.688 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:10:21.839 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:21.879 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 81 16 620126 620110 478.44 483.125 0.0012345 0.00208889 2026-02-23T13:10:21.974 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:21.972+0000 7f64c6ee7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:21.974 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:21.972+0000 7f64c6ee7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:21.974 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:21 trial046 ceph-mon[38575]: pgmap v261: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 35 GiB data, 113 GiB used, 2.6 TiB / 2.7 TiB avail; 326 MiB/s wr, 5.21k op/s 2026-02-23T13:10:21.974 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:21 trial046 ceph-mon[38575]: 4.8 scrub starts 2026-02-23T13:10:21.990 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:10:21.990 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:10:22.003 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:10:22.003 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:10:22.016 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:10:22.016 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:10:22.028 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:10:22.028 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:10:22.231 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:10:22.231 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:10:22.232 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-23T13:10:22.232 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:10:22.373 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:22.493 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:22.491+0000 7f11a50b0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:22.494 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:22.492+0000 7f11a50b0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:22.637 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:10:22.638 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:10:22.682 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":261,"stamp":"2026-02-23T13:10:20.649270+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":38014878240,"num_objects":580054,"num_object_clones":0,"num_object_copies":1740162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":580054,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":580187,"num_write_kb":37125478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":118646588,"kb_used_data":110751020,"kb_used_omap":47,"kb_used_meta":7895376,"kb_avail":2817366212,"statfs":{"total":3006477107200,"available":2884983001088,"internally_reserved":0,"allocated":113409044480,"data_stored":113407256092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":48928,"internal_metadata":8084865248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,3,8,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4099342336,"num_objects":62551,"num_object_clones":0,"num_object_copies":187653,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62551,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62551,"num_write_kb":4003264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001748"},"pg_stats":[{"pgid":"4.f","version":"65'36376","reported_seq":36542,"reported_epoch":65,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:10:16.766463+0000","last_change":"2026-02-23T13:10:15.228106+0000","last_active":"2026-02-23T13:10:16.766463+0000","last_peered":"2026-02-23T13:10:16.766463+0000","last_clean":"2026-02-23T13:10:16.766463+0000","last_became_active":"2026-02-23T13:08:59.784888+0000","last_became_peered":"2026-02-23T13:08:59.784888+0000","last_unstale":"2026-02-23T13:10:16.766463+0000","last_undegraded":"2026-02-23T13:10:16.766463+0000","last_fullsized":"2026-02-23T13:10:16.766463+0000","mapping_epoch":62,"log_start":"65'36373","ondisk_log_start":"65'36373","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":14249,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2383937536,"num_objects":36376,"num_object_clones":0,"num_object_copies":109128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36376,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36376,"num_write_kb":2328064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"65'35771","reported_seq":35788,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:16.644767+0000","last_change":"2026-02-23T13:08:59.785686+0000","last_active":"2026-02-23T13:10:16.644767+0000","last_peered":"2026-02-23T13:10:16.644767+0000","last_clean":"2026-02-23T13:10:16.644767+0000","last_became_active":"2026-02-23T13:08:59.785397+0000","last_became_peered":"2026-02-23T13:08:59.785397+0000","last_unstale":"2026-02-23T13:10:16.644767+0000","last_undegraded":"2026-02-23T13:10:16.644767+0000","last_fullsized":"2026-02-23T13:10:16.644767+0000","mapping_epoch":62,"log_start":"65'35768","ondisk_log_start":"65'35768","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:19.572572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2344288256,"num_objects":35771,"num_object_clones":0,"num_object_copies":107313,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35771,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35771,"num_write_kb":2289344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"65'36191","reported_seq":36540,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:16.645165+0000","last_change":"2026-02-23T13:10:07.875495+0000","last_active":"2026-02-23T13:10:16.645165+0000","last_peered":"2026-02-23T13:10:16.645165+0000","last_clean":"2026-02-23T13:10:16.645165+0000","last_became_active":"2026-02-23T13:08:59.785780+0000","last_became_peered":"2026-02-23T13:08:59.785780+0000","last_unstale":"2026-02-23T13:10:16.645165+0000","last_undegraded":"2026-02-23T13:10:16.645165+0000","last_fullsized":"2026-02-23T13:10:16.645165+0000","mapping_epoch":62,"log_start":"65'36188","ondisk_log_start":"65'36188","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'32743","last_scrub_stamp":"2026-02-23T13:10:07.875449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:07.875449+0000","objects_scrubbed":32129,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:15.294906+0000","scrub_duration":3040,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2371813376,"num_objects":36191,"num_object_clones":0,"num_object_copies":108573,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36191,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36191,"num_write_kb":2316224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"65'36647","reported_seq":36664,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:16.643026+0000","last_change":"2026-02-23T13:08:59.784416+0000","last_active":"2026-02-23T13:10:16.643026+0000","last_peered":"2026-02-23T13:10:16.643026+0000","last_clean":"2026-02-23T13:10:16.643026+0000","last_became_active":"2026-02-23T13:08:59.783982+0000","last_became_peered":"2026-02-23T13:08:59.783982+0000","last_unstale":"2026-02-23T13:10:16.643026+0000","last_undegraded":"2026-02-23T13:10:16.643026+0000","last_fullsized":"2026-02-23T13:10:16.643026+0000","mapping_epoch":62,"log_start":"65'36644","ondisk_log_start":"65'36644","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:19.759236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2401697792,"num_objects":36647,"num_object_clones":0,"num_object_copies":109941,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36647,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36647,"num_write_kb":2345408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"65'36204","reported_seq":36221,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:16.633526+0000","last_change":"2026-02-23T13:08:59.784919+0000","last_active":"2026-02-23T13:10:16.633526+0000","last_peered":"2026-02-23T13:10:16.633526+0000","last_clean":"2026-02-23T13:10:16.633526+0000","last_became_active":"2026-02-23T13:08:59.784710+0000","last_became_peered":"2026-02-23T13:08:59.784710+0000","last_unstale":"2026-02-23T13:10:16.633526+0000","last_undegraded":"2026-02-23T13:10:16.633526+0000","last_fullsized":"2026-02-23T13:10:16.633526+0000","mapping_epoch":62,"log_start":"65'36201","ondisk_log_start":"65'36201","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:22.287957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2372665344,"num_objects":36204,"num_object_clones":0,"num_object_copies":108612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36204,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36204,"num_write_kb":2317056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"65'36429","reported_seq":36446,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:16.641124+0000","last_change":"2026-02-23T13:08:59.784739+0000","last_active":"2026-02-23T13:10:16.641124+0000","last_peered":"2026-02-23T13:10:16.641124+0000","last_clean":"2026-02-23T13:10:16.641124+0000","last_became_active":"2026-02-23T13:08:59.784218+0000","last_became_peered":"2026-02-23T13:08:59.784218+0000","last_unstale":"2026-02-23T13:10:16.641124+0000","last_undegraded":"2026-02-23T13:10:16.641124+0000","last_fullsized":"2026-02-23T13:10:16.641124+0000","mapping_epoch":62,"log_start":"65'36426","ondisk_log_start":"65'36426","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:25.462760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2387410944,"num_objects":36429,"num_object_clones":0,"num_object_copies":109287,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36429,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36429,"num_write_kb":2331456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"65'36132","reported_seq":36472,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:16.640032+0000","last_change":"2026-02-23T13:10:06.461634+0000","last_active":"2026-02-23T13:10:16.640032+0000","last_peered":"2026-02-23T13:10:16.640032+0000","last_clean":"2026-02-23T13:10:16.640032+0000","last_became_active":"2026-02-23T13:08:59.784210+0000","last_became_peered":"2026-02-23T13:08:59.784210+0000","last_unstale":"2026-02-23T13:10:16.640032+0000","last_undegraded":"2026-02-23T13:10:16.640032+0000","last_fullsized":"2026-02-23T13:10:16.640032+0000","mapping_epoch":62,"log_start":"65'36129","ondisk_log_start":"65'36129","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'32118","last_scrub_stamp":"2026-02-23T13:10:06.461563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:06.461563+0000","objects_scrubbed":31388,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:22.890897+0000","scrub_duration":3366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2367946752,"num_objects":36132,"num_object_clones":0,"num_object_copies":108396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36132,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36132,"num_write_kb":2312448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"65'35948","reported_seq":35965,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:16.644140+0000","last_change":"2026-02-23T13:08:59.785913+0000","last_active":"2026-02-23T13:10:16.644140+0000","last_peered":"2026-02-23T13:10:16.644140+0000","last_clean":"2026-02-23T13:10:16.644140+0000","last_became_active":"2026-02-23T13:08:59.785359+0000","last_became_peered":"2026-02-23T13:08:59.785359+0000","last_unstale":"2026-02-23T13:10:16.644140+0000","last_undegraded":"2026-02-23T13:10:16.644140+0000","last_fullsized":"2026-02-23T13:10:16.644140+0000","mapping_epoch":62,"log_start":"65'35945","ondisk_log_start":"65'35945","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:18.876316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2355888128,"num_objects":35948,"num_object_clones":0,"num_object_copies":107844,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35948,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35948,"num_write_kb":2300672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"65'36395","reported_seq":36410,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:16.766441+0000","last_change":"2026-02-23T13:08:59.786387+0000","last_active":"2026-02-23T13:10:16.766441+0000","last_peered":"2026-02-23T13:10:16.766441+0000","last_clean":"2026-02-23T13:10:16.766441+0000","last_became_active":"2026-02-23T13:08:59.785106+0000","last_became_peered":"2026-02-23T13:08:59.785106+0000","last_unstale":"2026-02-23T13:10:16.766441+0000","last_undegraded":"2026-02-23T13:10:16.766441+0000","last_fullsized":"2026-02-23T13:10:16.766441+0000","mapping_epoch":62,"log_start":"65'36392","ondisk_log_start":"65'36392","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:27.939858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2385182720,"num_objects":36395,"num_object_clones":0,"num_object_copies":109185,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36395,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36395,"num_write_kb":2329280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"65'36393","reported_seq":36712,"reported_epoch":65,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:10:16.643105+0000","last_change":"2026-02-23T13:10:13.691017+0000","last_active":"2026-02-23T13:10:16.643105+0000","last_peered":"2026-02-23T13:10:16.643105+0000","last_clean":"2026-02-23T13:10:16.643105+0000","last_became_active":"2026-02-23T13:08:59.784457+0000","last_became_peered":"2026-02-23T13:08:59.784457+0000","last_unstale":"2026-02-23T13:10:16.643105+0000","last_undegraded":"2026-02-23T13:10:16.643105+0000","last_fullsized":"2026-02-23T13:10:16.643105+0000","mapping_epoch":62,"log_start":"65'36390","ondisk_log_start":"65'36390","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":29599,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 3s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2385051648,"num_objects":36393,"num_object_clones":0,"num_object_copies":109179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36393,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36393,"num_write_kb":2329152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"65'36156","reported_seq":36538,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:16.764693+0000","last_change":"2026-02-23T13:10:16.715418+0000","last_active":"2026-02-23T13:10:16.764693+0000","last_peered":"2026-02-23T13:10:16.764693+0000","last_clean":"2026-02-23T13:10:16.764693+0000","last_became_active":"2026-02-23T13:08:59.784235+0000","last_became_peered":"2026-02-23T13:08:59.784235+0000","last_unstale":"2026-02-23T13:10:16.764693+0000","last_undegraded":"2026-02-23T13:10:16.764693+0000","last_fullsized":"2026-02-23T13:10:16.764693+0000","mapping_epoch":62,"log_start":"65'36153","ondisk_log_start":"65'36153","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'36136","last_scrub_stamp":"2026-02-23T13:10:16.715358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:16.715358+0000","objects_scrubbed":35429,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:30.935136+0000","scrub_duration":3530,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2369519616,"num_objects":36156,"num_object_clones":0,"num_object_copies":108468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36156,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36156,"num_write_kb":2313984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"65'36410","reported_seq":36743,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:16.635642+0000","last_change":"2026-02-23T13:10:03.037875+0000","last_active":"2026-02-23T13:10:16.635642+0000","last_peered":"2026-02-23T13:10:16.635642+0000","last_clean":"2026-02-23T13:10:16.635642+0000","last_became_active":"2026-02-23T13:08:59.784318+0000","last_became_peered":"2026-02-23T13:08:59.784318+0000","last_unstale":"2026-02-23T13:10:16.635642+0000","last_undegraded":"2026-02-23T13:10:16.635642+0000","last_fullsized":"2026-02-23T13:10:16.635642+0000","mapping_epoch":62,"log_start":"65'36407","ondisk_log_start":"65'36407","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'30914","last_scrub_stamp":"2026-02-23T13:10:03.037814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:03.037814+0000","objects_scrubbed":30174,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:29.315340+0000","scrub_duration":3318,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2386165760,"num_objects":36410,"num_object_clones":0,"num_object_copies":109230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36410,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36410,"num_write_kb":2330240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"65'36405","reported_seq":36776,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:16.766426+0000","last_change":"2026-02-23T13:10:13.380759+0000","last_active":"2026-02-23T13:10:16.766426+0000","last_peered":"2026-02-23T13:10:16.766426+0000","last_clean":"2026-02-23T13:10:16.766426+0000","last_became_active":"2026-02-23T13:08:59.784463+0000","last_became_peered":"2026-02-23T13:08:59.784463+0000","last_unstale":"2026-02-23T13:10:16.766426+0000","last_undegraded":"2026-02-23T13:10:16.766426+0000","last_fullsized":"2026-02-23T13:10:16.766426+0000","mapping_epoch":62,"log_start":"65'36402","ondisk_log_start":"65'36402","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'35060","last_scrub_stamp":"2026-02-23T13:10:13.380652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:13.380652+0000","objects_scrubbed":34448,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:31.033114+0000","scrub_duration":3163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2385838080,"num_objects":36405,"num_object_clones":0,"num_object_copies":109215,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36405,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36405,"num_write_kb":2329920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"65'36390","reported_seq":36750,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:16.639973+0000","last_change":"2026-02-23T13:10:11.150558+0000","last_active":"2026-02-23T13:10:16.639973+0000","last_peered":"2026-02-23T13:10:16.639973+0000","last_clean":"2026-02-23T13:10:16.639973+0000","last_became_active":"2026-02-23T13:08:59.784436+0000","last_became_peered":"2026-02-23T13:08:59.784436+0000","last_unstale":"2026-02-23T13:10:16.639973+0000","last_undegraded":"2026-02-23T13:10:16.639973+0000","last_fullsized":"2026-02-23T13:10:16.639973+0000","mapping_epoch":62,"log_start":"65'36387","ondisk_log_start":"65'36387","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'34103","last_scrub_stamp":"2026-02-23T13:10:11.150522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:11.150522+0000","objects_scrubbed":33383,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:36.031575+0000","scrub_duration":3995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2384855040,"num_objects":36390,"num_object_clones":0,"num_object_copies":109170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36390,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36390,"num_write_kb":2328960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"65'36170","reported_seq":36187,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:16.634735+0000","last_change":"2026-02-23T13:08:59.784689+0000","last_active":"2026-02-23T13:10:16.634735+0000","last_peered":"2026-02-23T13:10:16.634735+0000","last_clean":"2026-02-23T13:10:16.634735+0000","last_became_active":"2026-02-23T13:08:59.784290+0000","last_became_peered":"2026-02-23T13:08:59.784290+0000","last_unstale":"2026-02-23T13:10:16.634735+0000","last_undegraded":"2026-02-23T13:10:16.634735+0000","last_fullsized":"2026-02-23T13:10:16.634735+0000","mapping_epoch":62,"log_start":"65'36167","ondisk_log_start":"65'36167","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:25.847402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2370437120,"num_objects":36170,"num_object_clones":0,"num_object_copies":108510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36170,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36170,"num_write_kb":2314880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"65'36035","reported_seq":36402,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:10:16.640251+0000","last_change":"2026-02-23T13:10:13.394783+0000","last_active":"2026-02-23T13:10:16.640251+0000","last_peered":"2026-02-23T13:10:16.640251+0000","last_clean":"2026-02-23T13:10:16.640251+0000","last_became_active":"2026-02-23T13:08:59.785634+0000","last_became_peered":"2026-02-23T13:08:59.785634+0000","last_unstale":"2026-02-23T13:10:16.640251+0000","last_undegraded":"2026-02-23T13:10:16.640251+0000","last_fullsized":"2026-02-23T13:10:16.640251+0000","mapping_epoch":62,"log_start":"65'36032","ondisk_log_start":"65'36032","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'34740","last_scrub_stamp":"2026-02-23T13:10:13.394732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:13.394732+0000","objects_scrubbed":34037,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:23.660349+0000","scrub_duration":3642,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2361589760,"num_objects":36035,"num_object_clones":0,"num_object_copies":108105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36035,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36035,"num_write_kb":2306240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":301,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-23T13:09:15.445539+0000","last_change":"2026-02-23T13:09:15.445539+0000","last_active":"2026-02-23T13:09:15.445539+0000","last_peered":"2026-02-23T13:09:15.445539+0000","last_clean":"2026-02-23T13:09:15.445539+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:09:15.445539+0000","last_undegraded":"2026-02-23T13:09:15.445539+0000","last_fullsized":"2026-02-23T13:09:15.445539+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:09:15.445510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:09:15.445510+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:37.194057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":38014287872,"num_objects":580052,"num_object_clones":0,"num_object_copies":1740156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":580052,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":580052,"num_write_kb":37123328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114036113408,"data_stored":114036113408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247898,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":29461248,"kb_used_data":27563948,"kb_used_omap":13,"kb_used_meta":1897202,"kb_avail":704541952,"statfs":{"total":751619276800,"available":721450958848,"internally_reserved":0,"allocated":28225482752,"data_stored":28225034767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13353,"internal_metadata":1942735831},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444125,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":34420288,"kb_used_data":32264812,"kb_used_omap":14,"kb_used_meta":2155441,"kb_avail":699582912,"statfs":{"total":751619276800,"available":716372901888,"internally_reserved":0,"allocated":33039167488,"data_stored":33038719503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15349,"internal_metadata":2207171595},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574943,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":24916732,"kb_used_data":23117544,"kb_used_omap":11,"kb_used_meta":1799156,"kb_avail":709086468,"statfs":{"total":751619276800,"available":726104543232,"internally_reserved":0,"allocated":23672365056,"data_stored":23671920623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11524,"internal_metadata":1842336508},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3,8,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705760,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":29848320,"kb_used_data":27804716,"kb_used_omap":8,"kb_used_meta":2043575,"kb_avail":704154880,"statfs":{"total":751619276800,"available":721054597120,"internally_reserved":0,"allocated":28472029184,"data_stored":28471581199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8702,"internal_metadata":2092621314},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28487188480,"data_stored":28487188480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23800971264,"data_stored":23800971264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33252769792,"data_stored":33252769792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28495183872,"data_stored":28495183872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:10:22.683 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 171 2026-02-23T13:10:22.817 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:22.880 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 82 16 627393 627377 478.144 454.188 0.00188947 0.00209018 2026-02-23T13:10:22.934 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:22 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2683329239' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:10:22.938 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:22.935+0000 7f6f1eaa2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:22.938 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:22.936+0000 7f6f1eaa2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:23.073 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-23T13:10:23.113 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:10:23.880 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 83 16 633342 633326 476.863 371.812 0.000827463 0.00209576 2026-02-23T13:10:24.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:23 trial046 ceph-mon[38575]: 4.c scrub starts 2026-02-23T13:10:24.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:23 trial046 ceph-mon[38575]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:10:24.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:23 trial046 ceph-mon[38575]: pgmap v262: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 38 GiB data, 118 GiB used, 2.6 TiB / 2.7 TiB avail; 526 MiB/s wr, 8.42k op/s 2026-02-23T13:10:24.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:23 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/572849001' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "171"} : dispatch 2026-02-23T13:10:24.074 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:10:24.213 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:24.332 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:24.330+0000 7fbc81fef640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:24.332 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:24.330+0000 7fbc81fef640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:24.348 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:10:24.348 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:10:24.360 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:10:24.361 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:10:24.374 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:10:24.374 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:10:24.387 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:10:24.388 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:10:24.880 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 84 16 639404 639388 475.696 378.875 0.00848751 0.00210092 2026-02-23T13:10:25.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:24 trial046 ceph-mon[38575]: 4.e scrub starts 2026-02-23T13:10:25.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:24 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1372109561' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:10:25.880 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 85 16 646048 646032 474.984 415.25 0.00137422 0.00210408 2026-02-23T13:10:26.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:25 trial046 ceph-mon[38575]: 4.8 scrub ok 2026-02-23T13:10:26.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:25 trial046 ceph-mon[38575]: pgmap v263: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 38 GiB data, 118 GiB used, 2.6 TiB / 2.7 TiB avail; 366 MiB/s wr, 5.86k op/s 2026-02-23T13:10:26.433 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:10:26.458 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:10:26 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:10:26] "GET /metrics HTTP/1.1" 200 4212 "" "Prometheus/3.6.0" 2026-02-23T13:10:26.561 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:10:26 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:10:26.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:10:26.572 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:26.694 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:26.691+0000 7f3068252640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:26.694 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:26.692+0000 7f3068252640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:26.712 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:10:26.713 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:10:26.726 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:10:26.726 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:10:26.739 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:10:26.740 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:10:26.752 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:10:26.752 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:10:26.880 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 86 16 653179 653163 474.643 445.688 0.00134124 0.00210562 2026-02-23T13:10:27.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:26 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1045915665' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:10:27.880 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 87 15 661060 661045 474.849 492.625 0.00169579 0.0021047 2026-02-23T13:10:28.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:27 trial046 ceph-mon[38575]: 4.c scrub ok 2026-02-23T13:10:28.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:27 trial046 ceph-mon[38575]: pgmap v264: 17 pgs: 17 active+clean; 39 GiB data, 122 GiB used, 2.6 TiB / 2.7 TiB avail; 453 MiB/s wr, 7.25k op/s 2026-02-23T13:10:28.114 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:10:28.115 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-23T13:10:28.256 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:28.660 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:28.657+0000 7f9f3c4fe640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:28.660 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:28.658+0000 7f9f3c4fe640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:28.799 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:10:28.880 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 88 16 667909 667893 474.317 428 0.00205202 0.00210707 2026-02-23T13:10:28.944 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:29.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:28 trial046 ceph-mon[38575]: 4.e scrub ok 2026-02-23T13:10:29.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:28 trial046 ceph-mon[38575]: 4.a scrub starts 2026-02-23T13:10:29.160 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:29.158+0000 7f7a221ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:29.161 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:29.159+0000 7f7a221ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:29.176 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:10:29.176 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:10:29.188 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:10:29.188 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:10:29.202 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:10:29.202 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:10:29.214 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:10:29.214 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:10:29.781 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.0 to 1 (10000) 2026-02-23T13:10:29.880 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 89 16 674737 674721 473.782 426.75 0.00219161 0.00210943 2026-02-23T13:10:30.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:29 trial046 ceph-mon[38575]: pgmap v265: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 40 GiB data, 124 GiB used, 2.6 TiB / 2.7 TiB avail; 414 MiB/s wr, 6.62k op/s 2026-02-23T13:10:30.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:29 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/996466603' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-23T13:10:30.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:29 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2235845367' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:10:30.196 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-23T13:10:30.335 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:30.470 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:30.467+0000 7f7c54370640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:30.470 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:30.468+0000 7f7c54370640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:30.783 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.1 to 1 (10000) 2026-02-23T13:10:30.831 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-23T13:10:30.880 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Total time run: 90.0034 2026-02-23T13:10:30.881 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Total writes made: 680758 2026-02-23T13:10:30.881 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Write size: 65536 2026-02-23T13:10:30.881 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Object size: 65536 2026-02-23T13:10:30.881 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Bandwidth (MB/sec): 472.731 2026-02-23T13:10:30.881 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Stddev Bandwidth: 60.1494 2026-02-23T13:10:30.881 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Max bandwidth (MB/sec): 543.688 2026-02-23T13:10:30.881 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Min bandwidth (MB/sec): 318 2026-02-23T13:10:30.881 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Average IOPS: 7563 2026-02-23T13:10:30.881 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Stddev IOPS: 962.391 2026-02-23T13:10:30.881 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Max IOPS: 8699 2026-02-23T13:10:30.881 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Min IOPS: 5088 2026-02-23T13:10:30.882 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Average Latency(s): 0.00211411 2026-02-23T13:10:30.882 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Stddev Latency(s): 0.00189434 2026-02-23T13:10:30.882 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Max latency(s): 0.0659431 2026-02-23T13:10:30.882 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Min latency(s): 0.000698614 2026-02-23T13:10:30.882 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Cleaning up (deleting benchmark objects) 2026-02-23T13:10:30.974 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:31.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:30 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/996466603' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-23T13:10:31.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:30 trial046 ceph-mon[38575]: osdmap e66: 4 total, 4 up, 4 in 2026-02-23T13:10:31.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:30 trial046 ceph-mon[38575]: 4.7 scrub starts 2026-02-23T13:10:31.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:30 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/880832447' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-23T13:10:31.099 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:31.098+0000 7fd91ab05640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:31.099 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:31.098+0000 7fd91ab05640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:31.329 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:10:31.462 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:31.580 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:31.579+0000 7fd3430b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:31.580 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:31.580+0000 7fd3430b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:31.596 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:10:31.596 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:10:31.610 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:10:31.611 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:10:31.623 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:10:31.623 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:10:31.636 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:10:31.636 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:10:31.784 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.2 to 1 (10000) 2026-02-23T13:10:31.938 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:31 trial046 ceph-mon[38575]: pgmap v267: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 40 GiB data, 124 GiB used, 2.6 TiB / 2.7 TiB avail; 447 MiB/s wr, 7.15k op/s 2026-02-23T13:10:31.939 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:31 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/880832447' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-23T13:10:31.939 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:31 trial046 ceph-mon[38575]: osdmap e67: 4 total, 4 up, 4 in 2026-02-23T13:10:31.939 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:31 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:10:31.939 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:31 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3839917156' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-23T13:10:31.939 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:31 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1900746819' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:10:32.762 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-23T13:10:32.897 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:33.016 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:32 trial046 ceph-mon[38575]: 4.b scrub starts 2026-02-23T13:10:33.016 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:32 trial046 ceph-mon[38575]: 4.a scrub ok 2026-02-23T13:10:33.016 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:32 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3839917156' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-23T13:10:33.016 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:32 trial046 ceph-mon[38575]: osdmap e68: 4 total, 4 up, 4 in 2026-02-23T13:10:33.317 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:33.295+0000 7f0daf4bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:33.317 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:33.295+0000 7f0daf4bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:33.789 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.3 to 1 (10000) 2026-02-23T13:10:34.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:33 trial046 ceph-mon[38575]: pgmap v270: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 41 GiB data, 129 GiB used, 2.6 TiB / 2.7 TiB avail; 170 B/s rd, 475 MiB/s wr, 8.60k op/s 2026-02-23T13:10:34.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:33 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/603522363' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-23T13:10:34.417 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-23T13:10:34.418 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:10:34.598 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:34.866 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:10:34.990 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:34 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/603522363' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-23T13:10:34.990 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:34 trial046 ceph-mon[38575]: osdmap e69: 4 total, 4 up, 4 in 2026-02-23T13:10:34.990 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:34 trial046 ceph-mon[38575]: osdmap e70: 4 total, 4 up, 4 in 2026-02-23T13:10:35.003 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:34.988+0000 7f8267afa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:35.003 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:34.989+0000 7f8267afa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:35.015 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:35.130 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:10:35.130 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:10:35.138 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:35.137+0000 7f5289f6e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:35.138 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:35.137+0000 7f5289f6e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:35.154 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:10:35.154 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:10:35.166 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:10:35.167 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:10:35.177 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":273,"stamp":"2026-02-23T13:10:34.651124+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":44221465144,"num_objects":674760,"num_object_clones":0,"num_object_copies":2024280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":674760,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":686895,"num_write_kb":43570663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":135724392,"kb_used_data":129976216,"kb_used_omap":53,"kb_used_meta":5748042,"kb_avail":2800288408,"statfs":{"total":3006477107200,"available":2867495329792,"internally_reserved":0,"allocated":133095645184,"data_stored":133093781548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":54960,"internal_metadata":5885995344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[22,5,3,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1518207000,"num_objects":23167,"num_object_clones":0,"num_object_copies":69501,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23167,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":35169,"num_write_kb":1866689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000475"},"pg_stats":[{"pgid":"4.f","version":"67'43210","reported_seq":43608,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.768244+0000","last_change":"2026-02-23T13:10:18.889561+0000","last_active":"2026-02-23T13:10:31.768244+0000","last_peered":"2026-02-23T13:10:31.768244+0000","last_clean":"2026-02-23T13:10:31.768244+0000","last_became_active":"2026-02-23T13:08:59.784888+0000","last_became_peered":"2026-02-23T13:08:59.784888+0000","last_unstale":"2026-02-23T13:10:31.768244+0000","last_undegraded":"2026-02-23T13:10:31.768244+0000","last_fullsized":"2026-02-23T13:10:31.768244+0000","mapping_epoch":62,"log_start":"67'43207","ondisk_log_start":"67'43207","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'37338","last_scrub_stamp":"2026-02-23T13:10:18.889417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:18.889417+0000","objects_scrubbed":36552,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:46.655322+0000","scrub_duration":3662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2781216768,"num_objects":42438,"num_object_clones":0,"num_object_copies":127314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42438,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43210,"num_write_kb":2740736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"67'42411","reported_seq":42836,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.651982+0000","last_change":"2026-02-23T13:10:27.126280+0000","last_active":"2026-02-23T13:10:31.651982+0000","last_peered":"2026-02-23T13:10:31.651982+0000","last_clean":"2026-02-23T13:10:31.651982+0000","last_became_active":"2026-02-23T13:08:59.785397+0000","last_became_peered":"2026-02-23T13:08:59.785397+0000","last_unstale":"2026-02-23T13:10:31.651982+0000","last_undegraded":"2026-02-23T13:10:31.651982+0000","last_fullsized":"2026-02-23T13:10:31.651982+0000","mapping_epoch":62,"log_start":"67'42408","ondisk_log_start":"67'42408","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'40440","last_scrub_stamp":"2026-02-23T13:10:27.126174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:27.126174+0000","objects_scrubbed":39592,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:48.254573+0000","scrub_duration":3978,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2729508864,"num_objects":41649,"num_object_clones":0,"num_object_copies":124947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41649,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42411,"num_write_kb":2689920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"67'42921","reported_seq":43275,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.644798+0000","last_change":"2026-02-23T13:10:07.875495+0000","last_active":"2026-02-23T13:10:31.644798+0000","last_peered":"2026-02-23T13:10:31.644798+0000","last_clean":"2026-02-23T13:10:31.644798+0000","last_became_active":"2026-02-23T13:08:59.785780+0000","last_became_peered":"2026-02-23T13:08:59.785780+0000","last_unstale":"2026-02-23T13:10:31.644798+0000","last_undegraded":"2026-02-23T13:10:31.644798+0000","last_fullsized":"2026-02-23T13:10:31.644798+0000","mapping_epoch":62,"log_start":"67'42918","ondisk_log_start":"67'42918","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'32743","last_scrub_stamp":"2026-02-23T13:10:07.875449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:07.875449+0000","objects_scrubbed":32129,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:15.294906+0000","scrub_duration":3040,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2764701720,"num_objects":42187,"num_object_clones":0,"num_object_copies":126561,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42187,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":42921,"num_write_kb":2723393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"67'43231","reported_seq":43662,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.645617+0000","last_change":"2026-02-23T13:10:26.384628+0000","last_active":"2026-02-23T13:10:31.645617+0000","last_peered":"2026-02-23T13:10:31.645617+0000","last_clean":"2026-02-23T13:10:31.645617+0000","last_became_active":"2026-02-23T13:08:59.783982+0000","last_became_peered":"2026-02-23T13:08:59.783982+0000","last_unstale":"2026-02-23T13:10:31.645617+0000","last_undegraded":"2026-02-23T13:10:31.645617+0000","last_fullsized":"2026-02-23T13:10:31.645617+0000","mapping_epoch":62,"log_start":"67'43228","ondisk_log_start":"67'43228","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'40924","last_scrub_stamp":"2026-02-23T13:10:26.384602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:26.384602+0000","objects_scrubbed":40159,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:51.409315+0000","scrub_duration":3763,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2785476608,"num_objects":42503,"num_object_clones":0,"num_object_copies":127509,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42503,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43231,"num_write_kb":2743488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"67'42853","reported_seq":42888,"reported_epoch":67,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:10:31.645684+0000","last_change":"2026-02-23T13:10:31.564830+0000","last_active":"2026-02-23T13:10:31.645684+0000","last_peered":"2026-02-23T13:10:31.645684+0000","last_clean":"2026-02-23T13:10:31.645684+0000","last_became_active":"2026-02-23T13:08:59.784710+0000","last_became_peered":"2026-02-23T13:08:59.784710+0000","last_unstale":"2026-02-23T13:10:31.645684+0000","last_undegraded":"2026-02-23T13:10:31.645684+0000","last_fullsized":"2026-02-23T13:10:31.645684+0000","mapping_epoch":62,"log_start":"67'42850","ondisk_log_start":"67'42850","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":999,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2755461120,"num_objects":42045,"num_object_clones":0,"num_object_copies":126135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42045,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42853,"num_write_kb":2716736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"67'43156","reported_seq":43602,"reported_epoch":67,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:10:31.656882+0000","last_change":"2026-02-23T13:10:27.178982+0000","last_active":"2026-02-23T13:10:31.656882+0000","last_peered":"2026-02-23T13:10:31.656882+0000","last_clean":"2026-02-23T13:10:31.656882+0000","last_became_active":"2026-02-23T13:08:59.784218+0000","last_became_peered":"2026-02-23T13:08:59.784218+0000","last_unstale":"2026-02-23T13:10:31.656882+0000","last_undegraded":"2026-02-23T13:10:31.656882+0000","last_fullsized":"2026-02-23T13:10:31.656882+0000","mapping_epoch":62,"log_start":"67'43153","ondisk_log_start":"67'43153","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":41749,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 5s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2779906048,"num_objects":42418,"num_object_clones":0,"num_object_copies":127254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42418,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43156,"num_write_kb":2738368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"67'42842","reported_seq":43186,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.652559+0000","last_change":"2026-02-23T13:10:06.461634+0000","last_active":"2026-02-23T13:10:31.652559+0000","last_peered":"2026-02-23T13:10:31.652559+0000","last_clean":"2026-02-23T13:10:31.652559+0000","last_became_active":"2026-02-23T13:08:59.784210+0000","last_became_peered":"2026-02-23T13:08:59.784210+0000","last_unstale":"2026-02-23T13:10:31.652559+0000","last_undegraded":"2026-02-23T13:10:31.652559+0000","last_fullsized":"2026-02-23T13:10:31.652559+0000","mapping_epoch":62,"log_start":"67'42839","ondisk_log_start":"67'42839","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'32118","last_scrub_stamp":"2026-02-23T13:10:06.461563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:06.461563+0000","objects_scrubbed":31388,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:22.890897+0000","scrub_duration":3366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2759720960,"num_objects":42110,"num_object_clones":0,"num_object_copies":126330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42110,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42842,"num_write_kb":2718464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"67'42621","reported_seq":43038,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.648319+0000","last_change":"2026-02-23T13:10:24.387952+0000","last_active":"2026-02-23T13:10:31.648319+0000","last_peered":"2026-02-23T13:10:31.648319+0000","last_clean":"2026-02-23T13:10:31.648319+0000","last_became_active":"2026-02-23T13:08:59.785359+0000","last_became_peered":"2026-02-23T13:08:59.785359+0000","last_unstale":"2026-02-23T13:10:31.648319+0000","last_undegraded":"2026-02-23T13:10:31.648319+0000","last_fullsized":"2026-02-23T13:10:31.648319+0000","mapping_epoch":62,"log_start":"67'42618","ondisk_log_start":"67'42618","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'39419","last_scrub_stamp":"2026-02-23T13:10:24.387875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:24.387875+0000","objects_scrubbed":38695,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:54.083097+0000","scrub_duration":3689,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2746679296,"num_objects":41911,"num_object_clones":0,"num_object_copies":125733,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41911,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42621,"num_write_kb":2705024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"67'43025","reported_seq":43214,"reported_epoch":67,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:10:31.769081+0000","last_change":"2026-02-23T13:10:30.135379+0000","last_active":"2026-02-23T13:10:31.769081+0000","last_peered":"2026-02-23T13:10:31.769081+0000","last_clean":"2026-02-23T13:10:31.769081+0000","last_became_active":"2026-02-23T13:08:59.785106+0000","last_became_peered":"2026-02-23T13:08:59.785106+0000","last_unstale":"2026-02-23T13:10:31.769081+0000","last_undegraded":"2026-02-23T13:10:31.769081+0000","last_fullsized":"2026-02-23T13:10:31.769081+0000","mapping_epoch":62,"log_start":"67'43022","ondisk_log_start":"67'43022","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":16549,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2768568320,"num_objects":42245,"num_object_clones":0,"num_object_copies":126735,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42245,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43025,"num_write_kb":2728640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"67'42991","reported_seq":43382,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.638015+0000","last_change":"2026-02-23T13:10:17.283236+0000","last_active":"2026-02-23T13:10:31.638015+0000","last_peered":"2026-02-23T13:10:31.638015+0000","last_clean":"2026-02-23T13:10:31.638015+0000","last_became_active":"2026-02-23T13:08:59.784457+0000","last_became_peered":"2026-02-23T13:08:59.784457+0000","last_unstale":"2026-02-23T13:10:31.638015+0000","last_undegraded":"2026-02-23T13:10:31.638015+0000","last_fullsized":"2026-02-23T13:10:31.638015+0000","mapping_epoch":62,"log_start":"67'42988","ondisk_log_start":"67'42988","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'36652","last_scrub_stamp":"2026-02-23T13:10:17.283183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:17.283183+0000","objects_scrubbed":35965,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:47.102975+0000","scrub_duration":3592,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2770010112,"num_objects":42267,"num_object_clones":0,"num_object_copies":126801,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42267,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42991,"num_write_kb":2728256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"67'42881","reported_seq":43267,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.761950+0000","last_change":"2026-02-23T13:10:16.715418+0000","last_active":"2026-02-23T13:10:31.761950+0000","last_peered":"2026-02-23T13:10:31.761950+0000","last_clean":"2026-02-23T13:10:31.761950+0000","last_became_active":"2026-02-23T13:08:59.784235+0000","last_became_peered":"2026-02-23T13:08:59.784235+0000","last_unstale":"2026-02-23T13:10:31.761950+0000","last_undegraded":"2026-02-23T13:10:31.761950+0000","last_fullsized":"2026-02-23T13:10:31.761950+0000","mapping_epoch":62,"log_start":"67'42878","ondisk_log_start":"67'42878","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'36136","last_scrub_stamp":"2026-02-23T13:10:16.715358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:16.715358+0000","objects_scrubbed":35429,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:30.935136+0000","scrub_duration":3530,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2755854336,"num_objects":42051,"num_object_clones":0,"num_object_copies":126153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42051,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42881,"num_write_kb":2717824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"67'43140","reported_seq":43477,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.641408+0000","last_change":"2026-02-23T13:10:03.037875+0000","last_active":"2026-02-23T13:10:31.641408+0000","last_peered":"2026-02-23T13:10:31.641408+0000","last_clean":"2026-02-23T13:10:31.641408+0000","last_became_active":"2026-02-23T13:08:59.784318+0000","last_became_peered":"2026-02-23T13:08:59.784318+0000","last_unstale":"2026-02-23T13:10:31.641408+0000","last_undegraded":"2026-02-23T13:10:31.641408+0000","last_fullsized":"2026-02-23T13:10:31.641408+0000","mapping_epoch":62,"log_start":"67'43137","ondisk_log_start":"67'43137","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'30914","last_scrub_stamp":"2026-02-23T13:10:03.037814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:03.037814+0000","objects_scrubbed":30174,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:29.315340+0000","scrub_duration":3318,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2778726400,"num_objects":42400,"num_object_clones":0,"num_object_copies":127200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42400,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43140,"num_write_kb":2737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"67'43024","reported_seq":43399,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.763129+0000","last_change":"2026-02-23T13:10:13.380759+0000","last_active":"2026-02-23T13:10:31.763129+0000","last_peered":"2026-02-23T13:10:31.763129+0000","last_clean":"2026-02-23T13:10:31.763129+0000","last_became_active":"2026-02-23T13:08:59.784463+0000","last_became_peered":"2026-02-23T13:08:59.784463+0000","last_unstale":"2026-02-23T13:10:31.763129+0000","last_undegraded":"2026-02-23T13:10:31.763129+0000","last_fullsized":"2026-02-23T13:10:31.763129+0000","mapping_epoch":62,"log_start":"67'43021","ondisk_log_start":"67'43021","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'35060","last_scrub_stamp":"2026-02-23T13:10:13.380652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:13.380652+0000","objects_scrubbed":34448,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:31.033114+0000","scrub_duration":3163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2766274560,"num_objects":42210,"num_object_clones":0,"num_object_copies":126630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42210,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43024,"num_write_kb":2727488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"67'42981","reported_seq":43345,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.655263+0000","last_change":"2026-02-23T13:10:11.150558+0000","last_active":"2026-02-23T13:10:31.655263+0000","last_peered":"2026-02-23T13:10:31.655263+0000","last_clean":"2026-02-23T13:10:31.655263+0000","last_became_active":"2026-02-23T13:08:59.784436+0000","last_became_peered":"2026-02-23T13:08:59.784436+0000","last_unstale":"2026-02-23T13:10:31.655263+0000","last_undegraded":"2026-02-23T13:10:31.655263+0000","last_fullsized":"2026-02-23T13:10:31.655263+0000","mapping_epoch":62,"log_start":"67'42978","ondisk_log_start":"67'42978","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'34103","last_scrub_stamp":"2026-02-23T13:10:11.150522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:11.150522+0000","objects_scrubbed":33383,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:36.031575+0000","scrub_duration":3995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2769879040,"num_objects":42265,"num_object_clones":0,"num_object_copies":126795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42265,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42981,"num_write_kb":2727872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"67'42793","reported_seq":42814,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.642638+0000","last_change":"2026-02-23T13:08:59.784689+0000","last_active":"2026-02-23T13:10:31.642638+0000","last_peered":"2026-02-23T13:10:31.642638+0000","last_clean":"2026-02-23T13:10:31.642638+0000","last_became_active":"2026-02-23T13:08:59.784290+0000","last_became_peered":"2026-02-23T13:08:59.784290+0000","last_unstale":"2026-02-23T13:10:31.642638+0000","last_undegraded":"2026-02-23T13:10:31.642638+0000","last_fullsized":"2026-02-23T13:10:31.642638+0000","mapping_epoch":62,"log_start":"67'42790","ondisk_log_start":"67'42790","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2755067904,"num_objects":42039,"num_object_clones":0,"num_object_copies":126117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42039,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42793,"num_write_kb":2714624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"67'42680","reported_seq":43051,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.646302+0000","last_change":"2026-02-23T13:10:13.394783+0000","last_active":"2026-02-23T13:10:31.646302+0000","last_peered":"2026-02-23T13:10:31.646302+0000","last_clean":"2026-02-23T13:10:31.646302+0000","last_became_active":"2026-02-23T13:08:59.785634+0000","last_became_peered":"2026-02-23T13:08:59.785634+0000","last_unstale":"2026-02-23T13:10:31.646302+0000","last_undegraded":"2026-02-23T13:10:31.646302+0000","last_fullsized":"2026-02-23T13:10:31.646302+0000","mapping_epoch":62,"log_start":"67'42677","ondisk_log_start":"67'42677","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'34740","last_scrub_stamp":"2026-02-23T13:10:13.394732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:13.394732+0000","objects_scrubbed":34037,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:23.660349+0000","scrub_duration":3642,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2753822720,"num_objects":42020,"num_object_clones":0,"num_object_copies":126060,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42020,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42680,"num_write_kb":2710400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":305,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:30.784324+0000","last_change":"2026-02-23T13:09:15.445539+0000","last_active":"2026-02-23T13:10:30.784324+0000","last_peered":"2026-02-23T13:10:30.784324+0000","last_clean":"2026-02-23T13:10:30.784324+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:10:30.784324+0000","last_undegraded":"2026-02-23T13:10:30.784324+0000","last_fullsized":"2026-02-23T13:10:30.784324+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:09:15.445510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:09:15.445510+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:37.194057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":44220874776,"num_objects":674758,"num_object_clones":0,"num_object_copies":2024274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":674758,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":686760,"num_write_kb":43568513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":132666568704,"data_stored":132666556488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247901,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":34572124,"kb_used_data":32422152,"kb_used_omap":15,"kb_used_meta":2149936,"kb_avail":699431076,"statfs":{"total":751619276800,"available":716217421824,"internally_reserved":0,"allocated":33200283648,"data_stored":33199815833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15743,"internal_metadata":2201535105},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444128,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":38733084,"kb_used_data":37985224,"kb_used_omap":14,"kb_used_meta":747825,"kb_avail":695270116,"statfs":{"total":751619276800,"available":711956598784,"internally_reserved":0,"allocated":38896869376,"data_stored":38896401561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14414,"internal_metadata":765773746},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574946,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":29071252,"kb_used_data":27163712,"kb_used_omap":13,"kb_used_meta":1907506,"kb_avail":704931948,"statfs":{"total":751619276800,"available":721850314752,"internally_reserved":0,"allocated":27815641088,"data_stored":27815180897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13812,"internal_metadata":1953286668},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,2,2,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705763,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":33347932,"kb_used_data":32405128,"kb_used_omap":10,"kb_used_meta":942773,"kb_avail":700655268,"statfs":{"total":751619276800,"available":717470994432,"internally_reserved":0,"allocated":33182851072,"data_stored":33182383257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10991,"internal_metadata":965399825},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33153617920,"data_stored":33153613848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27637317632,"data_stored":27637317632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":38700912640,"data_stored":38700908568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33174720512,"data_stored":33174716440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:10:35.179 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:10:35.180 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:10:35.180 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:10:35.195 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:10:35.195 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:10:35.319 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:35.446 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:35.445+0000 7fc048e51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:35.447 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:35.446+0000 7fc048e51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:35.592 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:10:35.593 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:10:35.638 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":273,"stamp":"2026-02-23T13:10:34.651124+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":44221465144,"num_objects":674760,"num_object_clones":0,"num_object_copies":2024280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":674760,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":686895,"num_write_kb":43570663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":135724392,"kb_used_data":129976216,"kb_used_omap":53,"kb_used_meta":5748042,"kb_avail":2800288408,"statfs":{"total":3006477107200,"available":2867495329792,"internally_reserved":0,"allocated":133095645184,"data_stored":133093781548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":54960,"internal_metadata":5885995344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[22,5,3,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1518207000,"num_objects":23167,"num_object_clones":0,"num_object_copies":69501,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23167,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":35169,"num_write_kb":1866689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000475"},"pg_stats":[{"pgid":"4.f","version":"67'43210","reported_seq":43608,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.768244+0000","last_change":"2026-02-23T13:10:18.889561+0000","last_active":"2026-02-23T13:10:31.768244+0000","last_peered":"2026-02-23T13:10:31.768244+0000","last_clean":"2026-02-23T13:10:31.768244+0000","last_became_active":"2026-02-23T13:08:59.784888+0000","last_became_peered":"2026-02-23T13:08:59.784888+0000","last_unstale":"2026-02-23T13:10:31.768244+0000","last_undegraded":"2026-02-23T13:10:31.768244+0000","last_fullsized":"2026-02-23T13:10:31.768244+0000","mapping_epoch":62,"log_start":"67'43207","ondisk_log_start":"67'43207","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'37338","last_scrub_stamp":"2026-02-23T13:10:18.889417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:18.889417+0000","objects_scrubbed":36552,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:46.655322+0000","scrub_duration":3662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2781216768,"num_objects":42438,"num_object_clones":0,"num_object_copies":127314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42438,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43210,"num_write_kb":2740736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"67'42411","reported_seq":42836,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.651982+0000","last_change":"2026-02-23T13:10:27.126280+0000","last_active":"2026-02-23T13:10:31.651982+0000","last_peered":"2026-02-23T13:10:31.651982+0000","last_clean":"2026-02-23T13:10:31.651982+0000","last_became_active":"2026-02-23T13:08:59.785397+0000","last_became_peered":"2026-02-23T13:08:59.785397+0000","last_unstale":"2026-02-23T13:10:31.651982+0000","last_undegraded":"2026-02-23T13:10:31.651982+0000","last_fullsized":"2026-02-23T13:10:31.651982+0000","mapping_epoch":62,"log_start":"67'42408","ondisk_log_start":"67'42408","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'40440","last_scrub_stamp":"2026-02-23T13:10:27.126174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:27.126174+0000","objects_scrubbed":39592,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:48.254573+0000","scrub_duration":3978,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2729508864,"num_objects":41649,"num_object_clones":0,"num_object_copies":124947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41649,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42411,"num_write_kb":2689920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"67'42921","reported_seq":43275,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.644798+0000","last_change":"2026-02-23T13:10:07.875495+0000","last_active":"2026-02-23T13:10:31.644798+0000","last_peered":"2026-02-23T13:10:31.644798+0000","last_clean":"2026-02-23T13:10:31.644798+0000","last_became_active":"2026-02-23T13:08:59.785780+0000","last_became_peered":"2026-02-23T13:08:59.785780+0000","last_unstale":"2026-02-23T13:10:31.644798+0000","last_undegraded":"2026-02-23T13:10:31.644798+0000","last_fullsized":"2026-02-23T13:10:31.644798+0000","mapping_epoch":62,"log_start":"67'42918","ondisk_log_start":"67'42918","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'32743","last_scrub_stamp":"2026-02-23T13:10:07.875449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:07.875449+0000","objects_scrubbed":32129,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:15.294906+0000","scrub_duration":3040,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2764701720,"num_objects":42187,"num_object_clones":0,"num_object_copies":126561,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42187,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":42921,"num_write_kb":2723393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"67'43231","reported_seq":43662,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.645617+0000","last_change":"2026-02-23T13:10:26.384628+0000","last_active":"2026-02-23T13:10:31.645617+0000","last_peered":"2026-02-23T13:10:31.645617+0000","last_clean":"2026-02-23T13:10:31.645617+0000","last_became_active":"2026-02-23T13:08:59.783982+0000","last_became_peered":"2026-02-23T13:08:59.783982+0000","last_unstale":"2026-02-23T13:10:31.645617+0000","last_undegraded":"2026-02-23T13:10:31.645617+0000","last_fullsized":"2026-02-23T13:10:31.645617+0000","mapping_epoch":62,"log_start":"67'43228","ondisk_log_start":"67'43228","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'40924","last_scrub_stamp":"2026-02-23T13:10:26.384602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:26.384602+0000","objects_scrubbed":40159,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:51.409315+0000","scrub_duration":3763,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2785476608,"num_objects":42503,"num_object_clones":0,"num_object_copies":127509,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42503,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43231,"num_write_kb":2743488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"67'42853","reported_seq":42888,"reported_epoch":67,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:10:31.645684+0000","last_change":"2026-02-23T13:10:31.564830+0000","last_active":"2026-02-23T13:10:31.645684+0000","last_peered":"2026-02-23T13:10:31.645684+0000","last_clean":"2026-02-23T13:10:31.645684+0000","last_became_active":"2026-02-23T13:08:59.784710+0000","last_became_peered":"2026-02-23T13:08:59.784710+0000","last_unstale":"2026-02-23T13:10:31.645684+0000","last_undegraded":"2026-02-23T13:10:31.645684+0000","last_fullsized":"2026-02-23T13:10:31.645684+0000","mapping_epoch":62,"log_start":"67'42850","ondisk_log_start":"67'42850","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":999,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2755461120,"num_objects":42045,"num_object_clones":0,"num_object_copies":126135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42045,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42853,"num_write_kb":2716736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"67'43156","reported_seq":43602,"reported_epoch":67,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:10:31.656882+0000","last_change":"2026-02-23T13:10:27.178982+0000","last_active":"2026-02-23T13:10:31.656882+0000","last_peered":"2026-02-23T13:10:31.656882+0000","last_clean":"2026-02-23T13:10:31.656882+0000","last_became_active":"2026-02-23T13:08:59.784218+0000","last_became_peered":"2026-02-23T13:08:59.784218+0000","last_unstale":"2026-02-23T13:10:31.656882+0000","last_undegraded":"2026-02-23T13:10:31.656882+0000","last_fullsized":"2026-02-23T13:10:31.656882+0000","mapping_epoch":62,"log_start":"67'43153","ondisk_log_start":"67'43153","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":41749,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 5s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2779906048,"num_objects":42418,"num_object_clones":0,"num_object_copies":127254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42418,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43156,"num_write_kb":2738368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"67'42842","reported_seq":43186,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.652559+0000","last_change":"2026-02-23T13:10:06.461634+0000","last_active":"2026-02-23T13:10:31.652559+0000","last_peered":"2026-02-23T13:10:31.652559+0000","last_clean":"2026-02-23T13:10:31.652559+0000","last_became_active":"2026-02-23T13:08:59.784210+0000","last_became_peered":"2026-02-23T13:08:59.784210+0000","last_unstale":"2026-02-23T13:10:31.652559+0000","last_undegraded":"2026-02-23T13:10:31.652559+0000","last_fullsized":"2026-02-23T13:10:31.652559+0000","mapping_epoch":62,"log_start":"67'42839","ondisk_log_start":"67'42839","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'32118","last_scrub_stamp":"2026-02-23T13:10:06.461563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:06.461563+0000","objects_scrubbed":31388,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:22.890897+0000","scrub_duration":3366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2759720960,"num_objects":42110,"num_object_clones":0,"num_object_copies":126330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42110,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42842,"num_write_kb":2718464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"67'42621","reported_seq":43038,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.648319+0000","last_change":"2026-02-23T13:10:24.387952+0000","last_active":"2026-02-23T13:10:31.648319+0000","last_peered":"2026-02-23T13:10:31.648319+0000","last_clean":"2026-02-23T13:10:31.648319+0000","last_became_active":"2026-02-23T13:08:59.785359+0000","last_became_peered":"2026-02-23T13:08:59.785359+0000","last_unstale":"2026-02-23T13:10:31.648319+0000","last_undegraded":"2026-02-23T13:10:31.648319+0000","last_fullsized":"2026-02-23T13:10:31.648319+0000","mapping_epoch":62,"log_start":"67'42618","ondisk_log_start":"67'42618","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'39419","last_scrub_stamp":"2026-02-23T13:10:24.387875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:24.387875+0000","objects_scrubbed":38695,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:54.083097+0000","scrub_duration":3689,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2746679296,"num_objects":41911,"num_object_clones":0,"num_object_copies":125733,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41911,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42621,"num_write_kb":2705024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"67'43025","reported_seq":43214,"reported_epoch":67,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:10:31.769081+0000","last_change":"2026-02-23T13:10:30.135379+0000","last_active":"2026-02-23T13:10:31.769081+0000","last_peered":"2026-02-23T13:10:31.769081+0000","last_clean":"2026-02-23T13:10:31.769081+0000","last_became_active":"2026-02-23T13:08:59.785106+0000","last_became_peered":"2026-02-23T13:08:59.785106+0000","last_unstale":"2026-02-23T13:10:31.769081+0000","last_undegraded":"2026-02-23T13:10:31.769081+0000","last_fullsized":"2026-02-23T13:10:31.769081+0000","mapping_epoch":62,"log_start":"67'43022","ondisk_log_start":"67'43022","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":16549,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2768568320,"num_objects":42245,"num_object_clones":0,"num_object_copies":126735,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42245,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43025,"num_write_kb":2728640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"67'42991","reported_seq":43382,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.638015+0000","last_change":"2026-02-23T13:10:17.283236+0000","last_active":"2026-02-23T13:10:31.638015+0000","last_peered":"2026-02-23T13:10:31.638015+0000","last_clean":"2026-02-23T13:10:31.638015+0000","last_became_active":"2026-02-23T13:08:59.784457+0000","last_became_peered":"2026-02-23T13:08:59.784457+0000","last_unstale":"2026-02-23T13:10:31.638015+0000","last_undegraded":"2026-02-23T13:10:31.638015+0000","last_fullsized":"2026-02-23T13:10:31.638015+0000","mapping_epoch":62,"log_start":"67'42988","ondisk_log_start":"67'42988","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'36652","last_scrub_stamp":"2026-02-23T13:10:17.283183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:17.283183+0000","objects_scrubbed":35965,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:47.102975+0000","scrub_duration":3592,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2770010112,"num_objects":42267,"num_object_clones":0,"num_object_copies":126801,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42267,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42991,"num_write_kb":2728256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"67'42881","reported_seq":43267,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.761950+0000","last_change":"2026-02-23T13:10:16.715418+0000","last_active":"2026-02-23T13:10:31.761950+0000","last_peered":"2026-02-23T13:10:31.761950+0000","last_clean":"2026-02-23T13:10:31.761950+0000","last_became_active":"2026-02-23T13:08:59.784235+0000","last_became_peered":"2026-02-23T13:08:59.784235+0000","last_unstale":"2026-02-23T13:10:31.761950+0000","last_undegraded":"2026-02-23T13:10:31.761950+0000","last_fullsized":"2026-02-23T13:10:31.761950+0000","mapping_epoch":62,"log_start":"67'42878","ondisk_log_start":"67'42878","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'36136","last_scrub_stamp":"2026-02-23T13:10:16.715358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:16.715358+0000","objects_scrubbed":35429,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:30.935136+0000","scrub_duration":3530,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2755854336,"num_objects":42051,"num_object_clones":0,"num_object_copies":126153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42051,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42881,"num_write_kb":2717824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"67'43140","reported_seq":43477,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.641408+0000","last_change":"2026-02-23T13:10:03.037875+0000","last_active":"2026-02-23T13:10:31.641408+0000","last_peered":"2026-02-23T13:10:31.641408+0000","last_clean":"2026-02-23T13:10:31.641408+0000","last_became_active":"2026-02-23T13:08:59.784318+0000","last_became_peered":"2026-02-23T13:08:59.784318+0000","last_unstale":"2026-02-23T13:10:31.641408+0000","last_undegraded":"2026-02-23T13:10:31.641408+0000","last_fullsized":"2026-02-23T13:10:31.641408+0000","mapping_epoch":62,"log_start":"67'43137","ondisk_log_start":"67'43137","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'30914","last_scrub_stamp":"2026-02-23T13:10:03.037814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:03.037814+0000","objects_scrubbed":30174,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:29.315340+0000","scrub_duration":3318,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2778726400,"num_objects":42400,"num_object_clones":0,"num_object_copies":127200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42400,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43140,"num_write_kb":2737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"67'43024","reported_seq":43399,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.763129+0000","last_change":"2026-02-23T13:10:13.380759+0000","last_active":"2026-02-23T13:10:31.763129+0000","last_peered":"2026-02-23T13:10:31.763129+0000","last_clean":"2026-02-23T13:10:31.763129+0000","last_became_active":"2026-02-23T13:08:59.784463+0000","last_became_peered":"2026-02-23T13:08:59.784463+0000","last_unstale":"2026-02-23T13:10:31.763129+0000","last_undegraded":"2026-02-23T13:10:31.763129+0000","last_fullsized":"2026-02-23T13:10:31.763129+0000","mapping_epoch":62,"log_start":"67'43021","ondisk_log_start":"67'43021","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'35060","last_scrub_stamp":"2026-02-23T13:10:13.380652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:13.380652+0000","objects_scrubbed":34448,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:31.033114+0000","scrub_duration":3163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2766274560,"num_objects":42210,"num_object_clones":0,"num_object_copies":126630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42210,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43024,"num_write_kb":2727488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"67'42981","reported_seq":43345,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.655263+0000","last_change":"2026-02-23T13:10:11.150558+0000","last_active":"2026-02-23T13:10:31.655263+0000","last_peered":"2026-02-23T13:10:31.655263+0000","last_clean":"2026-02-23T13:10:31.655263+0000","last_became_active":"2026-02-23T13:08:59.784436+0000","last_became_peered":"2026-02-23T13:08:59.784436+0000","last_unstale":"2026-02-23T13:10:31.655263+0000","last_undegraded":"2026-02-23T13:10:31.655263+0000","last_fullsized":"2026-02-23T13:10:31.655263+0000","mapping_epoch":62,"log_start":"67'42978","ondisk_log_start":"67'42978","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'34103","last_scrub_stamp":"2026-02-23T13:10:11.150522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:11.150522+0000","objects_scrubbed":33383,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:36.031575+0000","scrub_duration":3995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2769879040,"num_objects":42265,"num_object_clones":0,"num_object_copies":126795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42265,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42981,"num_write_kb":2727872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"67'42793","reported_seq":42814,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.642638+0000","last_change":"2026-02-23T13:08:59.784689+0000","last_active":"2026-02-23T13:10:31.642638+0000","last_peered":"2026-02-23T13:10:31.642638+0000","last_clean":"2026-02-23T13:10:31.642638+0000","last_became_active":"2026-02-23T13:08:59.784290+0000","last_became_peered":"2026-02-23T13:08:59.784290+0000","last_unstale":"2026-02-23T13:10:31.642638+0000","last_undegraded":"2026-02-23T13:10:31.642638+0000","last_fullsized":"2026-02-23T13:10:31.642638+0000","mapping_epoch":62,"log_start":"67'42790","ondisk_log_start":"67'42790","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2755067904,"num_objects":42039,"num_object_clones":0,"num_object_copies":126117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42039,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42793,"num_write_kb":2714624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"67'42680","reported_seq":43051,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.646302+0000","last_change":"2026-02-23T13:10:13.394783+0000","last_active":"2026-02-23T13:10:31.646302+0000","last_peered":"2026-02-23T13:10:31.646302+0000","last_clean":"2026-02-23T13:10:31.646302+0000","last_became_active":"2026-02-23T13:08:59.785634+0000","last_became_peered":"2026-02-23T13:08:59.785634+0000","last_unstale":"2026-02-23T13:10:31.646302+0000","last_undegraded":"2026-02-23T13:10:31.646302+0000","last_fullsized":"2026-02-23T13:10:31.646302+0000","mapping_epoch":62,"log_start":"67'42677","ondisk_log_start":"67'42677","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'34740","last_scrub_stamp":"2026-02-23T13:10:13.394732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:13.394732+0000","objects_scrubbed":34037,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:23.660349+0000","scrub_duration":3642,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2753822720,"num_objects":42020,"num_object_clones":0,"num_object_copies":126060,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42020,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42680,"num_write_kb":2710400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":305,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:30.784324+0000","last_change":"2026-02-23T13:09:15.445539+0000","last_active":"2026-02-23T13:10:30.784324+0000","last_peered":"2026-02-23T13:10:30.784324+0000","last_clean":"2026-02-23T13:10:30.784324+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:10:30.784324+0000","last_undegraded":"2026-02-23T13:10:30.784324+0000","last_fullsized":"2026-02-23T13:10:30.784324+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:09:15.445510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:09:15.445510+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:37.194057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":44220874776,"num_objects":674758,"num_object_clones":0,"num_object_copies":2024274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":674758,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":686760,"num_write_kb":43568513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":132666568704,"data_stored":132666556488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247901,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":34572124,"kb_used_data":32422152,"kb_used_omap":15,"kb_used_meta":2149936,"kb_avail":699431076,"statfs":{"total":751619276800,"available":716217421824,"internally_reserved":0,"allocated":33200283648,"data_stored":33199815833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15743,"internal_metadata":2201535105},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444128,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":38733084,"kb_used_data":37985224,"kb_used_omap":14,"kb_used_meta":747825,"kb_avail":695270116,"statfs":{"total":751619276800,"available":711956598784,"internally_reserved":0,"allocated":38896869376,"data_stored":38896401561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14414,"internal_metadata":765773746},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574946,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":29071252,"kb_used_data":27163712,"kb_used_omap":13,"kb_used_meta":1907506,"kb_avail":704931948,"statfs":{"total":751619276800,"available":721850314752,"internally_reserved":0,"allocated":27815641088,"data_stored":27815180897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13812,"internal_metadata":1953286668},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,2,2,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705763,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":33347932,"kb_used_data":32405128,"kb_used_omap":10,"kb_used_meta":942773,"kb_avail":700655268,"statfs":{"total":751619276800,"available":717470994432,"internally_reserved":0,"allocated":33182851072,"data_stored":33182383257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10991,"internal_metadata":965399825},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33153617920,"data_stored":33153613848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27637317632,"data_stored":27637317632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":38700912640,"data_stored":38700908568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33174720512,"data_stored":33174716440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:10:35.640 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-23T13:10:35.640 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:10:35.640 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:10:35.775 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:35.844 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:35 trial046 ceph-mon[38575]: pgmap v273: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 41 GiB data, 129 GiB used, 2.6 TiB / 2.7 TiB avail; 255 B/s rd, 456 MiB/s wr, 8.79k op/s 2026-02-23T13:10:35.844 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:35 trial046 ceph-mon[38575]: 4.7 scrub ok 2026-02-23T13:10:35.844 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:35 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4104432624' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:10:35.895 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:35.894+0000 7fe6bd279640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:35.896 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:35.895+0000 7fe6bd279640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:36.043 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:10:36.043 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:10:36.087 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":273,"stamp":"2026-02-23T13:10:34.651124+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":44221465144,"num_objects":674760,"num_object_clones":0,"num_object_copies":2024280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":674760,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":686895,"num_write_kb":43570663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":135724392,"kb_used_data":129976216,"kb_used_omap":53,"kb_used_meta":5748042,"kb_avail":2800288408,"statfs":{"total":3006477107200,"available":2867495329792,"internally_reserved":0,"allocated":133095645184,"data_stored":133093781548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":54960,"internal_metadata":5885995344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[22,5,3,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1518207000,"num_objects":23167,"num_object_clones":0,"num_object_copies":69501,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23167,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":35169,"num_write_kb":1866689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000475"},"pg_stats":[{"pgid":"4.f","version":"67'43210","reported_seq":43608,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.768244+0000","last_change":"2026-02-23T13:10:18.889561+0000","last_active":"2026-02-23T13:10:31.768244+0000","last_peered":"2026-02-23T13:10:31.768244+0000","last_clean":"2026-02-23T13:10:31.768244+0000","last_became_active":"2026-02-23T13:08:59.784888+0000","last_became_peered":"2026-02-23T13:08:59.784888+0000","last_unstale":"2026-02-23T13:10:31.768244+0000","last_undegraded":"2026-02-23T13:10:31.768244+0000","last_fullsized":"2026-02-23T13:10:31.768244+0000","mapping_epoch":62,"log_start":"67'43207","ondisk_log_start":"67'43207","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'37338","last_scrub_stamp":"2026-02-23T13:10:18.889417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:18.889417+0000","objects_scrubbed":36552,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:46.655322+0000","scrub_duration":3662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2781216768,"num_objects":42438,"num_object_clones":0,"num_object_copies":127314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42438,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43210,"num_write_kb":2740736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"67'42411","reported_seq":42836,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.651982+0000","last_change":"2026-02-23T13:10:27.126280+0000","last_active":"2026-02-23T13:10:31.651982+0000","last_peered":"2026-02-23T13:10:31.651982+0000","last_clean":"2026-02-23T13:10:31.651982+0000","last_became_active":"2026-02-23T13:08:59.785397+0000","last_became_peered":"2026-02-23T13:08:59.785397+0000","last_unstale":"2026-02-23T13:10:31.651982+0000","last_undegraded":"2026-02-23T13:10:31.651982+0000","last_fullsized":"2026-02-23T13:10:31.651982+0000","mapping_epoch":62,"log_start":"67'42408","ondisk_log_start":"67'42408","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'40440","last_scrub_stamp":"2026-02-23T13:10:27.126174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:27.126174+0000","objects_scrubbed":39592,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:48.254573+0000","scrub_duration":3978,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2729508864,"num_objects":41649,"num_object_clones":0,"num_object_copies":124947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41649,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42411,"num_write_kb":2689920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"67'42921","reported_seq":43275,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.644798+0000","last_change":"2026-02-23T13:10:07.875495+0000","last_active":"2026-02-23T13:10:31.644798+0000","last_peered":"2026-02-23T13:10:31.644798+0000","last_clean":"2026-02-23T13:10:31.644798+0000","last_became_active":"2026-02-23T13:08:59.785780+0000","last_became_peered":"2026-02-23T13:08:59.785780+0000","last_unstale":"2026-02-23T13:10:31.644798+0000","last_undegraded":"2026-02-23T13:10:31.644798+0000","last_fullsized":"2026-02-23T13:10:31.644798+0000","mapping_epoch":62,"log_start":"67'42918","ondisk_log_start":"67'42918","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'32743","last_scrub_stamp":"2026-02-23T13:10:07.875449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:07.875449+0000","objects_scrubbed":32129,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:15.294906+0000","scrub_duration":3040,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2764701720,"num_objects":42187,"num_object_clones":0,"num_object_copies":126561,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42187,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":42921,"num_write_kb":2723393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"67'43231","reported_seq":43662,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.645617+0000","last_change":"2026-02-23T13:10:26.384628+0000","last_active":"2026-02-23T13:10:31.645617+0000","last_peered":"2026-02-23T13:10:31.645617+0000","last_clean":"2026-02-23T13:10:31.645617+0000","last_became_active":"2026-02-23T13:08:59.783982+0000","last_became_peered":"2026-02-23T13:08:59.783982+0000","last_unstale":"2026-02-23T13:10:31.645617+0000","last_undegraded":"2026-02-23T13:10:31.645617+0000","last_fullsized":"2026-02-23T13:10:31.645617+0000","mapping_epoch":62,"log_start":"67'43228","ondisk_log_start":"67'43228","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'40924","last_scrub_stamp":"2026-02-23T13:10:26.384602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:26.384602+0000","objects_scrubbed":40159,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:51.409315+0000","scrub_duration":3763,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2785476608,"num_objects":42503,"num_object_clones":0,"num_object_copies":127509,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42503,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43231,"num_write_kb":2743488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"67'42853","reported_seq":42888,"reported_epoch":67,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:10:31.645684+0000","last_change":"2026-02-23T13:10:31.564830+0000","last_active":"2026-02-23T13:10:31.645684+0000","last_peered":"2026-02-23T13:10:31.645684+0000","last_clean":"2026-02-23T13:10:31.645684+0000","last_became_active":"2026-02-23T13:08:59.784710+0000","last_became_peered":"2026-02-23T13:08:59.784710+0000","last_unstale":"2026-02-23T13:10:31.645684+0000","last_undegraded":"2026-02-23T13:10:31.645684+0000","last_fullsized":"2026-02-23T13:10:31.645684+0000","mapping_epoch":62,"log_start":"67'42850","ondisk_log_start":"67'42850","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":999,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2755461120,"num_objects":42045,"num_object_clones":0,"num_object_copies":126135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42045,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42853,"num_write_kb":2716736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"67'43156","reported_seq":43602,"reported_epoch":67,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:10:31.656882+0000","last_change":"2026-02-23T13:10:27.178982+0000","last_active":"2026-02-23T13:10:31.656882+0000","last_peered":"2026-02-23T13:10:31.656882+0000","last_clean":"2026-02-23T13:10:31.656882+0000","last_became_active":"2026-02-23T13:08:59.784218+0000","last_became_peered":"2026-02-23T13:08:59.784218+0000","last_unstale":"2026-02-23T13:10:31.656882+0000","last_undegraded":"2026-02-23T13:10:31.656882+0000","last_fullsized":"2026-02-23T13:10:31.656882+0000","mapping_epoch":62,"log_start":"67'43153","ondisk_log_start":"67'43153","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":41749,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 5s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2779906048,"num_objects":42418,"num_object_clones":0,"num_object_copies":127254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42418,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43156,"num_write_kb":2738368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"67'42842","reported_seq":43186,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.652559+0000","last_change":"2026-02-23T13:10:06.461634+0000","last_active":"2026-02-23T13:10:31.652559+0000","last_peered":"2026-02-23T13:10:31.652559+0000","last_clean":"2026-02-23T13:10:31.652559+0000","last_became_active":"2026-02-23T13:08:59.784210+0000","last_became_peered":"2026-02-23T13:08:59.784210+0000","last_unstale":"2026-02-23T13:10:31.652559+0000","last_undegraded":"2026-02-23T13:10:31.652559+0000","last_fullsized":"2026-02-23T13:10:31.652559+0000","mapping_epoch":62,"log_start":"67'42839","ondisk_log_start":"67'42839","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'32118","last_scrub_stamp":"2026-02-23T13:10:06.461563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:06.461563+0000","objects_scrubbed":31388,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:22.890897+0000","scrub_duration":3366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2759720960,"num_objects":42110,"num_object_clones":0,"num_object_copies":126330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42110,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42842,"num_write_kb":2718464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"67'42621","reported_seq":43038,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.648319+0000","last_change":"2026-02-23T13:10:24.387952+0000","last_active":"2026-02-23T13:10:31.648319+0000","last_peered":"2026-02-23T13:10:31.648319+0000","last_clean":"2026-02-23T13:10:31.648319+0000","last_became_active":"2026-02-23T13:08:59.785359+0000","last_became_peered":"2026-02-23T13:08:59.785359+0000","last_unstale":"2026-02-23T13:10:31.648319+0000","last_undegraded":"2026-02-23T13:10:31.648319+0000","last_fullsized":"2026-02-23T13:10:31.648319+0000","mapping_epoch":62,"log_start":"67'42618","ondisk_log_start":"67'42618","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'39419","last_scrub_stamp":"2026-02-23T13:10:24.387875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:24.387875+0000","objects_scrubbed":38695,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:54.083097+0000","scrub_duration":3689,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2746679296,"num_objects":41911,"num_object_clones":0,"num_object_copies":125733,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41911,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42621,"num_write_kb":2705024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"67'43025","reported_seq":43214,"reported_epoch":67,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:10:31.769081+0000","last_change":"2026-02-23T13:10:30.135379+0000","last_active":"2026-02-23T13:10:31.769081+0000","last_peered":"2026-02-23T13:10:31.769081+0000","last_clean":"2026-02-23T13:10:31.769081+0000","last_became_active":"2026-02-23T13:08:59.785106+0000","last_became_peered":"2026-02-23T13:08:59.785106+0000","last_unstale":"2026-02-23T13:10:31.769081+0000","last_undegraded":"2026-02-23T13:10:31.769081+0000","last_fullsized":"2026-02-23T13:10:31.769081+0000","mapping_epoch":62,"log_start":"67'43022","ondisk_log_start":"67'43022","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":16549,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2768568320,"num_objects":42245,"num_object_clones":0,"num_object_copies":126735,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42245,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43025,"num_write_kb":2728640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"67'42991","reported_seq":43382,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.638015+0000","last_change":"2026-02-23T13:10:17.283236+0000","last_active":"2026-02-23T13:10:31.638015+0000","last_peered":"2026-02-23T13:10:31.638015+0000","last_clean":"2026-02-23T13:10:31.638015+0000","last_became_active":"2026-02-23T13:08:59.784457+0000","last_became_peered":"2026-02-23T13:08:59.784457+0000","last_unstale":"2026-02-23T13:10:31.638015+0000","last_undegraded":"2026-02-23T13:10:31.638015+0000","last_fullsized":"2026-02-23T13:10:31.638015+0000","mapping_epoch":62,"log_start":"67'42988","ondisk_log_start":"67'42988","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'36652","last_scrub_stamp":"2026-02-23T13:10:17.283183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:17.283183+0000","objects_scrubbed":35965,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:47.102975+0000","scrub_duration":3592,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2770010112,"num_objects":42267,"num_object_clones":0,"num_object_copies":126801,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42267,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42991,"num_write_kb":2728256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"67'42881","reported_seq":43267,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.761950+0000","last_change":"2026-02-23T13:10:16.715418+0000","last_active":"2026-02-23T13:10:31.761950+0000","last_peered":"2026-02-23T13:10:31.761950+0000","last_clean":"2026-02-23T13:10:31.761950+0000","last_became_active":"2026-02-23T13:08:59.784235+0000","last_became_peered":"2026-02-23T13:08:59.784235+0000","last_unstale":"2026-02-23T13:10:31.761950+0000","last_undegraded":"2026-02-23T13:10:31.761950+0000","last_fullsized":"2026-02-23T13:10:31.761950+0000","mapping_epoch":62,"log_start":"67'42878","ondisk_log_start":"67'42878","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'36136","last_scrub_stamp":"2026-02-23T13:10:16.715358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:16.715358+0000","objects_scrubbed":35429,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:30.935136+0000","scrub_duration":3530,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2755854336,"num_objects":42051,"num_object_clones":0,"num_object_copies":126153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42051,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42881,"num_write_kb":2717824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"67'43140","reported_seq":43477,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.641408+0000","last_change":"2026-02-23T13:10:03.037875+0000","last_active":"2026-02-23T13:10:31.641408+0000","last_peered":"2026-02-23T13:10:31.641408+0000","last_clean":"2026-02-23T13:10:31.641408+0000","last_became_active":"2026-02-23T13:08:59.784318+0000","last_became_peered":"2026-02-23T13:08:59.784318+0000","last_unstale":"2026-02-23T13:10:31.641408+0000","last_undegraded":"2026-02-23T13:10:31.641408+0000","last_fullsized":"2026-02-23T13:10:31.641408+0000","mapping_epoch":62,"log_start":"67'43137","ondisk_log_start":"67'43137","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'30914","last_scrub_stamp":"2026-02-23T13:10:03.037814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:03.037814+0000","objects_scrubbed":30174,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:29.315340+0000","scrub_duration":3318,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2778726400,"num_objects":42400,"num_object_clones":0,"num_object_copies":127200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42400,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43140,"num_write_kb":2737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"67'43024","reported_seq":43399,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.763129+0000","last_change":"2026-02-23T13:10:13.380759+0000","last_active":"2026-02-23T13:10:31.763129+0000","last_peered":"2026-02-23T13:10:31.763129+0000","last_clean":"2026-02-23T13:10:31.763129+0000","last_became_active":"2026-02-23T13:08:59.784463+0000","last_became_peered":"2026-02-23T13:08:59.784463+0000","last_unstale":"2026-02-23T13:10:31.763129+0000","last_undegraded":"2026-02-23T13:10:31.763129+0000","last_fullsized":"2026-02-23T13:10:31.763129+0000","mapping_epoch":62,"log_start":"67'43021","ondisk_log_start":"67'43021","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'35060","last_scrub_stamp":"2026-02-23T13:10:13.380652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:13.380652+0000","objects_scrubbed":34448,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:31.033114+0000","scrub_duration":3163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2766274560,"num_objects":42210,"num_object_clones":0,"num_object_copies":126630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42210,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43024,"num_write_kb":2727488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"67'42981","reported_seq":43345,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.655263+0000","last_change":"2026-02-23T13:10:11.150558+0000","last_active":"2026-02-23T13:10:31.655263+0000","last_peered":"2026-02-23T13:10:31.655263+0000","last_clean":"2026-02-23T13:10:31.655263+0000","last_became_active":"2026-02-23T13:08:59.784436+0000","last_became_peered":"2026-02-23T13:08:59.784436+0000","last_unstale":"2026-02-23T13:10:31.655263+0000","last_undegraded":"2026-02-23T13:10:31.655263+0000","last_fullsized":"2026-02-23T13:10:31.655263+0000","mapping_epoch":62,"log_start":"67'42978","ondisk_log_start":"67'42978","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'34103","last_scrub_stamp":"2026-02-23T13:10:11.150522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:11.150522+0000","objects_scrubbed":33383,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:36.031575+0000","scrub_duration":3995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2769879040,"num_objects":42265,"num_object_clones":0,"num_object_copies":126795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42265,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42981,"num_write_kb":2727872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"67'42793","reported_seq":42814,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.642638+0000","last_change":"2026-02-23T13:08:59.784689+0000","last_active":"2026-02-23T13:10:31.642638+0000","last_peered":"2026-02-23T13:10:31.642638+0000","last_clean":"2026-02-23T13:10:31.642638+0000","last_became_active":"2026-02-23T13:08:59.784290+0000","last_became_peered":"2026-02-23T13:08:59.784290+0000","last_unstale":"2026-02-23T13:10:31.642638+0000","last_undegraded":"2026-02-23T13:10:31.642638+0000","last_fullsized":"2026-02-23T13:10:31.642638+0000","mapping_epoch":62,"log_start":"67'42790","ondisk_log_start":"67'42790","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2755067904,"num_objects":42039,"num_object_clones":0,"num_object_copies":126117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42039,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42793,"num_write_kb":2714624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"67'42680","reported_seq":43051,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:31.646302+0000","last_change":"2026-02-23T13:10:13.394783+0000","last_active":"2026-02-23T13:10:31.646302+0000","last_peered":"2026-02-23T13:10:31.646302+0000","last_clean":"2026-02-23T13:10:31.646302+0000","last_became_active":"2026-02-23T13:08:59.785634+0000","last_became_peered":"2026-02-23T13:08:59.785634+0000","last_unstale":"2026-02-23T13:10:31.646302+0000","last_undegraded":"2026-02-23T13:10:31.646302+0000","last_fullsized":"2026-02-23T13:10:31.646302+0000","mapping_epoch":62,"log_start":"67'42677","ondisk_log_start":"67'42677","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'34740","last_scrub_stamp":"2026-02-23T13:10:13.394732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:13.394732+0000","objects_scrubbed":34037,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:23.660349+0000","scrub_duration":3642,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2753822720,"num_objects":42020,"num_object_clones":0,"num_object_copies":126060,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42020,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42680,"num_write_kb":2710400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":305,"reported_epoch":67,"state":"active+clean","last_fresh":"2026-02-23T13:10:30.784324+0000","last_change":"2026-02-23T13:09:15.445539+0000","last_active":"2026-02-23T13:10:30.784324+0000","last_peered":"2026-02-23T13:10:30.784324+0000","last_clean":"2026-02-23T13:10:30.784324+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:10:30.784324+0000","last_undegraded":"2026-02-23T13:10:30.784324+0000","last_fullsized":"2026-02-23T13:10:30.784324+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:09:15.445510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:09:15.445510+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:37.194057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":44220874776,"num_objects":674758,"num_object_clones":0,"num_object_copies":2024274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":674758,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":686760,"num_write_kb":43568513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":132666568704,"data_stored":132666556488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247901,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":34572124,"kb_used_data":32422152,"kb_used_omap":15,"kb_used_meta":2149936,"kb_avail":699431076,"statfs":{"total":751619276800,"available":716217421824,"internally_reserved":0,"allocated":33200283648,"data_stored":33199815833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15743,"internal_metadata":2201535105},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444128,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":38733084,"kb_used_data":37985224,"kb_used_omap":14,"kb_used_meta":747825,"kb_avail":695270116,"statfs":{"total":751619276800,"available":711956598784,"internally_reserved":0,"allocated":38896869376,"data_stored":38896401561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14414,"internal_metadata":765773746},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574946,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":29071252,"kb_used_data":27163712,"kb_used_omap":13,"kb_used_meta":1907506,"kb_avail":704931948,"statfs":{"total":751619276800,"available":721850314752,"internally_reserved":0,"allocated":27815641088,"data_stored":27815180897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13812,"internal_metadata":1953286668},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,2,2,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705763,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":33347932,"kb_used_data":32405128,"kb_used_omap":10,"kb_used_meta":942773,"kb_avail":700655268,"statfs":{"total":751619276800,"available":717470994432,"internally_reserved":0,"allocated":33182851072,"data_stored":33182383257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10991,"internal_metadata":965399825},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33153617920,"data_stored":33153613848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27637317632,"data_stored":27637317632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":38700912640,"data_stored":38700908568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33174720512,"data_stored":33174716440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:10:36.289 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:10:36 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:10:36] "GET /metrics HTTP/1.1" 200 4209 "" "Prometheus/3.6.0" 2026-02-23T13:10:36.561 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:10:36 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:10:36.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:10:37.240 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:10:37.265 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:36 trial046 ceph-mon[38575]: from='client.15032 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:10:37.265 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:36 trial046 ceph-mon[38575]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:10:37.389 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:37.515 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:37.514+0000 7fe09bb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:37.515 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:37.514+0000 7fe09bb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:37.531 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:10:37.531 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:10:37.544 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:10:37.545 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:10:37.559 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:10:37.559 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:10:37.571 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:10:37.571 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:10:38.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:37 trial046 ceph-mon[38575]: from='client.15038 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:10:38.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:37 trial046 ceph-mon[38575]: 4.b scrub ok 2026-02-23T13:10:38.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:37 trial046 ceph-mon[38575]: pgmap v274: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 40 GiB data, 126 GiB used, 2.6 TiB / 2.7 TiB avail; 174 B/s rd, 311 MiB/s wr, 8.71k op/s 2026-02-23T13:10:38.290 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:37 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1021243800' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:10:39.615 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:10:39.756 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:39.876 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:39.874+0000 7f3c30747640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:39.876 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:39.875+0000 7f3c30747640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:39.890 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:10:39.890 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:10:39.903 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:10:39.903 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:10:39.904 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:39 trial046 ceph-mon[38575]: pgmap v275: 17 pgs: 17 active+clean; 39 GiB data, 123 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 4.67k op/s 2026-02-23T13:10:39.904 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:39 trial046 ceph-mon[38575]: osdmap e71: 4 total, 4 up, 4 in 2026-02-23T13:10:39.918 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:10:39.919 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:10:39.930 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:10:39.931 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:10:41.090 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:10:41.090 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:10:41.090 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:10:41.090 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:10:41.116 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:40 trial046 ceph-mon[38575]: 4.0 scrub starts 2026-02-23T13:10:41.116 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:40 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/915517037' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:10:41.239 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:41.546 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:41.545+0000 7f6bac0c3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:41.547 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:41.545+0000 7f6bac0c3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:41.687 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:10:41.687 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:10:41.731 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":277,"stamp":"2026-02-23T13:10:40.651884+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":42120446520,"num_objects":642701,"num_object_clones":0,"num_object_copies":1928103,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":642701,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":718954,"num_write_kb":43570663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":128870840,"kb_used_data":123970664,"kb_used_omap":55,"kb_used_meta":4899912,"kb_avail":2807141960,"statfs":{"total":3006477107200,"available":2874513367040,"internally_reserved":0,"allocated":126945959936,"data_stored":126944001720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57208,"internal_metadata":5017510024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[12,4],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2101018624,"num_objects":-32059,"num_object_clones":0,"num_object_copies":-96177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-32059,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32059,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.862487"},"pg_stats":[{"pgid":"4.f","version":"70'45290","reported_seq":45694,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-23T13:10:36.767896+0000","last_change":"2026-02-23T13:10:18.889561+0000","last_active":"2026-02-23T13:10:36.767896+0000","last_peered":"2026-02-23T13:10:36.767896+0000","last_clean":"2026-02-23T13:10:36.767896+0000","last_became_active":"2026-02-23T13:08:59.784888+0000","last_became_peered":"2026-02-23T13:08:59.784888+0000","last_unstale":"2026-02-23T13:10:36.767896+0000","last_undegraded":"2026-02-23T13:10:36.767896+0000","last_fullsized":"2026-02-23T13:10:36.767896+0000","mapping_epoch":62,"log_start":"70'45287","ondisk_log_start":"70'45287","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'37338","last_scrub_stamp":"2026-02-23T13:10:18.889417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:18.889417+0000","objects_scrubbed":36552,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:46.655322+0000","scrub_duration":3662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2644901888,"num_objects":40358,"num_object_clones":0,"num_object_copies":121074,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40358,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45290,"num_write_kb":2740736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"70'44357","reported_seq":44788,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-23T13:10:36.656036+0000","last_change":"2026-02-23T13:10:27.126280+0000","last_active":"2026-02-23T13:10:36.656036+0000","last_peered":"2026-02-23T13:10:36.656036+0000","last_clean":"2026-02-23T13:10:36.656036+0000","last_became_active":"2026-02-23T13:08:59.785397+0000","last_became_peered":"2026-02-23T13:08:59.785397+0000","last_unstale":"2026-02-23T13:10:36.656036+0000","last_undegraded":"2026-02-23T13:10:36.656036+0000","last_fullsized":"2026-02-23T13:10:36.656036+0000","mapping_epoch":62,"log_start":"70'44354","ondisk_log_start":"70'44354","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'40440","last_scrub_stamp":"2026-02-23T13:10:27.126174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:27.126174+0000","objects_scrubbed":39592,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:48.254573+0000","scrub_duration":3978,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2601975808,"num_objects":39703,"num_object_clones":0,"num_object_copies":119109,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39703,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44357,"num_write_kb":2689920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"70'44888","reported_seq":45247,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-23T13:10:36.647131+0000","last_change":"2026-02-23T13:10:07.875495+0000","last_active":"2026-02-23T13:10:36.647131+0000","last_peered":"2026-02-23T13:10:36.647131+0000","last_clean":"2026-02-23T13:10:36.647131+0000","last_became_active":"2026-02-23T13:08:59.785780+0000","last_became_peered":"2026-02-23T13:08:59.785780+0000","last_unstale":"2026-02-23T13:10:36.647131+0000","last_undegraded":"2026-02-23T13:10:36.647131+0000","last_fullsized":"2026-02-23T13:10:36.647131+0000","mapping_epoch":62,"log_start":"70'44885","ondisk_log_start":"70'44885","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'32743","last_scrub_stamp":"2026-02-23T13:10:07.875449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:07.875449+0000","objects_scrubbed":32129,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:15.294906+0000","scrub_duration":3040,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2635792408,"num_objects":40220,"num_object_clones":0,"num_object_copies":120660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40220,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":44888,"num_write_kb":2723393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"70'45207","reported_seq":45644,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-23T13:10:36.642767+0000","last_change":"2026-02-23T13:10:26.384628+0000","last_active":"2026-02-23T13:10:36.642767+0000","last_peered":"2026-02-23T13:10:36.642767+0000","last_clean":"2026-02-23T13:10:36.642767+0000","last_became_active":"2026-02-23T13:08:59.783982+0000","last_became_peered":"2026-02-23T13:08:59.783982+0000","last_unstale":"2026-02-23T13:10:36.642767+0000","last_undegraded":"2026-02-23T13:10:36.642767+0000","last_fullsized":"2026-02-23T13:10:36.642767+0000","mapping_epoch":62,"log_start":"70'45204","ondisk_log_start":"70'45204","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'40924","last_scrub_stamp":"2026-02-23T13:10:26.384602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:26.384602+0000","objects_scrubbed":40159,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:51.409315+0000","scrub_duration":3763,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2655977472,"num_objects":40527,"num_object_clones":0,"num_object_copies":121581,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40527,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45207,"num_write_kb":2743488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"70'44855","reported_seq":45304,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-23T13:10:36.646368+0000","last_change":"2026-02-23T13:10:36.436883+0000","last_active":"2026-02-23T13:10:36.646368+0000","last_peered":"2026-02-23T13:10:36.646368+0000","last_clean":"2026-02-23T13:10:36.646368+0000","last_became_active":"2026-02-23T13:08:59.784710+0000","last_became_peered":"2026-02-23T13:08:59.784710+0000","last_unstale":"2026-02-23T13:10:36.646368+0000","last_undegraded":"2026-02-23T13:10:36.646368+0000","last_fullsized":"2026-02-23T13:10:36.646368+0000","mapping_epoch":62,"log_start":"70'44852","ondisk_log_start":"70'44852","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'44729","last_scrub_stamp":"2026-02-23T13:10:36.436786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:36.436786+0000","objects_scrubbed":41142,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:51.122805+0000","scrub_duration":4872,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2624258048,"num_objects":40043,"num_object_clones":0,"num_object_copies":120129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40043,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44855,"num_write_kb":2716736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"70'45267","reported_seq":45728,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-23T13:10:36.656817+0000","last_change":"2026-02-23T13:10:31.717671+0000","last_active":"2026-02-23T13:10:36.656817+0000","last_peered":"2026-02-23T13:10:36.656817+0000","last_clean":"2026-02-23T13:10:36.656817+0000","last_became_active":"2026-02-23T13:08:59.784218+0000","last_became_peered":"2026-02-23T13:08:59.784218+0000","last_unstale":"2026-02-23T13:10:36.656817+0000","last_undegraded":"2026-02-23T13:10:36.656817+0000","last_fullsized":"2026-02-23T13:10:36.656817+0000","mapping_epoch":62,"log_start":"70'45264","ondisk_log_start":"70'45264","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'43162","last_scrub_stamp":"2026-02-23T13:10:31.717638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:31.717638+0000","objects_scrubbed":42156,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:36.022448+0000","scrub_duration":4538,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2641559552,"num_objects":40307,"num_object_clones":0,"num_object_copies":120921,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40307,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45267,"num_write_kb":2738368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"70'44874","reported_seq":45224,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-23T13:10:36.656010+0000","last_change":"2026-02-23T13:10:06.461634+0000","last_active":"2026-02-23T13:10:36.656010+0000","last_peered":"2026-02-23T13:10:36.656010+0000","last_clean":"2026-02-23T13:10:36.656010+0000","last_became_active":"2026-02-23T13:08:59.784210+0000","last_became_peered":"2026-02-23T13:08:59.784210+0000","last_unstale":"2026-02-23T13:10:36.656010+0000","last_undegraded":"2026-02-23T13:10:36.656010+0000","last_fullsized":"2026-02-23T13:10:36.656010+0000","mapping_epoch":62,"log_start":"70'44871","ondisk_log_start":"70'44871","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'32118","last_scrub_stamp":"2026-02-23T13:10:06.461563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:06.461563+0000","objects_scrubbed":31388,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:22.890897+0000","scrub_duration":3366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2626551808,"num_objects":40078,"num_object_clones":0,"num_object_copies":120234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40078,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44874,"num_write_kb":2718464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"70'44571","reported_seq":44994,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-23T13:10:36.646738+0000","last_change":"2026-02-23T13:10:24.387952+0000","last_active":"2026-02-23T13:10:36.646738+0000","last_peered":"2026-02-23T13:10:36.646738+0000","last_clean":"2026-02-23T13:10:36.646738+0000","last_became_active":"2026-02-23T13:08:59.785359+0000","last_became_peered":"2026-02-23T13:08:59.785359+0000","last_unstale":"2026-02-23T13:10:36.646738+0000","last_undegraded":"2026-02-23T13:10:36.646738+0000","last_fullsized":"2026-02-23T13:10:36.646738+0000","mapping_epoch":62,"log_start":"70'44568","ondisk_log_start":"70'44568","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'39419","last_scrub_stamp":"2026-02-23T13:10:24.387875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:24.387875+0000","objects_scrubbed":38695,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:54.083097+0000","scrub_duration":3689,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2618884096,"num_objects":39961,"num_object_clones":0,"num_object_copies":119883,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39961,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44571,"num_write_kb":2705024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"70'44973","reported_seq":45430,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-23T13:10:36.765515+0000","last_change":"2026-02-23T13:10:34.960546+0000","last_active":"2026-02-23T13:10:36.765515+0000","last_peered":"2026-02-23T13:10:36.765515+0000","last_clean":"2026-02-23T13:10:36.765515+0000","last_became_active":"2026-02-23T13:08:59.785106+0000","last_became_peered":"2026-02-23T13:08:59.785106+0000","last_unstale":"2026-02-23T13:10:36.765515+0000","last_undegraded":"2026-02-23T13:10:36.765515+0000","last_fullsized":"2026-02-23T13:10:36.765515+0000","mapping_epoch":62,"log_start":"70'44970","ondisk_log_start":"70'44970","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'44040","last_scrub_stamp":"2026-02-23T13:10:34.960505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:34.960505+0000","objects_scrubbed":42002,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:42.696429+0000","scrub_duration":4826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2640904192,"num_objects":40297,"num_object_clones":0,"num_object_copies":120891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40297,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44973,"num_write_kb":2728640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"70'44908","reported_seq":45305,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-23T13:10:36.646129+0000","last_change":"2026-02-23T13:10:17.283236+0000","last_active":"2026-02-23T13:10:36.646129+0000","last_peered":"2026-02-23T13:10:36.646129+0000","last_clean":"2026-02-23T13:10:36.646129+0000","last_became_active":"2026-02-23T13:08:59.784457+0000","last_became_peered":"2026-02-23T13:08:59.784457+0000","last_unstale":"2026-02-23T13:10:36.646129+0000","last_undegraded":"2026-02-23T13:10:36.646129+0000","last_fullsized":"2026-02-23T13:10:36.646129+0000","mapping_epoch":62,"log_start":"70'44905","ondisk_log_start":"70'44905","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'36652","last_scrub_stamp":"2026-02-23T13:10:17.283183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:17.283183+0000","objects_scrubbed":35965,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:47.102975+0000","scrub_duration":3592,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2644377600,"num_objects":40350,"num_object_clones":0,"num_object_copies":121050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40350,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44908,"num_write_kb":2728256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"70'44891","reported_seq":45283,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-23T13:10:36.763998+0000","last_change":"2026-02-23T13:10:16.715418+0000","last_active":"2026-02-23T13:10:36.763998+0000","last_peered":"2026-02-23T13:10:36.763998+0000","last_clean":"2026-02-23T13:10:36.763998+0000","last_became_active":"2026-02-23T13:08:59.784235+0000","last_became_peered":"2026-02-23T13:08:59.784235+0000","last_unstale":"2026-02-23T13:10:36.763998+0000","last_undegraded":"2026-02-23T13:10:36.763998+0000","last_fullsized":"2026-02-23T13:10:36.763998+0000","mapping_epoch":62,"log_start":"70'44888","ondisk_log_start":"70'44888","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'36136","last_scrub_stamp":"2026-02-23T13:10:16.715358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:16.715358+0000","objects_scrubbed":35429,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:30.935136+0000","scrub_duration":3530,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2624126976,"num_objects":40041,"num_object_clones":0,"num_object_copies":120123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40041,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44891,"num_write_kb":2717824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"70'45190","reported_seq":45533,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-23T13:10:36.643268+0000","last_change":"2026-02-23T13:10:03.037875+0000","last_active":"2026-02-23T13:10:36.643268+0000","last_peered":"2026-02-23T13:10:36.643268+0000","last_clean":"2026-02-23T13:10:36.643268+0000","last_became_active":"2026-02-23T13:08:59.784318+0000","last_became_peered":"2026-02-23T13:08:59.784318+0000","last_unstale":"2026-02-23T13:10:36.643268+0000","last_undegraded":"2026-02-23T13:10:36.643268+0000","last_fullsized":"2026-02-23T13:10:36.643268+0000","mapping_epoch":62,"log_start":"70'45187","ondisk_log_start":"70'45187","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'30914","last_scrub_stamp":"2026-02-23T13:10:03.037814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:03.037814+0000","objects_scrubbed":30174,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:29.315340+0000","scrub_duration":3318,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2644377600,"num_objects":40350,"num_object_clones":0,"num_object_copies":121050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40350,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45190,"num_write_kb":2737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"70'45069","reported_seq":45450,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-23T13:10:36.762239+0000","last_change":"2026-02-23T13:10:13.380759+0000","last_active":"2026-02-23T13:10:36.762239+0000","last_peered":"2026-02-23T13:10:36.762239+0000","last_clean":"2026-02-23T13:10:36.762239+0000","last_became_active":"2026-02-23T13:08:59.784463+0000","last_became_peered":"2026-02-23T13:08:59.784463+0000","last_unstale":"2026-02-23T13:10:36.762239+0000","last_undegraded":"2026-02-23T13:10:36.762239+0000","last_fullsized":"2026-02-23T13:10:36.762239+0000","mapping_epoch":62,"log_start":"70'45066","ondisk_log_start":"70'45066","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'35060","last_scrub_stamp":"2026-02-23T13:10:13.380652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:13.380652+0000","objects_scrubbed":34448,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:31.033114+0000","scrub_duration":3163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2632253440,"num_objects":40165,"num_object_clones":0,"num_object_copies":120495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40165,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45069,"num_write_kb":2727488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"70'44949","reported_seq":45319,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-23T13:10:36.654880+0000","last_change":"2026-02-23T13:10:11.150558+0000","last_active":"2026-02-23T13:10:36.654880+0000","last_peered":"2026-02-23T13:10:36.654880+0000","last_clean":"2026-02-23T13:10:36.654880+0000","last_became_active":"2026-02-23T13:08:59.784436+0000","last_became_peered":"2026-02-23T13:08:59.784436+0000","last_unstale":"2026-02-23T13:10:36.654880+0000","last_undegraded":"2026-02-23T13:10:36.654880+0000","last_fullsized":"2026-02-23T13:10:36.654880+0000","mapping_epoch":62,"log_start":"70'44946","ondisk_log_start":"70'44946","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'34103","last_scrub_stamp":"2026-02-23T13:10:11.150522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:11.150522+0000","objects_scrubbed":33383,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:36.031575+0000","scrub_duration":3995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2640904192,"num_objects":40297,"num_object_clones":0,"num_object_copies":120891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40297,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44949,"num_write_kb":2727872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"70'44826","reported_seq":44853,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-23T13:10:36.644199+0000","last_change":"2026-02-23T13:08:59.784689+0000","last_active":"2026-02-23T13:10:36.644199+0000","last_peered":"2026-02-23T13:10:36.644199+0000","last_clean":"2026-02-23T13:10:36.644199+0000","last_became_active":"2026-02-23T13:08:59.784290+0000","last_became_peered":"2026-02-23T13:08:59.784290+0000","last_unstale":"2026-02-23T13:10:36.644199+0000","last_undegraded":"2026-02-23T13:10:36.644199+0000","last_fullsized":"2026-02-23T13:10:36.644199+0000","mapping_epoch":62,"log_start":"70'44823","ondisk_log_start":"70'44823","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:08:58.774458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621833216,"num_objects":40006,"num_object_clones":0,"num_object_copies":120018,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40006,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44826,"num_write_kb":2714624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"70'44704","reported_seq":45081,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-23T13:10:36.647049+0000","last_change":"2026-02-23T13:10:13.394783+0000","last_active":"2026-02-23T13:10:36.647049+0000","last_peered":"2026-02-23T13:10:36.647049+0000","last_clean":"2026-02-23T13:10:36.647049+0000","last_became_active":"2026-02-23T13:08:59.785634+0000","last_became_peered":"2026-02-23T13:08:59.785634+0000","last_unstale":"2026-02-23T13:10:36.647049+0000","last_undegraded":"2026-02-23T13:10:36.647049+0000","last_fullsized":"2026-02-23T13:10:36.647049+0000","mapping_epoch":62,"log_start":"70'44701","ondisk_log_start":"70'44701","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'34740","last_scrub_stamp":"2026-02-23T13:10:13.394732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:13.394732+0000","objects_scrubbed":34037,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:23.660349+0000","scrub_duration":3642,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621177856,"num_objects":39996,"num_object_clones":0,"num_object_copies":119988,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39996,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44704,"num_write_kb":2710400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":311,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-23T13:10:34.563664+0000","last_change":"2026-02-23T13:09:15.445539+0000","last_active":"2026-02-23T13:10:34.563664+0000","last_peered":"2026-02-23T13:10:34.563664+0000","last_clean":"2026-02-23T13:10:34.563664+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:10:34.563664+0000","last_undegraded":"2026-02-23T13:10:34.563664+0000","last_fullsized":"2026-02-23T13:10:34.563664+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:09:15.445510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:09:15.445510+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:10:37.194057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":42119856152,"num_objects":642699,"num_object_clones":0,"num_object_copies":1928097,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":642699,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":718819,"num_write_kb":43568513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":126367641600,"data_stored":126367629384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247902,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":31930048,"kb_used_data":30862828,"kb_used_omap":11,"kb_used_meta":1067188,"kb_avail":702073152,"statfs":{"total":751619276800,"available":718922907648,"internally_reserved":0,"allocated":31603535872,"data_stored":31603044412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12123,"internal_metadata":1092800677},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,4],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444129,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":37068160,"kb_used_data":36248044,"kb_used_omap":15,"kb_used_meta":820016,"kb_avail":696935040,"statfs":{"total":751619276800,"available":713661480960,"internally_reserved":0,"allocated":37117997056,"data_stored":37117505596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16370,"internal_metadata":839696398},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574947,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27880056,"kb_used_data":25936356,"kb_used_omap":15,"kb_used_meta":1943600,"kb_avail":706123144,"statfs":{"total":751619276800,"available":723070099456,"internally_reserved":0,"allocated":26558828544,"data_stored":26558344708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15768,"internal_metadata":1990247016},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705764,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":31992576,"kb_used_data":30923436,"kb_used_omap":12,"kb_used_meta":1069107,"kb_avail":702010624,"statfs":{"total":751619276800,"available":718858878976,"internally_reserved":0,"allocated":31665598464,"data_stored":31665107004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12947,"internal_metadata":1094765933},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31590846464,"data_stored":31590842392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26310737920,"data_stored":26310737920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36867543040,"data_stored":36867538968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":31598514176,"data_stored":31598510104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:10:41.733 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:10:41.734 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 181 2026-02-23T13:10:41.911 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:41.966 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:41 trial046 ceph-mon[38575]: pgmap v277: 17 pgs: 17 active+clean; 39 GiB data, 123 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 4.67k op/s 2026-02-23T13:10:41.974 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:10:42.040 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:42.039+0000 7fe9e7066640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:42.040 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:42.039+0000 7fe9e7066640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:42.124 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:42.196 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:10:42.236 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:10:42.256 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:42.255+0000 7fd404217640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:42.256 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:42.255+0000 7fd404217640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:42.271 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:10:42.271 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:10:42.284 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:10:42.285 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:10:42.299 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:10:42.299 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:10:42.311 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:10:42.312 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:10:43.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:42 trial046 ceph-mon[38575]: from='client.15044 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:10:43.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:42 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2767058808' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "181"} : dispatch 2026-02-23T13:10:43.290 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:42 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1354462104' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:10:44.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:43 trial046 ceph-mon[38575]: pgmap v278: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 36 GiB data, 114 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 9.74k op/s 2026-02-23T13:10:44.353 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:10:44.497 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:44.866 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:44.864+0000 7f8f5cf5e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:44.866 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:44.865+0000 7f8f5cf5e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:44.881 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:10:44.881 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:10:44.895 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:10:44.896 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:10:44.908 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:10:44.909 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:10:44.922 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:10:44.923 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:10:45.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:44 trial046 ceph-mon[38575]: 4.0 scrub ok 2026-02-23T13:10:45.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:44 trial046 ceph-mon[38575]: osdmap e72: 4 total, 4 up, 4 in 2026-02-23T13:10:46.087 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:45 trial046 ceph-mon[38575]: pgmap v280: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 36 GiB data, 114 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 7.86k op/s 2026-02-23T13:10:46.087 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:45 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2792523208' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:10:46.471 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:10:46 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:10:46.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:10:46.539 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:10:46 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:10:46] "GET /metrics HTTP/1.1" 200 4229 "" "Prometheus/3.6.0" 2026-02-23T13:10:47.238 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:10:47.238 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:10:47.238 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:10:47.239 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:10:47.264 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:46 trial046 ceph-mon[38575]: 1.0 scrub starts 2026-02-23T13:10:47.264 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:46 trial046 ceph-mon[38575]: 1.0 scrub ok 2026-02-23T13:10:47.264 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:46 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:10:47.388 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:47.421 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:10:47.557 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:47.773 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:47.763+0000 7f2c42f2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:47.773 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:47.764+0000 7f2c42f2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:47.905 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:10:47.906 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:10:48.061 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:47 trial046 ceph-mon[38575]: pgmap v281: 17 pgs: 17 active+clean; 35 GiB data, 111 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 8.56k op/s 2026-02-23T13:10:48.062 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":281,"stamp":"2026-02-23T13:10:46.652660+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":37633720888,"num_objects":574239,"num_object_clones":0,"num_object_copies":1722717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":574239,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":787416,"num_write_kb":43570663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":115915136,"kb_used_data":110744240,"kb_used_omap":60,"kb_used_meta":5170691,"kb_avail":2820097664,"statfs":{"total":3006477107200,"available":2887780007936,"internally_reserved":0,"allocated":113402101760,"data_stored":113400096222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62164,"internal_metadata":5294787884},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4486725632,"num_objects":-68462,"num_object_clones":0,"num_object_copies":-205386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-68462,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68462,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001037"},"pg_stats":[{"pgid":"4.f","version":"71'48254","reported_seq":48660,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-23T13:10:41.765484+0000","last_change":"2026-02-23T13:10:18.889561+0000","last_active":"2026-02-23T13:10:41.765484+0000","last_peered":"2026-02-23T13:10:41.765484+0000","last_clean":"2026-02-23T13:10:41.765484+0000","last_became_active":"2026-02-23T13:08:59.784888+0000","last_became_peered":"2026-02-23T13:08:59.784888+0000","last_unstale":"2026-02-23T13:10:41.765484+0000","last_undegraded":"2026-02-23T13:10:41.765484+0000","last_fullsized":"2026-02-23T13:10:41.765484+0000","mapping_epoch":62,"log_start":"71'48251","ondisk_log_start":"71'48251","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'37338","last_scrub_stamp":"2026-02-23T13:10:18.889417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:18.889417+0000","objects_scrubbed":36552,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:46.655322+0000","scrub_duration":3662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2450653184,"num_objects":37394,"num_object_clones":0,"num_object_copies":112182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37394,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48254,"num_write_kb":2740736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'47269","reported_seq":47702,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-23T13:10:41.657129+0000","last_change":"2026-02-23T13:10:27.126280+0000","last_active":"2026-02-23T13:10:41.657129+0000","last_peered":"2026-02-23T13:10:41.657129+0000","last_clean":"2026-02-23T13:10:41.657129+0000","last_became_active":"2026-02-23T13:08:59.785397+0000","last_became_peered":"2026-02-23T13:08:59.785397+0000","last_unstale":"2026-02-23T13:10:41.657129+0000","last_undegraded":"2026-02-23T13:10:41.657129+0000","last_fullsized":"2026-02-23T13:10:41.657129+0000","mapping_epoch":62,"log_start":"71'47266","ondisk_log_start":"71'47266","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'40440","last_scrub_stamp":"2026-02-23T13:10:27.126174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:27.126174+0000","objects_scrubbed":39592,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:48.254573+0000","scrub_duration":3978,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2411134976,"num_objects":36791,"num_object_clones":0,"num_object_copies":110373,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36791,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47269,"num_write_kb":2689920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"72'50526","reported_seq":50890,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:46.647196+0000","last_change":"2026-02-23T13:10:07.875495+0000","last_active":"2026-02-23T13:10:46.647196+0000","last_peered":"2026-02-23T13:10:46.647196+0000","last_clean":"2026-02-23T13:10:46.647196+0000","last_became_active":"2026-02-23T13:08:59.785780+0000","last_became_peered":"2026-02-23T13:08:59.785780+0000","last_unstale":"2026-02-23T13:10:46.647196+0000","last_undegraded":"2026-02-23T13:10:46.647196+0000","last_fullsized":"2026-02-23T13:10:46.647196+0000","mapping_epoch":62,"log_start":"72'50523","ondisk_log_start":"72'50523","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'32743","last_scrub_stamp":"2026-02-23T13:10:07.875449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:07.875449+0000","objects_scrubbed":32129,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:15.294906+0000","scrub_duration":3040,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2266300440,"num_objects":34582,"num_object_clones":0,"num_object_copies":103746,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34582,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":50526,"num_write_kb":2723393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"72'50825","reported_seq":51266,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:46.638844+0000","last_change":"2026-02-23T13:10:26.384628+0000","last_active":"2026-02-23T13:10:46.638844+0000","last_peered":"2026-02-23T13:10:46.638844+0000","last_clean":"2026-02-23T13:10:46.638844+0000","last_became_active":"2026-02-23T13:08:59.783982+0000","last_became_peered":"2026-02-23T13:08:59.783982+0000","last_unstale":"2026-02-23T13:10:46.638844+0000","last_undegraded":"2026-02-23T13:10:46.638844+0000","last_fullsized":"2026-02-23T13:10:46.638844+0000","mapping_epoch":62,"log_start":"72'50822","ondisk_log_start":"72'50822","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'40924","last_scrub_stamp":"2026-02-23T13:10:26.384602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:26.384602+0000","objects_scrubbed":40159,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:51.409315+0000","scrub_duration":3763,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2287796224,"num_objects":34909,"num_object_clones":0,"num_object_copies":104727,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34909,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50825,"num_write_kb":2743488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"72'50526","reported_seq":50979,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:46.643603+0000","last_change":"2026-02-23T13:10:36.436883+0000","last_active":"2026-02-23T13:10:46.643603+0000","last_peered":"2026-02-23T13:10:46.643603+0000","last_clean":"2026-02-23T13:10:46.643603+0000","last_became_active":"2026-02-23T13:08:59.784710+0000","last_became_peered":"2026-02-23T13:08:59.784710+0000","last_unstale":"2026-02-23T13:10:46.643603+0000","last_undegraded":"2026-02-23T13:10:46.643603+0000","last_fullsized":"2026-02-23T13:10:46.643603+0000","mapping_epoch":62,"log_start":"72'50523","ondisk_log_start":"72'50523","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'44729","last_scrub_stamp":"2026-02-23T13:10:36.436786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:36.436786+0000","objects_scrubbed":41142,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:51.122805+0000","scrub_duration":4872,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2252603392,"num_objects":34372,"num_object_clones":0,"num_object_copies":103116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34372,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50526,"num_write_kb":2716736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'48142","reported_seq":48605,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-23T13:10:41.656912+0000","last_change":"2026-02-23T13:10:31.717671+0000","last_active":"2026-02-23T13:10:41.656912+0000","last_peered":"2026-02-23T13:10:41.656912+0000","last_clean":"2026-02-23T13:10:41.656912+0000","last_became_active":"2026-02-23T13:08:59.784218+0000","last_became_peered":"2026-02-23T13:08:59.784218+0000","last_unstale":"2026-02-23T13:10:41.656912+0000","last_undegraded":"2026-02-23T13:10:41.656912+0000","last_fullsized":"2026-02-23T13:10:41.656912+0000","mapping_epoch":62,"log_start":"71'48139","ondisk_log_start":"71'48139","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'43162","last_scrub_stamp":"2026-02-23T13:10:31.717638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:31.717638+0000","objects_scrubbed":42156,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:36.022448+0000","scrub_duration":4538,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2453143552,"num_objects":37432,"num_object_clones":0,"num_object_copies":112296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37432,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48142,"num_write_kb":2738368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"71'47811","reported_seq":48163,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-23T13:10:41.654137+0000","last_change":"2026-02-23T13:10:06.461634+0000","last_active":"2026-02-23T13:10:41.654137+0000","last_peered":"2026-02-23T13:10:41.654137+0000","last_clean":"2026-02-23T13:10:41.654137+0000","last_became_active":"2026-02-23T13:08:59.784210+0000","last_became_peered":"2026-02-23T13:08:59.784210+0000","last_unstale":"2026-02-23T13:10:41.654137+0000","last_undegraded":"2026-02-23T13:10:41.654137+0000","last_fullsized":"2026-02-23T13:10:41.654137+0000","mapping_epoch":62,"log_start":"71'47808","ondisk_log_start":"71'47808","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'32118","last_scrub_stamp":"2026-02-23T13:10:06.461563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:06.461563+0000","objects_scrubbed":31388,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:22.890897+0000","scrub_duration":3366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2434072576,"num_objects":37141,"num_object_clones":0,"num_object_copies":111423,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37141,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47811,"num_write_kb":2718464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"72'50184","reported_seq":50611,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:46.649067+0000","last_change":"2026-02-23T13:10:24.387952+0000","last_active":"2026-02-23T13:10:46.649067+0000","last_peered":"2026-02-23T13:10:46.649067+0000","last_clean":"2026-02-23T13:10:46.649067+0000","last_became_active":"2026-02-23T13:08:59.785359+0000","last_became_peered":"2026-02-23T13:08:59.785359+0000","last_unstale":"2026-02-23T13:10:46.649067+0000","last_undegraded":"2026-02-23T13:10:46.649067+0000","last_fullsized":"2026-02-23T13:10:46.649067+0000","mapping_epoch":62,"log_start":"72'50181","ondisk_log_start":"72'50181","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'39419","last_scrub_stamp":"2026-02-23T13:10:24.387875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:24.387875+0000","objects_scrubbed":38695,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:54.083097+0000","scrub_duration":3689,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2251030528,"num_objects":34348,"num_object_clones":0,"num_object_copies":103044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34348,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50184,"num_write_kb":2705024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"71'47883","reported_seq":48342,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-23T13:10:41.767052+0000","last_change":"2026-02-23T13:10:34.960546+0000","last_active":"2026-02-23T13:10:41.767052+0000","last_peered":"2026-02-23T13:10:41.767052+0000","last_clean":"2026-02-23T13:10:41.767052+0000","last_became_active":"2026-02-23T13:08:59.785106+0000","last_became_peered":"2026-02-23T13:08:59.785106+0000","last_unstale":"2026-02-23T13:10:41.767052+0000","last_undegraded":"2026-02-23T13:10:41.767052+0000","last_fullsized":"2026-02-23T13:10:41.767052+0000","mapping_epoch":62,"log_start":"71'47880","ondisk_log_start":"71'47880","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'44040","last_scrub_stamp":"2026-02-23T13:10:34.960505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:34.960505+0000","objects_scrubbed":42002,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:42.696429+0000","scrub_duration":4826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2450194432,"num_objects":37387,"num_object_clones":0,"num_object_copies":112161,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37387,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47883,"num_write_kb":2728640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"72'50535","reported_seq":50936,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:46.648469+0000","last_change":"2026-02-23T13:10:17.283236+0000","last_active":"2026-02-23T13:10:46.648469+0000","last_peered":"2026-02-23T13:10:46.648469+0000","last_clean":"2026-02-23T13:10:46.648469+0000","last_became_active":"2026-02-23T13:08:59.784457+0000","last_became_peered":"2026-02-23T13:08:59.784457+0000","last_unstale":"2026-02-23T13:10:46.648469+0000","last_undegraded":"2026-02-23T13:10:46.648469+0000","last_fullsized":"2026-02-23T13:10:46.648469+0000","mapping_epoch":62,"log_start":"72'50532","ondisk_log_start":"72'50532","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'36652","last_scrub_stamp":"2026-02-23T13:10:17.283183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:17.283183+0000","objects_scrubbed":35965,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:47.102975+0000","scrub_duration":3592,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2275606528,"num_objects":34723,"num_object_clones":0,"num_object_copies":104169,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34723,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50535,"num_write_kb":2728256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'47737","reported_seq":48131,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-23T13:10:41.766069+0000","last_change":"2026-02-23T13:10:16.715418+0000","last_active":"2026-02-23T13:10:41.766069+0000","last_peered":"2026-02-23T13:10:41.766069+0000","last_clean":"2026-02-23T13:10:41.766069+0000","last_became_active":"2026-02-23T13:08:59.784235+0000","last_became_peered":"2026-02-23T13:08:59.784235+0000","last_unstale":"2026-02-23T13:10:41.766069+0000","last_undegraded":"2026-02-23T13:10:41.766069+0000","last_fullsized":"2026-02-23T13:10:41.766069+0000","mapping_epoch":62,"log_start":"71'47734","ondisk_log_start":"71'47734","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'36136","last_scrub_stamp":"2026-02-23T13:10:16.715358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:16.715358+0000","objects_scrubbed":35429,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:30.935136+0000","scrub_duration":3530,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2437611520,"num_objects":37195,"num_object_clones":0,"num_object_copies":111585,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37195,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47737,"num_write_kb":2717824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"72'50805","reported_seq":51152,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:46.646135+0000","last_change":"2026-02-23T13:10:03.037875+0000","last_active":"2026-02-23T13:10:46.646135+0000","last_peered":"2026-02-23T13:10:46.646135+0000","last_clean":"2026-02-23T13:10:46.646135+0000","last_became_active":"2026-02-23T13:08:59.784318+0000","last_became_peered":"2026-02-23T13:08:59.784318+0000","last_unstale":"2026-02-23T13:10:46.646135+0000","last_undegraded":"2026-02-23T13:10:46.646135+0000","last_fullsized":"2026-02-23T13:10:46.646135+0000","mapping_epoch":62,"log_start":"72'50802","ondisk_log_start":"72'50802","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'30914","last_scrub_stamp":"2026-02-23T13:10:03.037814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:03.037814+0000","objects_scrubbed":30174,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:29.315340+0000","scrub_duration":3318,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2276392960,"num_objects":34735,"num_object_clones":0,"num_object_copies":104205,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34735,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50805,"num_write_kb":2737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"71'47927","reported_seq":48310,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-23T13:10:41.768579+0000","last_change":"2026-02-23T13:10:13.380759+0000","last_active":"2026-02-23T13:10:41.768579+0000","last_peered":"2026-02-23T13:10:41.768579+0000","last_clean":"2026-02-23T13:10:41.768579+0000","last_became_active":"2026-02-23T13:08:59.784463+0000","last_became_peered":"2026-02-23T13:08:59.784463+0000","last_unstale":"2026-02-23T13:10:41.768579+0000","last_undegraded":"2026-02-23T13:10:41.768579+0000","last_fullsized":"2026-02-23T13:10:41.768579+0000","mapping_epoch":62,"log_start":"71'47924","ondisk_log_start":"71'47924","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'35060","last_scrub_stamp":"2026-02-23T13:10:13.380652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:13.380652+0000","objects_scrubbed":34448,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:31.033114+0000","scrub_duration":3163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2444951552,"num_objects":37307,"num_object_clones":0,"num_object_copies":111921,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37307,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47927,"num_write_kb":2727488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"71'47915","reported_seq":48287,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-23T13:10:41.651732+0000","last_change":"2026-02-23T13:10:11.150558+0000","last_active":"2026-02-23T13:10:41.651732+0000","last_peered":"2026-02-23T13:10:41.651732+0000","last_clean":"2026-02-23T13:10:41.651732+0000","last_became_active":"2026-02-23T13:08:59.784436+0000","last_became_peered":"2026-02-23T13:08:59.784436+0000","last_unstale":"2026-02-23T13:10:41.651732+0000","last_undegraded":"2026-02-23T13:10:41.651732+0000","last_fullsized":"2026-02-23T13:10:41.651732+0000","mapping_epoch":62,"log_start":"71'47912","ondisk_log_start":"71'47912","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'34103","last_scrub_stamp":"2026-02-23T13:10:11.150522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:11.150522+0000","objects_scrubbed":33383,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:36.031575+0000","scrub_duration":3995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2446524416,"num_objects":37331,"num_object_clones":0,"num_object_copies":111993,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37331,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47915,"num_write_kb":2727872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"72'50506","reported_seq":50921,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:46.644462+0000","last_change":"2026-02-23T13:10:43.059389+0000","last_active":"2026-02-23T13:10:46.644462+0000","last_peered":"2026-02-23T13:10:46.644462+0000","last_clean":"2026-02-23T13:10:46.644462+0000","last_became_active":"2026-02-23T13:08:59.784290+0000","last_became_peered":"2026-02-23T13:08:59.784290+0000","last_unstale":"2026-02-23T13:10:46.644462+0000","last_undegraded":"2026-02-23T13:10:46.644462+0000","last_fullsized":"2026-02-23T13:10:46.644462+0000","mapping_epoch":62,"log_start":"72'50503","ondisk_log_start":"72'50503","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'48491","last_scrub_stamp":"2026-02-23T13:10:43.059312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:43.059312+0000","objects_scrubbed":37287,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:55.819637+0000","scrub_duration":3592,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2249588736,"num_objects":34326,"num_object_clones":0,"num_object_copies":102978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34326,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50506,"num_write_kb":2714624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"72'50436","reported_seq":50817,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:46.648981+0000","last_change":"2026-02-23T13:10:13.394783+0000","last_active":"2026-02-23T13:10:46.648981+0000","last_peered":"2026-02-23T13:10:46.648981+0000","last_clean":"2026-02-23T13:10:46.648981+0000","last_became_active":"2026-02-23T13:08:59.785634+0000","last_became_peered":"2026-02-23T13:08:59.785634+0000","last_unstale":"2026-02-23T13:10:46.648981+0000","last_undegraded":"2026-02-23T13:10:46.648981+0000","last_fullsized":"2026-02-23T13:10:46.648981+0000","mapping_epoch":62,"log_start":"72'50433","ondisk_log_start":"72'50433","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'34740","last_scrub_stamp":"2026-02-23T13:10:13.394732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:13.394732+0000","objects_scrubbed":34037,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:23.660349+0000","scrub_duration":3642,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2245525504,"num_objects":34264,"num_object_clones":0,"num_object_copies":102792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34264,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50436,"num_write_kb":2710400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":323,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:45.570064+0000","last_change":"2026-02-23T13:10:45.570064+0000","last_active":"2026-02-23T13:10:45.570064+0000","last_peered":"2026-02-23T13:10:45.570064+0000","last_clean":"2026-02-23T13:10:45.570064+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:10:45.570064+0000","last_undegraded":"2026-02-23T13:10:45.570064+0000","last_fullsized":"2026-02-23T13:10:45.570064+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:10:45.570030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:10:45.570030+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:48.611576+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":37633130520,"num_objects":574237,"num_object_clones":0,"num_object_copies":1722711,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":574237,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":787281,"num_write_kb":43568513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":112851300352,"data_stored":112851288136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1023,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247904,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27748376,"kb_used_data":26554756,"kb_used_omap":13,"kb_used_meta":1193522,"kb_avail":706254824,"statfs":{"total":751619276800,"available":723204939776,"internally_reserved":0,"allocated":27192070144,"data_stored":27191562910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13487,"internal_metadata":1222167377},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444130,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":34493580,"kb_used_data":33601336,"kb_used_omap":16,"kb_used_meta":892207,"kb_avail":699509620,"statfs":{"total":751619276800,"available":716297850880,"internally_reserved":0,"allocated":34407768064,"data_stored":34407268717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17022,"internal_metadata":913620354},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574948,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":25949892,"kb_used_data":24042288,"kb_used_omap":16,"kb_used_meta":1907567,"kb_avail":708053308,"statfs":{"total":751619276800,"available":725046587392,"internally_reserved":0,"allocated":24619302912,"data_stored":24618811189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17404,"internal_metadata":1953348612},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705766,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27723288,"kb_used_data":26545860,"kb_used_omap":13,"kb_used_meta":1177394,"kb_avail":706279912,"statfs":{"total":751619276800,"available":723230629888,"internally_reserved":0,"allocated":27182960640,"data_stored":27182453406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14251,"internal_metadata":1205651541},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1023,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27128827904,"data_stored":27128823832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24401739776,"data_stored":24401739776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":34181287936,"data_stored":34181283864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":27139444736,"data_stored":27139440664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:10:48.064 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:10:48.064 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 191 2026-02-23T13:10:48.100 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:48.098+0000 7f700347a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:48.101 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:48.098+0000 7f700347a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:48.115 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:10:48.116 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:10:48.128 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:10:48.128 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:10:48.142 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:10:48.142 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:10:48.156 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:10:48.156 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:10:48.219 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:48.347 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:48.345+0000 7f2225440640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:48.348 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:48.346+0000 7f2225440640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:48.487 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:10:48.531 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:10:49.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:48 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3652501655' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:10:49.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:48 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:10:49.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:48 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:10:49.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:48 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/386610508' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "191"} : dispatch 2026-02-23T13:10:50.205 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:10:50.230 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:49 trial046 ceph-mon[38575]: from='client.15052 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:10:50.230 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:49 trial046 ceph-mon[38575]: pgmap v282: 17 pgs: 17 active+clean; 34 GiB data, 107 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 9.98k op/s 2026-02-23T13:10:50.349 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:50.487 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:50.485+0000 7f29d717c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:50.487 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:50.485+0000 7f29d717c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:50.503 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:10:50.503 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:10:50.516 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:10:50.517 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:10:50.531 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:10:50.531 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:10:50.544 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:10:50.544 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:10:51.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:50 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/202281894' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:10:52.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:51 trial046 ceph-mon[38575]: pgmap v283: 17 pgs: 17 active+clean; 34 GiB data, 107 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 9.07k op/s 2026-02-23T13:10:52.587 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:10:52.729 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:52.839 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:52.837+0000 7fd252494640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:52.839 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:52.838+0000 7fd252494640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:52.856 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:10:52.856 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:10:52.868 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:10:52.868 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:10:52.883 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:10:52.883 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:10:52.899 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:10:52.899 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:10:53.532 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:10:53.533 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:10:53.533 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:10:53.533 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:10:53.677 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:53.798 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:53.796+0000 7f8ef2571640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:53.798 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:53.796+0000 7f8ef2571640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:53.940 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:10:53.940 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:10:53.984 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2026-02-23T13:10:52.653488+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":33036501560,"num_objects":504091,"num_object_clones":0,"num_object_copies":1512273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":504091,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":857564,"num_write_kb":43570663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53,"ondisk_log_size":53,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":102181976,"kb_used_data":97395784,"kb_used_omap":61,"kb_used_meta":4786050,"kb_avail":2833830824,"statfs":{"total":3006477107200,"available":2901842763776,"internally_reserved":0,"allocated":99733282816,"data_stored":99731261504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63468,"internal_metadata":4900915220},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,0,0,0,0,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6022365184,"num_objects":-91894,"num_object_clones":0,"num_object_copies":-275682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-91894,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91894,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001356"},"pg_stats":[{"pgid":"4.f","version":"72'53972","reported_seq":54380,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:51.768327+0000","last_change":"2026-02-23T13:10:18.889561+0000","last_active":"2026-02-23T13:10:51.768327+0000","last_peered":"2026-02-23T13:10:51.768327+0000","last_clean":"2026-02-23T13:10:51.768327+0000","last_became_active":"2026-02-23T13:08:59.784888+0000","last_became_peered":"2026-02-23T13:08:59.784888+0000","last_unstale":"2026-02-23T13:10:51.768327+0000","last_undegraded":"2026-02-23T13:10:51.768327+0000","last_fullsized":"2026-02-23T13:10:51.768327+0000","mapping_epoch":62,"log_start":"72'53969","ondisk_log_start":"72'53969","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'37338","last_scrub_stamp":"2026-02-23T13:10:18.889417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:18.889417+0000","objects_scrubbed":36552,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:46.655322+0000","scrub_duration":3662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2075918336,"num_objects":31676,"num_object_clones":0,"num_object_copies":95028,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31676,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53972,"num_write_kb":2740736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"72'52898","reported_seq":53333,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:51.654794+0000","last_change":"2026-02-23T13:10:27.126280+0000","last_active":"2026-02-23T13:10:51.654794+0000","last_peered":"2026-02-23T13:10:51.654794+0000","last_clean":"2026-02-23T13:10:51.654794+0000","last_became_active":"2026-02-23T13:08:59.785397+0000","last_became_peered":"2026-02-23T13:08:59.785397+0000","last_unstale":"2026-02-23T13:10:51.654794+0000","last_undegraded":"2026-02-23T13:10:51.654794+0000","last_fullsized":"2026-02-23T13:10:51.654794+0000","mapping_epoch":62,"log_start":"72'52895","ondisk_log_start":"72'52895","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'40440","last_scrub_stamp":"2026-02-23T13:10:27.126174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:27.126174+0000","objects_scrubbed":39592,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:48.254573+0000","scrub_duration":3978,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2042232832,"num_objects":31162,"num_object_clones":0,"num_object_copies":93486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31162,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52898,"num_write_kb":2689920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"72'53552","reported_seq":53915,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:51.648773+0000","last_change":"2026-02-23T13:10:07.875495+0000","last_active":"2026-02-23T13:10:51.648773+0000","last_peered":"2026-02-23T13:10:51.648773+0000","last_clean":"2026-02-23T13:10:51.648773+0000","last_became_active":"2026-02-23T13:08:59.785780+0000","last_became_peered":"2026-02-23T13:08:59.785780+0000","last_unstale":"2026-02-23T13:10:51.648773+0000","last_undegraded":"2026-02-23T13:10:51.648773+0000","last_fullsized":"2026-02-23T13:10:51.648773+0000","mapping_epoch":62,"log_start":"72'53549","ondisk_log_start":"72'53549","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'32743","last_scrub_stamp":"2026-02-23T13:10:07.875449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:07.875449+0000","objects_scrubbed":32129,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:15.294906+0000","scrub_duration":3040,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2067988504,"num_objects":31556,"num_object_clones":0,"num_object_copies":94668,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31556,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":53552,"num_write_kb":2723393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"72'53858","reported_seq":54299,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:51.647469+0000","last_change":"2026-02-23T13:10:26.384628+0000","last_active":"2026-02-23T13:10:51.647469+0000","last_peered":"2026-02-23T13:10:51.647469+0000","last_clean":"2026-02-23T13:10:51.647469+0000","last_became_active":"2026-02-23T13:08:59.783982+0000","last_became_peered":"2026-02-23T13:08:59.783982+0000","last_unstale":"2026-02-23T13:10:51.647469+0000","last_undegraded":"2026-02-23T13:10:51.647469+0000","last_fullsized":"2026-02-23T13:10:51.647469+0000","mapping_epoch":62,"log_start":"72'53855","ondisk_log_start":"72'53855","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'40924","last_scrub_stamp":"2026-02-23T13:10:26.384602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:26.384602+0000","objects_scrubbed":40159,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:51.409315+0000","scrub_duration":3763,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2089025536,"num_objects":31876,"num_object_clones":0,"num_object_copies":95628,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31876,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53858,"num_write_kb":2743488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"72'53481","reported_seq":53934,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:51.648551+0000","last_change":"2026-02-23T13:10:36.436883+0000","last_active":"2026-02-23T13:10:51.648551+0000","last_peered":"2026-02-23T13:10:51.648551+0000","last_clean":"2026-02-23T13:10:51.648551+0000","last_became_active":"2026-02-23T13:08:59.784710+0000","last_became_peered":"2026-02-23T13:08:59.784710+0000","last_unstale":"2026-02-23T13:10:51.648551+0000","last_undegraded":"2026-02-23T13:10:51.648551+0000","last_fullsized":"2026-02-23T13:10:51.648551+0000","mapping_epoch":62,"log_start":"72'53478","ondisk_log_start":"72'53478","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'44729","last_scrub_stamp":"2026-02-23T13:10:36.436786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:36.436786+0000","objects_scrubbed":41142,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:51.122805+0000","scrub_duration":4872,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2058944512,"num_objects":31417,"num_object_clones":0,"num_object_copies":94251,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31417,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53481,"num_write_kb":2716736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"72'53894","reported_seq":54359,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:51.655964+0000","last_change":"2026-02-23T13:10:31.717671+0000","last_active":"2026-02-23T13:10:51.655964+0000","last_peered":"2026-02-23T13:10:51.655964+0000","last_clean":"2026-02-23T13:10:51.655964+0000","last_became_active":"2026-02-23T13:08:59.784218+0000","last_became_peered":"2026-02-23T13:08:59.784218+0000","last_unstale":"2026-02-23T13:10:51.655964+0000","last_undegraded":"2026-02-23T13:10:51.655964+0000","last_fullsized":"2026-02-23T13:10:51.655964+0000","mapping_epoch":62,"log_start":"72'53891","ondisk_log_start":"72'53891","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'43162","last_scrub_stamp":"2026-02-23T13:10:31.717638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:31.717638+0000","objects_scrubbed":42156,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:36.022448+0000","scrub_duration":4538,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2076180480,"num_objects":31680,"num_object_clones":0,"num_object_copies":95040,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31680,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53894,"num_write_kb":2738368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"72'53464","reported_seq":53818,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:51.659039+0000","last_change":"2026-02-23T13:10:06.461634+0000","last_active":"2026-02-23T13:10:51.659039+0000","last_peered":"2026-02-23T13:10:51.659039+0000","last_clean":"2026-02-23T13:10:51.659039+0000","last_became_active":"2026-02-23T13:08:59.784210+0000","last_became_peered":"2026-02-23T13:08:59.784210+0000","last_unstale":"2026-02-23T13:10:51.659039+0000","last_undegraded":"2026-02-23T13:10:51.659039+0000","last_fullsized":"2026-02-23T13:10:51.659039+0000","mapping_epoch":62,"log_start":"72'53461","ondisk_log_start":"72'53461","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'32118","last_scrub_stamp":"2026-02-23T13:10:06.461563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:06.461563+0000","objects_scrubbed":31388,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:22.890897+0000","scrub_duration":3366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2063597568,"num_objects":31488,"num_object_clones":0,"num_object_copies":94464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31488,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53464,"num_write_kb":2718464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"72'53114","reported_seq":53541,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:51.648709+0000","last_change":"2026-02-23T13:10:24.387952+0000","last_active":"2026-02-23T13:10:51.648709+0000","last_peered":"2026-02-23T13:10:51.648709+0000","last_clean":"2026-02-23T13:10:51.648709+0000","last_became_active":"2026-02-23T13:08:59.785359+0000","last_became_peered":"2026-02-23T13:08:59.785359+0000","last_unstale":"2026-02-23T13:10:51.648709+0000","last_undegraded":"2026-02-23T13:10:51.648709+0000","last_fullsized":"2026-02-23T13:10:51.648709+0000","mapping_epoch":62,"log_start":"72'53111","ondisk_log_start":"72'53111","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'39419","last_scrub_stamp":"2026-02-23T13:10:24.387875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:24.387875+0000","objects_scrubbed":38695,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:54.083097+0000","scrub_duration":3689,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2059010048,"num_objects":31418,"num_object_clones":0,"num_object_copies":94254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31418,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53114,"num_write_kb":2705024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"72'53841","reported_seq":54302,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:51.769440+0000","last_change":"2026-02-23T13:10:34.960546+0000","last_active":"2026-02-23T13:10:51.769440+0000","last_peered":"2026-02-23T13:10:51.769440+0000","last_clean":"2026-02-23T13:10:51.769440+0000","last_became_active":"2026-02-23T13:08:59.785106+0000","last_became_peered":"2026-02-23T13:08:59.785106+0000","last_unstale":"2026-02-23T13:10:51.769440+0000","last_undegraded":"2026-02-23T13:10:51.769440+0000","last_fullsized":"2026-02-23T13:10:51.769440+0000","mapping_epoch":62,"log_start":"72'53838","ondisk_log_start":"72'53838","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'44040","last_scrub_stamp":"2026-02-23T13:10:34.960505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:34.960505+0000","objects_scrubbed":42002,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:42.696429+0000","scrub_duration":4826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2059730944,"num_objects":31429,"num_object_clones":0,"num_object_copies":94287,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31429,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53841,"num_write_kb":2728640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"72'53571","reported_seq":53970,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:51.648364+0000","last_change":"2026-02-23T13:10:17.283236+0000","last_active":"2026-02-23T13:10:51.648364+0000","last_peered":"2026-02-23T13:10:51.648364+0000","last_clean":"2026-02-23T13:10:51.648364+0000","last_became_active":"2026-02-23T13:08:59.784457+0000","last_became_peered":"2026-02-23T13:08:59.784457+0000","last_unstale":"2026-02-23T13:10:51.648364+0000","last_undegraded":"2026-02-23T13:10:51.648364+0000","last_fullsized":"2026-02-23T13:10:51.648364+0000","mapping_epoch":62,"log_start":"72'53568","ondisk_log_start":"72'53568","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'36652","last_scrub_stamp":"2026-02-23T13:10:17.283183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:17.283183+0000","objects_scrubbed":35965,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:47.102975+0000","scrub_duration":3592,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2076639232,"num_objects":31687,"num_object_clones":0,"num_object_copies":95061,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31687,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53571,"num_write_kb":2728256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"72'53495","reported_seq":53891,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:51.768531+0000","last_change":"2026-02-23T13:10:16.715418+0000","last_active":"2026-02-23T13:10:51.768531+0000","last_peered":"2026-02-23T13:10:51.768531+0000","last_clean":"2026-02-23T13:10:51.768531+0000","last_became_active":"2026-02-23T13:08:59.784235+0000","last_became_peered":"2026-02-23T13:08:59.784235+0000","last_unstale":"2026-02-23T13:10:51.768531+0000","last_undegraded":"2026-02-23T13:10:51.768531+0000","last_fullsized":"2026-02-23T13:10:51.768531+0000","mapping_epoch":62,"log_start":"72'53492","ondisk_log_start":"72'53492","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'36136","last_scrub_stamp":"2026-02-23T13:10:16.715358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:16.715358+0000","objects_scrubbed":35429,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:30.935136+0000","scrub_duration":3530,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2060255232,"num_objects":31437,"num_object_clones":0,"num_object_copies":94311,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31437,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53495,"num_write_kb":2717824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"72'53855","reported_seq":54202,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:51.649574+0000","last_change":"2026-02-23T13:10:03.037875+0000","last_active":"2026-02-23T13:10:51.649574+0000","last_peered":"2026-02-23T13:10:51.649574+0000","last_clean":"2026-02-23T13:10:51.649574+0000","last_became_active":"2026-02-23T13:08:59.784318+0000","last_became_peered":"2026-02-23T13:08:59.784318+0000","last_unstale":"2026-02-23T13:10:51.649574+0000","last_undegraded":"2026-02-23T13:10:51.649574+0000","last_fullsized":"2026-02-23T13:10:51.649574+0000","mapping_epoch":62,"log_start":"72'53852","ondisk_log_start":"72'53852","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'30914","last_scrub_stamp":"2026-02-23T13:10:03.037814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:03.037814+0000","objects_scrubbed":30174,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:29.315340+0000","scrub_duration":3318,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2076508160,"num_objects":31685,"num_object_clones":0,"num_object_copies":95055,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31685,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53855,"num_write_kb":2737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"72'53802","reported_seq":54187,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:51.769624+0000","last_change":"2026-02-23T13:10:13.380759+0000","last_active":"2026-02-23T13:10:51.769624+0000","last_peered":"2026-02-23T13:10:51.769624+0000","last_clean":"2026-02-23T13:10:51.769624+0000","last_became_active":"2026-02-23T13:08:59.784463+0000","last_became_peered":"2026-02-23T13:08:59.784463+0000","last_unstale":"2026-02-23T13:10:51.769624+0000","last_undegraded":"2026-02-23T13:10:51.769624+0000","last_fullsized":"2026-02-23T13:10:51.769624+0000","mapping_epoch":62,"log_start":"72'53799","ondisk_log_start":"72'53799","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'35060","last_scrub_stamp":"2026-02-23T13:10:13.380652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:13.380652+0000","objects_scrubbed":34448,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:31.033114+0000","scrub_duration":3163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2059927552,"num_objects":31432,"num_object_clones":0,"num_object_copies":94296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31432,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53802,"num_write_kb":2727488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"72'53800","reported_seq":54174,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:51.660025+0000","last_change":"2026-02-23T13:10:11.150558+0000","last_active":"2026-02-23T13:10:51.660025+0000","last_peered":"2026-02-23T13:10:51.660025+0000","last_clean":"2026-02-23T13:10:51.660025+0000","last_became_active":"2026-02-23T13:08:59.784436+0000","last_became_peered":"2026-02-23T13:08:59.784436+0000","last_unstale":"2026-02-23T13:10:51.660025+0000","last_undegraded":"2026-02-23T13:10:51.660025+0000","last_fullsized":"2026-02-23T13:10:51.660025+0000","mapping_epoch":62,"log_start":"72'53797","ondisk_log_start":"72'53797","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'34103","last_scrub_stamp":"2026-02-23T13:10:11.150522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:11.150522+0000","objects_scrubbed":33383,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:36.031575+0000","scrub_duration":3995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2060845056,"num_objects":31446,"num_object_clones":0,"num_object_copies":94338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31446,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53800,"num_write_kb":2727872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"72'53523","reported_seq":53938,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:51.642335+0000","last_change":"2026-02-23T13:10:43.059389+0000","last_active":"2026-02-23T13:10:51.642335+0000","last_peered":"2026-02-23T13:10:51.642335+0000","last_clean":"2026-02-23T13:10:51.642335+0000","last_became_active":"2026-02-23T13:08:59.784290+0000","last_became_peered":"2026-02-23T13:08:59.784290+0000","last_unstale":"2026-02-23T13:10:51.642335+0000","last_undegraded":"2026-02-23T13:10:51.642335+0000","last_fullsized":"2026-02-23T13:10:51.642335+0000","mapping_epoch":62,"log_start":"72'53520","ondisk_log_start":"72'53520","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'48491","last_scrub_stamp":"2026-02-23T13:10:43.059312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:43.059312+0000","objects_scrubbed":37287,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:55.819637+0000","scrub_duration":3592,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2051866624,"num_objects":31309,"num_object_clones":0,"num_object_copies":93927,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31309,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53523,"num_write_kb":2714624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"72'53309","reported_seq":53686,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:51.648941+0000","last_change":"2026-02-23T13:10:13.394783+0000","last_active":"2026-02-23T13:10:51.648941+0000","last_peered":"2026-02-23T13:10:51.648941+0000","last_clean":"2026-02-23T13:10:51.648941+0000","last_became_active":"2026-02-23T13:08:59.785634+0000","last_became_peered":"2026-02-23T13:08:59.785634+0000","last_unstale":"2026-02-23T13:10:51.648941+0000","last_undegraded":"2026-02-23T13:10:51.648941+0000","last_fullsized":"2026-02-23T13:10:51.648941+0000","mapping_epoch":62,"log_start":"72'53304","ondisk_log_start":"72'53304","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'34740","last_scrub_stamp":"2026-02-23T13:10:13.394732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:13.394732+0000","objects_scrubbed":34037,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:23.660349+0000","scrub_duration":3642,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2057240576,"num_objects":31391,"num_object_clones":0,"num_object_copies":94173,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31391,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53309,"num_write_kb":2710400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":323,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:45.570064+0000","last_change":"2026-02-23T13:10:45.570064+0000","last_active":"2026-02-23T13:10:45.570064+0000","last_peered":"2026-02-23T13:10:45.570064+0000","last_clean":"2026-02-23T13:10:45.570064+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:10:45.570064+0000","last_undegraded":"2026-02-23T13:10:45.570064+0000","last_fullsized":"2026-02-23T13:10:45.570064+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:10:45.570030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:10:45.570030+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:48.611576+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":33035911192,"num_objects":504089,"num_object_clones":0,"num_object_copies":1512267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":504089,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":857429,"num_write_kb":43568513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":99115282432,"data_stored":99115270216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":50,"ondisk_log_size":50,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1023,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247905,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":25520664,"kb_used_data":24272964,"kb_used_omap":13,"kb_used_meta":1247666,"kb_avail":708482536,"statfs":{"total":751619276800,"available":725486116864,"internally_reserved":0,"allocated":24855515136,"data_stored":24855007902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13487,"internal_metadata":1277610833},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444132,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":29514264,"kb_used_data":28477636,"kb_used_omap":17,"kb_used_meta":1036590,"kb_avail":704488936,"statfs":{"total":751619276800,"available":721396670464,"internally_reserved":0,"allocated":29161099264,"data_stored":29160592030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17674,"internal_metadata":1061468918},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":21625808,"kb_used_data":20373564,"kb_used_omap":17,"kb_used_meta":1252206,"kb_avail":712377392,"statfs":{"total":751619276800,"available":729474449408,"internally_reserved":0,"allocated":20862529536,"data_stored":20862029926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18056,"internal_metadata":1282259320},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705767,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":25521240,"kb_used_data":24271620,"kb_used_omap":13,"kb_used_meta":1249586,"kb_avail":708481960,"statfs":{"total":751619276800,"available":725485527040,"internally_reserved":0,"allocated":24854138880,"data_stored":24853631646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14251,"internal_metadata":1279576149},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1023,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24767500288,"data_stored":24767496216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20634730496,"data_stored":20634730496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28920909824,"data_stored":28920905752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24792141824,"data_stored":24792137752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:10:53.986 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:10:53.987 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 201 2026-02-23T13:10:54.131 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:54.159 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:53 trial046 ceph-mon[38575]: pgmap v284: 17 pgs: 17 active+clean; 31 GiB data, 97 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 9.19k op/s 2026-02-23T13:10:54.159 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:53 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2099330660' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:10:54.261 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:54.259+0000 7f7f0d06a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:54.261 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:54.259+0000 7f7f0d06a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:54.417 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:10:54.454 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:10:54.941 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:10:55.082 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:55.109 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:54 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/125126939' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "201"} : dispatch 2026-02-23T13:10:55.206 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:55.203+0000 7f9fe5aa2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:55.206 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:55.204+0000 7f9fe5aa2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:55.220 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:10:55.220 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:10:55.232 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:10:55.232 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:10:55.248 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:10:55.249 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:10:55.261 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:10:55.262 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:10:56.088 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:55 trial046 ceph-mon[38575]: from='client.15062 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:10:56.088 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:55 trial046 ceph-mon[38575]: pgmap v285: 17 pgs: 17 active+clean; 31 GiB data, 97 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 9.11k op/s 2026-02-23T13:10:56.088 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:55 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2332800595' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:10:56.539 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:10:56 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:10:56] "GET /metrics HTTP/1.1" 200 4229 "" "Prometheus/3.6.0" 2026-02-23T13:10:56.561 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:10:56 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:10:56.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:10:57.304 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:10:57.453 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:57.571 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:57.569+0000 7f6f97765640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:57.571 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:57.569+0000 7f6f97765640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:57.585 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:10:57.585 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:10:57.597 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:10:57.598 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:10:57.613 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:10:57.613 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:10:57.626 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:10:57.626 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:10:57.837 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:57 trial046 ceph-mon[38575]: pgmap v286: 17 pgs: 17 active+clean; 29 GiB data, 93 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 9.65k op/s 2026-02-23T13:10:57.838 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:57 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/16743595' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:10:59.455 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:10:59.456 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:10:59.456 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_2 2026-02-23T13:10:59.456 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:10:59.609 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:10:59.729 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:59.727+0000 7f2d084c5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:59.729 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:10:59.728+0000 7f2d084c5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:10:59.852 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:10:59.867 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:10:59.868 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:10:59.916 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":287,"stamp":"2026-02-23T13:10:58.654309+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29877076536,"num_objects":455882,"num_object_clones":0,"num_object_copies":1367646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455882,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":905773,"num_write_kb":43570663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":93036632,"kb_used_data":87997576,"kb_used_omap":61,"kb_used_meta":5038722,"kb_avail":2842976168,"statfs":{"total":3006477107200,"available":2911207596032,"internally_reserved":0,"allocated":90109517824,"data_stored":90107496512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63468,"internal_metadata":5159651348},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7756644352,"num_objects":-118357,"num_object_clones":0,"num_object_copies":-355071,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-118357,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118357,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001648"},"pg_stats":[{"pgid":"4.f","version":"72'57006","reported_seq":57414,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:56.768106+0000","last_change":"2026-02-23T13:10:18.889561+0000","last_active":"2026-02-23T13:10:56.768106+0000","last_peered":"2026-02-23T13:10:56.768106+0000","last_clean":"2026-02-23T13:10:56.768106+0000","last_became_active":"2026-02-23T13:08:59.784888+0000","last_became_peered":"2026-02-23T13:08:59.784888+0000","last_unstale":"2026-02-23T13:10:56.768106+0000","last_undegraded":"2026-02-23T13:10:56.768106+0000","last_fullsized":"2026-02-23T13:10:56.768106+0000","mapping_epoch":62,"log_start":"72'57003","ondisk_log_start":"72'57003","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'37338","last_scrub_stamp":"2026-02-23T13:10:18.889417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:18.889417+0000","objects_scrubbed":36552,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:46.655322+0000","scrub_duration":3662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1877082112,"num_objects":28642,"num_object_clones":0,"num_object_copies":85926,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28642,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57006,"num_write_kb":2740736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"72'55905","reported_seq":56340,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:56.650993+0000","last_change":"2026-02-23T13:10:27.126280+0000","last_active":"2026-02-23T13:10:56.650993+0000","last_peered":"2026-02-23T13:10:56.650993+0000","last_clean":"2026-02-23T13:10:56.650993+0000","last_became_active":"2026-02-23T13:08:59.785397+0000","last_became_peered":"2026-02-23T13:08:59.785397+0000","last_unstale":"2026-02-23T13:10:56.650993+0000","last_undegraded":"2026-02-23T13:10:56.650993+0000","last_fullsized":"2026-02-23T13:10:56.650993+0000","mapping_epoch":62,"log_start":"72'55902","ondisk_log_start":"72'55902","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'40440","last_scrub_stamp":"2026-02-23T13:10:27.126174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:27.126174+0000","objects_scrubbed":39592,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:48.254573+0000","scrub_duration":3978,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1845166080,"num_objects":28155,"num_object_clones":0,"num_object_copies":84465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28155,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55905,"num_write_kb":2689920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"72'56616","reported_seq":56980,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:56.650580+0000","last_change":"2026-02-23T13:10:07.875495+0000","last_active":"2026-02-23T13:10:56.650580+0000","last_peered":"2026-02-23T13:10:56.650580+0000","last_clean":"2026-02-23T13:10:56.650580+0000","last_became_active":"2026-02-23T13:08:59.785780+0000","last_became_peered":"2026-02-23T13:08:59.785780+0000","last_unstale":"2026-02-23T13:10:56.650580+0000","last_undegraded":"2026-02-23T13:10:56.650580+0000","last_fullsized":"2026-02-23T13:10:56.650580+0000","mapping_epoch":62,"log_start":"72'56613","ondisk_log_start":"72'56613","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'32743","last_scrub_stamp":"2026-02-23T13:10:07.875449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:07.875449+0000","objects_scrubbed":32129,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:15.294906+0000","scrub_duration":3040,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1867186200,"num_objects":28492,"num_object_clones":0,"num_object_copies":85476,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28492,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":56616,"num_write_kb":2723393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"72'56901","reported_seq":57342,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:56.645172+0000","last_change":"2026-02-23T13:10:26.384628+0000","last_active":"2026-02-23T13:10:56.645172+0000","last_peered":"2026-02-23T13:10:56.645172+0000","last_clean":"2026-02-23T13:10:56.645172+0000","last_became_active":"2026-02-23T13:08:59.783982+0000","last_became_peered":"2026-02-23T13:08:59.783982+0000","last_unstale":"2026-02-23T13:10:56.645172+0000","last_undegraded":"2026-02-23T13:10:56.645172+0000","last_fullsized":"2026-02-23T13:10:56.645172+0000","mapping_epoch":62,"log_start":"72'56898","ondisk_log_start":"72'56898","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'40924","last_scrub_stamp":"2026-02-23T13:10:26.384602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:26.384602+0000","objects_scrubbed":40159,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:51.409315+0000","scrub_duration":3763,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1889599488,"num_objects":28833,"num_object_clones":0,"num_object_copies":86499,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28833,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56901,"num_write_kb":2743488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"72'56486","reported_seq":56939,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:56.647467+0000","last_change":"2026-02-23T13:10:36.436883+0000","last_active":"2026-02-23T13:10:56.647467+0000","last_peered":"2026-02-23T13:10:56.647467+0000","last_clean":"2026-02-23T13:10:56.647467+0000","last_became_active":"2026-02-23T13:08:59.784710+0000","last_became_peered":"2026-02-23T13:08:59.784710+0000","last_unstale":"2026-02-23T13:10:56.647467+0000","last_undegraded":"2026-02-23T13:10:56.647467+0000","last_fullsized":"2026-02-23T13:10:56.647467+0000","mapping_epoch":62,"log_start":"72'56483","ondisk_log_start":"72'56483","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'44729","last_scrub_stamp":"2026-02-23T13:10:36.436786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:36.436786+0000","objects_scrubbed":41142,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:51.122805+0000","scrub_duration":4872,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1862008832,"num_objects":28412,"num_object_clones":0,"num_object_copies":85236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28412,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56486,"num_write_kb":2716736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"72'56987","reported_seq":57452,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:56.657253+0000","last_change":"2026-02-23T13:10:31.717671+0000","last_active":"2026-02-23T13:10:56.657253+0000","last_peered":"2026-02-23T13:10:56.657253+0000","last_clean":"2026-02-23T13:10:56.657253+0000","last_became_active":"2026-02-23T13:08:59.784218+0000","last_became_peered":"2026-02-23T13:08:59.784218+0000","last_unstale":"2026-02-23T13:10:56.657253+0000","last_undegraded":"2026-02-23T13:10:56.657253+0000","last_fullsized":"2026-02-23T13:10:56.657253+0000","mapping_epoch":62,"log_start":"72'56984","ondisk_log_start":"72'56984","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'43162","last_scrub_stamp":"2026-02-23T13:10:31.717638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:31.717638+0000","objects_scrubbed":42156,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:36.022448+0000","scrub_duration":4538,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1873477632,"num_objects":28587,"num_object_clones":0,"num_object_copies":85761,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28587,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56987,"num_write_kb":2738368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"72'56459","reported_seq":56813,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:56.658987+0000","last_change":"2026-02-23T13:10:06.461634+0000","last_active":"2026-02-23T13:10:56.658987+0000","last_peered":"2026-02-23T13:10:56.658987+0000","last_clean":"2026-02-23T13:10:56.658987+0000","last_became_active":"2026-02-23T13:08:59.784210+0000","last_became_peered":"2026-02-23T13:08:59.784210+0000","last_unstale":"2026-02-23T13:10:56.658987+0000","last_undegraded":"2026-02-23T13:10:56.658987+0000","last_fullsized":"2026-02-23T13:10:56.658987+0000","mapping_epoch":62,"log_start":"72'56456","ondisk_log_start":"72'56456","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'32118","last_scrub_stamp":"2026-02-23T13:10:06.461563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:06.461563+0000","objects_scrubbed":31388,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:22.890897+0000","scrub_duration":3366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1867317248,"num_objects":28493,"num_object_clones":0,"num_object_copies":85479,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28493,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56459,"num_write_kb":2718464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"72'56079","reported_seq":56506,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:56.642690+0000","last_change":"2026-02-23T13:10:24.387952+0000","last_active":"2026-02-23T13:10:56.642690+0000","last_peered":"2026-02-23T13:10:56.642690+0000","last_clean":"2026-02-23T13:10:56.642690+0000","last_became_active":"2026-02-23T13:08:59.785359+0000","last_became_peered":"2026-02-23T13:08:59.785359+0000","last_unstale":"2026-02-23T13:10:56.642690+0000","last_undegraded":"2026-02-23T13:10:56.642690+0000","last_fullsized":"2026-02-23T13:10:56.642690+0000","mapping_epoch":62,"log_start":"72'56076","ondisk_log_start":"72'56076","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'39419","last_scrub_stamp":"2026-02-23T13:10:24.387875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:24.387875+0000","objects_scrubbed":38695,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:54.083097+0000","scrub_duration":3689,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1864695808,"num_objects":28453,"num_object_clones":0,"num_object_copies":85359,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28453,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56079,"num_write_kb":2705024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"72'56829","reported_seq":57290,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:56.769841+0000","last_change":"2026-02-23T13:10:34.960546+0000","last_active":"2026-02-23T13:10:56.769841+0000","last_peered":"2026-02-23T13:10:56.769841+0000","last_clean":"2026-02-23T13:10:56.769841+0000","last_became_active":"2026-02-23T13:08:59.785106+0000","last_became_peered":"2026-02-23T13:08:59.785106+0000","last_unstale":"2026-02-23T13:10:56.769841+0000","last_undegraded":"2026-02-23T13:10:56.769841+0000","last_fullsized":"2026-02-23T13:10:56.769841+0000","mapping_epoch":62,"log_start":"72'56826","ondisk_log_start":"72'56826","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'44040","last_scrub_stamp":"2026-02-23T13:10:34.960505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:34.960505+0000","objects_scrubbed":42002,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:42.696429+0000","scrub_duration":4826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1863909376,"num_objects":28441,"num_object_clones":0,"num_object_copies":85323,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28441,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56829,"num_write_kb":2728640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"72'56571","reported_seq":56972,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:56.649711+0000","last_change":"2026-02-23T13:10:17.283236+0000","last_active":"2026-02-23T13:10:56.649711+0000","last_peered":"2026-02-23T13:10:56.649711+0000","last_clean":"2026-02-23T13:10:56.649711+0000","last_became_active":"2026-02-23T13:08:59.784457+0000","last_became_peered":"2026-02-23T13:08:59.784457+0000","last_unstale":"2026-02-23T13:10:56.649711+0000","last_undegraded":"2026-02-23T13:10:56.649711+0000","last_fullsized":"2026-02-23T13:10:56.649711+0000","mapping_epoch":62,"log_start":"72'56568","ondisk_log_start":"72'56568","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'36652","last_scrub_stamp":"2026-02-23T13:10:17.283183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:17.283183+0000","objects_scrubbed":35965,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:47.102975+0000","scrub_duration":3592,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1880031232,"num_objects":28687,"num_object_clones":0,"num_object_copies":86061,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28687,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56571,"num_write_kb":2728256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"72'56570","reported_seq":56966,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:56.767081+0000","last_change":"2026-02-23T13:10:16.715418+0000","last_active":"2026-02-23T13:10:56.767081+0000","last_peered":"2026-02-23T13:10:56.767081+0000","last_clean":"2026-02-23T13:10:56.767081+0000","last_became_active":"2026-02-23T13:08:59.784235+0000","last_became_peered":"2026-02-23T13:08:59.784235+0000","last_unstale":"2026-02-23T13:10:56.767081+0000","last_undegraded":"2026-02-23T13:10:56.767081+0000","last_fullsized":"2026-02-23T13:10:56.767081+0000","mapping_epoch":62,"log_start":"72'56567","ondisk_log_start":"72'56567","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'36136","last_scrub_stamp":"2026-02-23T13:10:16.715358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:16.715358+0000","objects_scrubbed":35429,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:30.935136+0000","scrub_duration":3530,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1858732032,"num_objects":28362,"num_object_clones":0,"num_object_copies":85086,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28362,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56570,"num_write_kb":2717824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"72'56887","reported_seq":57234,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:56.643314+0000","last_change":"2026-02-23T13:10:03.037875+0000","last_active":"2026-02-23T13:10:56.643314+0000","last_peered":"2026-02-23T13:10:56.643314+0000","last_clean":"2026-02-23T13:10:56.643314+0000","last_became_active":"2026-02-23T13:08:59.784318+0000","last_became_peered":"2026-02-23T13:08:59.784318+0000","last_unstale":"2026-02-23T13:10:56.643314+0000","last_undegraded":"2026-02-23T13:10:56.643314+0000","last_fullsized":"2026-02-23T13:10:56.643314+0000","mapping_epoch":62,"log_start":"72'56884","ondisk_log_start":"72'56884","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'30914","last_scrub_stamp":"2026-02-23T13:10:03.037814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:03.037814+0000","objects_scrubbed":30174,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:29.315340+0000","scrub_duration":3318,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1877803008,"num_objects":28653,"num_object_clones":0,"num_object_copies":85959,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28653,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56887,"num_write_kb":2737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"72'56812","reported_seq":57197,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:56.765475+0000","last_change":"2026-02-23T13:10:13.380759+0000","last_active":"2026-02-23T13:10:56.765475+0000","last_peered":"2026-02-23T13:10:56.765475+0000","last_clean":"2026-02-23T13:10:56.765475+0000","last_became_active":"2026-02-23T13:08:59.784463+0000","last_became_peered":"2026-02-23T13:08:59.784463+0000","last_unstale":"2026-02-23T13:10:56.765475+0000","last_undegraded":"2026-02-23T13:10:56.765475+0000","last_fullsized":"2026-02-23T13:10:56.765475+0000","mapping_epoch":62,"log_start":"72'56809","ondisk_log_start":"72'56809","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'35060","last_scrub_stamp":"2026-02-23T13:10:13.380652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:13.380652+0000","objects_scrubbed":34448,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:31.033114+0000","scrub_duration":3163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1862664192,"num_objects":28422,"num_object_clones":0,"num_object_copies":85266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28422,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56812,"num_write_kb":2727488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"72'56837","reported_seq":57211,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:56.656874+0000","last_change":"2026-02-23T13:10:11.150558+0000","last_active":"2026-02-23T13:10:56.656874+0000","last_peered":"2026-02-23T13:10:56.656874+0000","last_clean":"2026-02-23T13:10:56.656874+0000","last_became_active":"2026-02-23T13:08:59.784436+0000","last_became_peered":"2026-02-23T13:08:59.784436+0000","last_unstale":"2026-02-23T13:10:56.656874+0000","last_undegraded":"2026-02-23T13:10:56.656874+0000","last_fullsized":"2026-02-23T13:10:56.656874+0000","mapping_epoch":62,"log_start":"72'56834","ondisk_log_start":"72'56834","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'34103","last_scrub_stamp":"2026-02-23T13:10:11.150522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:11.150522+0000","objects_scrubbed":33383,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:36.031575+0000","scrub_duration":3995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1861812224,"num_objects":28409,"num_object_clones":0,"num_object_copies":85227,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28409,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56837,"num_write_kb":2727872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"72'56498","reported_seq":56912,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:56.649504+0000","last_change":"2026-02-23T13:10:43.059389+0000","last_active":"2026-02-23T13:10:56.649504+0000","last_peered":"2026-02-23T13:10:56.649504+0000","last_clean":"2026-02-23T13:10:56.649504+0000","last_became_active":"2026-02-23T13:08:59.784290+0000","last_became_peered":"2026-02-23T13:08:59.784290+0000","last_unstale":"2026-02-23T13:10:56.649504+0000","last_undegraded":"2026-02-23T13:10:56.649504+0000","last_fullsized":"2026-02-23T13:10:56.649504+0000","mapping_epoch":62,"log_start":"72'56495","ondisk_log_start":"72'56495","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'48491","last_scrub_stamp":"2026-02-23T13:10:43.059312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:43.059312+0000","objects_scrubbed":37287,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:55.819637+0000","scrub_duration":3592,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1856897024,"num_objects":28334,"num_object_clones":0,"num_object_copies":85002,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28334,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56498,"num_write_kb":2714624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"72'56195","reported_seq":56576,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:56.649114+0000","last_change":"2026-02-23T13:10:13.394783+0000","last_active":"2026-02-23T13:10:56.649114+0000","last_peered":"2026-02-23T13:10:56.649114+0000","last_clean":"2026-02-23T13:10:56.649114+0000","last_became_active":"2026-02-23T13:08:59.785634+0000","last_became_peered":"2026-02-23T13:08:59.785634+0000","last_unstale":"2026-02-23T13:10:56.649114+0000","last_undegraded":"2026-02-23T13:10:56.649114+0000","last_fullsized":"2026-02-23T13:10:56.649114+0000","mapping_epoch":62,"log_start":"72'56192","ondisk_log_start":"72'56192","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'34740","last_scrub_stamp":"2026-02-23T13:10:13.394732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:13.394732+0000","objects_scrubbed":34037,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:23.660349+0000","scrub_duration":3642,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1868103680,"num_objects":28505,"num_object_clones":0,"num_object_copies":85515,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28505,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56195,"num_write_kb":2710400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":323,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:45.570064+0000","last_change":"2026-02-23T13:10:45.570064+0000","last_active":"2026-02-23T13:10:45.570064+0000","last_peered":"2026-02-23T13:10:45.570064+0000","last_clean":"2026-02-23T13:10:45.570064+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:10:45.570064+0000","last_undegraded":"2026-02-23T13:10:45.570064+0000","last_fullsized":"2026-02-23T13:10:45.570064+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:10:45.570030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:10:45.570030+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:48.611576+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":29876486168,"num_objects":455880,"num_object_clones":0,"num_object_copies":1367640,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455880,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":905638,"num_write_kb":43568513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":89640153088,"data_stored":89640140872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1023,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247906,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":23240024,"kb_used_data":21920068,"kb_used_omap":13,"kb_used_meta":1319858,"kb_avail":710763176,"statfs":{"total":751619276800,"available":727821492224,"internally_reserved":0,"allocated":22446149632,"data_stored":22445642398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13487,"internal_metadata":1351535441},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444133,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":26852504,"kb_used_data":25743684,"kb_used_omap":17,"kb_used_meta":1108782,"kb_avail":707150696,"statfs":{"total":751619276800,"available":724122312704,"internally_reserved":0,"allocated":26361532416,"data_stored":26361025182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17674,"internal_metadata":1135393526},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574951,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":19728720,"kb_used_data":18422204,"kb_used_omap":17,"kb_used_meta":1306350,"kb_avail":714274480,"statfs":{"total":751619276800,"available":731417067520,"internally_reserved":0,"allocated":18864336896,"data_stored":18863837286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18056,"internal_metadata":1337702776},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705768,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":23215384,"kb_used_data":21911620,"kb_used_omap":13,"kb_used_meta":1303730,"kb_avail":710787816,"statfs":{"total":751619276800,"available":727846723584,"internally_reserved":0,"allocated":22437498880,"data_stored":22436991646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14251,"internal_metadata":1335019605},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1023,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":22408007680,"data_stored":22408003608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":18651611136,"data_stored":18651611136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":26160926720,"data_stored":26160922648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":22419607552,"data_stored":22419603480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:10:59.918 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:10:59.918 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_2 pg_num 76 2026-02-23T13:10:59.993 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:00.070 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:10:59 trial046 ceph-mon[38575]: pgmap v287: 17 pgs: 17 active+clean; 28 GiB data, 89 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 9.86k op/s 2026-02-23T13:11:00.112 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:00.123 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:00.121+0000 7f9f2fcb4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:00.124 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:00.122+0000 7f9f2fcb4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:00.140 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:11:00.140 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:11:00.154 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:11:00.154 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:11:00.167 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:11:00.167 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:11:00.182 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:11:00.182 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:11:00.246 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:00.245+0000 7f78ca183640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:00.247 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:00.245+0000 7f78ca183640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:00.390 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:11:00.428 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:11:01.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:00 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1877488120' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:11:01.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:00 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1328661899' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_2", "var": "pg_num", "val": "76"} : dispatch 2026-02-23T13:11:01.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:00 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:11:02.245 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:11:02.272 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:01 trial046 ceph-mon[38575]: from='client.15070 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:11:02.272 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:01 trial046 ceph-mon[38575]: pgmap v288: 17 pgs: 17 active+clean; 28 GiB data, 89 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 8.00k op/s 2026-02-23T13:11:02.402 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:02.846 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:02.795+0000 7fdd122f7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:02.846 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:02.795+0000 7fdd122f7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:02.846 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:11:02.846 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:11:02.846 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:11:02.847 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:11:02.851 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:11:02.851 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:11:02.865 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:11:02.865 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:11:03.149 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:02 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1270098284' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:11:04.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:03 trial046 ceph-mon[38575]: pgmap v289: 17 pgs: 17 active+clean; 25 GiB data, 80 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 12.05k op/s 2026-02-23T13:11:05.430 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:11:05.430 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:11:05.430 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_2 2026-02-23T13:11:05.430 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:11:05.566 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:11:05.570 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:05.746 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:05 trial046 ceph-mon[38575]: pgmap v290: 17 pgs: 17 active+clean; 25 GiB data, 80 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 8.07k op/s 2026-02-23T13:11:05.819 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:05.744+0000 7fb57e61f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:05.820 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:05.744+0000 7fb57e61f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:05.838 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:05.895 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:11:05.895 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:11:06.121 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":290,"stamp":"2026-02-23T13:11:04.655139+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26691306040,"num_objects":407271,"num_object_clones":0,"num_object_copies":1221813,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":407271,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":954384,"num_write_kb":43570663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":84110616,"kb_used_data":78746824,"kb_used_omap":61,"kb_used_meta":5363586,"kb_avail":2851902184,"statfs":{"total":3006477107200,"available":2920347836416,"internally_reserved":0,"allocated":80636747776,"data_stored":80634726464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63468,"internal_metadata":5492312084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6345195520,"num_objects":-96820,"num_object_clones":0,"num_object_copies":-290460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-96820,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96820,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001651"},"pg_stats":[{"pgid":"4.f","version":"72'60003","reported_seq":60411,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:01.767802+0000","last_change":"2026-02-23T13:10:18.889561+0000","last_active":"2026-02-23T13:11:01.767802+0000","last_peered":"2026-02-23T13:11:01.767802+0000","last_clean":"2026-02-23T13:11:01.767802+0000","last_became_active":"2026-02-23T13:08:59.784888+0000","last_became_peered":"2026-02-23T13:08:59.784888+0000","last_unstale":"2026-02-23T13:11:01.767802+0000","last_undegraded":"2026-02-23T13:11:01.767802+0000","last_fullsized":"2026-02-23T13:11:01.767802+0000","mapping_epoch":62,"log_start":"72'60000","ondisk_log_start":"72'60000","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'37338","last_scrub_stamp":"2026-02-23T13:10:18.889417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:18.889417+0000","objects_scrubbed":36552,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:46.655322+0000","scrub_duration":3662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1680670720,"num_objects":25645,"num_object_clones":0,"num_object_copies":76935,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25645,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60003,"num_write_kb":2740736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"72'58869","reported_seq":59304,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:01.661068+0000","last_change":"2026-02-23T13:10:27.126280+0000","last_active":"2026-02-23T13:11:01.661068+0000","last_peered":"2026-02-23T13:11:01.661068+0000","last_clean":"2026-02-23T13:11:01.661068+0000","last_became_active":"2026-02-23T13:08:59.785397+0000","last_became_peered":"2026-02-23T13:08:59.785397+0000","last_unstale":"2026-02-23T13:11:01.661068+0000","last_undegraded":"2026-02-23T13:11:01.661068+0000","last_fullsized":"2026-02-23T13:11:01.661068+0000","mapping_epoch":62,"log_start":"72'58866","ondisk_log_start":"72'58866","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'40440","last_scrub_stamp":"2026-02-23T13:10:27.126174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:27.126174+0000","objects_scrubbed":39592,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:48.254573+0000","scrub_duration":3978,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1650917376,"num_objects":25191,"num_object_clones":0,"num_object_copies":75573,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25191,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58869,"num_write_kb":2689920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"72'59620","reported_seq":59984,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:01.651160+0000","last_change":"2026-02-23T13:10:07.875495+0000","last_active":"2026-02-23T13:11:01.651160+0000","last_peered":"2026-02-23T13:11:01.651160+0000","last_clean":"2026-02-23T13:11:01.651160+0000","last_became_active":"2026-02-23T13:08:59.785780+0000","last_became_peered":"2026-02-23T13:08:59.785780+0000","last_unstale":"2026-02-23T13:11:01.651160+0000","last_undegraded":"2026-02-23T13:11:01.651160+0000","last_fullsized":"2026-02-23T13:11:01.651160+0000","mapping_epoch":62,"log_start":"72'59617","ondisk_log_start":"72'59617","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'32743","last_scrub_stamp":"2026-02-23T13:10:07.875449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:07.875449+0000","objects_scrubbed":32129,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:15.294906+0000","scrub_duration":3040,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1670316056,"num_objects":25488,"num_object_clones":0,"num_object_copies":76464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25488,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":59620,"num_write_kb":2723393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"72'60002","reported_seq":60443,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:01.649424+0000","last_change":"2026-02-23T13:10:26.384628+0000","last_active":"2026-02-23T13:11:01.649424+0000","last_peered":"2026-02-23T13:11:01.649424+0000","last_clean":"2026-02-23T13:11:01.649424+0000","last_became_active":"2026-02-23T13:08:59.783982+0000","last_became_peered":"2026-02-23T13:08:59.783982+0000","last_unstale":"2026-02-23T13:11:01.649424+0000","last_undegraded":"2026-02-23T13:11:01.649424+0000","last_fullsized":"2026-02-23T13:11:01.649424+0000","mapping_epoch":62,"log_start":"72'59999","ondisk_log_start":"72'59999","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'40924","last_scrub_stamp":"2026-02-23T13:10:26.384602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:26.384602+0000","objects_scrubbed":40159,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:51.409315+0000","scrub_duration":3763,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1686372352,"num_objects":25732,"num_object_clones":0,"num_object_copies":77196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25732,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60002,"num_write_kb":2743488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"72'59542","reported_seq":59994,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:01.649115+0000","last_change":"2026-02-23T13:10:36.436883+0000","last_active":"2026-02-23T13:11:01.649115+0000","last_peered":"2026-02-23T13:11:01.649115+0000","last_clean":"2026-02-23T13:11:01.649115+0000","last_became_active":"2026-02-23T13:08:59.784710+0000","last_became_peered":"2026-02-23T13:08:59.784710+0000","last_unstale":"2026-02-23T13:11:01.649115+0000","last_undegraded":"2026-02-23T13:11:01.649115+0000","last_fullsized":"2026-02-23T13:11:01.649115+0000","mapping_epoch":62,"log_start":"72'59539","ondisk_log_start":"72'59539","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'44729","last_scrub_stamp":"2026-02-23T13:10:36.436786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:36.436786+0000","objects_scrubbed":41142,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:51.122805+0000","scrub_duration":4872,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1661730816,"num_objects":25356,"num_object_clones":0,"num_object_copies":76068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25356,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59542,"num_write_kb":2716736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"72'59999","reported_seq":60464,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:01.659009+0000","last_change":"2026-02-23T13:10:31.717671+0000","last_active":"2026-02-23T13:11:01.659009+0000","last_peered":"2026-02-23T13:11:01.659009+0000","last_clean":"2026-02-23T13:11:01.659009+0000","last_became_active":"2026-02-23T13:08:59.784218+0000","last_became_peered":"2026-02-23T13:08:59.784218+0000","last_unstale":"2026-02-23T13:11:01.659009+0000","last_undegraded":"2026-02-23T13:11:01.659009+0000","last_fullsized":"2026-02-23T13:11:01.659009+0000","mapping_epoch":62,"log_start":"72'59996","ondisk_log_start":"72'59996","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'43162","last_scrub_stamp":"2026-02-23T13:10:31.717638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:31.717638+0000","objects_scrubbed":42156,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:36.022448+0000","scrub_duration":4538,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1676083200,"num_objects":25575,"num_object_clones":0,"num_object_copies":76725,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25575,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59999,"num_write_kb":2738368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"72'59455","reported_seq":59809,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:01.659294+0000","last_change":"2026-02-23T13:10:06.461634+0000","last_active":"2026-02-23T13:11:01.659294+0000","last_peered":"2026-02-23T13:11:01.659294+0000","last_clean":"2026-02-23T13:11:01.659294+0000","last_became_active":"2026-02-23T13:08:59.784210+0000","last_became_peered":"2026-02-23T13:08:59.784210+0000","last_unstale":"2026-02-23T13:11:01.659294+0000","last_undegraded":"2026-02-23T13:11:01.659294+0000","last_fullsized":"2026-02-23T13:11:01.659294+0000","mapping_epoch":62,"log_start":"72'59452","ondisk_log_start":"72'59452","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'32118","last_scrub_stamp":"2026-02-23T13:10:06.461563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:06.461563+0000","objects_scrubbed":31388,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:22.890897+0000","scrub_duration":3366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1670971392,"num_objects":25497,"num_object_clones":0,"num_object_copies":76491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25497,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59455,"num_write_kb":2718464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"72'59165","reported_seq":59592,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:01.650523+0000","last_change":"2026-02-23T13:10:24.387952+0000","last_active":"2026-02-23T13:11:01.650523+0000","last_peered":"2026-02-23T13:11:01.650523+0000","last_clean":"2026-02-23T13:11:01.650523+0000","last_became_active":"2026-02-23T13:08:59.785359+0000","last_became_peered":"2026-02-23T13:08:59.785359+0000","last_unstale":"2026-02-23T13:11:01.650523+0000","last_undegraded":"2026-02-23T13:11:01.650523+0000","last_fullsized":"2026-02-23T13:11:01.650523+0000","mapping_epoch":62,"log_start":"72'59162","ondisk_log_start":"72'59162","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'39419","last_scrub_stamp":"2026-02-23T13:10:24.387875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:24.387875+0000","objects_scrubbed":38695,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:54.083097+0000","scrub_duration":3689,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1662451712,"num_objects":25367,"num_object_clones":0,"num_object_copies":76101,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25367,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59165,"num_write_kb":2705024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"72'59845","reported_seq":60306,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:01.771828+0000","last_change":"2026-02-23T13:10:34.960546+0000","last_active":"2026-02-23T13:11:01.771828+0000","last_peered":"2026-02-23T13:11:01.771828+0000","last_clean":"2026-02-23T13:11:01.771828+0000","last_became_active":"2026-02-23T13:08:59.785106+0000","last_became_peered":"2026-02-23T13:08:59.785106+0000","last_unstale":"2026-02-23T13:11:01.771828+0000","last_undegraded":"2026-02-23T13:11:01.771828+0000","last_fullsized":"2026-02-23T13:11:01.771828+0000","mapping_epoch":62,"log_start":"72'59842","ondisk_log_start":"72'59842","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'44040","last_scrub_stamp":"2026-02-23T13:10:34.960505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:34.960505+0000","objects_scrubbed":42002,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:42.696429+0000","scrub_duration":4826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1666252800,"num_objects":25425,"num_object_clones":0,"num_object_copies":76275,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25425,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59845,"num_write_kb":2728640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"72'59711","reported_seq":60112,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:01.645525+0000","last_change":"2026-02-23T13:10:17.283236+0000","last_active":"2026-02-23T13:11:01.645525+0000","last_peered":"2026-02-23T13:11:01.645525+0000","last_clean":"2026-02-23T13:11:01.645525+0000","last_became_active":"2026-02-23T13:08:59.784457+0000","last_became_peered":"2026-02-23T13:08:59.784457+0000","last_unstale":"2026-02-23T13:11:01.645525+0000","last_undegraded":"2026-02-23T13:11:01.645525+0000","last_fullsized":"2026-02-23T13:11:01.645525+0000","mapping_epoch":62,"log_start":"72'59708","ondisk_log_start":"72'59708","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'36652","last_scrub_stamp":"2026-02-23T13:10:17.283183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:17.283183+0000","objects_scrubbed":35965,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:47.102975+0000","scrub_duration":3592,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1674248192,"num_objects":25547,"num_object_clones":0,"num_object_copies":76641,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25547,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59711,"num_write_kb":2728256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"72'59529","reported_seq":59925,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:01.771072+0000","last_change":"2026-02-23T13:10:16.715418+0000","last_active":"2026-02-23T13:11:01.771072+0000","last_peered":"2026-02-23T13:11:01.771072+0000","last_clean":"2026-02-23T13:11:01.771072+0000","last_became_active":"2026-02-23T13:08:59.784235+0000","last_became_peered":"2026-02-23T13:08:59.784235+0000","last_unstale":"2026-02-23T13:11:01.771072+0000","last_undegraded":"2026-02-23T13:11:01.771072+0000","last_fullsized":"2026-02-23T13:11:01.771072+0000","mapping_epoch":62,"log_start":"72'59526","ondisk_log_start":"72'59526","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'36136","last_scrub_stamp":"2026-02-23T13:10:16.715358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:16.715358+0000","objects_scrubbed":35429,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:30.935136+0000","scrub_duration":3530,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1664811008,"num_objects":25403,"num_object_clones":0,"num_object_copies":76209,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25403,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59529,"num_write_kb":2717824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"72'59980","reported_seq":60326,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:01.648802+0000","last_change":"2026-02-23T13:10:03.037875+0000","last_active":"2026-02-23T13:11:01.648802+0000","last_peered":"2026-02-23T13:11:01.648802+0000","last_clean":"2026-02-23T13:11:01.648802+0000","last_became_active":"2026-02-23T13:08:59.784318+0000","last_became_peered":"2026-02-23T13:08:59.784318+0000","last_unstale":"2026-02-23T13:11:01.648802+0000","last_undegraded":"2026-02-23T13:11:01.648802+0000","last_fullsized":"2026-02-23T13:11:01.648802+0000","mapping_epoch":62,"log_start":"72'59977","ondisk_log_start":"72'59977","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'30914","last_scrub_stamp":"2026-02-23T13:10:03.037814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:03.037814+0000","objects_scrubbed":30174,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:29.315340+0000","scrub_duration":3318,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1675100160,"num_objects":25560,"num_object_clones":0,"num_object_copies":76680,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25560,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59980,"num_write_kb":2737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"72'59895","reported_seq":60280,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:01.768638+0000","last_change":"2026-02-23T13:10:13.380759+0000","last_active":"2026-02-23T13:11:01.768638+0000","last_peered":"2026-02-23T13:11:01.768638+0000","last_clean":"2026-02-23T13:11:01.768638+0000","last_became_active":"2026-02-23T13:08:59.784463+0000","last_became_peered":"2026-02-23T13:08:59.784463+0000","last_unstale":"2026-02-23T13:11:01.768638+0000","last_undegraded":"2026-02-23T13:11:01.768638+0000","last_fullsized":"2026-02-23T13:11:01.768638+0000","mapping_epoch":62,"log_start":"72'59892","ondisk_log_start":"72'59892","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'35060","last_scrub_stamp":"2026-02-23T13:10:13.380652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:13.380652+0000","objects_scrubbed":34448,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:31.033114+0000","scrub_duration":3163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1660616704,"num_objects":25339,"num_object_clones":0,"num_object_copies":76017,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25339,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59895,"num_write_kb":2727488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"72'59868","reported_seq":60242,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:01.659227+0000","last_change":"2026-02-23T13:10:11.150558+0000","last_active":"2026-02-23T13:11:01.659227+0000","last_peered":"2026-02-23T13:11:01.659227+0000","last_clean":"2026-02-23T13:11:01.659227+0000","last_became_active":"2026-02-23T13:08:59.784436+0000","last_became_peered":"2026-02-23T13:08:59.784436+0000","last_unstale":"2026-02-23T13:11:01.659227+0000","last_undegraded":"2026-02-23T13:11:01.659227+0000","last_fullsized":"2026-02-23T13:11:01.659227+0000","mapping_epoch":62,"log_start":"72'59865","ondisk_log_start":"72'59865","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'34103","last_scrub_stamp":"2026-02-23T13:10:11.150522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:11.150522+0000","objects_scrubbed":33383,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:36.031575+0000","scrub_duration":3995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1663172608,"num_objects":25378,"num_object_clones":0,"num_object_copies":76134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25378,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59868,"num_write_kb":2727872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"72'59482","reported_seq":59897,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:01.647179+0000","last_change":"2026-02-23T13:10:43.059389+0000","last_active":"2026-02-23T13:11:01.647179+0000","last_peered":"2026-02-23T13:11:01.647179+0000","last_clean":"2026-02-23T13:11:01.647179+0000","last_became_active":"2026-02-23T13:08:59.784290+0000","last_became_peered":"2026-02-23T13:08:59.784290+0000","last_unstale":"2026-02-23T13:11:01.647179+0000","last_undegraded":"2026-02-23T13:11:01.647179+0000","last_fullsized":"2026-02-23T13:11:01.647179+0000","mapping_epoch":62,"log_start":"72'59479","ondisk_log_start":"72'59479","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'48491","last_scrub_stamp":"2026-02-23T13:10:43.059312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:43.059312+0000","objects_scrubbed":37287,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:55.819637+0000","scrub_duration":3592,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1661337600,"num_objects":25350,"num_object_clones":0,"num_object_copies":76050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25350,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59482,"num_write_kb":2714624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"72'59284","reported_seq":59663,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:01.651102+0000","last_change":"2026-02-23T13:10:13.394783+0000","last_active":"2026-02-23T13:11:01.651102+0000","last_peered":"2026-02-23T13:11:01.651102+0000","last_clean":"2026-02-23T13:11:01.651102+0000","last_became_active":"2026-02-23T13:08:59.785634+0000","last_became_peered":"2026-02-23T13:08:59.785634+0000","last_unstale":"2026-02-23T13:11:01.651102+0000","last_undegraded":"2026-02-23T13:11:01.651102+0000","last_fullsized":"2026-02-23T13:11:01.651102+0000","mapping_epoch":62,"log_start":"72'59281","ondisk_log_start":"72'59281","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'34740","last_scrub_stamp":"2026-02-23T13:10:13.394732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:13.394732+0000","objects_scrubbed":34037,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:23.660349+0000","scrub_duration":3642,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1665662976,"num_objects":25416,"num_object_clones":0,"num_object_copies":76248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25416,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59284,"num_write_kb":2710400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":324,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:45.570100+0000","last_change":"2026-02-23T13:10:45.570064+0000","last_active":"2026-02-23T13:10:45.570100+0000","last_peered":"2026-02-23T13:10:45.570100+0000","last_clean":"2026-02-23T13:10:45.570100+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:10:45.570100+0000","last_undegraded":"2026-02-23T13:10:45.570100+0000","last_fullsized":"2026-02-23T13:10:45.570100+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:10:45.570030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:10:45.570030+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:48.611576+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":26690715672,"num_objects":407269,"num_object_clones":0,"num_object_copies":1221807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":407269,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":954249,"num_write_kb":43568513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":80081530880,"data_stored":80081518664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1023,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247907,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":20998680,"kb_used_data":19606532,"kb_used_omap":13,"kb_used_meta":1392050,"kb_avail":713004520,"statfs":{"total":751619276800,"available":730116628480,"internally_reserved":0,"allocated":20077088768,"data_stored":20076581534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13487,"internal_metadata":1425460049},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444134,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":24364120,"kb_used_data":23128964,"kb_used_omap":17,"kb_used_meta":1235118,"kb_avail":709639080,"statfs":{"total":751619276800,"available":726670417920,"internally_reserved":0,"allocated":23684059136,"data_stored":23683551902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17674,"internal_metadata":1264761590},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574952,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":17803344,"kb_used_data":16442812,"kb_used_omap":17,"kb_used_meta":1360494,"kb_avail":716199856,"statfs":{"total":751619276800,"available":733388652544,"internally_reserved":0,"allocated":16837439488,"data_stored":16836939878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18056,"internal_metadata":1393146232},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705769,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":20944472,"kb_used_data":19568516,"kb_used_omap":13,"kb_used_meta":1375922,"kb_avail":713058728,"statfs":{"total":751619276800,"available":730172137472,"internally_reserved":0,"allocated":20038160384,"data_stored":20037653150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14251,"internal_metadata":1408944213},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1023,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20012994560,"data_stored":20012990488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16664100864,"data_stored":16664100864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23370731520,"data_stored":23370727448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20033703936,"data_stored":20033699864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:11:06.123 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_2 pgp_num 76 2026-02-23T13:11:06.137 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:06.135+0000 7f04663d6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:06.138 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:06.136+0000 7f04663d6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:06.153 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:11:06.153 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:11:06.167 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:11:06.168 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:11:06.179 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:11:06.179 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:11:06.192 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:11:06.192 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:11:06.283 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:06.289 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:11:06 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:11:06] "GET /metrics HTTP/1.1" 200 4227 "" "Prometheus/3.6.0" 2026-02-23T13:11:06.419 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:06.417+0000 7f6278a23640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:06.419 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:06.418+0000 7f6278a23640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:06.560 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:11:06 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:11:06.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:11:06.587 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-23T13:11:06.628 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:11:07.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:06 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2021585050' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:11:08.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:07 trial046 ceph-mon[38575]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:11:08.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:07 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3454046676' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_2", "var": "pgp_num", "val": "76"} : dispatch 2026-02-23T13:11:08.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:07 trial046 ceph-mon[38575]: pgmap v291: 17 pgs: 17 active+clean; 23 GiB data, 77 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 9.92k op/s 2026-02-23T13:11:08.237 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:11:08.384 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:08.504 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:08.502+0000 7f5f9311b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:08.505 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:08.503+0000 7f5f9311b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:08.519 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:11:08.519 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:11:08.532 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:11:08.532 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:11:08.549 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:11:08.549 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:11:08.563 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:11:08.563 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:11:08.771 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:08 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1541812804' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:11:10.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:09 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-23T13:11:10.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:09 trial046 ceph-mon[38575]: pgmap v292: 17 pgs: 17 active+clean; 22 GiB data, 73 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 9.74k op/s 2026-02-23T13:11:10.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:09 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:11:10.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:09 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-23T13:11:10.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:09 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:11:10.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:09 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-23T13:11:11.142 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:11:11.283 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:11.409 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:11.407+0000 7f292a65b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:11.410 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:11.407+0000 7f292a65b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:11.428 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:11:11.428 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:11:11.445 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:11:11.445 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:11:11.458 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:11:11.458 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:11:11.471 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:11:11.471 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:11:11.629 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:11:11.630 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:11:11.630 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:11:11.779 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:11.900 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:11.897+0000 7f901539e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:11.900 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:11.898+0000 7f901539e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:12.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:11 trial046 ceph-mon[38575]: pgmap v293: 17 pgs: 17 active+clean; 22 GiB data, 73 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 7.72k op/s 2026-02-23T13:11:12.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:11 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2970662284' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:11:12.046 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:11:12.046 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:11:12.089 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":293,"stamp":"2026-02-23T13:11:10.655903+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23801430584,"num_objects":363175,"num_object_clones":0,"num_object_copies":1089525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":363175,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":998480,"num_write_kb":43570663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":76255448,"kb_used_data":70656904,"kb_used_omap":61,"kb_used_meta":5598210,"kb_avail":2859757352,"statfs":{"total":3006477107200,"available":2928391528448,"internally_reserved":0,"allocated":72352669696,"data_stored":72350648384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63468,"internal_metadata":5732567060},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6075645952,"num_objects":-92707,"num_object_clones":0,"num_object_copies":-278121,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-92707,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92707,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001593"},"pg_stats":[{"pgid":"4.f","version":"72'62711","reported_seq":63119,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:06.772443+0000","last_change":"2026-02-23T13:10:18.889561+0000","last_active":"2026-02-23T13:11:06.772443+0000","last_peered":"2026-02-23T13:11:06.772443+0000","last_clean":"2026-02-23T13:11:06.772443+0000","last_became_active":"2026-02-23T13:08:59.784888+0000","last_became_peered":"2026-02-23T13:08:59.784888+0000","last_unstale":"2026-02-23T13:11:06.772443+0000","last_undegraded":"2026-02-23T13:11:06.772443+0000","last_fullsized":"2026-02-23T13:11:06.772443+0000","mapping_epoch":62,"log_start":"72'62708","ondisk_log_start":"72'62708","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'37338","last_scrub_stamp":"2026-02-23T13:10:18.889417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:18.889417+0000","objects_scrubbed":36552,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:46.655322+0000","scrub_duration":3662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1503199232,"num_objects":22937,"num_object_clones":0,"num_object_copies":68811,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22937,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62711,"num_write_kb":2740736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"72'61621","reported_seq":62056,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:06.659495+0000","last_change":"2026-02-23T13:10:27.126280+0000","last_active":"2026-02-23T13:11:06.659495+0000","last_peered":"2026-02-23T13:11:06.659495+0000","last_clean":"2026-02-23T13:11:06.659495+0000","last_became_active":"2026-02-23T13:08:59.785397+0000","last_became_peered":"2026-02-23T13:08:59.785397+0000","last_unstale":"2026-02-23T13:11:06.659495+0000","last_undegraded":"2026-02-23T13:11:06.659495+0000","last_fullsized":"2026-02-23T13:11:06.659495+0000","mapping_epoch":62,"log_start":"72'61618","ondisk_log_start":"72'61618","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'40440","last_scrub_stamp":"2026-02-23T13:10:27.126174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:27.126174+0000","objects_scrubbed":39592,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:48.254573+0000","scrub_duration":3978,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470562304,"num_objects":22439,"num_object_clones":0,"num_object_copies":67317,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22439,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61621,"num_write_kb":2689920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"72'62371","reported_seq":62735,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:06.650502+0000","last_change":"2026-02-23T13:10:07.875495+0000","last_active":"2026-02-23T13:11:06.650502+0000","last_peered":"2026-02-23T13:11:06.650502+0000","last_clean":"2026-02-23T13:11:06.650502+0000","last_became_active":"2026-02-23T13:08:59.785780+0000","last_became_peered":"2026-02-23T13:08:59.785780+0000","last_unstale":"2026-02-23T13:11:06.650502+0000","last_undegraded":"2026-02-23T13:11:06.650502+0000","last_fullsized":"2026-02-23T13:11:06.650502+0000","mapping_epoch":62,"log_start":"72'62368","ondisk_log_start":"72'62368","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'32743","last_scrub_stamp":"2026-02-23T13:10:07.875449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:07.875449+0000","objects_scrubbed":32129,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:15.294906+0000","scrub_duration":3040,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1490026520,"num_objects":22737,"num_object_clones":0,"num_object_copies":68211,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22737,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":62371,"num_write_kb":2723393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"72'62864","reported_seq":63305,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:06.641082+0000","last_change":"2026-02-23T13:10:26.384628+0000","last_active":"2026-02-23T13:11:06.641082+0000","last_peered":"2026-02-23T13:11:06.641082+0000","last_clean":"2026-02-23T13:11:06.641082+0000","last_became_active":"2026-02-23T13:08:59.783982+0000","last_became_peered":"2026-02-23T13:08:59.783982+0000","last_unstale":"2026-02-23T13:11:06.641082+0000","last_undegraded":"2026-02-23T13:11:06.641082+0000","last_fullsized":"2026-02-23T13:11:06.641082+0000","mapping_epoch":62,"log_start":"72'62861","ondisk_log_start":"72'62861","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'40924","last_scrub_stamp":"2026-02-23T13:10:26.384602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:26.384602+0000","objects_scrubbed":40159,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:51.409315+0000","scrub_duration":3763,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1498808320,"num_objects":22870,"num_object_clones":0,"num_object_copies":68610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22870,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62864,"num_write_kb":2743488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"72'62258","reported_seq":62711,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:06.650040+0000","last_change":"2026-02-23T13:10:36.436883+0000","last_active":"2026-02-23T13:11:06.650040+0000","last_peered":"2026-02-23T13:11:06.650040+0000","last_clean":"2026-02-23T13:11:06.650040+0000","last_became_active":"2026-02-23T13:08:59.784710+0000","last_became_peered":"2026-02-23T13:08:59.784710+0000","last_unstale":"2026-02-23T13:11:06.650040+0000","last_undegraded":"2026-02-23T13:11:06.650040+0000","last_fullsized":"2026-02-23T13:11:06.650040+0000","mapping_epoch":62,"log_start":"72'62255","ondisk_log_start":"72'62255","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'44729","last_scrub_stamp":"2026-02-23T13:10:36.436786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:36.436786+0000","objects_scrubbed":41142,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:51.122805+0000","scrub_duration":4872,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1483735040,"num_objects":22640,"num_object_clones":0,"num_object_copies":67920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22640,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62258,"num_write_kb":2716736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"72'62679","reported_seq":63143,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:06.660929+0000","last_change":"2026-02-23T13:10:31.717671+0000","last_active":"2026-02-23T13:11:06.660929+0000","last_peered":"2026-02-23T13:11:06.660929+0000","last_clean":"2026-02-23T13:11:06.660929+0000","last_became_active":"2026-02-23T13:08:59.784218+0000","last_became_peered":"2026-02-23T13:08:59.784218+0000","last_unstale":"2026-02-23T13:11:06.660929+0000","last_undegraded":"2026-02-23T13:11:06.660929+0000","last_fullsized":"2026-02-23T13:11:06.660929+0000","mapping_epoch":62,"log_start":"72'62676","ondisk_log_start":"72'62676","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'43162","last_scrub_stamp":"2026-02-23T13:10:31.717638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:31.717638+0000","objects_scrubbed":42156,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:36.022448+0000","scrub_duration":4538,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1500446720,"num_objects":22895,"num_object_clones":0,"num_object_copies":68685,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22895,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62679,"num_write_kb":2738368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"72'62193","reported_seq":62547,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:06.658561+0000","last_change":"2026-02-23T13:10:06.461634+0000","last_active":"2026-02-23T13:11:06.658561+0000","last_peered":"2026-02-23T13:11:06.658561+0000","last_clean":"2026-02-23T13:11:06.658561+0000","last_became_active":"2026-02-23T13:08:59.784210+0000","last_became_peered":"2026-02-23T13:08:59.784210+0000","last_unstale":"2026-02-23T13:11:06.658561+0000","last_undegraded":"2026-02-23T13:11:06.658561+0000","last_fullsized":"2026-02-23T13:11:06.658561+0000","mapping_epoch":62,"log_start":"72'62190","ondisk_log_start":"72'62190","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'32118","last_scrub_stamp":"2026-02-23T13:10:06.461563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:06.461563+0000","objects_scrubbed":31388,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:22.890897+0000","scrub_duration":3366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1491533824,"num_objects":22759,"num_object_clones":0,"num_object_copies":68277,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22759,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62193,"num_write_kb":2718464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"72'62008","reported_seq":62435,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:06.648550+0000","last_change":"2026-02-23T13:10:24.387952+0000","last_active":"2026-02-23T13:11:06.648550+0000","last_peered":"2026-02-23T13:11:06.648550+0000","last_clean":"2026-02-23T13:11:06.648550+0000","last_became_active":"2026-02-23T13:08:59.785359+0000","last_became_peered":"2026-02-23T13:08:59.785359+0000","last_unstale":"2026-02-23T13:11:06.648550+0000","last_undegraded":"2026-02-23T13:11:06.648550+0000","last_fullsized":"2026-02-23T13:11:06.648550+0000","mapping_epoch":62,"log_start":"72'62005","ondisk_log_start":"72'62005","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'39419","last_scrub_stamp":"2026-02-23T13:10:24.387875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:24.387875+0000","objects_scrubbed":38695,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:54.083097+0000","scrub_duration":3689,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1476132864,"num_objects":22524,"num_object_clones":0,"num_object_copies":67572,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62008,"num_write_kb":2705024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"72'62548","reported_seq":63009,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:06.769856+0000","last_change":"2026-02-23T13:10:34.960546+0000","last_active":"2026-02-23T13:11:06.769856+0000","last_peered":"2026-02-23T13:11:06.769856+0000","last_clean":"2026-02-23T13:11:06.769856+0000","last_became_active":"2026-02-23T13:08:59.785106+0000","last_became_peered":"2026-02-23T13:08:59.785106+0000","last_unstale":"2026-02-23T13:11:06.769856+0000","last_undegraded":"2026-02-23T13:11:06.769856+0000","last_fullsized":"2026-02-23T13:11:06.769856+0000","mapping_epoch":62,"log_start":"72'62545","ondisk_log_start":"72'62545","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'44040","last_scrub_stamp":"2026-02-23T13:10:34.960505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:34.960505+0000","objects_scrubbed":42002,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:42.696429+0000","scrub_duration":4826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1489108992,"num_objects":22722,"num_object_clones":0,"num_object_copies":68166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22722,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62548,"num_write_kb":2728640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"72'62524","reported_seq":62925,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:06.645536+0000","last_change":"2026-02-23T13:10:17.283236+0000","last_active":"2026-02-23T13:11:06.645536+0000","last_peered":"2026-02-23T13:11:06.645536+0000","last_clean":"2026-02-23T13:11:06.645536+0000","last_became_active":"2026-02-23T13:08:59.784457+0000","last_became_peered":"2026-02-23T13:08:59.784457+0000","last_unstale":"2026-02-23T13:11:06.645536+0000","last_undegraded":"2026-02-23T13:11:06.645536+0000","last_fullsized":"2026-02-23T13:11:06.645536+0000","mapping_epoch":62,"log_start":"72'62521","ondisk_log_start":"72'62521","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'36652","last_scrub_stamp":"2026-02-23T13:10:17.283183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:17.283183+0000","objects_scrubbed":35965,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:47.102975+0000","scrub_duration":3592,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1489895424,"num_objects":22734,"num_object_clones":0,"num_object_copies":68202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22734,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62524,"num_write_kb":2728256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"72'62307","reported_seq":62704,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:06.771240+0000","last_change":"2026-02-23T13:10:16.715418+0000","last_active":"2026-02-23T13:11:06.771240+0000","last_peered":"2026-02-23T13:11:06.771240+0000","last_clean":"2026-02-23T13:11:06.771240+0000","last_became_active":"2026-02-23T13:08:59.784235+0000","last_became_peered":"2026-02-23T13:08:59.784235+0000","last_unstale":"2026-02-23T13:11:06.771240+0000","last_undegraded":"2026-02-23T13:11:06.771240+0000","last_fullsized":"2026-02-23T13:11:06.771240+0000","mapping_epoch":62,"log_start":"72'62304","ondisk_log_start":"72'62304","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'36136","last_scrub_stamp":"2026-02-23T13:10:16.715358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:16.715358+0000","objects_scrubbed":35429,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:30.935136+0000","scrub_duration":3530,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1482752000,"num_objects":22625,"num_object_clones":0,"num_object_copies":67875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22625,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62307,"num_write_kb":2717824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"72'62752","reported_seq":63099,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:06.650538+0000","last_change":"2026-02-23T13:10:03.037875+0000","last_active":"2026-02-23T13:11:06.650538+0000","last_peered":"2026-02-23T13:11:06.650538+0000","last_clean":"2026-02-23T13:11:06.650538+0000","last_became_active":"2026-02-23T13:08:59.784318+0000","last_became_peered":"2026-02-23T13:08:59.784318+0000","last_unstale":"2026-02-23T13:11:06.650538+0000","last_undegraded":"2026-02-23T13:11:06.650538+0000","last_fullsized":"2026-02-23T13:11:06.650538+0000","mapping_epoch":62,"log_start":"72'62749","ondisk_log_start":"72'62749","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'30914","last_scrub_stamp":"2026-02-23T13:10:03.037814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:03.037814+0000","objects_scrubbed":30174,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:29.315340+0000","scrub_duration":3318,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1493434368,"num_objects":22788,"num_object_clones":0,"num_object_copies":68364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22788,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62752,"num_write_kb":2737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"72'62600","reported_seq":62985,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:06.770278+0000","last_change":"2026-02-23T13:10:13.380759+0000","last_active":"2026-02-23T13:11:06.770278+0000","last_peered":"2026-02-23T13:11:06.770278+0000","last_clean":"2026-02-23T13:11:06.770278+0000","last_became_active":"2026-02-23T13:08:59.784463+0000","last_became_peered":"2026-02-23T13:08:59.784463+0000","last_unstale":"2026-02-23T13:11:06.770278+0000","last_undegraded":"2026-02-23T13:11:06.770278+0000","last_fullsized":"2026-02-23T13:11:06.770278+0000","mapping_epoch":62,"log_start":"72'62597","ondisk_log_start":"72'62597","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'35060","last_scrub_stamp":"2026-02-23T13:10:13.380652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:13.380652+0000","objects_scrubbed":34448,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:31.033114+0000","scrub_duration":3163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1483341824,"num_objects":22634,"num_object_clones":0,"num_object_copies":67902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22634,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62600,"num_write_kb":2727488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"72'62623","reported_seq":62996,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:06.654801+0000","last_change":"2026-02-23T13:10:11.150558+0000","last_active":"2026-02-23T13:11:06.654801+0000","last_peered":"2026-02-23T13:11:06.654801+0000","last_clean":"2026-02-23T13:11:06.654801+0000","last_became_active":"2026-02-23T13:08:59.784436+0000","last_became_peered":"2026-02-23T13:08:59.784436+0000","last_unstale":"2026-02-23T13:11:06.654801+0000","last_undegraded":"2026-02-23T13:11:06.654801+0000","last_fullsized":"2026-02-23T13:11:06.654801+0000","mapping_epoch":62,"log_start":"72'62620","ondisk_log_start":"72'62620","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'34103","last_scrub_stamp":"2026-02-23T13:10:11.150522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:11.150522+0000","objects_scrubbed":33383,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:36.031575+0000","scrub_duration":3995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1482620928,"num_objects":22623,"num_object_clones":0,"num_object_copies":67869,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22623,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62623,"num_write_kb":2727872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"72'62245","reported_seq":62660,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:06.651817+0000","last_change":"2026-02-23T13:10:43.059389+0000","last_active":"2026-02-23T13:11:06.651817+0000","last_peered":"2026-02-23T13:11:06.651817+0000","last_clean":"2026-02-23T13:11:06.651817+0000","last_became_active":"2026-02-23T13:08:59.784290+0000","last_became_peered":"2026-02-23T13:08:59.784290+0000","last_unstale":"2026-02-23T13:11:06.651817+0000","last_undegraded":"2026-02-23T13:11:06.651817+0000","last_fullsized":"2026-02-23T13:11:06.651817+0000","mapping_epoch":62,"log_start":"72'62242","ondisk_log_start":"72'62242","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'48491","last_scrub_stamp":"2026-02-23T13:10:43.059312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:43.059312+0000","objects_scrubbed":37287,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:55.819637+0000","scrub_duration":3592,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1480261632,"num_objects":22587,"num_object_clones":0,"num_object_copies":67761,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22587,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62245,"num_write_kb":2714624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"72'62041","reported_seq":62422,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:06.652230+0000","last_change":"2026-02-23T13:10:13.394783+0000","last_active":"2026-02-23T13:11:06.652230+0000","last_peered":"2026-02-23T13:11:06.652230+0000","last_clean":"2026-02-23T13:11:06.652230+0000","last_became_active":"2026-02-23T13:08:59.785634+0000","last_became_peered":"2026-02-23T13:08:59.785634+0000","last_unstale":"2026-02-23T13:11:06.652230+0000","last_undegraded":"2026-02-23T13:11:06.652230+0000","last_fullsized":"2026-02-23T13:11:06.652230+0000","mapping_epoch":62,"log_start":"72'62038","ondisk_log_start":"72'62038","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'34740","last_scrub_stamp":"2026-02-23T13:10:13.394732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:13.394732+0000","objects_scrubbed":34037,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:23.660349+0000","scrub_duration":3642,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1484980224,"num_objects":22659,"num_object_clones":0,"num_object_copies":67977,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22659,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62041,"num_write_kb":2710400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":324,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:45.570100+0000","last_change":"2026-02-23T13:10:45.570064+0000","last_active":"2026-02-23T13:10:45.570100+0000","last_peered":"2026-02-23T13:10:45.570100+0000","last_clean":"2026-02-23T13:10:45.570100+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:10:45.570100+0000","last_undegraded":"2026-02-23T13:10:45.570100+0000","last_fullsized":"2026-02-23T13:10:45.570100+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:10:45.570030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:10:45.570030+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:48.611576+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":23800840216,"num_objects":363173,"num_object_clones":0,"num_object_copies":1089519,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":363173,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":998345,"num_write_kb":43568513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":71410266112,"data_stored":71410253896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1023,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247908,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":18990168,"kb_used_data":17543940,"kb_used_omap":13,"kb_used_meta":1446194,"kb_avail":715013032,"statfs":{"total":751619276800,"available":732173344768,"internally_reserved":0,"allocated":17964994560,"data_stored":17964487326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13487,"internal_metadata":1480903505},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444135,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":21895128,"kb_used_data":20587780,"kb_used_omap":17,"kb_used_meta":1307310,"kb_avail":712108072,"statfs":{"total":751619276800,"available":729198665728,"internally_reserved":0,"allocated":21081886720,"data_stored":21081379486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17674,"internal_metadata":1338686198},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574953,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":16091216,"kb_used_data":14676476,"kb_used_omap":17,"kb_used_meta":1414638,"kb_avail":717911984,"statfs":{"total":751619276800,"available":735141871616,"internally_reserved":0,"allocated":15028711424,"data_stored":15028211814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18056,"internal_metadata":1448589688},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705770,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":19278936,"kb_used_data":17848708,"kb_used_omap":13,"kb_used_meta":1430066,"kb_avail":714724264,"statfs":{"total":751619276800,"available":731877646336,"internally_reserved":0,"allocated":18277076992,"data_stored":18276569758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14251,"internal_metadata":1464387669},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1023,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17840869376,"data_stored":17840865304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14867890176,"data_stored":14867890176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20840386560,"data_stored":20840382488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17861120000,"data_stored":17861115928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:11:13.513 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:11:13.654 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:13.788 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:13 trial046 ceph-mon[38575]: from='client.15088 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:11:13.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:13 trial046 ceph-mon[38575]: pgmap v294: 17 pgs: 17 active+clean; 19 GiB data, 64 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 11.54k op/s 2026-02-23T13:11:13.789 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:13.786+0000 7f541bf86640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:13.789 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:13.787+0000 7f541bf86640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:13.806 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:11:13.806 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:11:13.820 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:11:13.820 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:11:13.832 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:11:13.833 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:11:13.845 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:11:13.846 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:11:15.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:14 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3510165822' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:11:15.889 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:11:16.030 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:16.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:15 trial046 ceph-mon[38575]: pgmap v295: 17 pgs: 17 active+clean; 19 GiB data, 64 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 7.49k op/s 2026-02-23T13:11:16.365 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:11:16 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:11:16] "GET /metrics HTTP/1.1" 200 4234 "" "Prometheus/3.6.0" 2026-02-23T13:11:16.414 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:16.362+0000 7f5d7f774640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:16.414 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:16.363+0000 7f5d7f774640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:16.414 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:11:16.414 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:11:16.415 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:11:16.415 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:11:16.415 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:11:16.415 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:11:16.417 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:11:16.417 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:11:16.469 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:11:16 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:11:16.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:11:17.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:16 trial046 ceph-mon[38575]: 4.d scrub starts 2026-02-23T13:11:17.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:16 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:11:17.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:16 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3555786314' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:11:17.090 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:11:17.090 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:11:17.091 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_2 2026-02-23T13:11:17.091 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:11:17.229 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:17.361 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:17.358+0000 7f391d4cf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:17.361 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:17.359+0000 7f391d4cf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:17.505 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:11:17.506 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:11:17.550 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":296,"stamp":"2026-02-23T13:11:16.656682+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19332858424,"num_objects":294990,"num_object_clones":0,"num_object_copies":884970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":294990,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":1066665,"num_write_kb":43570663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":63109464,"kb_used_data":57149960,"kb_used_omap":62,"kb_used_meta":5959169,"kb_avail":2872903336,"statfs":{"total":3006477107200,"available":2941853016064,"internally_reserved":0,"allocated":58521559040,"data_stored":58519537728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63561,"internal_metadata":6102190007},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[12,5],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7358447616,"num_objects":-112281,"num_object_clones":0,"num_object_copies":-336843,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-112281,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112281,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001542"},"pg_stats":[{"pgid":"4.f","version":"72'65639","reported_seq":66047,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:11.771007+0000","last_change":"2026-02-23T13:10:18.889561+0000","last_active":"2026-02-23T13:11:11.771007+0000","last_peered":"2026-02-23T13:11:11.771007+0000","last_clean":"2026-02-23T13:11:11.771007+0000","last_became_active":"2026-02-23T13:08:59.784888+0000","last_became_peered":"2026-02-23T13:08:59.784888+0000","last_unstale":"2026-02-23T13:11:11.771007+0000","last_undegraded":"2026-02-23T13:11:11.771007+0000","last_fullsized":"2026-02-23T13:11:11.771007+0000","mapping_epoch":62,"log_start":"72'65636","ondisk_log_start":"72'65636","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'37338","last_scrub_stamp":"2026-02-23T13:10:18.889417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:18.889417+0000","objects_scrubbed":36552,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:46.655322+0000","scrub_duration":3662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1311309824,"num_objects":20009,"num_object_clones":0,"num_object_copies":60027,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20009,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65639,"num_write_kb":2740736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"72'64424","reported_seq":64859,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:11.661056+0000","last_change":"2026-02-23T13:10:27.126280+0000","last_active":"2026-02-23T13:11:11.661056+0000","last_peered":"2026-02-23T13:11:11.661056+0000","last_clean":"2026-02-23T13:11:11.661056+0000","last_became_active":"2026-02-23T13:08:59.785397+0000","last_became_peered":"2026-02-23T13:08:59.785397+0000","last_unstale":"2026-02-23T13:11:11.661056+0000","last_undegraded":"2026-02-23T13:11:11.661056+0000","last_fullsized":"2026-02-23T13:11:11.661056+0000","mapping_epoch":62,"log_start":"72'64421","ondisk_log_start":"72'64421","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'40440","last_scrub_stamp":"2026-02-23T13:10:27.126174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:27.126174+0000","objects_scrubbed":39592,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:48.254573+0000","scrub_duration":3978,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1286864896,"num_objects":19636,"num_object_clones":0,"num_object_copies":58908,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19636,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64424,"num_write_kb":2689920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"72'68006","reported_seq":68497,"reported_epoch":72,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:11:16.654449+0000","last_change":"2026-02-23T13:11:15.350740+0000","last_active":"2026-02-23T13:11:16.654449+0000","last_peered":"2026-02-23T13:11:16.654449+0000","last_clean":"2026-02-23T13:11:16.654449+0000","last_became_active":"2026-02-23T13:08:59.785780+0000","last_became_peered":"2026-02-23T13:08:59.785780+0000","last_unstale":"2026-02-23T13:11:16.654449+0000","last_undegraded":"2026-02-23T13:11:16.654449+0000","last_fullsized":"2026-02-23T13:11:16.654449+0000","mapping_epoch":62,"log_start":"72'68003","ondisk_log_start":"72'68003","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'32743","last_scrub_stamp":"2026-02-23T13:10:07.875449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:07.875449+0000","objects_scrubbed":12149,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"scrubbing for 2s","scrub_duration":3040,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120731160,"num_objects":17102,"num_object_clones":0,"num_object_copies":51306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17102,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":68006,"num_write_kb":2723393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"72'68571","reported_seq":69012,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:16.654505+0000","last_change":"2026-02-23T13:10:26.384628+0000","last_active":"2026-02-23T13:11:16.654505+0000","last_peered":"2026-02-23T13:11:16.654505+0000","last_clean":"2026-02-23T13:11:16.654505+0000","last_became_active":"2026-02-23T13:08:59.783982+0000","last_became_peered":"2026-02-23T13:08:59.783982+0000","last_unstale":"2026-02-23T13:11:16.654505+0000","last_undegraded":"2026-02-23T13:11:16.654505+0000","last_fullsized":"2026-02-23T13:11:16.654505+0000","mapping_epoch":62,"log_start":"72'68568","ondisk_log_start":"72'68568","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'40924","last_scrub_stamp":"2026-02-23T13:10:26.384602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:26.384602+0000","objects_scrubbed":40159,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:51.409315+0000","scrub_duration":3763,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1124794368,"num_objects":17163,"num_object_clones":0,"num_object_copies":51489,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17163,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68571,"num_write_kb":2743488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"72'67887","reported_seq":68340,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:16.649546+0000","last_change":"2026-02-23T13:10:36.436883+0000","last_active":"2026-02-23T13:11:16.649546+0000","last_peered":"2026-02-23T13:11:16.649546+0000","last_clean":"2026-02-23T13:11:16.649546+0000","last_became_active":"2026-02-23T13:08:59.784710+0000","last_became_peered":"2026-02-23T13:08:59.784710+0000","last_unstale":"2026-02-23T13:11:16.649546+0000","last_undegraded":"2026-02-23T13:11:16.649546+0000","last_fullsized":"2026-02-23T13:11:16.649546+0000","mapping_epoch":62,"log_start":"72'67884","ondisk_log_start":"72'67884","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'44729","last_scrub_stamp":"2026-02-23T13:10:36.436786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:36.436786+0000","objects_scrubbed":41142,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:51.122805+0000","scrub_duration":4872,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114832896,"num_objects":17011,"num_object_clones":0,"num_object_copies":51033,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17011,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67887,"num_write_kb":2716736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"72'65516","reported_seq":65981,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:11.656254+0000","last_change":"2026-02-23T13:10:31.717671+0000","last_active":"2026-02-23T13:11:11.656254+0000","last_peered":"2026-02-23T13:11:11.656254+0000","last_clean":"2026-02-23T13:11:11.656254+0000","last_became_active":"2026-02-23T13:08:59.784218+0000","last_became_peered":"2026-02-23T13:08:59.784218+0000","last_unstale":"2026-02-23T13:11:11.656254+0000","last_undegraded":"2026-02-23T13:11:11.656254+0000","last_fullsized":"2026-02-23T13:11:11.656254+0000","mapping_epoch":62,"log_start":"72'65513","ondisk_log_start":"72'65513","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'43162","last_scrub_stamp":"2026-02-23T13:10:31.717638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:31.717638+0000","objects_scrubbed":42156,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:36.022448+0000","scrub_duration":4538,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1314521088,"num_objects":20058,"num_object_clones":0,"num_object_copies":60174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20058,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65516,"num_write_kb":2738368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"72'65126","reported_seq":65480,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:11.661959+0000","last_change":"2026-02-23T13:10:06.461634+0000","last_active":"2026-02-23T13:11:11.661959+0000","last_peered":"2026-02-23T13:11:11.661959+0000","last_clean":"2026-02-23T13:11:11.661959+0000","last_became_active":"2026-02-23T13:08:59.784210+0000","last_became_peered":"2026-02-23T13:08:59.784210+0000","last_unstale":"2026-02-23T13:11:11.661959+0000","last_undegraded":"2026-02-23T13:11:11.661959+0000","last_fullsized":"2026-02-23T13:11:11.661959+0000","mapping_epoch":62,"log_start":"72'65123","ondisk_log_start":"72'65123","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'32118","last_scrub_stamp":"2026-02-23T13:10:06.461563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:06.461563+0000","objects_scrubbed":31388,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:22.890897+0000","scrub_duration":3366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1299316736,"num_objects":19826,"num_object_clones":0,"num_object_copies":59478,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19826,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65126,"num_write_kb":2718464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"72'67526","reported_seq":67953,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:16.652508+0000","last_change":"2026-02-23T13:10:24.387952+0000","last_active":"2026-02-23T13:11:16.652508+0000","last_peered":"2026-02-23T13:11:16.652508+0000","last_clean":"2026-02-23T13:11:16.652508+0000","last_became_active":"2026-02-23T13:08:59.785359+0000","last_became_peered":"2026-02-23T13:08:59.785359+0000","last_unstale":"2026-02-23T13:11:16.652508+0000","last_undegraded":"2026-02-23T13:11:16.652508+0000","last_fullsized":"2026-02-23T13:11:16.652508+0000","mapping_epoch":62,"log_start":"72'67523","ondisk_log_start":"72'67523","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'39419","last_scrub_stamp":"2026-02-23T13:10:24.387875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:24.387875+0000","objects_scrubbed":38695,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:54.083097+0000","scrub_duration":3689,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114505216,"num_objects":17006,"num_object_clones":0,"num_object_copies":51018,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17006,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67526,"num_write_kb":2705024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"72'65484","reported_seq":65945,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:11.769425+0000","last_change":"2026-02-23T13:10:34.960546+0000","last_active":"2026-02-23T13:11:11.769425+0000","last_peered":"2026-02-23T13:11:11.769425+0000","last_clean":"2026-02-23T13:11:11.769425+0000","last_became_active":"2026-02-23T13:08:59.785106+0000","last_became_peered":"2026-02-23T13:08:59.785106+0000","last_unstale":"2026-02-23T13:11:11.769425+0000","last_undegraded":"2026-02-23T13:11:11.769425+0000","last_fullsized":"2026-02-23T13:11:11.769425+0000","mapping_epoch":62,"log_start":"72'65481","ondisk_log_start":"72'65481","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'44040","last_scrub_stamp":"2026-02-23T13:10:34.960505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:34.960505+0000","objects_scrubbed":42002,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:42.696429+0000","scrub_duration":4826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1296695296,"num_objects":19786,"num_object_clones":0,"num_object_copies":59358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19786,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65484,"num_write_kb":2728640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"72'68336","reported_seq":68737,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:16.642628+0000","last_change":"2026-02-23T13:10:17.283236+0000","last_active":"2026-02-23T13:11:16.642628+0000","last_peered":"2026-02-23T13:11:16.642628+0000","last_clean":"2026-02-23T13:11:16.642628+0000","last_became_active":"2026-02-23T13:08:59.784457+0000","last_became_peered":"2026-02-23T13:08:59.784457+0000","last_unstale":"2026-02-23T13:11:16.642628+0000","last_undegraded":"2026-02-23T13:11:16.642628+0000","last_fullsized":"2026-02-23T13:11:16.642628+0000","mapping_epoch":62,"log_start":"72'68333","ondisk_log_start":"72'68333","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'36652","last_scrub_stamp":"2026-02-23T13:10:17.283183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:17.283183+0000","objects_scrubbed":35965,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:47.102975+0000","scrub_duration":3592,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1109000192,"num_objects":16922,"num_object_clones":0,"num_object_copies":50766,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16922,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68336,"num_write_kb":2728256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"72'65156","reported_seq":65553,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:11.766805+0000","last_change":"2026-02-23T13:10:16.715418+0000","last_active":"2026-02-23T13:11:11.766805+0000","last_peered":"2026-02-23T13:11:11.766805+0000","last_clean":"2026-02-23T13:11:11.766805+0000","last_became_active":"2026-02-23T13:08:59.784235+0000","last_became_peered":"2026-02-23T13:08:59.784235+0000","last_unstale":"2026-02-23T13:11:11.766805+0000","last_undegraded":"2026-02-23T13:11:11.766805+0000","last_fullsized":"2026-02-23T13:11:11.766805+0000","mapping_epoch":62,"log_start":"72'65153","ondisk_log_start":"72'65153","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'36136","last_scrub_stamp":"2026-02-23T13:10:16.715358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:16.715358+0000","objects_scrubbed":35429,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:30.935136+0000","scrub_duration":3530,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1296039936,"num_objects":19776,"num_object_clones":0,"num_object_copies":59328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19776,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65156,"num_write_kb":2717824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"72'68356","reported_seq":68703,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:16.646922+0000","last_change":"2026-02-23T13:10:03.037875+0000","last_active":"2026-02-23T13:11:16.646922+0000","last_peered":"2026-02-23T13:11:16.646922+0000","last_clean":"2026-02-23T13:11:16.646922+0000","last_became_active":"2026-02-23T13:08:59.784318+0000","last_became_peered":"2026-02-23T13:08:59.784318+0000","last_unstale":"2026-02-23T13:11:16.646922+0000","last_undegraded":"2026-02-23T13:11:16.646922+0000","last_fullsized":"2026-02-23T13:11:16.646922+0000","mapping_epoch":62,"log_start":"72'68353","ondisk_log_start":"72'68353","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'30914","last_scrub_stamp":"2026-02-23T13:10:03.037814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:03.037814+0000","objects_scrubbed":30174,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:29.315340+0000","scrub_duration":3318,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1126170624,"num_objects":17184,"num_object_clones":0,"num_object_copies":51552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17184,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68356,"num_write_kb":2737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"72'65509","reported_seq":65894,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:11.771165+0000","last_change":"2026-02-23T13:10:13.380759+0000","last_active":"2026-02-23T13:11:11.771165+0000","last_peered":"2026-02-23T13:11:11.771165+0000","last_clean":"2026-02-23T13:11:11.771165+0000","last_became_active":"2026-02-23T13:08:59.784463+0000","last_became_peered":"2026-02-23T13:08:59.784463+0000","last_unstale":"2026-02-23T13:11:11.771165+0000","last_undegraded":"2026-02-23T13:11:11.771165+0000","last_fullsized":"2026-02-23T13:11:11.771165+0000","mapping_epoch":62,"log_start":"72'65506","ondisk_log_start":"72'65506","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'35060","last_scrub_stamp":"2026-02-23T13:10:13.380652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:13.380652+0000","objects_scrubbed":34448,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:31.033114+0000","scrub_duration":3163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1292697600,"num_objects":19725,"num_object_clones":0,"num_object_copies":59175,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19725,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65509,"num_write_kb":2727488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"72'65370","reported_seq":65745,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:11.660594+0000","last_change":"2026-02-23T13:10:11.150558+0000","last_active":"2026-02-23T13:11:11.660594+0000","last_peered":"2026-02-23T13:11:11.660594+0000","last_clean":"2026-02-23T13:11:11.660594+0000","last_became_active":"2026-02-23T13:08:59.784436+0000","last_became_peered":"2026-02-23T13:08:59.784436+0000","last_unstale":"2026-02-23T13:11:11.660594+0000","last_undegraded":"2026-02-23T13:11:11.660594+0000","last_fullsized":"2026-02-23T13:11:11.660594+0000","mapping_epoch":62,"log_start":"72'65367","ondisk_log_start":"72'65367","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'34103","last_scrub_stamp":"2026-02-23T13:10:11.150522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:11.150522+0000","objects_scrubbed":33383,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:36.031575+0000","scrub_duration":3995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1302593536,"num_objects":19876,"num_object_clones":0,"num_object_copies":59628,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19876,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65370,"num_write_kb":2727872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"72'67967","reported_seq":68382,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:16.645093+0000","last_change":"2026-02-23T13:10:43.059389+0000","last_active":"2026-02-23T13:11:16.645093+0000","last_peered":"2026-02-23T13:11:16.645093+0000","last_clean":"2026-02-23T13:11:16.645093+0000","last_became_active":"2026-02-23T13:08:59.784290+0000","last_became_peered":"2026-02-23T13:08:59.784290+0000","last_unstale":"2026-02-23T13:11:16.645093+0000","last_undegraded":"2026-02-23T13:11:16.645093+0000","last_fullsized":"2026-02-23T13:11:16.645093+0000","mapping_epoch":62,"log_start":"72'67964","ondisk_log_start":"72'67964","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'48491","last_scrub_stamp":"2026-02-23T13:10:43.059312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:43.059312+0000","objects_scrubbed":37287,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:55.819637+0000","scrub_duration":3592,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1105264640,"num_objects":16865,"num_object_clones":0,"num_object_copies":50595,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16865,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67967,"num_write_kb":2714624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"72'67657","reported_seq":68038,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:16.653094+0000","last_change":"2026-02-23T13:10:13.394783+0000","last_active":"2026-02-23T13:11:16.653094+0000","last_peered":"2026-02-23T13:11:16.653094+0000","last_clean":"2026-02-23T13:11:16.653094+0000","last_became_active":"2026-02-23T13:08:59.785634+0000","last_became_peered":"2026-02-23T13:08:59.785634+0000","last_unstale":"2026-02-23T13:11:16.653094+0000","last_undegraded":"2026-02-23T13:11:16.653094+0000","last_fullsized":"2026-02-23T13:11:16.653094+0000","mapping_epoch":62,"log_start":"72'67654","ondisk_log_start":"72'67654","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'34740","last_scrub_stamp":"2026-02-23T13:10:13.394732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:13.394732+0000","objects_scrubbed":34037,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:23.660349+0000","scrub_duration":3642,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1116930048,"num_objects":17043,"num_object_clones":0,"num_object_copies":51129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17043,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67657,"num_write_kb":2710400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":324,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:45.570100+0000","last_change":"2026-02-23T13:10:45.570064+0000","last_active":"2026-02-23T13:10:45.570100+0000","last_peered":"2026-02-23T13:10:45.570100+0000","last_clean":"2026-02-23T13:10:45.570100+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:10:45.570100+0000","last_undegraded":"2026-02-23T13:10:45.570100+0000","last_fullsized":"2026-02-23T13:10:45.570100+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:10:45.570030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:10:45.570030+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:48.611576+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":19332268056,"num_objects":294988,"num_object_clones":0,"num_object_copies":884964,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":294988,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1066530,"num_write_kb":43568513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57978138624,"data_stored":57978126408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1023,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247910,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":14737688,"kb_used_data":13183108,"kb_used_omap":13,"kb_used_meta":1554482,"kb_avail":719265512,"statfs":{"total":751619276800,"available":736527884288,"internally_reserved":0,"allocated":13499502592,"data_stored":13498995358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13580,"internal_metadata":1591790324},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444136,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":19421784,"kb_used_data":18042180,"kb_used_omap":17,"kb_used_meta":1379502,"kb_avail":714581416,"statfs":{"total":751619276800,"available":731731369984,"internally_reserved":0,"allocated":18475192320,"data_stored":18474685086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17674,"internal_metadata":1412610806},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,3],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574954,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":14317136,"kb_used_data":12848316,"kb_used_omap":17,"kb_used_meta":1468782,"kb_avail":719686064,"statfs":{"total":751619276800,"available":736958529536,"internally_reserved":0,"allocated":13156675584,"data_stored":13156175974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18056,"internal_metadata":1504033144},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705772,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":14632856,"kb_used_data":13076356,"kb_used_omap":13,"kb_used_meta":1556402,"kb_avail":719370344,"statfs":{"total":751619276800,"available":736635232256,"internally_reserved":0,"allocated":13390188544,"data_stored":13389681310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14251,"internal_metadata":1593755733},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1023,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13382914048,"data_stored":13382909976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12976259072,"data_stored":12976259072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18221436928,"data_stored":18221432856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13397528576,"data_stored":13397524504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93,"internal_metadata":0}]}} 2026-02-23T13:11:17.551 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:11:17.552 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_2 pg_num 86 2026-02-23T13:11:17.697 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:17.758 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:17 trial046 ceph-mon[38575]: pgmap v296: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 18 GiB data, 60 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 9.36k op/s 2026-02-23T13:11:17.758 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:17 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:11:17.758 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:17 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:11:17.758 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:17 trial046 ceph-mon[38575]: 4.d scrub ok 2026-02-23T13:11:17.828 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:17.826+0000 7f0ef4767640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:17.828 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:17.826+0000 7f0ef4767640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:17.973 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:11:18.011 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:11:18.877 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:11:19.024 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:19.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:18 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:11:19.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:18 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:11:19.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:18 trial046 ceph-mon[38575]: from='client.15094 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:11:19.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:18 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4139363237' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_2", "var": "pg_num", "val": "86"} : dispatch 2026-02-23T13:11:19.152 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:19.150+0000 7f7263ff6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:19.153 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:19.150+0000 7f7263ff6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:19.169 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:11:19.169 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:11:19.184 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:11:19.184 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:11:19.199 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:11:19.199 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:11:19.211 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:11:19.212 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:11:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:19 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:11:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:19 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:11:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:19 trial046 ceph-mon[38575]: pgmap v297: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 17 GiB data, 56 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 9.39k op/s 2026-02-23T13:11:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:19 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/363574224' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:11:21.255 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:11:21.403 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:21.801 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:11:21.801 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:11:21.801 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:21.749+0000 7f3dc88f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:21.801 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:21.749+0000 7f3dc88f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:21.801 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:11:21.801 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:11:21.804 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:11:21.804 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:11:21.820 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:11:21.820 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:11:22.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:21 trial046 ceph-mon[38575]: pgmap v298: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 17 GiB data, 56 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 7.57k op/s 2026-02-23T13:11:23.012 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:11:23.012 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:11:23.012 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-23T13:11:23.013 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:11:23.037 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:22 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2895839607' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:11:23.150 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:23.275 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:23.273+0000 7fa98f5b5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:23.275 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:23.274+0000 7fa98f5b5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:23.424 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:11:23.424 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:11:23.486 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":299,"stamp":"2026-02-23T13:11:22.657513+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":14790492728,"num_objects":225679,"num_object_clones":0,"num_object_copies":677037,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":225679,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":1135976,"num_write_kb":43570663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":50639512,"kb_used_data":44337096,"kb_used_omap":63,"kb_used_meta":6302080,"kb_avail":2885373288,"statfs":{"total":3006477107200,"available":2954622246912,"internally_reserved":0,"allocated":45401186304,"data_stored":45399164992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":65516,"internal_metadata":6453329940},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-9010937856,"num_objects":-137496,"num_object_clones":0,"num_object_copies":-412488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-137496,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137496,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001610"},"pg_stats":[{"pgid":"4.f","version":"72'71355","reported_seq":71762,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:21.773697+0000","last_change":"2026-02-23T13:10:18.889561+0000","last_active":"2026-02-23T13:11:21.773697+0000","last_peered":"2026-02-23T13:11:21.773697+0000","last_clean":"2026-02-23T13:11:21.773697+0000","last_became_active":"2026-02-23T13:08:59.784888+0000","last_became_peered":"2026-02-23T13:08:59.784888+0000","last_unstale":"2026-02-23T13:11:21.773697+0000","last_undegraded":"2026-02-23T13:11:21.773697+0000","last_fullsized":"2026-02-23T13:11:21.773697+0000","mapping_epoch":62,"log_start":"72'71352","ondisk_log_start":"72'71352","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'37338","last_scrub_stamp":"2026-02-23T13:10:18.889417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:18.889417+0000","objects_scrubbed":36552,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:46.655322+0000","scrub_duration":3662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":936706048,"num_objects":14293,"num_object_clones":0,"num_object_copies":42879,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14293,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71355,"num_write_kb":2740736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"72'70146","reported_seq":70581,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:21.659151+0000","last_change":"2026-02-23T13:10:27.126280+0000","last_active":"2026-02-23T13:11:21.659151+0000","last_peered":"2026-02-23T13:11:21.659151+0000","last_clean":"2026-02-23T13:11:21.659151+0000","last_became_active":"2026-02-23T13:08:59.785397+0000","last_became_peered":"2026-02-23T13:08:59.785397+0000","last_unstale":"2026-02-23T13:11:21.659151+0000","last_undegraded":"2026-02-23T13:11:21.659151+0000","last_fullsized":"2026-02-23T13:11:21.659151+0000","mapping_epoch":62,"log_start":"72'70143","ondisk_log_start":"72'70143","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'40440","last_scrub_stamp":"2026-02-23T13:10:27.126174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:27.126174+0000","objects_scrubbed":39592,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:48.254573+0000","scrub_duration":3978,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":911867904,"num_objects":13914,"num_object_clones":0,"num_object_copies":41742,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13914,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70146,"num_write_kb":2689920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"72'70951","reported_seq":71501,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:21.646851+0000","last_change":"2026-02-23T13:11:17.234531+0000","last_active":"2026-02-23T13:11:21.646851+0000","last_peered":"2026-02-23T13:11:21.646851+0000","last_clean":"2026-02-23T13:11:21.646851+0000","last_became_active":"2026-02-23T13:08:59.785780+0000","last_became_peered":"2026-02-23T13:08:59.785780+0000","last_unstale":"2026-02-23T13:11:21.646851+0000","last_undegraded":"2026-02-23T13:11:21.646851+0000","last_fullsized":"2026-02-23T13:11:21.646851+0000","mapping_epoch":62,"log_start":"72'70948","ondisk_log_start":"72'70948","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'68273","last_scrub_stamp":"2026-02-23T13:11:17.234494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:11:17.234494+0000","objects_scrubbed":17257,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:22.985224+0000","scrub_duration":1883,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":927727640,"num_objects":14157,"num_object_clones":0,"num_object_copies":42471,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14157,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":70951,"num_write_kb":2723393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"72'71595","reported_seq":72037,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:21.652829+0000","last_change":"2026-02-23T13:10:26.384628+0000","last_active":"2026-02-23T13:11:21.652829+0000","last_peered":"2026-02-23T13:11:21.652829+0000","last_clean":"2026-02-23T13:11:21.652829+0000","last_became_active":"2026-02-23T13:08:59.783982+0000","last_became_peered":"2026-02-23T13:08:59.783982+0000","last_unstale":"2026-02-23T13:11:21.652829+0000","last_undegraded":"2026-02-23T13:11:21.652829+0000","last_fullsized":"2026-02-23T13:11:21.652829+0000","mapping_epoch":62,"log_start":"72'71592","ondisk_log_start":"72'71592","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'40924","last_scrub_stamp":"2026-02-23T13:10:26.384602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:26.384602+0000","objects_scrubbed":40159,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:51.409315+0000","scrub_duration":3763,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":926613504,"num_objects":14139,"num_object_clones":0,"num_object_copies":42417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71595,"num_write_kb":2743488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"72'70806","reported_seq":71258,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:21.652485+0000","last_change":"2026-02-23T13:10:36.436883+0000","last_active":"2026-02-23T13:11:21.652485+0000","last_peered":"2026-02-23T13:11:21.652485+0000","last_clean":"2026-02-23T13:11:21.652485+0000","last_became_active":"2026-02-23T13:08:59.784710+0000","last_became_peered":"2026-02-23T13:08:59.784710+0000","last_unstale":"2026-02-23T13:11:21.652485+0000","last_undegraded":"2026-02-23T13:11:21.652485+0000","last_fullsized":"2026-02-23T13:11:21.652485+0000","mapping_epoch":62,"log_start":"72'70803","ondisk_log_start":"72'70803","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'44729","last_scrub_stamp":"2026-02-23T13:10:36.436786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:36.436786+0000","objects_scrubbed":41142,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:51.122805+0000","scrub_duration":4872,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923533312,"num_objects":14092,"num_object_clones":0,"num_object_copies":42276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14092,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70806,"num_write_kb":2716736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"72'71407","reported_seq":71872,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:21.662288+0000","last_change":"2026-02-23T13:10:31.717671+0000","last_active":"2026-02-23T13:11:21.662288+0000","last_peered":"2026-02-23T13:11:21.662288+0000","last_clean":"2026-02-23T13:11:21.662288+0000","last_became_active":"2026-02-23T13:08:59.784218+0000","last_became_peered":"2026-02-23T13:08:59.784218+0000","last_unstale":"2026-02-23T13:11:21.662288+0000","last_undegraded":"2026-02-23T13:11:21.662288+0000","last_fullsized":"2026-02-23T13:11:21.662288+0000","mapping_epoch":62,"log_start":"72'71403","ondisk_log_start":"72'71403","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'43162","last_scrub_stamp":"2026-02-23T13:10:31.717638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:31.717638+0000","objects_scrubbed":42156,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:36.022448+0000","scrub_duration":4538,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":928448512,"num_objects":14167,"num_object_clones":0,"num_object_copies":42501,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14167,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71407,"num_write_kb":2738368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"72'70773","reported_seq":71127,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:21.663172+0000","last_change":"2026-02-23T13:10:06.461634+0000","last_active":"2026-02-23T13:11:21.663172+0000","last_peered":"2026-02-23T13:11:21.663172+0000","last_clean":"2026-02-23T13:11:21.663172+0000","last_became_active":"2026-02-23T13:08:59.784210+0000","last_became_peered":"2026-02-23T13:08:59.784210+0000","last_unstale":"2026-02-23T13:11:21.663172+0000","last_undegraded":"2026-02-23T13:11:21.663172+0000","last_fullsized":"2026-02-23T13:11:21.663172+0000","mapping_epoch":62,"log_start":"72'70770","ondisk_log_start":"72'70770","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'32118","last_scrub_stamp":"2026-02-23T13:10:06.461563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:06.461563+0000","objects_scrubbed":31388,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:22.890897+0000","scrub_duration":3366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":929234944,"num_objects":14179,"num_object_clones":0,"num_object_copies":42537,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14179,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70773,"num_write_kb":2718464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"72'70429","reported_seq":70854,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:21.652427+0000","last_change":"2026-02-23T13:10:24.387952+0000","last_active":"2026-02-23T13:11:21.652427+0000","last_peered":"2026-02-23T13:11:21.652427+0000","last_clean":"2026-02-23T13:11:21.652427+0000","last_became_active":"2026-02-23T13:08:59.785359+0000","last_became_peered":"2026-02-23T13:08:59.785359+0000","last_unstale":"2026-02-23T13:11:21.652427+0000","last_undegraded":"2026-02-23T13:11:21.652427+0000","last_fullsized":"2026-02-23T13:11:21.652427+0000","mapping_epoch":62,"log_start":"72'70426","ondisk_log_start":"72'70426","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'39419","last_scrub_stamp":"2026-02-23T13:10:24.387875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:24.387875+0000","objects_scrubbed":38695,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:54.083097+0000","scrub_duration":3689,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":924254208,"num_objects":14103,"num_object_clones":0,"num_object_copies":42309,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70429,"num_write_kb":2705024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"72'71186","reported_seq":71647,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:21.773238+0000","last_change":"2026-02-23T13:10:34.960546+0000","last_active":"2026-02-23T13:11:21.773238+0000","last_peered":"2026-02-23T13:11:21.773238+0000","last_clean":"2026-02-23T13:11:21.773238+0000","last_became_active":"2026-02-23T13:08:59.785106+0000","last_became_peered":"2026-02-23T13:08:59.785106+0000","last_unstale":"2026-02-23T13:11:21.773238+0000","last_undegraded":"2026-02-23T13:11:21.773238+0000","last_fullsized":"2026-02-23T13:11:21.773238+0000","mapping_epoch":62,"log_start":"72'71183","ondisk_log_start":"72'71183","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'44040","last_scrub_stamp":"2026-02-23T13:10:34.960505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:34.960505+0000","objects_scrubbed":42002,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:42.696429+0000","scrub_duration":4826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923009024,"num_objects":14084,"num_object_clones":0,"num_object_copies":42252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14084,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71186,"num_write_kb":2728640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"72'71207","reported_seq":71608,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:21.652260+0000","last_change":"2026-02-23T13:10:17.283236+0000","last_active":"2026-02-23T13:11:21.652260+0000","last_peered":"2026-02-23T13:11:21.652260+0000","last_clean":"2026-02-23T13:11:21.652260+0000","last_became_active":"2026-02-23T13:08:59.784457+0000","last_became_peered":"2026-02-23T13:08:59.784457+0000","last_unstale":"2026-02-23T13:11:21.652260+0000","last_undegraded":"2026-02-23T13:11:21.652260+0000","last_fullsized":"2026-02-23T13:11:21.652260+0000","mapping_epoch":62,"log_start":"72'71204","ondisk_log_start":"72'71204","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'36652","last_scrub_stamp":"2026-02-23T13:10:17.283183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:17.283183+0000","objects_scrubbed":35965,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:47.102975+0000","scrub_duration":3592,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":920846336,"num_objects":14051,"num_object_clones":0,"num_object_copies":42153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14051,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71207,"num_write_kb":2728256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"72'70893","reported_seq":71290,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:21.770623+0000","last_change":"2026-02-23T13:10:16.715418+0000","last_active":"2026-02-23T13:11:21.770623+0000","last_peered":"2026-02-23T13:11:21.770623+0000","last_clean":"2026-02-23T13:11:21.770623+0000","last_became_active":"2026-02-23T13:08:59.784235+0000","last_became_peered":"2026-02-23T13:08:59.784235+0000","last_unstale":"2026-02-23T13:11:21.770623+0000","last_undegraded":"2026-02-23T13:11:21.770623+0000","last_fullsized":"2026-02-23T13:11:21.770623+0000","mapping_epoch":62,"log_start":"72'70890","ondisk_log_start":"72'70890","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'36136","last_scrub_stamp":"2026-02-23T13:10:16.715358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:16.715358+0000","objects_scrubbed":35429,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:30.935136+0000","scrub_duration":3530,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":920059904,"num_objects":14039,"num_object_clones":0,"num_object_copies":42117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14039,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70893,"num_write_kb":2717824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"72'71320","reported_seq":71667,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:21.650570+0000","last_change":"2026-02-23T13:10:03.037875+0000","last_active":"2026-02-23T13:11:21.650570+0000","last_peered":"2026-02-23T13:11:21.650570+0000","last_clean":"2026-02-23T13:11:21.650570+0000","last_became_active":"2026-02-23T13:08:59.784318+0000","last_became_peered":"2026-02-23T13:08:59.784318+0000","last_unstale":"2026-02-23T13:11:21.650570+0000","last_undegraded":"2026-02-23T13:11:21.650570+0000","last_fullsized":"2026-02-23T13:11:21.650570+0000","mapping_epoch":62,"log_start":"72'71317","ondisk_log_start":"72'71317","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'30914","last_scrub_stamp":"2026-02-23T13:10:03.037814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:03.037814+0000","objects_scrubbed":30174,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:29.315340+0000","scrub_duration":3318,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":931921920,"num_objects":14220,"num_object_clones":0,"num_object_copies":42660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14220,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71320,"num_write_kb":2737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"72'71188","reported_seq":71573,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:21.769197+0000","last_change":"2026-02-23T13:10:13.380759+0000","last_active":"2026-02-23T13:11:21.769197+0000","last_peered":"2026-02-23T13:11:21.769197+0000","last_clean":"2026-02-23T13:11:21.769197+0000","last_became_active":"2026-02-23T13:08:59.784463+0000","last_became_peered":"2026-02-23T13:08:59.784463+0000","last_unstale":"2026-02-23T13:11:21.769197+0000","last_undegraded":"2026-02-23T13:11:21.769197+0000","last_fullsized":"2026-02-23T13:11:21.769197+0000","mapping_epoch":62,"log_start":"72'71185","ondisk_log_start":"72'71185","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'35060","last_scrub_stamp":"2026-02-23T13:10:13.380652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:13.380652+0000","objects_scrubbed":34448,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:31.033114+0000","scrub_duration":3163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":920518656,"num_objects":14046,"num_object_clones":0,"num_object_copies":42138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14046,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71188,"num_write_kb":2727488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"72'71164","reported_seq":71538,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:21.662464+0000","last_change":"2026-02-23T13:10:11.150558+0000","last_active":"2026-02-23T13:11:21.662464+0000","last_peered":"2026-02-23T13:11:21.662464+0000","last_clean":"2026-02-23T13:11:21.662464+0000","last_became_active":"2026-02-23T13:08:59.784436+0000","last_became_peered":"2026-02-23T13:08:59.784436+0000","last_unstale":"2026-02-23T13:11:21.662464+0000","last_undegraded":"2026-02-23T13:11:21.662464+0000","last_fullsized":"2026-02-23T13:11:21.662464+0000","mapping_epoch":62,"log_start":"72'71161","ondisk_log_start":"72'71161","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'34103","last_scrub_stamp":"2026-02-23T13:10:11.150522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:11.150522+0000","objects_scrubbed":33383,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:36.031575+0000","scrub_duration":3995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":922877952,"num_objects":14082,"num_object_clones":0,"num_object_copies":42246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14082,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71164,"num_write_kb":2727872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"72'70867","reported_seq":71282,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:21.652749+0000","last_change":"2026-02-23T13:10:43.059389+0000","last_active":"2026-02-23T13:11:21.652749+0000","last_peered":"2026-02-23T13:11:21.652749+0000","last_clean":"2026-02-23T13:11:21.652749+0000","last_became_active":"2026-02-23T13:08:59.784290+0000","last_became_peered":"2026-02-23T13:08:59.784290+0000","last_unstale":"2026-02-23T13:11:21.652749+0000","last_undegraded":"2026-02-23T13:11:21.652749+0000","last_fullsized":"2026-02-23T13:11:21.652749+0000","mapping_epoch":62,"log_start":"72'70864","ondisk_log_start":"72'70864","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'48491","last_scrub_stamp":"2026-02-23T13:10:43.059312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:43.059312+0000","objects_scrubbed":37287,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:55.819637+0000","scrub_duration":3592,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":915210240,"num_objects":13965,"num_object_clones":0,"num_object_copies":41895,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13965,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70867,"num_write_kb":2714624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"72'70554","reported_seq":70935,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:21.652793+0000","last_change":"2026-02-23T13:10:13.394783+0000","last_active":"2026-02-23T13:11:21.652793+0000","last_peered":"2026-02-23T13:11:21.652793+0000","last_clean":"2026-02-23T13:11:21.652793+0000","last_became_active":"2026-02-23T13:08:59.785634+0000","last_became_peered":"2026-02-23T13:08:59.785634+0000","last_unstale":"2026-02-23T13:11:21.652793+0000","last_undegraded":"2026-02-23T13:11:21.652793+0000","last_fullsized":"2026-02-23T13:11:21.652793+0000","mapping_epoch":62,"log_start":"72'70551","ondisk_log_start":"72'70551","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'34740","last_scrub_stamp":"2026-02-23T13:10:13.394732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:13.394732+0000","objects_scrubbed":34037,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:23.660349+0000","scrub_duration":3642,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":927072256,"num_objects":14146,"num_object_clones":0,"num_object_copies":42438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14146,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70554,"num_write_kb":2710400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":324,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:45.570100+0000","last_change":"2026-02-23T13:10:45.570064+0000","last_active":"2026-02-23T13:10:45.570100+0000","last_peered":"2026-02-23T13:10:45.570100+0000","last_clean":"2026-02-23T13:10:45.570100+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:10:45.570100+0000","last_undegraded":"2026-02-23T13:10:45.570100+0000","last_fullsized":"2026-02-23T13:10:45.570100+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:10:45.570030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:10:45.570030+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:48.611576+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":14789902360,"num_objects":225677,"num_object_clones":0,"num_object_copies":677031,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":225677,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1135841,"num_write_kb":43568513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":44369981440,"data_stored":44369969224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":806,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247911,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":12596888,"kb_used_data":10970116,"kb_used_omap":13,"kb_used_meta":1626674,"kb_avail":721406312,"statfs":{"total":751619276800,"available":738720063488,"internally_reserved":0,"allocated":11233398784,"data_stored":11232891550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14231,"internal_metadata":1665714281},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444138,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":14486040,"kb_used_data":12980036,"kb_used_omap":17,"kb_used_meta":1505838,"kb_avail":719517160,"statfs":{"total":751619276800,"available":736785571840,"internally_reserved":0,"allocated":13291556864,"data_stored":13291049630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18326,"internal_metadata":1541978218},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574956,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":10668624,"kb_used_data":9109564,"kb_used_omap":17,"kb_used_meta":1559022,"kb_avail":723334576,"statfs":{"total":751619276800,"available":740694605824,"internally_reserved":0,"allocated":9328193536,"data_stored":9327693926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18056,"internal_metadata":1596438904},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705773,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":12887960,"kb_used_data":11277380,"kb_used_omap":14,"kb_used_meta":1610545,"kb_avail":721115240,"statfs":{"total":751619276800,"available":738422005760,"internally_reserved":0,"allocated":11548037120,"data_stored":11547529886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14903,"internal_metadata":1649198537},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":806,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11093807104,"data_stored":11093803032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9226158080,"data_stored":9226158080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12949131264,"data_stored":12949127192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11100884992,"data_stored":11100880920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93,"internal_metadata":0}]}} 2026-02-23T13:11:23.488 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 201 2026-02-23T13:11:23.666 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:23.793 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:23.792+0000 7f6154f2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:23.793 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:23.793+0000 7f6154f2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:23.934 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-23T13:11:23.948 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:23 trial046 ceph-mon[38575]: pgmap v299: 17 pgs: 17 active+clean; 14 GiB data, 48 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 11.46k op/s 2026-02-23T13:11:23.973 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:11:24.410 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:11:24.552 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:24.672 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:24.671+0000 7fcfa1fc6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:24.672 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:24.671+0000 7fcfa1fc6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:24.686 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:11:24.686 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:11:24.699 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:11:24.699 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:11:24.714 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:11:24.714 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:11:24.727 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:11:24.727 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:11:25.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:24 trial046 ceph-mon[38575]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:11:25.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:24 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1674759097' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "201"} : dispatch 2026-02-23T13:11:25.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:24 trial046 ceph-mon[38575]: 4.5 scrub starts 2026-02-23T13:11:25.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:24 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4179307771' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:11:26.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:25 trial046 ceph-mon[38575]: pgmap v300: 17 pgs: 17 active+clean; 14 GiB data, 48 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 7.64k op/s 2026-02-23T13:11:26.539 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:11:26 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:11:26] "GET /metrics HTTP/1.1" 200 4234 "" "Prometheus/3.6.0" 2026-02-23T13:11:26.560 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:11:26 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:11:26.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:11:26.769 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:11:26.795 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:26 trial046 ceph-mon[38575]: 4.5 scrub ok 2026-02-23T13:11:26.916 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:27.344 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:27.343+0000 7f5818fe5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:27.344 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:27.343+0000 7f5818fe5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:27.359 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:11:27.359 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:11:27.373 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:11:27.374 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:11:27.386 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:11:27.386 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:11:27.399 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:11:27.399 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:11:28.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:27 trial046 ceph-mon[38575]: pgmap v301: 17 pgs: 17 active+clean; 12 GiB data, 45 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 9.46k op/s 2026-02-23T13:11:28.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:27 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1097763195' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:11:28.974 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:11:28.975 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:11:28.975 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2026-02-23T13:11:28.975 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph tell osd.0 'trim stale osdmaps' 2026-02-23T13:11:29.121 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:29.254 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:29.253+0000 7f04c4d13640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:29.255 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:29.254+0000 7f04c4d13640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:29.275 INFO:teuthology.orchestra.run.trial046.stderr:no valid command found; 10 closest matches: 2026-02-23T13:11:29.276 INFO:teuthology.orchestra.run.trial046.stderr:0 2026-02-23T13:11:29.276 INFO:teuthology.orchestra.run.trial046.stderr:1 2026-02-23T13:11:29.276 INFO:teuthology.orchestra.run.trial046.stderr:2 2026-02-23T13:11:29.276 INFO:teuthology.orchestra.run.trial046.stderr:abort 2026-02-23T13:11:29.276 INFO:teuthology.orchestra.run.trial046.stderr:assert 2026-02-23T13:11:29.276 INFO:teuthology.orchestra.run.trial046.stderr:bench [] [] [] [] 2026-02-23T13:11:29.276 INFO:teuthology.orchestra.run.trial046.stderr:bluefs debug_inject_read_zeros 2026-02-23T13:11:29.276 INFO:teuthology.orchestra.run.trial046.stderr:bluefs files list 2026-02-23T13:11:29.276 INFO:teuthology.orchestra.run.trial046.stderr:bluefs stats 2026-02-23T13:11:29.276 INFO:teuthology.orchestra.run.trial046.stderr:bluestore allocator dump block 2026-02-23T13:11:29.277 INFO:teuthology.orchestra.run.trial046.stderr:Error EINVAL: invalid command 2026-02-23T13:11:29.308 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-23T13:11:29.308 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-23T13:11:29.309 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph tell osd.1 'trim stale osdmaps' 2026-02-23T13:11:29.448 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:29.454 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:11:29.578 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:29.577+0000 7f2040ebe640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:29.578 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:29.577+0000 7f2040ebe640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:29.597 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:29.600 INFO:teuthology.orchestra.run.trial046.stderr:no valid command found; 10 closest matches: 2026-02-23T13:11:29.600 INFO:teuthology.orchestra.run.trial046.stderr:0 2026-02-23T13:11:29.600 INFO:teuthology.orchestra.run.trial046.stderr:1 2026-02-23T13:11:29.600 INFO:teuthology.orchestra.run.trial046.stderr:2 2026-02-23T13:11:29.600 INFO:teuthology.orchestra.run.trial046.stderr:abort 2026-02-23T13:11:29.600 INFO:teuthology.orchestra.run.trial046.stderr:assert 2026-02-23T13:11:29.600 INFO:teuthology.orchestra.run.trial046.stderr:bench [] [] [] [] 2026-02-23T13:11:29.600 INFO:teuthology.orchestra.run.trial046.stderr:bluefs debug_inject_read_zeros 2026-02-23T13:11:29.600 INFO:teuthology.orchestra.run.trial046.stderr:bluefs files list 2026-02-23T13:11:29.600 INFO:teuthology.orchestra.run.trial046.stderr:bluefs stats 2026-02-23T13:11:29.600 INFO:teuthology.orchestra.run.trial046.stderr:bluestore allocator dump block 2026-02-23T13:11:29.600 INFO:teuthology.orchestra.run.trial046.stderr:Error EINVAL: invalid command 2026-02-23T13:11:29.639 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-23T13:11:29.639 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-23T13:11:29.639 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph tell osd.2 'trim stale osdmaps' 2026-02-23T13:11:29.720 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:29.719+0000 7f77ede4a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:29.720 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:29.719+0000 7f77ede4a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:29.737 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:11:29.737 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:11:29.749 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:11:29.750 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:11:29.766 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:11:29.767 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:11:29.767 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:29 trial046 ceph-mon[38575]: pgmap v302: 17 pgs: 17 active+clean; 11 GiB data, 41 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 9.41k op/s 2026-02-23T13:11:29.767 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:29 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1709447305' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:11:29.779 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:29.780 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:11:29.780 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:11:29.910 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:29.909+0000 7ff673a31640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:29.910 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:29.909+0000 7ff673a31640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:29.930 INFO:teuthology.orchestra.run.trial046.stderr:no valid command found; 10 closest matches: 2026-02-23T13:11:29.930 INFO:teuthology.orchestra.run.trial046.stderr:0 2026-02-23T13:11:29.930 INFO:teuthology.orchestra.run.trial046.stderr:1 2026-02-23T13:11:29.930 INFO:teuthology.orchestra.run.trial046.stderr:2 2026-02-23T13:11:29.930 INFO:teuthology.orchestra.run.trial046.stderr:abort 2026-02-23T13:11:29.931 INFO:teuthology.orchestra.run.trial046.stderr:assert 2026-02-23T13:11:29.931 INFO:teuthology.orchestra.run.trial046.stderr:bench [] [] [] [] 2026-02-23T13:11:29.931 INFO:teuthology.orchestra.run.trial046.stderr:bluefs debug_inject_read_zeros 2026-02-23T13:11:29.931 INFO:teuthology.orchestra.run.trial046.stderr:bluefs files list 2026-02-23T13:11:29.931 INFO:teuthology.orchestra.run.trial046.stderr:bluefs stats 2026-02-23T13:11:29.931 INFO:teuthology.orchestra.run.trial046.stderr:bluestore allocator dump block 2026-02-23T13:11:29.931 INFO:teuthology.orchestra.run.trial046.stderr:Error EINVAL: invalid command 2026-02-23T13:11:29.974 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-23T13:11:29.975 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-23T13:11:29.975 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph tell osd.3 'trim stale osdmaps' 2026-02-23T13:11:30.114 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:30.240 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:30.239+0000 7f73cbd5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:30.241 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:30.239+0000 7f73cbd5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:30.262 INFO:teuthology.orchestra.run.trial046.stderr:no valid command found; 10 closest matches: 2026-02-23T13:11:30.263 INFO:teuthology.orchestra.run.trial046.stderr:0 2026-02-23T13:11:30.263 INFO:teuthology.orchestra.run.trial046.stderr:1 2026-02-23T13:11:30.263 INFO:teuthology.orchestra.run.trial046.stderr:2 2026-02-23T13:11:30.263 INFO:teuthology.orchestra.run.trial046.stderr:abort 2026-02-23T13:11:30.263 INFO:teuthology.orchestra.run.trial046.stderr:assert 2026-02-23T13:11:30.263 INFO:teuthology.orchestra.run.trial046.stderr:bench [] [] [] [] 2026-02-23T13:11:30.263 INFO:teuthology.orchestra.run.trial046.stderr:bluefs debug_inject_read_zeros 2026-02-23T13:11:30.263 INFO:teuthology.orchestra.run.trial046.stderr:bluefs files list 2026-02-23T13:11:30.263 INFO:teuthology.orchestra.run.trial046.stderr:bluefs stats 2026-02-23T13:11:30.263 INFO:teuthology.orchestra.run.trial046.stderr:bluestore allocator dump block 2026-02-23T13:11:30.264 INFO:teuthology.orchestra.run.trial046.stderr:Error EINVAL: invalid command 2026-02-23T13:11:30.300 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-23T13:11:30.301 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-23T13:11:31.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:30 trial046 ceph-mon[38575]: 4.9 scrub starts 2026-02-23T13:11:31.826 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:11:31.971 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:31.998 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:31 trial046 ceph-mon[38575]: 4.9 scrub ok 2026-02-23T13:11:31.998 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:31 trial046 ceph-mon[38575]: pgmap v303: 17 pgs: 17 active+clean; 11 GiB data, 41 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 7.52k op/s 2026-02-23T13:11:31.998 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:31 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:11:32.090 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:32.089+0000 7f9f65a74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:32.090 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:32.089+0000 7f9f65a74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:32.103 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:11:32.104 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:11:32.117 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:11:32.117 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:11:32.130 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:11:32.130 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:11:32.143 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:11:32.143 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:11:33.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:32 trial046 ceph-mon[38575]: 4.4 scrub starts 2026-02-23T13:11:33.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:32 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3221768721' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:11:34.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:33 trial046 ceph-mon[38575]: 4.4 scrub ok 2026-02-23T13:11:34.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:33 trial046 ceph-mon[38575]: pgmap v304: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.3 GiB data, 31 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 11.42k op/s 2026-02-23T13:11:34.186 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:11:34.337 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:34.896 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:34.830+0000 7f2b0b96f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:34.896 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:34.830+0000 7f2b0b96f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:34.896 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:11:34.896 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:11:34.897 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:11:34.897 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:11:34.897 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:11:34.897 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:11:34.899 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:11:34.899 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:11:35.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:34 trial046 ceph-mon[38575]: 4.2 scrub starts 2026-02-23T13:11:35.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:34 trial046 ceph-mon[38575]: 4.3 scrub starts 2026-02-23T13:11:35.302 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:11:35.302 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-23T13:11:35.440 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:35.643 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:35.642+0000 7fc952b6b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:35.644 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:35.642+0000 7fc952b6b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:36.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:35 trial046 ceph-mon[38575]: 4.2 scrub ok 2026-02-23T13:11:36.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:35 trial046 ceph-mon[38575]: pgmap v305: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.3 GiB data, 31 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 7.54k op/s 2026-02-23T13:11:36.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:35 trial046 ceph-mon[38575]: 4.3 scrub ok 2026-02-23T13:11:36.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:35 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1701454639' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:11:36.539 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:11:36 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:11:36] "GET /metrics HTTP/1.1" 200 4227 "" "Prometheus/3.6.0" 2026-02-23T13:11:36.560 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:11:36 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:11:36.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:11:36.736 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.0 to 1 (10000) 2026-02-23T13:11:37.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:36 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2361668372' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-23T13:11:37.274 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-23T13:11:37.412 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:37.453 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:11:37.546 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:37.544+0000 7fd28ed17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:37.546 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:37.544+0000 7fd28ed17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:37.600 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:37.720 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:37.717+0000 7f0cbe0a6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:37.720 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:37.718+0000 7f0cbe0a6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:37.736 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.1 to 1 (10000) 2026-02-23T13:11:37.737 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:11:37.737 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:11:37.751 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:11:37.751 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:11:37.765 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:11:37.766 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:11:37.780 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:11:37.781 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:11:37.786 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:37 trial046 ceph-mon[38575]: pgmap v306: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 6.9 GiB data, 27 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 9.33k op/s 2026-02-23T13:11:37.786 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:37 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2361668372' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-23T13:11:37.786 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:37 trial046 ceph-mon[38575]: osdmap e73: 4 total, 4 up, 4 in 2026-02-23T13:11:37.786 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:37 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1671940698' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-23T13:11:37.786 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:37 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2294925394' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:11:37.787 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-23T13:11:37.930 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:38.054 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:38.051+0000 7fcb5948a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:38.054 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:38.052+0000 7fcb5948a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:38.740 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.2 to 1 (10000) 2026-02-23T13:11:38.785 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-23T13:11:38.939 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:38.993 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:38 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1671940698' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-23T13:11:38.994 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:38 trial046 ceph-mon[38575]: osdmap e74: 4 total, 4 up, 4 in 2026-02-23T13:11:38.994 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:38 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/99163091' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-23T13:11:39.056 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:39.054+0000 7f5b9a8b1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:39.056 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:39.054+0000 7f5b9a8b1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:39.571 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.3 to 1 (10000) 2026-02-23T13:11:39.831 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:11:39.856 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:39 trial046 ceph-mon[38575]: pgmap v309: 17 pgs: 17 active+clean; 5.6 GiB data, 23 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 11.26k op/s 2026-02-23T13:11:39.856 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:39 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/99163091' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-23T13:11:39.856 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:39 trial046 ceph-mon[38575]: osdmap e75: 4 total, 4 up, 4 in 2026-02-23T13:11:39.856 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:39 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/773474503' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-23T13:11:39.856 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:39 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/773474503' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-23T13:11:39.856 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:39 trial046 ceph-mon[38575]: osdmap e76: 4 total, 4 up, 4 in 2026-02-23T13:11:40.127 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:40.232 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-23T13:11:40.232 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:11:40.421 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:40.652 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:11:40.652 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:11:40.652 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:11:40.652 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:11:40.653 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:40.566+0000 7fef56fd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:40.653 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:40.566+0000 7fef56fd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:40.653 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:11:40.653 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:11:40.653 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:11:40.653 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:11:40.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:40 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/161282996' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:11:41.001 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:40.999+0000 7f005fde3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:41.001 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:41.000+0000 7f005fde3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:41.146 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:11:41.147 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:11:41.194 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":312,"stamp":"2026-02-23T13:11:40.659966+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6026494520,"num_objects":91951,"num_object_clones":0,"num_object_copies":275853,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91951,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":1269704,"num_write_kb":43570663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":24107224,"kb_used_data":18797704,"kb_used_omap":60,"kb_used_meta":5309315,"kb_avail":2911905576,"statfs":{"total":3006477107200,"available":2981791309824,"internally_reserved":0,"allocated":19248848896,"data_stored":19246827584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":61782,"internal_metadata":5436739242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1421672448,"num_objects":-21693,"num_object_clones":0,"num_object_copies":-65079,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-21693,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21693,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000515"},"pg_stats":[{"pgid":"4.f","version":"73'79791","reported_seq":80201,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.774551+0000","last_change":"2026-02-23T13:10:18.889561+0000","last_active":"2026-02-23T13:11:36.774551+0000","last_peered":"2026-02-23T13:11:36.774551+0000","last_clean":"2026-02-23T13:11:36.774551+0000","last_became_active":"2026-02-23T13:08:59.784888+0000","last_became_peered":"2026-02-23T13:08:59.784888+0000","last_unstale":"2026-02-23T13:11:36.774551+0000","last_undegraded":"2026-02-23T13:11:36.774551+0000","last_fullsized":"2026-02-23T13:11:36.774551+0000","mapping_epoch":62,"log_start":"73'79788","ondisk_log_start":"73'79788","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'37338","last_scrub_stamp":"2026-02-23T13:10:18.889417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:18.889417+0000","objects_scrubbed":36552,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:46.655322+0000","scrub_duration":3662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383844352,"num_objects":5857,"num_object_clones":0,"num_object_copies":17571,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5857,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79791,"num_write_kb":2740736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"72'78350","reported_seq":78785,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.662699+0000","last_change":"2026-02-23T13:10:27.126280+0000","last_active":"2026-02-23T13:11:36.662699+0000","last_peered":"2026-02-23T13:11:36.662699+0000","last_clean":"2026-02-23T13:11:36.662699+0000","last_became_active":"2026-02-23T13:08:59.785397+0000","last_became_peered":"2026-02-23T13:08:59.785397+0000","last_unstale":"2026-02-23T13:11:36.662699+0000","last_undegraded":"2026-02-23T13:11:36.662699+0000","last_fullsized":"2026-02-23T13:11:36.662699+0000","mapping_epoch":62,"log_start":"72'78347","ondisk_log_start":"72'78347","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'40440","last_scrub_stamp":"2026-02-23T13:10:27.126174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:27.126174+0000","objects_scrubbed":39592,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:48.254573+0000","scrub_duration":3978,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":374210560,"num_objects":5710,"num_object_clones":0,"num_object_copies":17130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5710,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78350,"num_write_kb":2689920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"72'79275","reported_seq":79825,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.654046+0000","last_change":"2026-02-23T13:11:17.234531+0000","last_active":"2026-02-23T13:11:36.654046+0000","last_peered":"2026-02-23T13:11:36.654046+0000","last_clean":"2026-02-23T13:11:36.654046+0000","last_became_active":"2026-02-23T13:08:59.785780+0000","last_became_peered":"2026-02-23T13:08:59.785780+0000","last_unstale":"2026-02-23T13:11:36.654046+0000","last_undegraded":"2026-02-23T13:11:36.654046+0000","last_fullsized":"2026-02-23T13:11:36.654046+0000","mapping_epoch":62,"log_start":"72'79272","ondisk_log_start":"72'79272","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'68273","last_scrub_stamp":"2026-02-23T13:11:17.234494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:11:17.234494+0000","objects_scrubbed":17257,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:22.985224+0000","scrub_duration":1883,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":382205976,"num_objects":5833,"num_object_clones":0,"num_object_copies":17499,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5833,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":79275,"num_write_kb":2723393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"72'80043","reported_seq":80485,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.653287+0000","last_change":"2026-02-23T13:10:26.384628+0000","last_active":"2026-02-23T13:11:36.653287+0000","last_peered":"2026-02-23T13:11:36.653287+0000","last_clean":"2026-02-23T13:11:36.653287+0000","last_became_active":"2026-02-23T13:08:59.783982+0000","last_became_peered":"2026-02-23T13:08:59.783982+0000","last_unstale":"2026-02-23T13:11:36.653287+0000","last_undegraded":"2026-02-23T13:11:36.653287+0000","last_fullsized":"2026-02-23T13:11:36.653287+0000","mapping_epoch":62,"log_start":"72'80040","ondisk_log_start":"72'80040","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'40924","last_scrub_stamp":"2026-02-23T13:10:26.384602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:26.384602+0000","objects_scrubbed":40159,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:51.409315+0000","scrub_duration":3763,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":372965376,"num_objects":5691,"num_object_clones":0,"num_object_copies":17073,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5691,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80043,"num_write_kb":2743488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"72'79201","reported_seq":79654,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.652863+0000","last_change":"2026-02-23T13:10:36.436883+0000","last_active":"2026-02-23T13:11:36.652863+0000","last_peered":"2026-02-23T13:11:36.652863+0000","last_clean":"2026-02-23T13:11:36.652863+0000","last_became_active":"2026-02-23T13:08:59.784710+0000","last_became_peered":"2026-02-23T13:08:59.784710+0000","last_unstale":"2026-02-23T13:11:36.652863+0000","last_undegraded":"2026-02-23T13:11:36.652863+0000","last_fullsized":"2026-02-23T13:11:36.652863+0000","mapping_epoch":62,"log_start":"72'79198","ondisk_log_start":"72'79198","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'44729","last_scrub_stamp":"2026-02-23T13:10:36.436786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:36.436786+0000","objects_scrubbed":41142,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:51.122805+0000","scrub_duration":4872,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373358592,"num_objects":5697,"num_object_clones":0,"num_object_copies":17091,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5697,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79201,"num_write_kb":2716736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"72'79769","reported_seq":80233,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.660989+0000","last_change":"2026-02-23T13:10:31.717671+0000","last_active":"2026-02-23T13:11:36.660989+0000","last_peered":"2026-02-23T13:11:36.660989+0000","last_clean":"2026-02-23T13:11:36.660989+0000","last_became_active":"2026-02-23T13:08:59.784218+0000","last_became_peered":"2026-02-23T13:08:59.784218+0000","last_unstale":"2026-02-23T13:11:36.660989+0000","last_undegraded":"2026-02-23T13:11:36.660989+0000","last_fullsized":"2026-02-23T13:11:36.660989+0000","mapping_epoch":62,"log_start":"72'79766","ondisk_log_start":"72'79766","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'43162","last_scrub_stamp":"2026-02-23T13:10:31.717638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:31.717638+0000","objects_scrubbed":42156,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"queued for scrub","scrub_duration":4538,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":380436480,"num_objects":5805,"num_object_clones":0,"num_object_copies":17415,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5805,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79769,"num_write_kb":2738368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"72'79140","reported_seq":79601,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.660167+0000","last_change":"2026-02-23T13:11:30.102108+0000","last_active":"2026-02-23T13:11:36.660167+0000","last_peered":"2026-02-23T13:11:36.660167+0000","last_clean":"2026-02-23T13:11:36.660167+0000","last_became_active":"2026-02-23T13:08:59.784210+0000","last_became_peered":"2026-02-23T13:08:59.784210+0000","last_unstale":"2026-02-23T13:11:36.660167+0000","last_undegraded":"2026-02-23T13:11:36.660167+0000","last_fullsized":"2026-02-23T13:11:36.660167+0000","mapping_epoch":62,"log_start":"72'79137","ondisk_log_start":"72'79137","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'75509","last_scrub_stamp":"2026-02-23T13:11:30.102038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:11:30.102038+0000","objects_scrubbed":9740,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:37.705771+0000","scrub_duration":1067,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":380895232,"num_objects":5812,"num_object_clones":0,"num_object_copies":17436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5812,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79140,"num_write_kb":2718464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"72'78730","reported_seq":79157,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.655067+0000","last_change":"2026-02-23T13:10:24.387952+0000","last_active":"2026-02-23T13:11:36.655067+0000","last_peered":"2026-02-23T13:11:36.655067+0000","last_clean":"2026-02-23T13:11:36.655067+0000","last_became_active":"2026-02-23T13:08:59.785359+0000","last_became_peered":"2026-02-23T13:08:59.785359+0000","last_unstale":"2026-02-23T13:11:36.655067+0000","last_undegraded":"2026-02-23T13:11:36.655067+0000","last_fullsized":"2026-02-23T13:11:36.655067+0000","mapping_epoch":62,"log_start":"72'78727","ondisk_log_start":"72'78727","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'39419","last_scrub_stamp":"2026-02-23T13:10:24.387875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:24.387875+0000","objects_scrubbed":38695,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:54.083097+0000","scrub_duration":3689,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":380239872,"num_objects":5802,"num_object_clones":0,"num_object_copies":17406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5802,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78730,"num_write_kb":2705024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"73'79617","reported_seq":80080,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.770692+0000","last_change":"2026-02-23T13:10:34.960546+0000","last_active":"2026-02-23T13:11:36.770692+0000","last_peered":"2026-02-23T13:11:36.770692+0000","last_clean":"2026-02-23T13:11:36.770692+0000","last_became_active":"2026-02-23T13:08:59.785106+0000","last_became_peered":"2026-02-23T13:08:59.785106+0000","last_unstale":"2026-02-23T13:11:36.770692+0000","last_undegraded":"2026-02-23T13:11:36.770692+0000","last_fullsized":"2026-02-23T13:11:36.770692+0000","mapping_epoch":62,"log_start":"73'79614","ondisk_log_start":"73'79614","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'44040","last_scrub_stamp":"2026-02-23T13:10:34.960505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:34.960505+0000","objects_scrubbed":42002,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:42.696429+0000","scrub_duration":4826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":370475008,"num_objects":5653,"num_object_clones":0,"num_object_copies":16959,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5653,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79617,"num_write_kb":2728640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"72'79567","reported_seq":79968,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.654063+0000","last_change":"2026-02-23T13:10:17.283236+0000","last_active":"2026-02-23T13:11:36.654063+0000","last_peered":"2026-02-23T13:11:36.654063+0000","last_clean":"2026-02-23T13:11:36.654063+0000","last_became_active":"2026-02-23T13:08:59.784457+0000","last_became_peered":"2026-02-23T13:08:59.784457+0000","last_unstale":"2026-02-23T13:11:36.654063+0000","last_undegraded":"2026-02-23T13:11:36.654063+0000","last_fullsized":"2026-02-23T13:11:36.654063+0000","mapping_epoch":62,"log_start":"72'79564","ondisk_log_start":"72'79564","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'36652","last_scrub_stamp":"2026-02-23T13:10:17.283183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:17.283183+0000","objects_scrubbed":35965,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:47.102975+0000","scrub_duration":3592,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":372965376,"num_objects":5691,"num_object_clones":0,"num_object_copies":17073,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5691,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79567,"num_write_kb":2728256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"73'79205","reported_seq":79700,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.773756+0000","last_change":"2026-02-23T13:11:32.076321+0000","last_active":"2026-02-23T13:11:36.773756+0000","last_peered":"2026-02-23T13:11:36.773756+0000","last_clean":"2026-02-23T13:11:36.773756+0000","last_became_active":"2026-02-23T13:08:59.784235+0000","last_became_peered":"2026-02-23T13:08:59.784235+0000","last_unstale":"2026-02-23T13:11:36.773756+0000","last_undegraded":"2026-02-23T13:11:36.773756+0000","last_fullsized":"2026-02-23T13:11:36.773756+0000","mapping_epoch":62,"log_start":"73'79202","ondisk_log_start":"73'79202","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'76650","last_scrub_stamp":"2026-02-23T13:11:32.076239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:11:32.076239+0000","objects_scrubbed":8470,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:40.465753+0000","scrub_duration":771,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375324672,"num_objects":5727,"num_object_clones":0,"num_object_copies":17181,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5727,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79205,"num_write_kb":2717824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"72'79720","reported_seq":80146,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.655158+0000","last_change":"2026-02-23T13:11:34.682558+0000","last_active":"2026-02-23T13:11:36.655158+0000","last_peered":"2026-02-23T13:11:36.655158+0000","last_clean":"2026-02-23T13:11:36.655158+0000","last_became_active":"2026-02-23T13:08:59.784318+0000","last_became_peered":"2026-02-23T13:08:59.784318+0000","last_unstale":"2026-02-23T13:11:36.655158+0000","last_undegraded":"2026-02-23T13:11:36.655158+0000","last_fullsized":"2026-02-23T13:11:36.655158+0000","mapping_epoch":62,"log_start":"72'79717","ondisk_log_start":"72'79717","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'78677","last_scrub_stamp":"2026-02-23T13:11:34.682487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:11:34.682487+0000","objects_scrubbed":7062,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:57.105460+0000","scrub_duration":850,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381419520,"num_objects":5820,"num_object_clones":0,"num_object_copies":17460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5820,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79720,"num_write_kb":2737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"73'79586","reported_seq":80055,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.775443+0000","last_change":"2026-02-23T13:11:34.025322+0000","last_active":"2026-02-23T13:11:36.775443+0000","last_peered":"2026-02-23T13:11:36.775443+0000","last_clean":"2026-02-23T13:11:36.775443+0000","last_became_active":"2026-02-23T13:08:59.784463+0000","last_became_peered":"2026-02-23T13:08:59.784463+0000","last_unstale":"2026-02-23T13:11:36.775443+0000","last_undegraded":"2026-02-23T13:11:36.775443+0000","last_fullsized":"2026-02-23T13:11:36.775443+0000","mapping_epoch":62,"log_start":"73'79583","ondisk_log_start":"73'79583","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'78142","last_scrub_stamp":"2026-02-23T13:11:34.025270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:11:34.025270+0000","objects_scrubbed":7249,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:45.187496+0000","scrub_duration":730,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":370147328,"num_objects":5648,"num_object_clones":0,"num_object_copies":16944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5648,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79586,"num_write_kb":2727488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"72'79512","reported_seq":79887,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.663848+0000","last_change":"2026-02-23T13:10:11.150558+0000","last_active":"2026-02-23T13:11:36.663848+0000","last_peered":"2026-02-23T13:11:36.663848+0000","last_clean":"2026-02-23T13:11:36.663848+0000","last_became_active":"2026-02-23T13:08:59.784436+0000","last_became_peered":"2026-02-23T13:08:59.784436+0000","last_unstale":"2026-02-23T13:11:36.663848+0000","last_undegraded":"2026-02-23T13:11:36.663848+0000","last_fullsized":"2026-02-23T13:11:36.663848+0000","mapping_epoch":62,"log_start":"72'79509","ondisk_log_start":"72'79509","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'34103","last_scrub_stamp":"2026-02-23T13:10:11.150522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:11.150522+0000","objects_scrubbed":33383,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"queued for scrub","scrub_duration":3995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375783424,"num_objects":5734,"num_object_clones":0,"num_object_copies":17202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5734,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79512,"num_write_kb":2727872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"72'79143","reported_seq":79558,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.645110+0000","last_change":"2026-02-23T13:10:43.059389+0000","last_active":"2026-02-23T13:11:36.645110+0000","last_peered":"2026-02-23T13:11:36.645110+0000","last_clean":"2026-02-23T13:11:36.645110+0000","last_became_active":"2026-02-23T13:08:59.784290+0000","last_became_peered":"2026-02-23T13:08:59.784290+0000","last_unstale":"2026-02-23T13:11:36.645110+0000","last_undegraded":"2026-02-23T13:11:36.645110+0000","last_fullsized":"2026-02-23T13:11:36.645110+0000","mapping_epoch":62,"log_start":"72'79140","ondisk_log_start":"72'79140","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'48491","last_scrub_stamp":"2026-02-23T13:10:43.059312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:43.059312+0000","objects_scrubbed":37287,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:55.819637+0000","scrub_duration":3592,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":372834304,"num_objects":5689,"num_object_clones":0,"num_object_copies":17067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5689,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79143,"num_write_kb":2714624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"72'78920","reported_seq":79433,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.652271+0000","last_change":"2026-02-23T13:11:25.544993+0000","last_active":"2026-02-23T13:11:36.652271+0000","last_peered":"2026-02-23T13:11:36.652271+0000","last_clean":"2026-02-23T13:11:36.652271+0000","last_became_active":"2026-02-23T13:08:59.785634+0000","last_became_peered":"2026-02-23T13:08:59.785634+0000","last_unstale":"2026-02-23T13:11:36.652271+0000","last_undegraded":"2026-02-23T13:11:36.652271+0000","last_fullsized":"2026-02-23T13:11:36.652271+0000","mapping_epoch":62,"log_start":"72'78917","ondisk_log_start":"72'78917","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'72700","last_scrub_stamp":"2026-02-23T13:11:25.544914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:11:25.544914+0000","objects_scrubbed":12306,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:41.399102+0000","scrub_duration":1245,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":378798080,"num_objects":5780,"num_object_clones":0,"num_object_copies":17340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5780,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78920,"num_write_kb":2710400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":324,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:45.570100+0000","last_change":"2026-02-23T13:10:45.570064+0000","last_active":"2026-02-23T13:10:45.570100+0000","last_peered":"2026-02-23T13:10:45.570100+0000","last_clean":"2026-02-23T13:10:45.570100+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:10:45.570100+0000","last_undegraded":"2026-02-23T13:10:45.570100+0000","last_fullsized":"2026-02-23T13:10:45.570100+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:10:45.570030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:10:45.570030+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:48.611576+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":6025904152,"num_objects":91949,"num_object_clones":0,"num_object_copies":275847,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91949,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1269569,"num_write_kb":43568513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18084212736,"data_stored":18084200520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1911,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":806,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247914,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5463960,"kb_used_data":4590852,"kb_used_omap":13,"kb_used_meta":873010,"kb_avail":728539240,"statfs":{"total":751619276800,"available":746024181760,"internally_reserved":0,"allocated":4701032448,"data_stored":4700525214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14324,"internal_metadata":893962252},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444141,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6961752,"kb_used_data":5568708,"kb_used_omap":17,"kb_used_meta":1393006,"kb_avail":727041448,"statfs":{"total":751619276800,"available":744490442752,"internally_reserved":0,"allocated":5702356992,"data_stored":5701849758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18412,"internal_metadata":1426438164},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574959,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5552848,"kb_used_data":3831356,"kb_used_omap":17,"kb_used_meta":1721454,"kb_avail":728450352,"statfs":{"total":751619276800,"available":745933160448,"internally_reserved":0,"allocated":3923308544,"data_stored":3922808934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18242,"internal_metadata":1762769086},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705776,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6128664,"kb_used_data":4806788,"kb_used_omap":10,"kb_used_meta":1321845,"kb_avail":727874536,"statfs":{"total":751619276800,"available":745343524864,"internally_reserved":0,"allocated":4922150912,"data_stored":4921643678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10804,"internal_metadata":1353569740},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":806,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4529459200,"data_stored":4529455128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3725262848,"data_stored":3725262848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":186,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5286203392,"data_stored":5286199320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1446,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4543287296,"data_stored":4543283224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":186,"internal_metadata":0}]}} 2026-02-23T13:11:41.196 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:11:41.339 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:41.464 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:41.462+0000 7f910fb58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:41.464 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:41.462+0000 7f910fb58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:41.610 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:11:41.611 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:11:41.653 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":312,"stamp":"2026-02-23T13:11:40.659966+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6026494520,"num_objects":91951,"num_object_clones":0,"num_object_copies":275853,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91951,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":1269704,"num_write_kb":43570663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":24107224,"kb_used_data":18797704,"kb_used_omap":60,"kb_used_meta":5309315,"kb_avail":2911905576,"statfs":{"total":3006477107200,"available":2981791309824,"internally_reserved":0,"allocated":19248848896,"data_stored":19246827584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":61782,"internal_metadata":5436739242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1421672448,"num_objects":-21693,"num_object_clones":0,"num_object_copies":-65079,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-21693,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21693,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000515"},"pg_stats":[{"pgid":"4.f","version":"73'79791","reported_seq":80201,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.774551+0000","last_change":"2026-02-23T13:10:18.889561+0000","last_active":"2026-02-23T13:11:36.774551+0000","last_peered":"2026-02-23T13:11:36.774551+0000","last_clean":"2026-02-23T13:11:36.774551+0000","last_became_active":"2026-02-23T13:08:59.784888+0000","last_became_peered":"2026-02-23T13:08:59.784888+0000","last_unstale":"2026-02-23T13:11:36.774551+0000","last_undegraded":"2026-02-23T13:11:36.774551+0000","last_fullsized":"2026-02-23T13:11:36.774551+0000","mapping_epoch":62,"log_start":"73'79788","ondisk_log_start":"73'79788","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'37338","last_scrub_stamp":"2026-02-23T13:10:18.889417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:18.889417+0000","objects_scrubbed":36552,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:46.655322+0000","scrub_duration":3662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383844352,"num_objects":5857,"num_object_clones":0,"num_object_copies":17571,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5857,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79791,"num_write_kb":2740736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"72'78350","reported_seq":78785,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.662699+0000","last_change":"2026-02-23T13:10:27.126280+0000","last_active":"2026-02-23T13:11:36.662699+0000","last_peered":"2026-02-23T13:11:36.662699+0000","last_clean":"2026-02-23T13:11:36.662699+0000","last_became_active":"2026-02-23T13:08:59.785397+0000","last_became_peered":"2026-02-23T13:08:59.785397+0000","last_unstale":"2026-02-23T13:11:36.662699+0000","last_undegraded":"2026-02-23T13:11:36.662699+0000","last_fullsized":"2026-02-23T13:11:36.662699+0000","mapping_epoch":62,"log_start":"72'78347","ondisk_log_start":"72'78347","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'40440","last_scrub_stamp":"2026-02-23T13:10:27.126174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:27.126174+0000","objects_scrubbed":39592,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:48.254573+0000","scrub_duration":3978,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":374210560,"num_objects":5710,"num_object_clones":0,"num_object_copies":17130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5710,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78350,"num_write_kb":2689920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"72'79275","reported_seq":79825,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.654046+0000","last_change":"2026-02-23T13:11:17.234531+0000","last_active":"2026-02-23T13:11:36.654046+0000","last_peered":"2026-02-23T13:11:36.654046+0000","last_clean":"2026-02-23T13:11:36.654046+0000","last_became_active":"2026-02-23T13:08:59.785780+0000","last_became_peered":"2026-02-23T13:08:59.785780+0000","last_unstale":"2026-02-23T13:11:36.654046+0000","last_undegraded":"2026-02-23T13:11:36.654046+0000","last_fullsized":"2026-02-23T13:11:36.654046+0000","mapping_epoch":62,"log_start":"72'79272","ondisk_log_start":"72'79272","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'68273","last_scrub_stamp":"2026-02-23T13:11:17.234494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:11:17.234494+0000","objects_scrubbed":17257,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:22.985224+0000","scrub_duration":1883,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":382205976,"num_objects":5833,"num_object_clones":0,"num_object_copies":17499,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5833,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":79275,"num_write_kb":2723393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"72'80043","reported_seq":80485,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.653287+0000","last_change":"2026-02-23T13:10:26.384628+0000","last_active":"2026-02-23T13:11:36.653287+0000","last_peered":"2026-02-23T13:11:36.653287+0000","last_clean":"2026-02-23T13:11:36.653287+0000","last_became_active":"2026-02-23T13:08:59.783982+0000","last_became_peered":"2026-02-23T13:08:59.783982+0000","last_unstale":"2026-02-23T13:11:36.653287+0000","last_undegraded":"2026-02-23T13:11:36.653287+0000","last_fullsized":"2026-02-23T13:11:36.653287+0000","mapping_epoch":62,"log_start":"72'80040","ondisk_log_start":"72'80040","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'40924","last_scrub_stamp":"2026-02-23T13:10:26.384602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:26.384602+0000","objects_scrubbed":40159,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:51.409315+0000","scrub_duration":3763,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":372965376,"num_objects":5691,"num_object_clones":0,"num_object_copies":17073,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5691,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80043,"num_write_kb":2743488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"72'79201","reported_seq":79654,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.652863+0000","last_change":"2026-02-23T13:10:36.436883+0000","last_active":"2026-02-23T13:11:36.652863+0000","last_peered":"2026-02-23T13:11:36.652863+0000","last_clean":"2026-02-23T13:11:36.652863+0000","last_became_active":"2026-02-23T13:08:59.784710+0000","last_became_peered":"2026-02-23T13:08:59.784710+0000","last_unstale":"2026-02-23T13:11:36.652863+0000","last_undegraded":"2026-02-23T13:11:36.652863+0000","last_fullsized":"2026-02-23T13:11:36.652863+0000","mapping_epoch":62,"log_start":"72'79198","ondisk_log_start":"72'79198","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'44729","last_scrub_stamp":"2026-02-23T13:10:36.436786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:36.436786+0000","objects_scrubbed":41142,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:51.122805+0000","scrub_duration":4872,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373358592,"num_objects":5697,"num_object_clones":0,"num_object_copies":17091,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5697,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79201,"num_write_kb":2716736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"72'79769","reported_seq":80233,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.660989+0000","last_change":"2026-02-23T13:10:31.717671+0000","last_active":"2026-02-23T13:11:36.660989+0000","last_peered":"2026-02-23T13:11:36.660989+0000","last_clean":"2026-02-23T13:11:36.660989+0000","last_became_active":"2026-02-23T13:08:59.784218+0000","last_became_peered":"2026-02-23T13:08:59.784218+0000","last_unstale":"2026-02-23T13:11:36.660989+0000","last_undegraded":"2026-02-23T13:11:36.660989+0000","last_fullsized":"2026-02-23T13:11:36.660989+0000","mapping_epoch":62,"log_start":"72'79766","ondisk_log_start":"72'79766","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'43162","last_scrub_stamp":"2026-02-23T13:10:31.717638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:31.717638+0000","objects_scrubbed":42156,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"queued for scrub","scrub_duration":4538,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":380436480,"num_objects":5805,"num_object_clones":0,"num_object_copies":17415,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5805,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79769,"num_write_kb":2738368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"72'79140","reported_seq":79601,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.660167+0000","last_change":"2026-02-23T13:11:30.102108+0000","last_active":"2026-02-23T13:11:36.660167+0000","last_peered":"2026-02-23T13:11:36.660167+0000","last_clean":"2026-02-23T13:11:36.660167+0000","last_became_active":"2026-02-23T13:08:59.784210+0000","last_became_peered":"2026-02-23T13:08:59.784210+0000","last_unstale":"2026-02-23T13:11:36.660167+0000","last_undegraded":"2026-02-23T13:11:36.660167+0000","last_fullsized":"2026-02-23T13:11:36.660167+0000","mapping_epoch":62,"log_start":"72'79137","ondisk_log_start":"72'79137","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'75509","last_scrub_stamp":"2026-02-23T13:11:30.102038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:11:30.102038+0000","objects_scrubbed":9740,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:37.705771+0000","scrub_duration":1067,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":380895232,"num_objects":5812,"num_object_clones":0,"num_object_copies":17436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5812,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79140,"num_write_kb":2718464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"72'78730","reported_seq":79157,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.655067+0000","last_change":"2026-02-23T13:10:24.387952+0000","last_active":"2026-02-23T13:11:36.655067+0000","last_peered":"2026-02-23T13:11:36.655067+0000","last_clean":"2026-02-23T13:11:36.655067+0000","last_became_active":"2026-02-23T13:08:59.785359+0000","last_became_peered":"2026-02-23T13:08:59.785359+0000","last_unstale":"2026-02-23T13:11:36.655067+0000","last_undegraded":"2026-02-23T13:11:36.655067+0000","last_fullsized":"2026-02-23T13:11:36.655067+0000","mapping_epoch":62,"log_start":"72'78727","ondisk_log_start":"72'78727","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'39419","last_scrub_stamp":"2026-02-23T13:10:24.387875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:24.387875+0000","objects_scrubbed":38695,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:54.083097+0000","scrub_duration":3689,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":380239872,"num_objects":5802,"num_object_clones":0,"num_object_copies":17406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5802,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78730,"num_write_kb":2705024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"73'79617","reported_seq":80080,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.770692+0000","last_change":"2026-02-23T13:10:34.960546+0000","last_active":"2026-02-23T13:11:36.770692+0000","last_peered":"2026-02-23T13:11:36.770692+0000","last_clean":"2026-02-23T13:11:36.770692+0000","last_became_active":"2026-02-23T13:08:59.785106+0000","last_became_peered":"2026-02-23T13:08:59.785106+0000","last_unstale":"2026-02-23T13:11:36.770692+0000","last_undegraded":"2026-02-23T13:11:36.770692+0000","last_fullsized":"2026-02-23T13:11:36.770692+0000","mapping_epoch":62,"log_start":"73'79614","ondisk_log_start":"73'79614","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'44040","last_scrub_stamp":"2026-02-23T13:10:34.960505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:34.960505+0000","objects_scrubbed":42002,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:42.696429+0000","scrub_duration":4826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":370475008,"num_objects":5653,"num_object_clones":0,"num_object_copies":16959,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5653,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79617,"num_write_kb":2728640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"72'79567","reported_seq":79968,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.654063+0000","last_change":"2026-02-23T13:10:17.283236+0000","last_active":"2026-02-23T13:11:36.654063+0000","last_peered":"2026-02-23T13:11:36.654063+0000","last_clean":"2026-02-23T13:11:36.654063+0000","last_became_active":"2026-02-23T13:08:59.784457+0000","last_became_peered":"2026-02-23T13:08:59.784457+0000","last_unstale":"2026-02-23T13:11:36.654063+0000","last_undegraded":"2026-02-23T13:11:36.654063+0000","last_fullsized":"2026-02-23T13:11:36.654063+0000","mapping_epoch":62,"log_start":"72'79564","ondisk_log_start":"72'79564","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'36652","last_scrub_stamp":"2026-02-23T13:10:17.283183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:17.283183+0000","objects_scrubbed":35965,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:47.102975+0000","scrub_duration":3592,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":372965376,"num_objects":5691,"num_object_clones":0,"num_object_copies":17073,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5691,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79567,"num_write_kb":2728256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"73'79205","reported_seq":79700,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.773756+0000","last_change":"2026-02-23T13:11:32.076321+0000","last_active":"2026-02-23T13:11:36.773756+0000","last_peered":"2026-02-23T13:11:36.773756+0000","last_clean":"2026-02-23T13:11:36.773756+0000","last_became_active":"2026-02-23T13:08:59.784235+0000","last_became_peered":"2026-02-23T13:08:59.784235+0000","last_unstale":"2026-02-23T13:11:36.773756+0000","last_undegraded":"2026-02-23T13:11:36.773756+0000","last_fullsized":"2026-02-23T13:11:36.773756+0000","mapping_epoch":62,"log_start":"73'79202","ondisk_log_start":"73'79202","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'76650","last_scrub_stamp":"2026-02-23T13:11:32.076239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:11:32.076239+0000","objects_scrubbed":8470,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:40.465753+0000","scrub_duration":771,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375324672,"num_objects":5727,"num_object_clones":0,"num_object_copies":17181,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5727,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79205,"num_write_kb":2717824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"72'79720","reported_seq":80146,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.655158+0000","last_change":"2026-02-23T13:11:34.682558+0000","last_active":"2026-02-23T13:11:36.655158+0000","last_peered":"2026-02-23T13:11:36.655158+0000","last_clean":"2026-02-23T13:11:36.655158+0000","last_became_active":"2026-02-23T13:08:59.784318+0000","last_became_peered":"2026-02-23T13:08:59.784318+0000","last_unstale":"2026-02-23T13:11:36.655158+0000","last_undegraded":"2026-02-23T13:11:36.655158+0000","last_fullsized":"2026-02-23T13:11:36.655158+0000","mapping_epoch":62,"log_start":"72'79717","ondisk_log_start":"72'79717","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'78677","last_scrub_stamp":"2026-02-23T13:11:34.682487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:11:34.682487+0000","objects_scrubbed":7062,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:57.105460+0000","scrub_duration":850,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381419520,"num_objects":5820,"num_object_clones":0,"num_object_copies":17460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5820,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79720,"num_write_kb":2737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"73'79586","reported_seq":80055,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.775443+0000","last_change":"2026-02-23T13:11:34.025322+0000","last_active":"2026-02-23T13:11:36.775443+0000","last_peered":"2026-02-23T13:11:36.775443+0000","last_clean":"2026-02-23T13:11:36.775443+0000","last_became_active":"2026-02-23T13:08:59.784463+0000","last_became_peered":"2026-02-23T13:08:59.784463+0000","last_unstale":"2026-02-23T13:11:36.775443+0000","last_undegraded":"2026-02-23T13:11:36.775443+0000","last_fullsized":"2026-02-23T13:11:36.775443+0000","mapping_epoch":62,"log_start":"73'79583","ondisk_log_start":"73'79583","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'78142","last_scrub_stamp":"2026-02-23T13:11:34.025270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:11:34.025270+0000","objects_scrubbed":7249,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:45.187496+0000","scrub_duration":730,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":370147328,"num_objects":5648,"num_object_clones":0,"num_object_copies":16944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5648,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79586,"num_write_kb":2727488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"72'79512","reported_seq":79887,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.663848+0000","last_change":"2026-02-23T13:10:11.150558+0000","last_active":"2026-02-23T13:11:36.663848+0000","last_peered":"2026-02-23T13:11:36.663848+0000","last_clean":"2026-02-23T13:11:36.663848+0000","last_became_active":"2026-02-23T13:08:59.784436+0000","last_became_peered":"2026-02-23T13:08:59.784436+0000","last_unstale":"2026-02-23T13:11:36.663848+0000","last_undegraded":"2026-02-23T13:11:36.663848+0000","last_fullsized":"2026-02-23T13:11:36.663848+0000","mapping_epoch":62,"log_start":"72'79509","ondisk_log_start":"72'79509","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'34103","last_scrub_stamp":"2026-02-23T13:10:11.150522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:11.150522+0000","objects_scrubbed":33383,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"queued for scrub","scrub_duration":3995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375783424,"num_objects":5734,"num_object_clones":0,"num_object_copies":17202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5734,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79512,"num_write_kb":2727872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"72'79143","reported_seq":79558,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.645110+0000","last_change":"2026-02-23T13:10:43.059389+0000","last_active":"2026-02-23T13:11:36.645110+0000","last_peered":"2026-02-23T13:11:36.645110+0000","last_clean":"2026-02-23T13:11:36.645110+0000","last_became_active":"2026-02-23T13:08:59.784290+0000","last_became_peered":"2026-02-23T13:08:59.784290+0000","last_unstale":"2026-02-23T13:11:36.645110+0000","last_undegraded":"2026-02-23T13:11:36.645110+0000","last_fullsized":"2026-02-23T13:11:36.645110+0000","mapping_epoch":62,"log_start":"72'79140","ondisk_log_start":"72'79140","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'48491","last_scrub_stamp":"2026-02-23T13:10:43.059312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:43.059312+0000","objects_scrubbed":37287,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:55.819637+0000","scrub_duration":3592,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":372834304,"num_objects":5689,"num_object_clones":0,"num_object_copies":17067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5689,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79143,"num_write_kb":2714624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"72'78920","reported_seq":79433,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.652271+0000","last_change":"2026-02-23T13:11:25.544993+0000","last_active":"2026-02-23T13:11:36.652271+0000","last_peered":"2026-02-23T13:11:36.652271+0000","last_clean":"2026-02-23T13:11:36.652271+0000","last_became_active":"2026-02-23T13:08:59.785634+0000","last_became_peered":"2026-02-23T13:08:59.785634+0000","last_unstale":"2026-02-23T13:11:36.652271+0000","last_undegraded":"2026-02-23T13:11:36.652271+0000","last_fullsized":"2026-02-23T13:11:36.652271+0000","mapping_epoch":62,"log_start":"72'78917","ondisk_log_start":"72'78917","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'72700","last_scrub_stamp":"2026-02-23T13:11:25.544914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:11:25.544914+0000","objects_scrubbed":12306,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:41.399102+0000","scrub_duration":1245,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":378798080,"num_objects":5780,"num_object_clones":0,"num_object_copies":17340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5780,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78920,"num_write_kb":2710400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":324,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:45.570100+0000","last_change":"2026-02-23T13:10:45.570064+0000","last_active":"2026-02-23T13:10:45.570100+0000","last_peered":"2026-02-23T13:10:45.570100+0000","last_clean":"2026-02-23T13:10:45.570100+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:10:45.570100+0000","last_undegraded":"2026-02-23T13:10:45.570100+0000","last_fullsized":"2026-02-23T13:10:45.570100+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:10:45.570030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:10:45.570030+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:48.611576+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":6025904152,"num_objects":91949,"num_object_clones":0,"num_object_copies":275847,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91949,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1269569,"num_write_kb":43568513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18084212736,"data_stored":18084200520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1911,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":806,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247914,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5463960,"kb_used_data":4590852,"kb_used_omap":13,"kb_used_meta":873010,"kb_avail":728539240,"statfs":{"total":751619276800,"available":746024181760,"internally_reserved":0,"allocated":4701032448,"data_stored":4700525214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14324,"internal_metadata":893962252},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444141,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6961752,"kb_used_data":5568708,"kb_used_omap":17,"kb_used_meta":1393006,"kb_avail":727041448,"statfs":{"total":751619276800,"available":744490442752,"internally_reserved":0,"allocated":5702356992,"data_stored":5701849758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18412,"internal_metadata":1426438164},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574959,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5552848,"kb_used_data":3831356,"kb_used_omap":17,"kb_used_meta":1721454,"kb_avail":728450352,"statfs":{"total":751619276800,"available":745933160448,"internally_reserved":0,"allocated":3923308544,"data_stored":3922808934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18242,"internal_metadata":1762769086},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705776,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6128664,"kb_used_data":4806788,"kb_used_omap":10,"kb_used_meta":1321845,"kb_avail":727874536,"statfs":{"total":751619276800,"available":745343524864,"internally_reserved":0,"allocated":4922150912,"data_stored":4921643678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10804,"internal_metadata":1353569740},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":806,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4529459200,"data_stored":4529455128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3725262848,"data_stored":3725262848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":186,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5286203392,"data_stored":5286199320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1446,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4543287296,"data_stored":4543283224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":186,"internal_metadata":0}]}} 2026-02-23T13:11:41.655 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-23T13:11:41.655 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:11:41.655 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_2 2026-02-23T13:11:41.655 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:11:41.801 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:41.919 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:41 trial046 ceph-mon[38575]: pgmap v312: 17 pgs: 17 active+clean; 5.6 GiB data, 23 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 5.42k op/s 2026-02-23T13:11:41.932 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:41.930+0000 7f81176c0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:41.932 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:41.930+0000 7f81176c0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:42.073 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:11:42.074 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:11:42.121 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":312,"stamp":"2026-02-23T13:11:40.659966+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6026494520,"num_objects":91951,"num_object_clones":0,"num_object_copies":275853,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91951,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":1269704,"num_write_kb":43570663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":24107224,"kb_used_data":18797704,"kb_used_omap":60,"kb_used_meta":5309315,"kb_avail":2911905576,"statfs":{"total":3006477107200,"available":2981791309824,"internally_reserved":0,"allocated":19248848896,"data_stored":19246827584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":61782,"internal_metadata":5436739242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1421672448,"num_objects":-21693,"num_object_clones":0,"num_object_copies":-65079,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-21693,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21693,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000515"},"pg_stats":[{"pgid":"4.f","version":"73'79791","reported_seq":80201,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.774551+0000","last_change":"2026-02-23T13:10:18.889561+0000","last_active":"2026-02-23T13:11:36.774551+0000","last_peered":"2026-02-23T13:11:36.774551+0000","last_clean":"2026-02-23T13:11:36.774551+0000","last_became_active":"2026-02-23T13:08:59.784888+0000","last_became_peered":"2026-02-23T13:08:59.784888+0000","last_unstale":"2026-02-23T13:11:36.774551+0000","last_undegraded":"2026-02-23T13:11:36.774551+0000","last_fullsized":"2026-02-23T13:11:36.774551+0000","mapping_epoch":62,"log_start":"73'79788","ondisk_log_start":"73'79788","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'37338","last_scrub_stamp":"2026-02-23T13:10:18.889417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:18.889417+0000","objects_scrubbed":36552,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:46.655322+0000","scrub_duration":3662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383844352,"num_objects":5857,"num_object_clones":0,"num_object_copies":17571,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5857,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79791,"num_write_kb":2740736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"72'78350","reported_seq":78785,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.662699+0000","last_change":"2026-02-23T13:10:27.126280+0000","last_active":"2026-02-23T13:11:36.662699+0000","last_peered":"2026-02-23T13:11:36.662699+0000","last_clean":"2026-02-23T13:11:36.662699+0000","last_became_active":"2026-02-23T13:08:59.785397+0000","last_became_peered":"2026-02-23T13:08:59.785397+0000","last_unstale":"2026-02-23T13:11:36.662699+0000","last_undegraded":"2026-02-23T13:11:36.662699+0000","last_fullsized":"2026-02-23T13:11:36.662699+0000","mapping_epoch":62,"log_start":"72'78347","ondisk_log_start":"72'78347","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'40440","last_scrub_stamp":"2026-02-23T13:10:27.126174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:27.126174+0000","objects_scrubbed":39592,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:48.254573+0000","scrub_duration":3978,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":374210560,"num_objects":5710,"num_object_clones":0,"num_object_copies":17130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5710,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78350,"num_write_kb":2689920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"72'79275","reported_seq":79825,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.654046+0000","last_change":"2026-02-23T13:11:17.234531+0000","last_active":"2026-02-23T13:11:36.654046+0000","last_peered":"2026-02-23T13:11:36.654046+0000","last_clean":"2026-02-23T13:11:36.654046+0000","last_became_active":"2026-02-23T13:08:59.785780+0000","last_became_peered":"2026-02-23T13:08:59.785780+0000","last_unstale":"2026-02-23T13:11:36.654046+0000","last_undegraded":"2026-02-23T13:11:36.654046+0000","last_fullsized":"2026-02-23T13:11:36.654046+0000","mapping_epoch":62,"log_start":"72'79272","ondisk_log_start":"72'79272","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'68273","last_scrub_stamp":"2026-02-23T13:11:17.234494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:11:17.234494+0000","objects_scrubbed":17257,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:22.985224+0000","scrub_duration":1883,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":382205976,"num_objects":5833,"num_object_clones":0,"num_object_copies":17499,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5833,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":79275,"num_write_kb":2723393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"72'80043","reported_seq":80485,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.653287+0000","last_change":"2026-02-23T13:10:26.384628+0000","last_active":"2026-02-23T13:11:36.653287+0000","last_peered":"2026-02-23T13:11:36.653287+0000","last_clean":"2026-02-23T13:11:36.653287+0000","last_became_active":"2026-02-23T13:08:59.783982+0000","last_became_peered":"2026-02-23T13:08:59.783982+0000","last_unstale":"2026-02-23T13:11:36.653287+0000","last_undegraded":"2026-02-23T13:11:36.653287+0000","last_fullsized":"2026-02-23T13:11:36.653287+0000","mapping_epoch":62,"log_start":"72'80040","ondisk_log_start":"72'80040","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'40924","last_scrub_stamp":"2026-02-23T13:10:26.384602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:26.384602+0000","objects_scrubbed":40159,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:51.409315+0000","scrub_duration":3763,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":372965376,"num_objects":5691,"num_object_clones":0,"num_object_copies":17073,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5691,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80043,"num_write_kb":2743488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"72'79201","reported_seq":79654,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.652863+0000","last_change":"2026-02-23T13:10:36.436883+0000","last_active":"2026-02-23T13:11:36.652863+0000","last_peered":"2026-02-23T13:11:36.652863+0000","last_clean":"2026-02-23T13:11:36.652863+0000","last_became_active":"2026-02-23T13:08:59.784710+0000","last_became_peered":"2026-02-23T13:08:59.784710+0000","last_unstale":"2026-02-23T13:11:36.652863+0000","last_undegraded":"2026-02-23T13:11:36.652863+0000","last_fullsized":"2026-02-23T13:11:36.652863+0000","mapping_epoch":62,"log_start":"72'79198","ondisk_log_start":"72'79198","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'44729","last_scrub_stamp":"2026-02-23T13:10:36.436786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:36.436786+0000","objects_scrubbed":41142,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:51.122805+0000","scrub_duration":4872,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373358592,"num_objects":5697,"num_object_clones":0,"num_object_copies":17091,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5697,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79201,"num_write_kb":2716736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"72'79769","reported_seq":80233,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.660989+0000","last_change":"2026-02-23T13:10:31.717671+0000","last_active":"2026-02-23T13:11:36.660989+0000","last_peered":"2026-02-23T13:11:36.660989+0000","last_clean":"2026-02-23T13:11:36.660989+0000","last_became_active":"2026-02-23T13:08:59.784218+0000","last_became_peered":"2026-02-23T13:08:59.784218+0000","last_unstale":"2026-02-23T13:11:36.660989+0000","last_undegraded":"2026-02-23T13:11:36.660989+0000","last_fullsized":"2026-02-23T13:11:36.660989+0000","mapping_epoch":62,"log_start":"72'79766","ondisk_log_start":"72'79766","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'43162","last_scrub_stamp":"2026-02-23T13:10:31.717638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:31.717638+0000","objects_scrubbed":42156,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"queued for scrub","scrub_duration":4538,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":380436480,"num_objects":5805,"num_object_clones":0,"num_object_copies":17415,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5805,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79769,"num_write_kb":2738368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"72'79140","reported_seq":79601,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.660167+0000","last_change":"2026-02-23T13:11:30.102108+0000","last_active":"2026-02-23T13:11:36.660167+0000","last_peered":"2026-02-23T13:11:36.660167+0000","last_clean":"2026-02-23T13:11:36.660167+0000","last_became_active":"2026-02-23T13:08:59.784210+0000","last_became_peered":"2026-02-23T13:08:59.784210+0000","last_unstale":"2026-02-23T13:11:36.660167+0000","last_undegraded":"2026-02-23T13:11:36.660167+0000","last_fullsized":"2026-02-23T13:11:36.660167+0000","mapping_epoch":62,"log_start":"72'79137","ondisk_log_start":"72'79137","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'75509","last_scrub_stamp":"2026-02-23T13:11:30.102038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:11:30.102038+0000","objects_scrubbed":9740,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:37.705771+0000","scrub_duration":1067,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":380895232,"num_objects":5812,"num_object_clones":0,"num_object_copies":17436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5812,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79140,"num_write_kb":2718464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"72'78730","reported_seq":79157,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.655067+0000","last_change":"2026-02-23T13:10:24.387952+0000","last_active":"2026-02-23T13:11:36.655067+0000","last_peered":"2026-02-23T13:11:36.655067+0000","last_clean":"2026-02-23T13:11:36.655067+0000","last_became_active":"2026-02-23T13:08:59.785359+0000","last_became_peered":"2026-02-23T13:08:59.785359+0000","last_unstale":"2026-02-23T13:11:36.655067+0000","last_undegraded":"2026-02-23T13:11:36.655067+0000","last_fullsized":"2026-02-23T13:11:36.655067+0000","mapping_epoch":62,"log_start":"72'78727","ondisk_log_start":"72'78727","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'39419","last_scrub_stamp":"2026-02-23T13:10:24.387875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:24.387875+0000","objects_scrubbed":38695,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:54.083097+0000","scrub_duration":3689,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":380239872,"num_objects":5802,"num_object_clones":0,"num_object_copies":17406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5802,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78730,"num_write_kb":2705024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"73'79617","reported_seq":80080,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.770692+0000","last_change":"2026-02-23T13:10:34.960546+0000","last_active":"2026-02-23T13:11:36.770692+0000","last_peered":"2026-02-23T13:11:36.770692+0000","last_clean":"2026-02-23T13:11:36.770692+0000","last_became_active":"2026-02-23T13:08:59.785106+0000","last_became_peered":"2026-02-23T13:08:59.785106+0000","last_unstale":"2026-02-23T13:11:36.770692+0000","last_undegraded":"2026-02-23T13:11:36.770692+0000","last_fullsized":"2026-02-23T13:11:36.770692+0000","mapping_epoch":62,"log_start":"73'79614","ondisk_log_start":"73'79614","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'44040","last_scrub_stamp":"2026-02-23T13:10:34.960505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:34.960505+0000","objects_scrubbed":42002,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:42.696429+0000","scrub_duration":4826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":370475008,"num_objects":5653,"num_object_clones":0,"num_object_copies":16959,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5653,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79617,"num_write_kb":2728640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"72'79567","reported_seq":79968,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.654063+0000","last_change":"2026-02-23T13:10:17.283236+0000","last_active":"2026-02-23T13:11:36.654063+0000","last_peered":"2026-02-23T13:11:36.654063+0000","last_clean":"2026-02-23T13:11:36.654063+0000","last_became_active":"2026-02-23T13:08:59.784457+0000","last_became_peered":"2026-02-23T13:08:59.784457+0000","last_unstale":"2026-02-23T13:11:36.654063+0000","last_undegraded":"2026-02-23T13:11:36.654063+0000","last_fullsized":"2026-02-23T13:11:36.654063+0000","mapping_epoch":62,"log_start":"72'79564","ondisk_log_start":"72'79564","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'36652","last_scrub_stamp":"2026-02-23T13:10:17.283183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:17.283183+0000","objects_scrubbed":35965,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:47.102975+0000","scrub_duration":3592,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":372965376,"num_objects":5691,"num_object_clones":0,"num_object_copies":17073,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5691,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79567,"num_write_kb":2728256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"73'79205","reported_seq":79700,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.773756+0000","last_change":"2026-02-23T13:11:32.076321+0000","last_active":"2026-02-23T13:11:36.773756+0000","last_peered":"2026-02-23T13:11:36.773756+0000","last_clean":"2026-02-23T13:11:36.773756+0000","last_became_active":"2026-02-23T13:08:59.784235+0000","last_became_peered":"2026-02-23T13:08:59.784235+0000","last_unstale":"2026-02-23T13:11:36.773756+0000","last_undegraded":"2026-02-23T13:11:36.773756+0000","last_fullsized":"2026-02-23T13:11:36.773756+0000","mapping_epoch":62,"log_start":"73'79202","ondisk_log_start":"73'79202","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'76650","last_scrub_stamp":"2026-02-23T13:11:32.076239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:11:32.076239+0000","objects_scrubbed":8470,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:40.465753+0000","scrub_duration":771,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375324672,"num_objects":5727,"num_object_clones":0,"num_object_copies":17181,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5727,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79205,"num_write_kb":2717824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"72'79720","reported_seq":80146,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.655158+0000","last_change":"2026-02-23T13:11:34.682558+0000","last_active":"2026-02-23T13:11:36.655158+0000","last_peered":"2026-02-23T13:11:36.655158+0000","last_clean":"2026-02-23T13:11:36.655158+0000","last_became_active":"2026-02-23T13:08:59.784318+0000","last_became_peered":"2026-02-23T13:08:59.784318+0000","last_unstale":"2026-02-23T13:11:36.655158+0000","last_undegraded":"2026-02-23T13:11:36.655158+0000","last_fullsized":"2026-02-23T13:11:36.655158+0000","mapping_epoch":62,"log_start":"72'79717","ondisk_log_start":"72'79717","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'78677","last_scrub_stamp":"2026-02-23T13:11:34.682487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:11:34.682487+0000","objects_scrubbed":7062,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:57.105460+0000","scrub_duration":850,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381419520,"num_objects":5820,"num_object_clones":0,"num_object_copies":17460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5820,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79720,"num_write_kb":2737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"73'79586","reported_seq":80055,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.775443+0000","last_change":"2026-02-23T13:11:34.025322+0000","last_active":"2026-02-23T13:11:36.775443+0000","last_peered":"2026-02-23T13:11:36.775443+0000","last_clean":"2026-02-23T13:11:36.775443+0000","last_became_active":"2026-02-23T13:08:59.784463+0000","last_became_peered":"2026-02-23T13:08:59.784463+0000","last_unstale":"2026-02-23T13:11:36.775443+0000","last_undegraded":"2026-02-23T13:11:36.775443+0000","last_fullsized":"2026-02-23T13:11:36.775443+0000","mapping_epoch":62,"log_start":"73'79583","ondisk_log_start":"73'79583","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'78142","last_scrub_stamp":"2026-02-23T13:11:34.025270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:11:34.025270+0000","objects_scrubbed":7249,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:45.187496+0000","scrub_duration":730,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":370147328,"num_objects":5648,"num_object_clones":0,"num_object_copies":16944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5648,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79586,"num_write_kb":2727488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"72'79512","reported_seq":79887,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.663848+0000","last_change":"2026-02-23T13:10:11.150558+0000","last_active":"2026-02-23T13:11:36.663848+0000","last_peered":"2026-02-23T13:11:36.663848+0000","last_clean":"2026-02-23T13:11:36.663848+0000","last_became_active":"2026-02-23T13:08:59.784436+0000","last_became_peered":"2026-02-23T13:08:59.784436+0000","last_unstale":"2026-02-23T13:11:36.663848+0000","last_undegraded":"2026-02-23T13:11:36.663848+0000","last_fullsized":"2026-02-23T13:11:36.663848+0000","mapping_epoch":62,"log_start":"72'79509","ondisk_log_start":"72'79509","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'34103","last_scrub_stamp":"2026-02-23T13:10:11.150522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:11.150522+0000","objects_scrubbed":33383,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"queued for scrub","scrub_duration":3995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375783424,"num_objects":5734,"num_object_clones":0,"num_object_copies":17202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5734,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79512,"num_write_kb":2727872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"72'79143","reported_seq":79558,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.645110+0000","last_change":"2026-02-23T13:10:43.059389+0000","last_active":"2026-02-23T13:11:36.645110+0000","last_peered":"2026-02-23T13:11:36.645110+0000","last_clean":"2026-02-23T13:11:36.645110+0000","last_became_active":"2026-02-23T13:08:59.784290+0000","last_became_peered":"2026-02-23T13:08:59.784290+0000","last_unstale":"2026-02-23T13:11:36.645110+0000","last_undegraded":"2026-02-23T13:11:36.645110+0000","last_fullsized":"2026-02-23T13:11:36.645110+0000","mapping_epoch":62,"log_start":"72'79140","ondisk_log_start":"72'79140","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'48491","last_scrub_stamp":"2026-02-23T13:10:43.059312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:10:43.059312+0000","objects_scrubbed":37287,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:55.819637+0000","scrub_duration":3592,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":372834304,"num_objects":5689,"num_object_clones":0,"num_object_copies":17067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5689,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79143,"num_write_kb":2714624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"72'78920","reported_seq":79433,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:11:36.652271+0000","last_change":"2026-02-23T13:11:25.544993+0000","last_active":"2026-02-23T13:11:36.652271+0000","last_peered":"2026-02-23T13:11:36.652271+0000","last_clean":"2026-02-23T13:11:36.652271+0000","last_became_active":"2026-02-23T13:08:59.785634+0000","last_became_peered":"2026-02-23T13:08:59.785634+0000","last_unstale":"2026-02-23T13:11:36.652271+0000","last_undegraded":"2026-02-23T13:11:36.652271+0000","last_fullsized":"2026-02-23T13:11:36.652271+0000","mapping_epoch":62,"log_start":"72'78917","ondisk_log_start":"72'78917","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'72700","last_scrub_stamp":"2026-02-23T13:11:25.544914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:08:58.774458+0000","last_clean_scrub_stamp":"2026-02-23T13:11:25.544914+0000","objects_scrubbed":12306,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:41.399102+0000","scrub_duration":1245,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":378798080,"num_objects":5780,"num_object_clones":0,"num_object_copies":17340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5780,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78920,"num_write_kb":2710400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":324,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-23T13:10:45.570100+0000","last_change":"2026-02-23T13:10:45.570064+0000","last_active":"2026-02-23T13:10:45.570100+0000","last_peered":"2026-02-23T13:10:45.570100+0000","last_clean":"2026-02-23T13:10:45.570100+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:10:45.570100+0000","last_undegraded":"2026-02-23T13:10:45.570100+0000","last_fullsized":"2026-02-23T13:10:45.570100+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:10:45.570030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:10:45.570030+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:11:48.611576+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":6025904152,"num_objects":91949,"num_object_clones":0,"num_object_copies":275847,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91949,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1269569,"num_write_kb":43568513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18084212736,"data_stored":18084200520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1911,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":806,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247914,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5463960,"kb_used_data":4590852,"kb_used_omap":13,"kb_used_meta":873010,"kb_avail":728539240,"statfs":{"total":751619276800,"available":746024181760,"internally_reserved":0,"allocated":4701032448,"data_stored":4700525214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14324,"internal_metadata":893962252},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444141,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6961752,"kb_used_data":5568708,"kb_used_omap":17,"kb_used_meta":1393006,"kb_avail":727041448,"statfs":{"total":751619276800,"available":744490442752,"internally_reserved":0,"allocated":5702356992,"data_stored":5701849758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18412,"internal_metadata":1426438164},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574959,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5552848,"kb_used_data":3831356,"kb_used_omap":17,"kb_used_meta":1721454,"kb_avail":728450352,"statfs":{"total":751619276800,"available":745933160448,"internally_reserved":0,"allocated":3923308544,"data_stored":3922808934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18242,"internal_metadata":1762769086},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705776,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6128664,"kb_used_data":4806788,"kb_used_omap":10,"kb_used_meta":1321845,"kb_avail":727874536,"statfs":{"total":751619276800,"available":745343524864,"internally_reserved":0,"allocated":4922150912,"data_stored":4921643678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10804,"internal_metadata":1353569740},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":806,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4529459200,"data_stored":4529455128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3725262848,"data_stored":3725262848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":186,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5286203392,"data_stored":5286199320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1446,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4543287296,"data_stored":4543283224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":186,"internal_metadata":0}]}} 2026-02-23T13:11:42.123 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_2 pgp_num 86 2026-02-23T13:11:42.274 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:42.401 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:42.399+0000 7f137d67d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:42.401 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:42.400+0000 7f137d67d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:42.544 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-23T13:11:42.585 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:11:42.915 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:11:42.940 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:42 trial046 ceph-mon[38575]: from='client.15136 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:11:42.941 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:42 trial046 ceph-mon[38575]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:11:42.941 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:42 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3885794667' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_2", "var": "pgp_num", "val": "86"} : dispatch 2026-02-23T13:11:43.063 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:43.196 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:43.194+0000 7fdaadbe3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:43.196 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:43.194+0000 7fdaadbe3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:43.212 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:11:43.212 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:11:43.229 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:11:43.229 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:11:43.244 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:11:43.245 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:11:43.257 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:11:43.257 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:11:44.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:43 trial046 ceph-mon[38575]: 4.a scrub starts 2026-02-23T13:11:44.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:43 trial046 ceph-mon[38575]: from='client.15140 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:11:44.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:43 trial046 ceph-mon[38575]: 4.a scrub ok 2026-02-23T13:11:44.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:43 trial046 ceph-mon[38575]: pgmap v313: 17 pgs: 17 active+clean; 3.1 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 8.92k op/s 2026-02-23T13:11:44.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:43 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2949049153' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:11:45.299 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:11:45.440 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:45.564 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:45.562+0000 7f315ef68640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:45.565 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:45.562+0000 7f315ef68640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:45.579 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:11:45.579 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:11:45.592 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:11:45.592 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:11:45.606 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:11:45.607 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:11:45.621 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:11:45.621 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:11:46.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:45 trial046 ceph-mon[38575]: pgmap v314: 17 pgs: 17 active+clean; 3.1 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 6.05k op/s 2026-02-23T13:11:46.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:45 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1120975031' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:11:46.469 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:11:46 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:11:46.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:11:46.539 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:11:46 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:11:46] "GET /metrics HTTP/1.1" 200 4226 "" "Prometheus/3.6.0" 2026-02-23T13:11:46.780 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Removed 680758 objects 2026-02-23T13:11:46.781 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Clean up completed and total clean up time :75.8988 2026-02-23T13:11:47.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:46 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:11:47.586 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:11:47.586 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:11:47.586 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2026-02-23T13:11:47.587 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph tell osd.0 'trim stale osdmaps' 2026-02-23T13:11:47.665 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:11:47.704 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:47.778 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:47.820 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:47.818+0000 7f159c81b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:47.820 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:47.818+0000 7f159c81b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:47.829 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:47 trial046 ceph-mon[38575]: 4.1 scrub starts 2026-02-23T13:11:47.829 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:47 trial046 ceph-mon[38575]: 4.1 scrub ok 2026-02-23T13:11:47.829 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:47 trial046 ceph-mon[38575]: pgmap v315: 17 pgs: 17 active+clean; 1.6 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 8.31k op/s 2026-02-23T13:11:47.837 INFO:teuthology.orchestra.run.trial046.stderr:no valid command found; 10 closest matches: 2026-02-23T13:11:47.837 INFO:teuthology.orchestra.run.trial046.stderr:0 2026-02-23T13:11:47.837 INFO:teuthology.orchestra.run.trial046.stderr:1 2026-02-23T13:11:47.838 INFO:teuthology.orchestra.run.trial046.stderr:2 2026-02-23T13:11:47.838 INFO:teuthology.orchestra.run.trial046.stderr:abort 2026-02-23T13:11:47.838 INFO:teuthology.orchestra.run.trial046.stderr:assert 2026-02-23T13:11:47.838 INFO:teuthology.orchestra.run.trial046.stderr:bench [] [] [] [] 2026-02-23T13:11:47.838 INFO:teuthology.orchestra.run.trial046.stderr:bluefs debug_inject_read_zeros 2026-02-23T13:11:47.838 INFO:teuthology.orchestra.run.trial046.stderr:bluefs files list 2026-02-23T13:11:47.838 INFO:teuthology.orchestra.run.trial046.stderr:bluefs stats 2026-02-23T13:11:47.838 INFO:teuthology.orchestra.run.trial046.stderr:bluestore allocator dump block 2026-02-23T13:11:47.838 INFO:teuthology.orchestra.run.trial046.stderr:Error EINVAL: invalid command 2026-02-23T13:11:47.867 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-23T13:11:47.868 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-23T13:11:47.868 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph tell osd.1 'trim stale osdmaps' 2026-02-23T13:11:47.884 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:47.882+0000 7f15ab1d2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:47.884 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:47.882+0000 7f15ab1d2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:47.897 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:11:47.897 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:11:47.908 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:11:47.908 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:11:47.919 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:11:47.919 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:11:47.929 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:11:47.929 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:11:48.002 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:48.105 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:48.103+0000 7f4b827d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:48.105 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:48.103+0000 7f4b827d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:48.122 INFO:teuthology.orchestra.run.trial046.stderr:no valid command found; 10 closest matches: 2026-02-23T13:11:48.122 INFO:teuthology.orchestra.run.trial046.stderr:0 2026-02-23T13:11:48.122 INFO:teuthology.orchestra.run.trial046.stderr:1 2026-02-23T13:11:48.123 INFO:teuthology.orchestra.run.trial046.stderr:2 2026-02-23T13:11:48.123 INFO:teuthology.orchestra.run.trial046.stderr:abort 2026-02-23T13:11:48.123 INFO:teuthology.orchestra.run.trial046.stderr:assert 2026-02-23T13:11:48.123 INFO:teuthology.orchestra.run.trial046.stderr:bench [] [] [] [] 2026-02-23T13:11:48.123 INFO:teuthology.orchestra.run.trial046.stderr:bluefs debug_inject_read_zeros 2026-02-23T13:11:48.123 INFO:teuthology.orchestra.run.trial046.stderr:bluefs files list 2026-02-23T13:11:48.123 INFO:teuthology.orchestra.run.trial046.stderr:bluefs stats 2026-02-23T13:11:48.123 INFO:teuthology.orchestra.run.trial046.stderr:bluestore allocator dump block 2026-02-23T13:11:48.123 INFO:teuthology.orchestra.run.trial046.stderr:Error EINVAL: invalid command 2026-02-23T13:11:48.149 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-23T13:11:48.150 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-23T13:11:48.150 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph tell osd.2 'trim stale osdmaps' 2026-02-23T13:11:48.306 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:48.406 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:48.404+0000 7f9483f07640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:48.407 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:48.405+0000 7f9483f07640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:48.424 INFO:teuthology.orchestra.run.trial046.stderr:no valid command found; 10 closest matches: 2026-02-23T13:11:48.424 INFO:teuthology.orchestra.run.trial046.stderr:0 2026-02-23T13:11:48.424 INFO:teuthology.orchestra.run.trial046.stderr:1 2026-02-23T13:11:48.424 INFO:teuthology.orchestra.run.trial046.stderr:2 2026-02-23T13:11:48.424 INFO:teuthology.orchestra.run.trial046.stderr:abort 2026-02-23T13:11:48.424 INFO:teuthology.orchestra.run.trial046.stderr:assert 2026-02-23T13:11:48.424 INFO:teuthology.orchestra.run.trial046.stderr:bench [] [] [] [] 2026-02-23T13:11:48.424 INFO:teuthology.orchestra.run.trial046.stderr:bluefs debug_inject_read_zeros 2026-02-23T13:11:48.425 INFO:teuthology.orchestra.run.trial046.stderr:bluefs files list 2026-02-23T13:11:48.425 INFO:teuthology.orchestra.run.trial046.stderr:bluefs stats 2026-02-23T13:11:48.425 INFO:teuthology.orchestra.run.trial046.stderr:bluestore allocator dump block 2026-02-23T13:11:48.425 INFO:teuthology.orchestra.run.trial046.stderr:Error EINVAL: invalid command 2026-02-23T13:11:48.452 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-23T13:11:48.452 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-23T13:11:48.453 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph tell osd.3 'trim stale osdmaps' 2026-02-23T13:11:48.568 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:48.615 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:48 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/11089301' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:11:48.669 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:48.667+0000 7f90ed109640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:48.669 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:48.667+0000 7f90ed109640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:48.686 INFO:teuthology.orchestra.run.trial046.stderr:no valid command found; 10 closest matches: 2026-02-23T13:11:48.686 INFO:teuthology.orchestra.run.trial046.stderr:0 2026-02-23T13:11:48.687 INFO:teuthology.orchestra.run.trial046.stderr:1 2026-02-23T13:11:48.687 INFO:teuthology.orchestra.run.trial046.stderr:2 2026-02-23T13:11:48.687 INFO:teuthology.orchestra.run.trial046.stderr:abort 2026-02-23T13:11:48.687 INFO:teuthology.orchestra.run.trial046.stderr:assert 2026-02-23T13:11:48.687 INFO:teuthology.orchestra.run.trial046.stderr:bench [] [] [] [] 2026-02-23T13:11:48.687 INFO:teuthology.orchestra.run.trial046.stderr:bluefs debug_inject_read_zeros 2026-02-23T13:11:48.687 INFO:teuthology.orchestra.run.trial046.stderr:bluefs files list 2026-02-23T13:11:48.687 INFO:teuthology.orchestra.run.trial046.stderr:bluefs stats 2026-02-23T13:11:48.687 INFO:teuthology.orchestra.run.trial046.stderr:bluestore allocator dump block 2026-02-23T13:11:48.687 INFO:teuthology.orchestra.run.trial046.stderr:Error EINVAL: invalid command 2026-02-23T13:11:48.715 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-23T13:11:48.716 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-23T13:11:49.964 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:11:49.989 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:49 trial046 ceph-mon[38575]: pgmap v316: 17 pgs: 17 active+clean; 58 MiB data, 5.1 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 9.18k op/s 2026-02-23T13:11:50.082 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:50.184 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:50.183+0000 7fad57cb7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:50.185 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:50.183+0000 7fad57cb7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:50.197 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:11:50.197 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:11:50.207 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:11:50.208 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:11:50.217 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:11:50.218 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:11:50.228 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:11:50.228 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:11:51.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:50 trial046 ceph-mon[38575]: 1.0 scrub starts 2026-02-23T13:11:51.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:50 trial046 ceph-mon[38575]: 1.0 scrub ok 2026-02-23T13:11:51.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:50 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1520533888' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:11:51.658 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_2 2026-02-23T13:11:51.658 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool rm unique_pool_2 unique_pool_2 --yes-i-really-really-mean-it 2026-02-23T13:11:51.777 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:51.893 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:51 trial046 ceph-mon[38575]: pgmap v317: 17 pgs: 17 active+clean; 58 MiB data, 5.1 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 8.21k op/s 2026-02-23T13:11:52.162 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:52.100+0000 7fa5aafb5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:52.162 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:52.101+0000 7fa5aafb5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:52.263 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:11:52.382 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:52.484 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:52.482+0000 7fcc55afe640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:52.484 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:52.482+0000 7fcc55afe640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:52.497 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:11:52.497 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:11:52.508 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:11:52.508 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:11:52.519 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:11:52.519 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:11:52.529 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:11:52.530 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:11:52.586 INFO:teuthology.orchestra.run.trial046.stderr:pool 'unique_pool_2' removed 2026-02-23T13:11:52.659 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2026-02-23T13:11:52.659 INFO:tasks.radosbench:Beginning radosbench... 2026-02-23T13:11:52.659 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_3 2026-02-23T13:11:52.660 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool create unique_pool_3 16 2026-02-23T13:11:52.720 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:52 trial046 ceph-mon[38575]: 4.e scrub starts 2026-02-23T13:11:52.721 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:52 trial046 ceph-mon[38575]: 4.e scrub ok 2026-02-23T13:11:52.721 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:52 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3800593902' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "unique_pool_2", "pool2": "unique_pool_2", "yes_i_really_really_mean_it": true} : dispatch 2026-02-23T13:11:52.721 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:52 trial046 ceph-mon[38575]: 4.c scrub starts 2026-02-23T13:11:52.721 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:52 trial046 ceph-mon[38575]: 4.c scrub ok 2026-02-23T13:11:52.721 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:52 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3024018316' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:11:52.821 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:52.937 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:52.935+0000 7ff77d858640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:52.937 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:52.935+0000 7ff77d858640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:53.591 INFO:teuthology.orchestra.run.trial046.stderr:pool 'unique_pool_3' created 2026-02-23T13:11:53.634 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool application enable unique_pool_3 rados --yes-i-really-mean-it || true 2026-02-23T13:11:53.717 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:11:53.717 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:11:53.788 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:53.843 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:53 trial046 ceph-mon[38575]: 4.7 scrub starts 2026-02-23T13:11:53.843 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:53 trial046 ceph-mon[38575]: 4.7 scrub ok 2026-02-23T13:11:53.843 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:53 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3800593902' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_2", "pool2": "unique_pool_2", "yes_i_really_really_mean_it": true}]': finished 2026-02-23T13:11:53.844 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:53 trial046 ceph-mon[38575]: osdmap e77: 4 total, 4 up, 4 in 2026-02-23T13:11:53.844 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:53 trial046 ceph-mon[38575]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 3.8 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-23T13:11:53.844 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:53 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3465660180' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16} : dispatch 2026-02-23T13:11:53.898 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:53.896+0000 7f9bf34ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:53.898 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:53.896+0000 7f9bf34ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:54.567 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:11:54.591 INFO:teuthology.orchestra.run.trial046.stderr:enabled application 'rados' on pool 'unique_pool_3' 2026-02-23T13:11:54.691 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:54.796 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:54.794+0000 7f15e2963640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:54.796 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:54.794+0000 7f15e2963640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:54.808 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:11:54.808 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:11:54.818 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:11:54.819 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:11:54.830 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:11:54.830 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:11:54.840 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:11:54.841 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:11:54.846 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:54 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3465660180' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16}]': finished 2026-02-23T13:11:54.847 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:54 trial046 ceph-mon[38575]: osdmap e78: 4 total, 4 up, 4 in 2026-02-23T13:11:54.847 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:54 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3292010149' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true} : dispatch 2026-02-23T13:11:55.634 DEBUG:teuthology.orchestra.run.trial046:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -t 16 -b 65536 --object-size 65536 -p unique_pool_3 bench 90 write' 2026-02-23T13:11:55.635 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_3 2026-02-23T13:11:55.635 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:11:55.638 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2026-02-23T13:11:55.639 INFO:teuthology.orchestra.run:waiting for 3000 2026-02-23T13:11:55.687 INFO:tasks.radosbench.radosbench.0.trial046.stdout:hints = 1 2026-02-23T13:11:55.687 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2026-02-23T13:11:55.688 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Object prefix: benchmark_data_trial046_124691 2026-02-23T13:11:55.688 INFO:tasks.radosbench.radosbench.0.trial046.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-23T13:11:55.688 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 0 0 0 0 0 0 - 0 2026-02-23T13:11:55.770 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:55.886 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:55 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3292010149' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]': finished 2026-02-23T13:11:55.886 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:55 trial046 ceph-mon[38575]: osdmap e79: 4 total, 4 up, 4 in 2026-02-23T13:11:55.886 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:55 trial046 ceph-mon[38575]: pgmap v322: 17 pgs: 16 unknown, 1 active+clean; 577 KiB data, 3.8 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-23T13:11:55.887 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:55 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/230870014' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:11:55.901 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:55.899+0000 7fa7b84d8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:55.901 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:55.899+0000 7fa7b84d8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:56.042 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:11:56.043 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:11:56.102 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":323,"stamp":"2026-02-23T13:11:55.597034+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":3997132,"kb_used_data":4988,"kb_used_omap":58,"kb_used_meta":3992005,"kb_avail":2932015668,"statfs":{"total":3006477107200,"available":3002384044032,"internally_reserved":0,"allocated":5107712,"data_stored":2972552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":59892,"internal_metadata":4087813644},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-59965464,"num_objects":-916,"num_object_clones":0,"num_object_copies":-2748,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-916,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-1360602,"num_write_kb":-43568513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.935668"},"pg_stats":[{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:11:53.586576+0000","last_change":"2026-02-23T13:11:53.586576+0000","last_active":"2026-02-23T13:11:53.586576+0000","last_peered":"2026-02-23T13:11:53.586576+0000","last_clean":"2026-02-23T13:11:53.586576+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:11:53.586576+0000","last_undegraded":"2026-02-23T13:11:53.586576+0000","last_fullsized":"2026-02-23T13:11:53.586576+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:11:53.586576+0000","last_change":"2026-02-23T13:11:53.586576+0000","last_active":"2026-02-23T13:11:53.586576+0000","last_peered":"2026-02-23T13:11:53.586576+0000","last_clean":"2026-02-23T13:11:53.586576+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:11:53.586576+0000","last_undegraded":"2026-02-23T13:11:53.586576+0000","last_fullsized":"2026-02-23T13:11:53.586576+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:11:53.586576+0000","last_change":"2026-02-23T13:11:53.586576+0000","last_active":"2026-02-23T13:11:53.586576+0000","last_peered":"2026-02-23T13:11:53.586576+0000","last_clean":"2026-02-23T13:11:53.586576+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:11:53.586576+0000","last_undegraded":"2026-02-23T13:11:53.586576+0000","last_fullsized":"2026-02-23T13:11:53.586576+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:11:53.586576+0000","last_change":"2026-02-23T13:11:53.586576+0000","last_active":"2026-02-23T13:11:53.586576+0000","last_peered":"2026-02-23T13:11:53.586576+0000","last_clean":"2026-02-23T13:11:53.586576+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:11:53.586576+0000","last_undegraded":"2026-02-23T13:11:53.586576+0000","last_fullsized":"2026-02-23T13:11:53.586576+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:11:53.586576+0000","last_change":"2026-02-23T13:11:53.586576+0000","last_active":"2026-02-23T13:11:53.586576+0000","last_peered":"2026-02-23T13:11:53.586576+0000","last_clean":"2026-02-23T13:11:53.586576+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:11:53.586576+0000","last_undegraded":"2026-02-23T13:11:53.586576+0000","last_fullsized":"2026-02-23T13:11:53.586576+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:11:53.586576+0000","last_change":"2026-02-23T13:11:53.586576+0000","last_active":"2026-02-23T13:11:53.586576+0000","last_peered":"2026-02-23T13:11:53.586576+0000","last_clean":"2026-02-23T13:11:53.586576+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:11:53.586576+0000","last_undegraded":"2026-02-23T13:11:53.586576+0000","last_fullsized":"2026-02-23T13:11:53.586576+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:11:53.586576+0000","last_change":"2026-02-23T13:11:53.586576+0000","last_active":"2026-02-23T13:11:53.586576+0000","last_peered":"2026-02-23T13:11:53.586576+0000","last_clean":"2026-02-23T13:11:53.586576+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:11:53.586576+0000","last_undegraded":"2026-02-23T13:11:53.586576+0000","last_fullsized":"2026-02-23T13:11:53.586576+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:11:53.586576+0000","last_change":"2026-02-23T13:11:53.586576+0000","last_active":"2026-02-23T13:11:53.586576+0000","last_peered":"2026-02-23T13:11:53.586576+0000","last_clean":"2026-02-23T13:11:53.586576+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:11:53.586576+0000","last_undegraded":"2026-02-23T13:11:53.586576+0000","last_fullsized":"2026-02-23T13:11:53.586576+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:11:53.586576+0000","last_change":"2026-02-23T13:11:53.586576+0000","last_active":"2026-02-23T13:11:53.586576+0000","last_peered":"2026-02-23T13:11:53.586576+0000","last_clean":"2026-02-23T13:11:53.586576+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:11:53.586576+0000","last_undegraded":"2026-02-23T13:11:53.586576+0000","last_fullsized":"2026-02-23T13:11:53.586576+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:11:53.586576+0000","last_change":"2026-02-23T13:11:53.586576+0000","last_active":"2026-02-23T13:11:53.586576+0000","last_peered":"2026-02-23T13:11:53.586576+0000","last_clean":"2026-02-23T13:11:53.586576+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:11:53.586576+0000","last_undegraded":"2026-02-23T13:11:53.586576+0000","last_fullsized":"2026-02-23T13:11:53.586576+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:11:53.586576+0000","last_change":"2026-02-23T13:11:53.586576+0000","last_active":"2026-02-23T13:11:53.586576+0000","last_peered":"2026-02-23T13:11:53.586576+0000","last_clean":"2026-02-23T13:11:53.586576+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:11:53.586576+0000","last_undegraded":"2026-02-23T13:11:53.586576+0000","last_fullsized":"2026-02-23T13:11:53.586576+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:11:53.586576+0000","last_change":"2026-02-23T13:11:53.586576+0000","last_active":"2026-02-23T13:11:53.586576+0000","last_peered":"2026-02-23T13:11:53.586576+0000","last_clean":"2026-02-23T13:11:53.586576+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:11:53.586576+0000","last_undegraded":"2026-02-23T13:11:53.586576+0000","last_fullsized":"2026-02-23T13:11:53.586576+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:11:53.586576+0000","last_change":"2026-02-23T13:11:53.586576+0000","last_active":"2026-02-23T13:11:53.586576+0000","last_peered":"2026-02-23T13:11:53.586576+0000","last_clean":"2026-02-23T13:11:53.586576+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:11:53.586576+0000","last_undegraded":"2026-02-23T13:11:53.586576+0000","last_fullsized":"2026-02-23T13:11:53.586576+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:11:53.586576+0000","last_change":"2026-02-23T13:11:53.586576+0000","last_active":"2026-02-23T13:11:53.586576+0000","last_peered":"2026-02-23T13:11:53.586576+0000","last_clean":"2026-02-23T13:11:53.586576+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:11:53.586576+0000","last_undegraded":"2026-02-23T13:11:53.586576+0000","last_fullsized":"2026-02-23T13:11:53.586576+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:11:53.586576+0000","last_change":"2026-02-23T13:11:53.586576+0000","last_active":"2026-02-23T13:11:53.586576+0000","last_peered":"2026-02-23T13:11:53.586576+0000","last_clean":"2026-02-23T13:11:53.586576+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:11:53.586576+0000","last_undegraded":"2026-02-23T13:11:53.586576+0000","last_fullsized":"2026-02-23T13:11:53.586576+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-23T13:11:53.586576+0000","last_change":"2026-02-23T13:11:53.586576+0000","last_active":"2026-02-23T13:11:53.586576+0000","last_peered":"2026-02-23T13:11:53.586576+0000","last_clean":"2026-02-23T13:11:53.586576+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-23T13:11:53.586576+0000","last_undegraded":"2026-02-23T13:11:53.586576+0000","last_fullsized":"2026-02-23T13:11:53.586576+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":340,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-23T13:11:50.169148+0000","last_change":"2026-02-23T13:11:50.169148+0000","last_active":"2026-02-23T13:11:50.169148+0000","last_peered":"2026-02-23T13:11:50.169148+0000","last_clean":"2026-02-23T13:11:50.169148+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:11:50.169148+0000","last_undegraded":"2026-02-23T13:11:50.169148+0000","last_fullsized":"2026-02-23T13:11:50.169148+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:11:50.169094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:11:50.169094+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:57.448558+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":426,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247917,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1018820,"kb_used_data":1392,"kb_used_omap":15,"kb_used_meta":1017392,"kb_avail":732984380,"statfs":{"total":751619276800,"available":750576005120,"internally_reserved":0,"allocated":1425408,"data_stored":890730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16143,"internal_metadata":1041809649},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444144,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":762884,"kb_used_data":1392,"kb_used_omap":14,"kb_used_meta":761457,"kb_avail":733240316,"statfs":{"total":751619276800,"available":750838083584,"internally_reserved":0,"allocated":1425408,"data_stored":890730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14989,"internal_metadata":779732339},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574962,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":747776,"kb_used_data":812,"kb_used_omap":14,"kb_used_meta":746929,"kb_avail":733255424,"statfs":{"total":751619276800,"available":750853554176,"internally_reserved":0,"allocated":831488,"data_stored":300362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15354,"internal_metadata":764855302},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705779,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1467652,"kb_used_data":1392,"kb_used_omap":13,"kb_used_meta":1466226,"kb_avail":732535548,"statfs":{"total":751619276800,"available":750116401152,"internally_reserved":0,"allocated":1425408,"data_stored":890730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13406,"internal_metadata":1501416354},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":426,"internal_metadata":0}]}} 2026-02-23T13:11:56.105 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:11:56.106 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_3 pg_num 26 2026-02-23T13:11:56.136 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:11:56 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:11:56] "GET /metrics HTTP/1.1" 200 4226 "" "Prometheus/3.6.0" 2026-02-23T13:11:56.256 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:56.393 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:56.391+0000 7f5c71e37640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:56.394 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:56.391+0000 7f5c71e37640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:56.531 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:11:56.561 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:11:56 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:11:56.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:11:56.574 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:11:56.687 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 1 16 7458 7442 465.087 465.125 0.00255704 0.00214524 2026-02-23T13:11:56.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:56 trial046 ceph-mon[38575]: osdmap e80: 4 total, 4 up, 4 in 2026-02-23T13:11:56.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:56 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1536762149' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_3", "var": "pg_num", "val": "26"} : dispatch 2026-02-23T13:11:56.876 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:11:57.024 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:57.146 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:57.144+0000 7f967c47d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:57.147 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:57.145+0000 7f967c47d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:57.164 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:11:57.165 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:11:57.177 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:11:57.178 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:11:57.191 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:11:57.191 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:11:57.205 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:11:57.205 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:11:57.688 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 2 15 15105 15090 471.525 478 0.00393648 0.00211821 2026-02-23T13:11:58.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:57 trial046 ceph-mon[38575]: from='client.15173 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:11:58.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:57 trial046 ceph-mon[38575]: pgmap v324: 17 pgs: 13 active+clean, 4 unknown; 341 MiB data, 4.1 GiB used, 2.7 TiB / 2.7 TiB avail; 84 MiB/s wr, 1.34k op/s 2026-02-23T13:11:58.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:57 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2598769620' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:11:58.688 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 3 16 22723 22707 472.975 476.062 0.00123867 0.00211229 2026-02-23T13:11:59.246 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:11:59.386 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:11:59.507 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:59.505+0000 7fac34c9b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:59.507 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:11:59.505+0000 7fac34c9b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:11:59.522 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:11:59.523 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:11:59.537 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:11:59.537 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:11:59.550 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:11:59.551 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:11:59.563 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:11:59.563 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:11:59.688 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 4 16 29944 29928 467.551 451.312 0.00152034 0.00213686 2026-02-23T13:11:59.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:59 trial046 ceph-mon[38575]: pgmap v325: 17 pgs: 17 active+clean; 460 MiB data, 4.4 GiB used, 2.7 TiB / 2.7 TiB avail; 77 MiB/s wr, 1.23k op/s 2026-02-23T13:11:59.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:11:59 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3284052312' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:12:00.688 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 5 15 37558 37543 469.221 475.938 0.0029673 0.00212936 2026-02-23T13:12:01.576 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:12:01.576 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:12:01.576 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_3 2026-02-23T13:12:01.577 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:12:01.609 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:12:01.688 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 6 15 44961 44946 468.126 462.688 0.00333087 0.00213452 2026-02-23T13:12:01.716 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:01.765 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:01.836 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:01.834+0000 7f43b0814640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:01.836 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:01.834+0000 7f43b0814640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:01.882 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:01 trial046 ceph-mon[38575]: pgmap v326: 17 pgs: 17 active+clean; 460 MiB data, 4.4 GiB used, 2.7 TiB / 2.7 TiB avail; 65 MiB/s wr, 1.04k op/s 2026-02-23T13:12:01.882 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:01 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:12:01.886 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:01.885+0000 7fd3601f7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:01.886 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:01.885+0000 7fd3601f7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:01.903 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:12:01.904 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:12:01.918 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:12:01.918 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:12:01.932 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:12:01.932 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:12:01.945 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:12:01.945 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:12:01.972 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:12:01.972 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:12:02.016 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2026-02-23T13:12:00.662697+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":482411040,"num_objects":7354,"num_object_clones":0,"num_object_copies":22062,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7354,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":7487,"num_write_kb":472678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53,"ondisk_log_size":53,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":4585408,"kb_used_data":554032,"kb_used_omap":67,"kb_used_meta":4031228,"kb_avail":2931427392,"statfs":{"total":3006477107200,"available":3001781649408,"internally_reserved":0,"allocated":567328768,"data_stored":565079312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":69545,"internal_metadata":4127977559},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":481820672,"num_objects":7352,"num_object_clones":0,"num_object_copies":22056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7352,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7352,"num_write_kb":470528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.071550"},"pg_stats":[{"pgid":"5.f","version":"80'459","reported_seq":473,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:11:56.668132+0000","last_change":"2026-02-23T13:11:54.596706+0000","last_active":"2026-02-23T13:11:56.668132+0000","last_peered":"2026-02-23T13:11:56.668132+0000","last_clean":"2026-02-23T13:11:56.668132+0000","last_became_active":"2026-02-23T13:11:54.595945+0000","last_became_peered":"2026-02-23T13:11:54.595945+0000","last_unstale":"2026-02-23T13:11:56.668132+0000","last_undegraded":"2026-02-23T13:11:56.668132+0000","last_fullsized":"2026-02-23T13:11:56.668132+0000","mapping_epoch":78,"log_start":"80'456","ondisk_log_start":"80'456","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":456,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:06.207061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30081024,"num_objects":459,"num_object_clones":0,"num_object_copies":1377,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":459,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":459,"num_write_kb":29376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"80'447","reported_seq":461,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:11:56.657715+0000","last_change":"2026-02-23T13:11:54.599809+0000","last_active":"2026-02-23T13:11:56.657715+0000","last_peered":"2026-02-23T13:11:56.657715+0000","last_clean":"2026-02-23T13:11:56.657715+0000","last_became_active":"2026-02-23T13:11:54.599064+0000","last_became_peered":"2026-02-23T13:11:54.599064+0000","last_unstale":"2026-02-23T13:11:56.657715+0000","last_undegraded":"2026-02-23T13:11:56.657715+0000","last_fullsized":"2026-02-23T13:11:56.657715+0000","mapping_epoch":78,"log_start":"80'444","ondisk_log_start":"80'444","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":444,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:11.698138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29294592,"num_objects":447,"num_object_clones":0,"num_object_copies":1341,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":447,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":28608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"80'442","reported_seq":456,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:11:56.657299+0000","last_change":"2026-02-23T13:11:54.596174+0000","last_active":"2026-02-23T13:11:56.657299+0000","last_peered":"2026-02-23T13:11:56.657299+0000","last_clean":"2026-02-23T13:11:56.657299+0000","last_became_active":"2026-02-23T13:11:54.595773+0000","last_became_peered":"2026-02-23T13:11:54.595773+0000","last_unstale":"2026-02-23T13:11:56.657299+0000","last_undegraded":"2026-02-23T13:11:56.657299+0000","last_fullsized":"2026-02-23T13:11:56.657299+0000","mapping_epoch":78,"log_start":"80'439","ondisk_log_start":"80'439","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":439,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.566475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28966912,"num_objects":442,"num_object_clones":0,"num_object_copies":1326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":442,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":442,"num_write_kb":28288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"80'488","reported_seq":502,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:11:56.774018+0000","last_change":"2026-02-23T13:11:54.595749+0000","last_active":"2026-02-23T13:11:56.774018+0000","last_peered":"2026-02-23T13:11:56.774018+0000","last_clean":"2026-02-23T13:11:56.774018+0000","last_became_active":"2026-02-23T13:11:54.595560+0000","last_became_peered":"2026-02-23T13:11:54.595560+0000","last_unstale":"2026-02-23T13:11:56.774018+0000","last_undegraded":"2026-02-23T13:11:56.774018+0000","last_fullsized":"2026-02-23T13:11:56.774018+0000","mapping_epoch":78,"log_start":"80'485","ondisk_log_start":"80'485","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":485,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:11.860237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31981568,"num_objects":488,"num_object_clones":0,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":488,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"80'439","reported_seq":453,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:11:56.656053+0000","last_change":"2026-02-23T13:11:54.596349+0000","last_active":"2026-02-23T13:11:56.656053+0000","last_peered":"2026-02-23T13:11:56.656053+0000","last_clean":"2026-02-23T13:11:56.656053+0000","last_became_active":"2026-02-23T13:11:54.596133+0000","last_became_peered":"2026-02-23T13:11:54.596133+0000","last_unstale":"2026-02-23T13:11:56.656053+0000","last_undegraded":"2026-02-23T13:11:56.656053+0000","last_fullsized":"2026-02-23T13:11:56.656053+0000","mapping_epoch":78,"log_start":"80'436","ondisk_log_start":"80'436","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":436,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:03.865476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28770304,"num_objects":439,"num_object_clones":0,"num_object_copies":1317,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":439,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":439,"num_write_kb":28096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"80'466","reported_seq":479,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:11:56.658666+0000","last_change":"2026-02-23T13:11:54.595383+0000","last_active":"2026-02-23T13:11:56.658666+0000","last_peered":"2026-02-23T13:11:56.658666+0000","last_clean":"2026-02-23T13:11:56.658666+0000","last_became_active":"2026-02-23T13:11:54.595080+0000","last_became_peered":"2026-02-23T13:11:54.595080+0000","last_unstale":"2026-02-23T13:11:56.658666+0000","last_undegraded":"2026-02-23T13:11:56.658666+0000","last_fullsized":"2026-02-23T13:11:56.658666+0000","mapping_epoch":78,"log_start":"80'462","ondisk_log_start":"80'462","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":462,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:12.934698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30539776,"num_objects":466,"num_object_clones":0,"num_object_copies":1398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":466,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":466,"num_write_kb":29824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"80'430","reported_seq":443,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:11:56.657253+0000","last_change":"2026-02-23T13:11:54.598497+0000","last_active":"2026-02-23T13:11:56.657253+0000","last_peered":"2026-02-23T13:11:56.657253+0000","last_clean":"2026-02-23T13:11:56.657253+0000","last_became_active":"2026-02-23T13:11:54.598325+0000","last_became_peered":"2026-02-23T13:11:54.598325+0000","last_unstale":"2026-02-23T13:11:56.657253+0000","last_undegraded":"2026-02-23T13:11:56.657253+0000","last_fullsized":"2026-02-23T13:11:56.657253+0000","mapping_epoch":78,"log_start":"80'427","ondisk_log_start":"80'427","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":427,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:57.924450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28180480,"num_objects":430,"num_object_clones":0,"num_object_copies":1290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":430,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":430,"num_write_kb":27520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"80'462","reported_seq":476,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:11:56.653887+0000","last_change":"2026-02-23T13:11:54.595376+0000","last_active":"2026-02-23T13:11:56.653887+0000","last_peered":"2026-02-23T13:11:56.653887+0000","last_clean":"2026-02-23T13:11:56.653887+0000","last_became_active":"2026-02-23T13:11:54.595110+0000","last_became_peered":"2026-02-23T13:11:54.595110+0000","last_unstale":"2026-02-23T13:11:56.653887+0000","last_undegraded":"2026-02-23T13:11:56.653887+0000","last_fullsized":"2026-02-23T13:11:56.653887+0000","mapping_epoch":78,"log_start":"80'459","ondisk_log_start":"80'459","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":459,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:02.754608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":462,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":462,"num_write_kb":29568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"80'422","reported_seq":435,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:11:56.654917+0000","last_change":"2026-02-23T13:11:54.599364+0000","last_active":"2026-02-23T13:11:56.654917+0000","last_peered":"2026-02-23T13:11:56.654917+0000","last_clean":"2026-02-23T13:11:56.654917+0000","last_became_active":"2026-02-23T13:11:54.599155+0000","last_became_peered":"2026-02-23T13:11:54.599155+0000","last_unstale":"2026-02-23T13:11:56.654917+0000","last_undegraded":"2026-02-23T13:11:56.654917+0000","last_fullsized":"2026-02-23T13:11:56.654917+0000","mapping_epoch":78,"log_start":"80'419","ondisk_log_start":"80'419","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":419,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:14.711414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27656192,"num_objects":422,"num_object_clones":0,"num_object_copies":1266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":422,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":422,"num_write_kb":27008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"80'500","reported_seq":514,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:11:56.776345+0000","last_change":"2026-02-23T13:11:54.595872+0000","last_active":"2026-02-23T13:11:56.776345+0000","last_peered":"2026-02-23T13:11:56.776345+0000","last_clean":"2026-02-23T13:11:56.776345+0000","last_became_active":"2026-02-23T13:11:54.595645+0000","last_became_peered":"2026-02-23T13:11:54.595645+0000","last_unstale":"2026-02-23T13:11:56.776345+0000","last_undegraded":"2026-02-23T13:11:56.776345+0000","last_fullsized":"2026-02-23T13:11:56.776345+0000","mapping_epoch":78,"log_start":"80'497","ondisk_log_start":"80'497","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":497,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.565438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32768000,"num_objects":500,"num_object_clones":0,"num_object_copies":1500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":500,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":500,"num_write_kb":32000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"80'463","reported_seq":477,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:11:56.657292+0000","last_change":"2026-02-23T13:11:54.595399+0000","last_active":"2026-02-23T13:11:56.657292+0000","last_peered":"2026-02-23T13:11:56.657292+0000","last_clean":"2026-02-23T13:11:56.657292+0000","last_became_active":"2026-02-23T13:11:54.595144+0000","last_became_peered":"2026-02-23T13:11:54.595144+0000","last_unstale":"2026-02-23T13:11:56.657292+0000","last_undegraded":"2026-02-23T13:11:56.657292+0000","last_fullsized":"2026-02-23T13:11:56.657292+0000","mapping_epoch":78,"log_start":"80'460","ondisk_log_start":"80'460","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":460,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:16.231133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30343168,"num_objects":463,"num_object_clones":0,"num_object_copies":1389,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":463,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":463,"num_write_kb":29632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"80'481","reported_seq":492,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:11:56.658655+0000","last_change":"2026-02-23T13:11:54.596295+0000","last_active":"2026-02-23T13:11:56.658655+0000","last_peered":"2026-02-23T13:11:56.658655+0000","last_clean":"2026-02-23T13:11:56.658655+0000","last_became_active":"2026-02-23T13:11:54.595996+0000","last_became_peered":"2026-02-23T13:11:54.595996+0000","last_unstale":"2026-02-23T13:11:56.658655+0000","last_undegraded":"2026-02-23T13:11:56.658655+0000","last_fullsized":"2026-02-23T13:11:56.658655+0000","mapping_epoch":78,"log_start":"80'477","ondisk_log_start":"80'477","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":477,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.493149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31522816,"num_objects":481,"num_object_clones":0,"num_object_copies":1443,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":481,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":30784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"80'450","reported_seq":464,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:11:56.655204+0000","last_change":"2026-02-23T13:11:54.599275+0000","last_active":"2026-02-23T13:11:56.655204+0000","last_peered":"2026-02-23T13:11:56.655204+0000","last_clean":"2026-02-23T13:11:56.655204+0000","last_became_active":"2026-02-23T13:11:54.598958+0000","last_became_peered":"2026-02-23T13:11:54.598958+0000","last_unstale":"2026-02-23T13:11:56.655204+0000","last_undegraded":"2026-02-23T13:11:56.655204+0000","last_fullsized":"2026-02-23T13:11:56.655204+0000","mapping_epoch":78,"log_start":"80'447","ondisk_log_start":"80'447","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":447,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:13.230076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29491200,"num_objects":450,"num_object_clones":0,"num_object_copies":1350,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":450,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":28800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"80'497","reported_seq":511,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:11:56.655937+0000","last_change":"2026-02-23T13:11:54.599032+0000","last_active":"2026-02-23T13:11:56.655937+0000","last_peered":"2026-02-23T13:11:56.655937+0000","last_clean":"2026-02-23T13:11:56.655937+0000","last_became_active":"2026-02-23T13:11:54.598751+0000","last_became_peered":"2026-02-23T13:11:54.598751+0000","last_unstale":"2026-02-23T13:11:56.655937+0000","last_undegraded":"2026-02-23T13:11:56.655937+0000","last_fullsized":"2026-02-23T13:11:56.655937+0000","mapping_epoch":78,"log_start":"80'494","ondisk_log_start":"80'494","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":494,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:59.904586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32571392,"num_objects":497,"num_object_clones":0,"num_object_copies":1491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":497,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":497,"num_write_kb":31808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"80'454","reported_seq":468,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:11:56.658262+0000","last_change":"2026-02-23T13:11:54.596162+0000","last_active":"2026-02-23T13:11:56.658262+0000","last_peered":"2026-02-23T13:11:56.658262+0000","last_clean":"2026-02-23T13:11:56.658262+0000","last_became_active":"2026-02-23T13:11:54.595840+0000","last_became_peered":"2026-02-23T13:11:54.595840+0000","last_unstale":"2026-02-23T13:11:56.658262+0000","last_undegraded":"2026-02-23T13:11:56.658262+0000","last_fullsized":"2026-02-23T13:11:56.658262+0000","mapping_epoch":78,"log_start":"80'451","ondisk_log_start":"80'451","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":451,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:57.412771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29753344,"num_objects":454,"num_object_clones":0,"num_object_copies":1362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":454,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":454,"num_write_kb":29056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"80'452","reported_seq":466,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:11:56.668468+0000","last_change":"2026-02-23T13:11:54.596007+0000","last_active":"2026-02-23T13:11:56.668468+0000","last_peered":"2026-02-23T13:11:56.668468+0000","last_clean":"2026-02-23T13:11:56.668468+0000","last_became_active":"2026-02-23T13:11:54.595287+0000","last_became_peered":"2026-02-23T13:11:54.595287+0000","last_unstale":"2026-02-23T13:11:56.668468+0000","last_undegraded":"2026-02-23T13:11:56.668468+0000","last_fullsized":"2026-02-23T13:11:56.668468+0000","mapping_epoch":78,"log_start":"80'449","ondisk_log_start":"80'449","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":449,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:03.108821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29622272,"num_objects":452,"num_object_clones":0,"num_object_copies":1356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":452,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":452,"num_write_kb":28928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":348,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:11:55.597234+0000","last_change":"2026-02-23T13:11:50.169148+0000","last_active":"2026-02-23T13:11:55.597234+0000","last_peered":"2026-02-23T13:11:55.597234+0000","last_clean":"2026-02-23T13:11:55.597234+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:11:55.597234+0000","last_undegraded":"2026-02-23T13:11:55.597234+0000","last_fullsized":"2026-02-23T13:11:55.597234+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:11:50.169094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:11:50.169094+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:57.448558+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":481820672,"num_objects":7352,"num_object_clones":0,"num_object_copies":22056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7352,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7352,"num_write_kb":470528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1464139776,"data_stored":1464139776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":50,"ondisk_log_size":50,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":390,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247918,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1288436,"kb_used_data":271008,"kb_used_omap":17,"kb_used_meta":1017390,"kb_avail":732714764,"statfs":{"total":751619276800,"available":750299918336,"internally_reserved":0,"allocated":277512192,"data_stored":276947054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18190,"internal_metadata":1041807602},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444145,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":889652,"kb_used_data":106976,"kb_used_omap":17,"kb_used_meta":782638,"kb_avail":733113548,"statfs":{"total":751619276800,"available":750708273152,"internally_reserved":0,"allocated":109543424,"data_stored":108978286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17810,"internal_metadata":801421934},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574963,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":939632,"kb_used_data":174620,"kb_used_omap":17,"kb_used_meta":764974,"kb_avail":733063568,"statfs":{"total":751619276800,"available":750657093632,"internally_reserved":0,"allocated":178810880,"data_stored":178249294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18148,"internal_metadata":783333660},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705780,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1467688,"kb_used_data":1428,"kb_used_omap":15,"kb_used_meta":1466224,"kb_avail":732535512,"statfs":{"total":751619276800,"available":750116364288,"internally_reserved":0,"allocated":1462272,"data_stored":904678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15397,"internal_metadata":1501414363},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":390,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":387842048,"data_stored":387842048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":329449472,"data_stored":329449472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":330498048,"data_stored":330498048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":416350208,"data_stored":416350208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:12:02.017 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:12:02.017 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_3 pg_num 36 2026-02-23T13:12:02.213 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:02.346 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:02.344+0000 7fa3cb1b5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:02.346 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:02.344+0000 7fa3cb1b5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:02.473 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:12:02.517 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:12:02.688 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 7 16 52131 52115 465.255 448.062 0.00174007 0.00214771 2026-02-23T13:12:02.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:02 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1548134265' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:12:02.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:02 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2774745601' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_3", "var": "pg_num", "val": "36"} : dispatch 2026-02-23T13:12:03.688 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 8 16 59227 59211 462.531 443.5 0.00115331 0.00216046 2026-02-23T13:12:03.994 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:12:04.019 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:03 trial046 ceph-mon[38575]: from='client.15181 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:12:04.020 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:03 trial046 ceph-mon[38575]: pgmap v327: 17 pgs: 17 active+clean; 2.7 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 348 MiB/s wr, 5.56k op/s 2026-02-23T13:12:04.141 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:04.263 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:04.261+0000 7f3a1840e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:04.263 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:04.261+0000 7f3a1840e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:04.278 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:12:04.279 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:12:04.294 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:12:04.295 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:12:04.308 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:12:04.309 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:12:04.321 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:12:04.322 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:12:04.688 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 9 16 66879 66863 464.274 478.25 0.00130083 0.00215224 2026-02-23T13:12:05.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:04 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2262629403' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:12:05.688 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 10 16 75372 75356 470.923 530.812 0.00164502 0.0021221 2026-02-23T13:12:06.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:05 trial046 ceph-mon[38575]: pgmap v328: 17 pgs: 17 active+clean; 2.7 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 280 MiB/s wr, 4.49k op/s 2026-02-23T13:12:06.367 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:12:06.399 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:12:06 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:12:06] "GET /metrics HTTP/1.1" 200 4208 "" "Prometheus/3.6.0" 2026-02-23T13:12:06.522 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:06.560 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:12:06 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:12:06.087Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:12:06.668 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:06.666+0000 7fd61d127640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:06.668 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:06.666+0000 7fd61d127640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:06.683 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:12:06.684 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:12:06.688 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 11 15 83134 83119 472.217 485.188 0.00232716 0.00211629 2026-02-23T13:12:06.696 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:12:06.696 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:12:06.710 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:12:06.711 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:12:06.724 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:12:06.724 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:12:07.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:06 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3354342844' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:12:07.519 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:12:07.519 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:12:07.519 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:12:07.666 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:07.688 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 12 15 91252 91237 475.143 507.375 0.00184083 0.00210301 2026-02-23T13:12:07.791 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:07.789+0000 7fe0f3bf8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:07.791 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:07.789+0000 7fe0f3bf8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:07.948 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:12:07.949 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:12:07.950 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:07 trial046 ceph-mon[38575]: pgmap v329: 17 pgs: 17 active+clean; 3.5 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 321 MiB/s wr, 5.14k op/s 2026-02-23T13:12:07.995 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2026-02-23T13:12:06.663484+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3729916448,"num_objects":56907,"num_object_clones":0,"num_object_copies":170721,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56907,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":57040,"num_write_kb":3644070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":14051468,"kb_used_data":9897980,"kb_used_omap":68,"kb_used_meta":4153339,"kb_avail":2921961332,"statfs":{"total":3006477107200,"available":2992088403968,"internally_reserved":0,"allocated":10135531520,"data_stored":10133274520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":70199,"internal_metadata":4253019593},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3729326080,"num_objects":56905,"num_object_clones":0,"num_object_copies":170715,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56905,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56905,"num_write_kb":3641920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.066449"},"pg_stats":[{"pgid":"5.f","version":"80'2815","reported_seq":2829,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:01.666679+0000","last_change":"2026-02-23T13:11:54.596706+0000","last_active":"2026-02-23T13:12:01.666679+0000","last_peered":"2026-02-23T13:12:01.666679+0000","last_clean":"2026-02-23T13:12:01.666679+0000","last_became_active":"2026-02-23T13:11:54.595945+0000","last_became_peered":"2026-02-23T13:11:54.595945+0000","last_unstale":"2026-02-23T13:12:01.666679+0000","last_undegraded":"2026-02-23T13:12:01.666679+0000","last_fullsized":"2026-02-23T13:12:01.666679+0000","mapping_epoch":78,"log_start":"80'2812","ondisk_log_start":"80'2812","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2812,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:06.207061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184483840,"num_objects":2815,"num_object_clones":0,"num_object_copies":8445,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2815,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2815,"num_write_kb":180160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"80'5187","reported_seq":5201,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:06.648531+0000","last_change":"2026-02-23T13:11:54.599809+0000","last_active":"2026-02-23T13:12:06.648531+0000","last_peered":"2026-02-23T13:12:06.648531+0000","last_clean":"2026-02-23T13:12:06.648531+0000","last_became_active":"2026-02-23T13:11:54.599064+0000","last_became_peered":"2026-02-23T13:11:54.599064+0000","last_unstale":"2026-02-23T13:12:06.648531+0000","last_undegraded":"2026-02-23T13:12:06.648531+0000","last_fullsized":"2026-02-23T13:12:06.648531+0000","mapping_epoch":78,"log_start":"80'5184","ondisk_log_start":"80'5184","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:11.698138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":339935232,"num_objects":5187,"num_object_clones":0,"num_object_copies":15561,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5187,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5187,"num_write_kb":331968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"80'2852","reported_seq":2866,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:01.662469+0000","last_change":"2026-02-23T13:11:54.596174+0000","last_active":"2026-02-23T13:12:01.662469+0000","last_peered":"2026-02-23T13:12:01.662469+0000","last_clean":"2026-02-23T13:12:01.662469+0000","last_became_active":"2026-02-23T13:11:54.595773+0000","last_became_peered":"2026-02-23T13:11:54.595773+0000","last_unstale":"2026-02-23T13:12:01.662469+0000","last_undegraded":"2026-02-23T13:12:01.662469+0000","last_fullsized":"2026-02-23T13:12:01.662469+0000","mapping_epoch":78,"log_start":"80'2849","ondisk_log_start":"80'2849","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2849,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.566475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186908672,"num_objects":2852,"num_object_clones":0,"num_object_copies":8556,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2852,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2852,"num_write_kb":182528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"80'2770","reported_seq":2784,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:01.774982+0000","last_change":"2026-02-23T13:11:54.595749+0000","last_active":"2026-02-23T13:12:01.774982+0000","last_peered":"2026-02-23T13:12:01.774982+0000","last_clean":"2026-02-23T13:12:01.774982+0000","last_became_active":"2026-02-23T13:11:54.595560+0000","last_became_peered":"2026-02-23T13:11:54.595560+0000","last_unstale":"2026-02-23T13:12:01.774982+0000","last_undegraded":"2026-02-23T13:12:01.774982+0000","last_fullsized":"2026-02-23T13:12:01.774982+0000","mapping_epoch":78,"log_start":"80'2767","ondisk_log_start":"80'2767","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2767,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:11.860237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181534720,"num_objects":2770,"num_object_clones":0,"num_object_copies":8310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2770,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2770,"num_write_kb":177280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"80'2875","reported_seq":2889,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:01.658699+0000","last_change":"2026-02-23T13:11:54.596349+0000","last_active":"2026-02-23T13:12:01.658699+0000","last_peered":"2026-02-23T13:12:01.658699+0000","last_clean":"2026-02-23T13:12:01.658699+0000","last_became_active":"2026-02-23T13:11:54.596133+0000","last_became_peered":"2026-02-23T13:11:54.596133+0000","last_unstale":"2026-02-23T13:12:01.658699+0000","last_undegraded":"2026-02-23T13:12:01.658699+0000","last_fullsized":"2026-02-23T13:12:01.658699+0000","mapping_epoch":78,"log_start":"80'2872","ondisk_log_start":"80'2872","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2872,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:03.865476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188416000,"num_objects":2875,"num_object_clones":0,"num_object_copies":8625,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2875,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2875,"num_write_kb":184000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"80'2811","reported_seq":2825,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:01.662435+0000","last_change":"2026-02-23T13:11:54.595383+0000","last_active":"2026-02-23T13:12:01.662435+0000","last_peered":"2026-02-23T13:12:01.662435+0000","last_clean":"2026-02-23T13:12:01.662435+0000","last_became_active":"2026-02-23T13:11:54.595080+0000","last_became_peered":"2026-02-23T13:11:54.595080+0000","last_unstale":"2026-02-23T13:12:01.662435+0000","last_undegraded":"2026-02-23T13:12:01.662435+0000","last_fullsized":"2026-02-23T13:12:01.662435+0000","mapping_epoch":78,"log_start":"80'2808","ondisk_log_start":"80'2808","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2808,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:12.934698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184221696,"num_objects":2811,"num_object_clones":0,"num_object_copies":8433,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2811,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2811,"num_write_kb":179904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"80'5066","reported_seq":5080,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:06.655797+0000","last_change":"2026-02-23T13:11:54.598497+0000","last_active":"2026-02-23T13:12:06.655797+0000","last_peered":"2026-02-23T13:12:06.655797+0000","last_clean":"2026-02-23T13:12:06.655797+0000","last_became_active":"2026-02-23T13:11:54.598325+0000","last_became_peered":"2026-02-23T13:11:54.598325+0000","last_unstale":"2026-02-23T13:12:06.655797+0000","last_undegraded":"2026-02-23T13:12:06.655797+0000","last_fullsized":"2026-02-23T13:12:06.655797+0000","mapping_epoch":78,"log_start":"80'5063","ondisk_log_start":"80'5063","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:57.924450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":332005376,"num_objects":5066,"num_object_clones":0,"num_object_copies":15198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5066,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5066,"num_write_kb":324224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"80'2765","reported_seq":2779,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:01.655267+0000","last_change":"2026-02-23T13:11:54.595376+0000","last_active":"2026-02-23T13:12:01.655267+0000","last_peered":"2026-02-23T13:12:01.655267+0000","last_clean":"2026-02-23T13:12:01.655267+0000","last_became_active":"2026-02-23T13:11:54.595110+0000","last_became_peered":"2026-02-23T13:11:54.595110+0000","last_unstale":"2026-02-23T13:12:01.655267+0000","last_undegraded":"2026-02-23T13:12:01.655267+0000","last_fullsized":"2026-02-23T13:12:01.655267+0000","mapping_epoch":78,"log_start":"80'2762","ondisk_log_start":"80'2762","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2762,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:02.754608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181207040,"num_objects":2765,"num_object_clones":0,"num_object_copies":8295,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2765,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2765,"num_write_kb":176960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"80'5270","reported_seq":5284,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:06.650426+0000","last_change":"2026-02-23T13:11:54.599364+0000","last_active":"2026-02-23T13:12:06.650426+0000","last_peered":"2026-02-23T13:12:06.650426+0000","last_clean":"2026-02-23T13:12:06.650426+0000","last_became_active":"2026-02-23T13:11:54.599155+0000","last_became_peered":"2026-02-23T13:11:54.599155+0000","last_unstale":"2026-02-23T13:12:06.650426+0000","last_undegraded":"2026-02-23T13:12:06.650426+0000","last_fullsized":"2026-02-23T13:12:06.650426+0000","mapping_epoch":78,"log_start":"80'5267","ondisk_log_start":"80'5267","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:14.711414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":345374720,"num_objects":5270,"num_object_clones":0,"num_object_copies":15810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5270,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5270,"num_write_kb":337280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"80'2875","reported_seq":2889,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:01.772894+0000","last_change":"2026-02-23T13:11:54.595872+0000","last_active":"2026-02-23T13:12:01.772894+0000","last_peered":"2026-02-23T13:12:01.772894+0000","last_clean":"2026-02-23T13:12:01.772894+0000","last_became_active":"2026-02-23T13:11:54.595645+0000","last_became_peered":"2026-02-23T13:11:54.595645+0000","last_unstale":"2026-02-23T13:12:01.772894+0000","last_undegraded":"2026-02-23T13:12:01.772894+0000","last_fullsized":"2026-02-23T13:12:01.772894+0000","mapping_epoch":78,"log_start":"80'2872","ondisk_log_start":"80'2872","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2872,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.565438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188416000,"num_objects":2875,"num_object_clones":0,"num_object_copies":8625,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2875,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2875,"num_write_kb":184000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"80'2773","reported_seq":2787,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:01.651337+0000","last_change":"2026-02-23T13:11:54.595399+0000","last_active":"2026-02-23T13:12:01.651337+0000","last_peered":"2026-02-23T13:12:01.651337+0000","last_clean":"2026-02-23T13:12:01.651337+0000","last_became_active":"2026-02-23T13:11:54.595144+0000","last_became_peered":"2026-02-23T13:11:54.595144+0000","last_unstale":"2026-02-23T13:12:01.651337+0000","last_undegraded":"2026-02-23T13:12:01.651337+0000","last_fullsized":"2026-02-23T13:12:01.651337+0000","mapping_epoch":78,"log_start":"80'2770","ondisk_log_start":"80'2770","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2770,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:16.231133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181731328,"num_objects":2773,"num_object_clones":0,"num_object_copies":8319,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2773,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2773,"num_write_kb":177472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"80'2801","reported_seq":2814,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:01.653846+0000","last_change":"2026-02-23T13:11:54.596295+0000","last_active":"2026-02-23T13:12:01.653846+0000","last_peered":"2026-02-23T13:12:01.653846+0000","last_clean":"2026-02-23T13:12:01.653846+0000","last_became_active":"2026-02-23T13:11:54.595996+0000","last_became_peered":"2026-02-23T13:11:54.595996+0000","last_unstale":"2026-02-23T13:12:01.653846+0000","last_undegraded":"2026-02-23T13:12:01.653846+0000","last_fullsized":"2026-02-23T13:12:01.653846+0000","mapping_epoch":78,"log_start":"80'2798","ondisk_log_start":"80'2798","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2798,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.493149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183566336,"num_objects":2801,"num_object_clones":0,"num_object_copies":8403,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2801,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2801,"num_write_kb":179264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"80'5178","reported_seq":5192,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:06.653270+0000","last_change":"2026-02-23T13:11:54.599275+0000","last_active":"2026-02-23T13:12:06.653270+0000","last_peered":"2026-02-23T13:12:06.653270+0000","last_clean":"2026-02-23T13:12:06.653270+0000","last_became_active":"2026-02-23T13:11:54.598958+0000","last_became_peered":"2026-02-23T13:11:54.598958+0000","last_unstale":"2026-02-23T13:12:06.653270+0000","last_undegraded":"2026-02-23T13:12:06.653270+0000","last_fullsized":"2026-02-23T13:12:06.653270+0000","mapping_epoch":78,"log_start":"80'5175","ondisk_log_start":"80'5175","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:13.230076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":339345408,"num_objects":5178,"num_object_clones":0,"num_object_copies":15534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5178,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5178,"num_write_kb":331392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"80'5290","reported_seq":5304,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:06.657376+0000","last_change":"2026-02-23T13:11:54.599032+0000","last_active":"2026-02-23T13:12:06.657376+0000","last_peered":"2026-02-23T13:12:06.657376+0000","last_clean":"2026-02-23T13:12:06.657376+0000","last_became_active":"2026-02-23T13:11:54.598751+0000","last_became_peered":"2026-02-23T13:11:54.598751+0000","last_unstale":"2026-02-23T13:12:06.657376+0000","last_undegraded":"2026-02-23T13:12:06.657376+0000","last_fullsized":"2026-02-23T13:12:06.657376+0000","mapping_epoch":78,"log_start":"80'5287","ondisk_log_start":"80'5287","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:59.904586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":346685440,"num_objects":5290,"num_object_clones":0,"num_object_copies":15870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5290,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5290,"num_write_kb":338560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"80'2830","reported_seq":2843,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:01.657546+0000","last_change":"2026-02-23T13:11:54.596162+0000","last_active":"2026-02-23T13:12:01.657546+0000","last_peered":"2026-02-23T13:12:01.657546+0000","last_clean":"2026-02-23T13:12:01.657546+0000","last_became_active":"2026-02-23T13:11:54.595840+0000","last_became_peered":"2026-02-23T13:11:54.595840+0000","last_unstale":"2026-02-23T13:12:01.657546+0000","last_undegraded":"2026-02-23T13:12:01.657546+0000","last_fullsized":"2026-02-23T13:12:01.657546+0000","mapping_epoch":78,"log_start":"80'2827","ondisk_log_start":"80'2827","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2827,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:57.412771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185466880,"num_objects":2830,"num_object_clones":0,"num_object_copies":8490,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2830,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2830,"num_write_kb":181120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"80'2747","reported_seq":2761,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:01.667589+0000","last_change":"2026-02-23T13:11:54.596007+0000","last_active":"2026-02-23T13:12:01.667589+0000","last_peered":"2026-02-23T13:12:01.667589+0000","last_clean":"2026-02-23T13:12:01.667589+0000","last_became_active":"2026-02-23T13:11:54.595287+0000","last_became_peered":"2026-02-23T13:11:54.595287+0000","last_unstale":"2026-02-23T13:12:01.667589+0000","last_undegraded":"2026-02-23T13:12:01.667589+0000","last_fullsized":"2026-02-23T13:12:01.667589+0000","mapping_epoch":78,"log_start":"80'2744","ondisk_log_start":"80'2744","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2744,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:03.108821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180027392,"num_objects":2747,"num_object_clones":0,"num_object_copies":8241,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2747,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2747,"num_write_kb":175808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":348,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:11:55.597234+0000","last_change":"2026-02-23T13:11:50.169148+0000","last_active":"2026-02-23T13:11:55.597234+0000","last_peered":"2026-02-23T13:11:55.597234+0000","last_clean":"2026-02-23T13:11:55.597234+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:11:55.597234+0000","last_undegraded":"2026-02-23T13:11:55.597234+0000","last_fullsized":"2026-02-23T13:11:55.597234+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:11:50.169094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:11:50.169094+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:57.448558+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":3729326080,"num_objects":56905,"num_object_clones":0,"num_object_copies":170715,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56905,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56905,"num_write_kb":3641920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":11024793600,"data_stored":11024793600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":390,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247920,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5788148,"kb_used_data":4535968,"kb_used_omap":17,"kb_used_meta":1252142,"kb_avail":728215052,"statfs":{"total":751619276800,"available":745692213248,"internally_reserved":0,"allocated":4644831232,"data_stored":4644266094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18190,"internal_metadata":1282193650},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444146,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2178612,"kb_used_data":1706720,"kb_used_omap":17,"kb_used_meta":471854,"kb_avail":731824588,"statfs":{"total":751619276800,"available":749388378112,"internally_reserved":0,"allocated":1747681280,"data_stored":1747116142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17810,"internal_metadata":483179118},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574964,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2507248,"kb_used_data":1670044,"kb_used_omap":17,"kb_used_meta":837166,"kb_avail":731495952,"statfs":{"total":751619276800,"available":749051854848,"internally_reserved":0,"allocated":1710125056,"data_stored":1709563470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18148,"internal_metadata":857258268},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705781,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3577460,"kb_used_data":1985248,"kb_used_omap":15,"kb_used_meta":1592176,"kb_avail":730425740,"statfs":{"total":751619276800,"available":747955957760,"internally_reserved":0,"allocated":2032893952,"data_stored":2032328814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16051,"internal_metadata":1630388557},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":390,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2391670784,"data_stored":2391670784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1854406656,"data_stored":1854406656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2021457920,"data_stored":2021457920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4757258240,"data_stored":4757258240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:12:08.689 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 13 16 99382 99366 477.673 508.062 0.00138522 0.00209211 2026-02-23T13:12:08.771 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:12:08.918 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:09.045 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:09.043+0000 7f4bc881a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:09.046 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:09.044+0000 7f4bc881a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:09.060 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:12:09.061 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:12:09.073 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:12:09.074 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:12:09.087 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:12:09.088 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:12:09.101 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:12:09.101 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:12:09.689 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 14 15 106860 106845 476.939 467.438 0.00227271 0.00209527 2026-02-23T13:12:10.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:09 trial046 ceph-mon[38575]: from='client.15191 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:12:10.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:09 trial046 ceph-mon[38575]: pgmap v330: 17 pgs: 17 active+clean; 5.1 GiB data, 17 GiB used, 2.7 TiB / 2.7 TiB avail; 404 MiB/s wr, 6.46k op/s 2026-02-23T13:12:10.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:09 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1439290550' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:12:10.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:09 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-23T13:12:10.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:09 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:12:10.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:09 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:12:10.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:09 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:12:10.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:09 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-23T13:12:10.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:09 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:12:10.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:09 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-23T13:12:10.689 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 15 16 114321 114305 476.224 466.25 0.00114899 0.00209847 2026-02-23T13:12:11.147 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:12:11.291 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:11.418 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:11.416+0000 7f24243aa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:11.418 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:11.416+0000 7f24243aa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:11.434 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:12:11.434 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:12:11.448 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:12:11.448 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:12:11.461 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:12:11.461 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:12:11.475 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:12:11.475 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:12:11.689 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 16 16 121428 121412 474.22 444.188 0.00265395 0.00210733 2026-02-23T13:12:12.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:11 trial046 ceph-mon[38575]: pgmap v331: 17 pgs: 17 active+clean; 5.1 GiB data, 17 GiB used, 2.7 TiB / 2.7 TiB avail; 394 MiB/s wr, 6.30k op/s 2026-02-23T13:12:12.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:11 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2175992685' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:12:12.689 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 17 15 128658 128643 472.907 451.938 0.00327553 0.00211328 2026-02-23T13:12:12.998 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:12:12.998 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:12:12.999 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:12:12.999 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:12:13.143 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:13.518 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:12:13.678 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:13.602+0000 7fc275b0f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:13.678 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:13.602+0000 7fc275b0f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:13.689 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 18 15 134750 134735 467.786 380.75 0.0028248 0.0021364 2026-02-23T13:12:13.692 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:13.742 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:12:13.743 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:12:14.038 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:13 trial046 ceph-mon[38575]: pgmap v332: 17 pgs: 17 active+clean; 7.4 GiB data, 25 GiB used, 2.7 TiB / 2.7 TiB avail; 594 MiB/s wr, 9.50k op/s 2026-02-23T13:12:14.464 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":332,"stamp":"2026-02-23T13:12:12.664351+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7952728608,"num_objects":121342,"num_object_clones":0,"num_object_copies":364026,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121342,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":121475,"num_write_kb":7767910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":26107724,"kb_used_data":22539324,"kb_used_omap":64,"kb_used_meta":3568191,"kb_avail":2909905076,"statfs":{"total":3006477107200,"available":2979742797824,"internally_reserved":0,"allocated":23080267776,"data_stored":23078010776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":66554,"internal_metadata":3653827590},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,3],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7470317568,"num_objects":113988,"num_object_clones":0,"num_object_copies":341964,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113988,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113988,"num_write_kb":7295232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001653"},"pg_stats":[{"pgid":"5.f","version":"80'7689","reported_seq":7703,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:11.662640+0000","last_change":"2026-02-23T13:11:54.596706+0000","last_active":"2026-02-23T13:12:11.662640+0000","last_peered":"2026-02-23T13:12:11.662640+0000","last_clean":"2026-02-23T13:12:11.662640+0000","last_became_active":"2026-02-23T13:11:54.595945+0000","last_became_peered":"2026-02-23T13:11:54.595945+0000","last_unstale":"2026-02-23T13:12:11.662640+0000","last_undegraded":"2026-02-23T13:12:11.662640+0000","last_fullsized":"2026-02-23T13:12:11.662640+0000","mapping_epoch":78,"log_start":"80'7686","ondisk_log_start":"80'7686","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:06.207061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":503906304,"num_objects":7689,"num_object_clones":0,"num_object_copies":23067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7689,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7689,"num_write_kb":492096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"80'7543","reported_seq":7557,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:11.657460+0000","last_change":"2026-02-23T13:11:54.599809+0000","last_active":"2026-02-23T13:12:11.657460+0000","last_peered":"2026-02-23T13:12:11.657460+0000","last_clean":"2026-02-23T13:12:11.657460+0000","last_became_active":"2026-02-23T13:11:54.599064+0000","last_became_peered":"2026-02-23T13:11:54.599064+0000","last_unstale":"2026-02-23T13:12:11.657460+0000","last_undegraded":"2026-02-23T13:12:11.657460+0000","last_fullsized":"2026-02-23T13:12:11.657460+0000","mapping_epoch":78,"log_start":"80'7540","ondisk_log_start":"80'7540","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:11.698138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":494338048,"num_objects":7543,"num_object_clones":0,"num_object_copies":22629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7543,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7543,"num_write_kb":482752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"80'7714","reported_seq":7728,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:11.659340+0000","last_change":"2026-02-23T13:11:54.596174+0000","last_active":"2026-02-23T13:12:11.659340+0000","last_peered":"2026-02-23T13:12:11.659340+0000","last_clean":"2026-02-23T13:12:11.659340+0000","last_became_active":"2026-02-23T13:11:54.595773+0000","last_became_peered":"2026-02-23T13:11:54.595773+0000","last_unstale":"2026-02-23T13:12:11.659340+0000","last_undegraded":"2026-02-23T13:12:11.659340+0000","last_fullsized":"2026-02-23T13:12:11.659340+0000","mapping_epoch":78,"log_start":"80'7711","ondisk_log_start":"80'7711","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.566475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505544704,"num_objects":7714,"num_object_clones":0,"num_object_copies":23142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7714,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7714,"num_write_kb":493696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"80'7433","reported_seq":7446,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:11.775502+0000","last_change":"2026-02-23T13:11:54.595749+0000","last_active":"2026-02-23T13:12:11.775502+0000","last_peered":"2026-02-23T13:12:11.775502+0000","last_clean":"2026-02-23T13:12:11.775502+0000","last_became_active":"2026-02-23T13:11:54.595560+0000","last_became_peered":"2026-02-23T13:11:54.595560+0000","last_unstale":"2026-02-23T13:12:11.775502+0000","last_undegraded":"2026-02-23T13:12:11.775502+0000","last_fullsized":"2026-02-23T13:12:11.775502+0000","mapping_epoch":78,"log_start":"80'7430","ondisk_log_start":"80'7430","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:11.860237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":487129088,"num_objects":7433,"num_object_clones":0,"num_object_copies":22299,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7433,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7433,"num_write_kb":475712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"80'7615","reported_seq":7628,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:11.661478+0000","last_change":"2026-02-23T13:11:54.596349+0000","last_active":"2026-02-23T13:12:11.661478+0000","last_peered":"2026-02-23T13:12:11.661478+0000","last_clean":"2026-02-23T13:12:11.661478+0000","last_became_active":"2026-02-23T13:11:54.596133+0000","last_became_peered":"2026-02-23T13:11:54.596133+0000","last_unstale":"2026-02-23T13:12:11.661478+0000","last_undegraded":"2026-02-23T13:12:11.661478+0000","last_fullsized":"2026-02-23T13:12:11.661478+0000","mapping_epoch":78,"log_start":"80'7612","ondisk_log_start":"80'7612","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:03.865476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":499056640,"num_objects":7615,"num_object_clones":0,"num_object_copies":22845,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7615,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7615,"num_write_kb":487360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"80'7459","reported_seq":7473,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:11.661438+0000","last_change":"2026-02-23T13:11:54.595383+0000","last_active":"2026-02-23T13:12:11.661438+0000","last_peered":"2026-02-23T13:12:11.661438+0000","last_clean":"2026-02-23T13:12:11.661438+0000","last_became_active":"2026-02-23T13:11:54.595080+0000","last_became_peered":"2026-02-23T13:11:54.595080+0000","last_unstale":"2026-02-23T13:12:11.661438+0000","last_undegraded":"2026-02-23T13:12:11.661438+0000","last_fullsized":"2026-02-23T13:12:11.661438+0000","mapping_epoch":78,"log_start":"80'7456","ondisk_log_start":"80'7456","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:12.934698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":488833024,"num_objects":7459,"num_object_clones":0,"num_object_copies":22377,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7459,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7459,"num_write_kb":477376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"80'7485","reported_seq":7499,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:11.659175+0000","last_change":"2026-02-23T13:11:54.598497+0000","last_active":"2026-02-23T13:12:11.659175+0000","last_peered":"2026-02-23T13:12:11.659175+0000","last_clean":"2026-02-23T13:12:11.659175+0000","last_became_active":"2026-02-23T13:11:54.598325+0000","last_became_peered":"2026-02-23T13:11:54.598325+0000","last_unstale":"2026-02-23T13:12:11.659175+0000","last_undegraded":"2026-02-23T13:12:11.659175+0000","last_fullsized":"2026-02-23T13:12:11.659175+0000","mapping_epoch":78,"log_start":"80'7482","ondisk_log_start":"80'7482","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:57.924450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":490536960,"num_objects":7485,"num_object_clones":0,"num_object_copies":22455,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7485,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7485,"num_write_kb":479040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"80'7535","reported_seq":7549,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:11.658719+0000","last_change":"2026-02-23T13:11:54.595376+0000","last_active":"2026-02-23T13:12:11.658719+0000","last_peered":"2026-02-23T13:12:11.658719+0000","last_clean":"2026-02-23T13:12:11.658719+0000","last_became_active":"2026-02-23T13:11:54.595110+0000","last_became_peered":"2026-02-23T13:11:54.595110+0000","last_unstale":"2026-02-23T13:12:11.658719+0000","last_undegraded":"2026-02-23T13:12:11.658719+0000","last_fullsized":"2026-02-23T13:12:11.658719+0000","mapping_epoch":78,"log_start":"80'7532","ondisk_log_start":"80'7532","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:02.754608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493813760,"num_objects":7535,"num_object_clones":0,"num_object_copies":22605,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7535,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7535,"num_write_kb":482240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"80'7727","reported_seq":7741,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:11.652433+0000","last_change":"2026-02-23T13:11:54.599364+0000","last_active":"2026-02-23T13:12:11.652433+0000","last_peered":"2026-02-23T13:12:11.652433+0000","last_clean":"2026-02-23T13:12:11.652433+0000","last_became_active":"2026-02-23T13:11:54.599155+0000","last_became_peered":"2026-02-23T13:11:54.599155+0000","last_unstale":"2026-02-23T13:12:11.652433+0000","last_undegraded":"2026-02-23T13:12:11.652433+0000","last_fullsized":"2026-02-23T13:12:11.652433+0000","mapping_epoch":78,"log_start":"80'7724","ondisk_log_start":"80'7724","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:14.711414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":506396672,"num_objects":7727,"num_object_clones":0,"num_object_copies":23181,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7727,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7727,"num_write_kb":494528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"80'7615","reported_seq":7629,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:11.768696+0000","last_change":"2026-02-23T13:11:54.595872+0000","last_active":"2026-02-23T13:12:11.768696+0000","last_peered":"2026-02-23T13:12:11.768696+0000","last_clean":"2026-02-23T13:12:11.768696+0000","last_became_active":"2026-02-23T13:11:54.595645+0000","last_became_peered":"2026-02-23T13:11:54.595645+0000","last_unstale":"2026-02-23T13:12:11.768696+0000","last_undegraded":"2026-02-23T13:12:11.768696+0000","last_fullsized":"2026-02-23T13:12:11.768696+0000","mapping_epoch":78,"log_start":"80'7612","ondisk_log_start":"80'7612","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.565438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":499056640,"num_objects":7615,"num_object_clones":0,"num_object_copies":22845,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7615,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7615,"num_write_kb":487360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"80'7478","reported_seq":7492,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:11.663209+0000","last_change":"2026-02-23T13:11:54.595399+0000","last_active":"2026-02-23T13:12:11.663209+0000","last_peered":"2026-02-23T13:12:11.663209+0000","last_clean":"2026-02-23T13:12:11.663209+0000","last_became_active":"2026-02-23T13:11:54.595144+0000","last_became_peered":"2026-02-23T13:11:54.595144+0000","last_unstale":"2026-02-23T13:12:11.663209+0000","last_undegraded":"2026-02-23T13:12:11.663209+0000","last_fullsized":"2026-02-23T13:12:11.663209+0000","mapping_epoch":78,"log_start":"80'7475","ondisk_log_start":"80'7475","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:16.231133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":490078208,"num_objects":7478,"num_object_clones":0,"num_object_copies":22434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7478,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7478,"num_write_kb":478592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"80'7631","reported_seq":7645,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:11.661392+0000","last_change":"2026-02-23T13:11:54.596295+0000","last_active":"2026-02-23T13:12:11.661392+0000","last_peered":"2026-02-23T13:12:11.661392+0000","last_clean":"2026-02-23T13:12:11.661392+0000","last_became_active":"2026-02-23T13:11:54.595996+0000","last_became_peered":"2026-02-23T13:11:54.595996+0000","last_unstale":"2026-02-23T13:12:11.661392+0000","last_undegraded":"2026-02-23T13:12:11.661392+0000","last_fullsized":"2026-02-23T13:12:11.661392+0000","mapping_epoch":78,"log_start":"80'7628","ondisk_log_start":"80'7628","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.493149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":500105216,"num_objects":7631,"num_object_clones":0,"num_object_copies":22893,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7631,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7631,"num_write_kb":488384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"80'7539","reported_seq":7552,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:11.657762+0000","last_change":"2026-02-23T13:11:54.599275+0000","last_active":"2026-02-23T13:12:11.657762+0000","last_peered":"2026-02-23T13:12:11.657762+0000","last_clean":"2026-02-23T13:12:11.657762+0000","last_became_active":"2026-02-23T13:11:54.598958+0000","last_became_peered":"2026-02-23T13:11:54.598958+0000","last_unstale":"2026-02-23T13:12:11.657762+0000","last_undegraded":"2026-02-23T13:12:11.657762+0000","last_fullsized":"2026-02-23T13:12:11.657762+0000","mapping_epoch":78,"log_start":"80'7536","ondisk_log_start":"80'7536","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:13.230076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":494075904,"num_objects":7539,"num_object_clones":0,"num_object_copies":22617,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7539,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7539,"num_write_kb":482496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"80'7714","reported_seq":7728,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:11.655295+0000","last_change":"2026-02-23T13:11:54.599032+0000","last_active":"2026-02-23T13:12:11.655295+0000","last_peered":"2026-02-23T13:12:11.655295+0000","last_clean":"2026-02-23T13:12:11.655295+0000","last_became_active":"2026-02-23T13:11:54.598751+0000","last_became_peered":"2026-02-23T13:11:54.598751+0000","last_unstale":"2026-02-23T13:12:11.655295+0000","last_undegraded":"2026-02-23T13:12:11.655295+0000","last_fullsized":"2026-02-23T13:12:11.655295+0000","mapping_epoch":78,"log_start":"80'7711","ondisk_log_start":"80'7711","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:59.904586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505544704,"num_objects":7714,"num_object_clones":0,"num_object_copies":23142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7714,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7714,"num_write_kb":493696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"80'7569","reported_seq":7583,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:11.654515+0000","last_change":"2026-02-23T13:11:54.596162+0000","last_active":"2026-02-23T13:12:11.654515+0000","last_peered":"2026-02-23T13:12:11.654515+0000","last_clean":"2026-02-23T13:12:11.654515+0000","last_became_active":"2026-02-23T13:11:54.595840+0000","last_became_peered":"2026-02-23T13:11:54.595840+0000","last_unstale":"2026-02-23T13:12:11.654515+0000","last_undegraded":"2026-02-23T13:12:11.654515+0000","last_fullsized":"2026-02-23T13:12:11.654515+0000","mapping_epoch":78,"log_start":"80'7566","ondisk_log_start":"80'7566","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:57.412771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":496041984,"num_objects":7569,"num_object_clones":0,"num_object_copies":22707,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7569,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7569,"num_write_kb":484416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"80'7594","reported_seq":7608,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:11.666974+0000","last_change":"2026-02-23T13:11:54.596007+0000","last_active":"2026-02-23T13:12:11.666974+0000","last_peered":"2026-02-23T13:12:11.666974+0000","last_clean":"2026-02-23T13:12:11.666974+0000","last_became_active":"2026-02-23T13:11:54.595287+0000","last_became_peered":"2026-02-23T13:11:54.595287+0000","last_unstale":"2026-02-23T13:12:11.666974+0000","last_undegraded":"2026-02-23T13:12:11.666974+0000","last_fullsized":"2026-02-23T13:12:11.666974+0000","mapping_epoch":78,"log_start":"80'7591","ondisk_log_start":"80'7591","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:03.108821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":497680384,"num_objects":7594,"num_object_clones":0,"num_object_copies":22782,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7594,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7594,"num_write_kb":486016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":348,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:11:55.597234+0000","last_change":"2026-02-23T13:11:50.169148+0000","last_active":"2026-02-23T13:11:55.597234+0000","last_peered":"2026-02-23T13:11:55.597234+0000","last_clean":"2026-02-23T13:11:55.597234+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:11:55.597234+0000","last_undegraded":"2026-02-23T13:11:55.597234+0000","last_fullsized":"2026-02-23T13:11:55.597234+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:11:50.169094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:11:50.169094+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:57.448558+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":7952138240,"num_objects":121340,"num_object_clones":0,"num_object_copies":364020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121340,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121340,"num_write_kb":7765760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":23873716224,"data_stored":23873716224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":390,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247921,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":8141236,"kb_used_data":6726624,"kb_used_omap":17,"kb_used_meta":1414574,"kb_avail":725861964,"statfs":{"total":751619276800,"available":743282651136,"internally_reserved":0,"allocated":6888062976,"data_stored":6887497838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18190,"internal_metadata":1448524018},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,3],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444148,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5809396,"kb_used_data":5102880,"kb_used_omap":17,"kb_used_meta":706478,"kb_avail":728193804,"statfs":{"total":751619276800,"available":745670455296,"internally_reserved":0,"allocated":5225349120,"data_stored":5224783982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17810,"internal_metadata":723434094},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574966,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5805808,"kb_used_data":4752028,"kb_used_omap":17,"kb_used_meta":1053742,"kb_avail":728197392,"statfs":{"total":751619276800,"available":745674129408,"internally_reserved":0,"allocated":4866076672,"data_stored":4865515086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18148,"internal_metadata":1079032092},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705783,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6351284,"kb_used_data":5957792,"kb_used_omap":12,"kb_used_meta":393395,"kb_avail":727651916,"statfs":{"total":751619276800,"available":745115561984,"internally_reserved":0,"allocated":6100779008,"data_stored":6100213870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12406,"internal_metadata":402837386},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":390,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6462636032,"data_stored":6462636032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4970577920,"data_stored":4970577920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5475139584,"data_stored":5475139584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6965362688,"data_stored":6965362688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:12:14.466 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:12:14.466 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 211 2026-02-23T13:12:14.689 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 19 16 140279 140263 461.348 345.5 0.00173101 0.00216612 2026-02-23T13:12:14.786 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:14.977 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:14 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:12:14.977 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:14 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:12:14.977 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:14 trial046 ceph-mon[38575]: from='client.15197 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:12:14.999 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:12:15.000 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:12:15.000 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:14.944+0000 7f32b6c57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:15.000 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:14.944+0000 7f32b6c57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:15.000 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:12:15.000 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:12:15.005 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:12:15.005 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:12:15.018 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:12:15.019 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:12:15.689 INFO:tasks.radosbench.radosbench.0.trial046.stdout:2026-02-23T13:12:15.689311+0000 min lat: 0.000700939 max lat: 0.0626709 avg lat: 0.00219441 2026-02-23T13:12:15.689 INFO:tasks.radosbench.radosbench.0.trial046.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-23T13:12:15.689 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 20 16 145769 145753 455.437 343.125 0.0018013 0.00219441 2026-02-23T13:12:15.892 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:15 trial046 ceph-mon[38575]: pgmap v333: 17 pgs: 17 active+clean; 7.4 GiB data, 25 GiB used, 2.7 TiB / 2.7 TiB avail; 398 MiB/s wr, 6.37k op/s 2026-02-23T13:12:15.892 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:15 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3012468532' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:12:16.142 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:16.080+0000 7fe8a003a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:16.142 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:16.080+0000 7fe8a003a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:16.223 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:12:16.224 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:12:16 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:12:16] "GET /metrics HTTP/1.1" 200 4208 "" "Prometheus/3.6.0" 2026-02-23T13:12:16.470 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:12:16 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:12:16.085Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:12:16.689 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 21 16 150696 150680 448.412 307.938 0.00193965 0.00222881 2026-02-23T13:12:16.818 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:12:17.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:16 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:12:17.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:16 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2492896518' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "211"} : dispatch 2026-02-23T13:12:17.639 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:12:17.689 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 22 16 157634 157618 447.738 433.625 0.00303187 0.00223215 2026-02-23T13:12:17.785 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:17.946 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:17 trial046 ceph-mon[38575]: pgmap v334: 17 pgs: 17 active+clean; 8.8 GiB data, 28 GiB used, 2.7 TiB / 2.7 TiB avail; 513 MiB/s wr, 8.21k op/s 2026-02-23T13:12:18.228 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:18.152+0000 7fd875400640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:18.228 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:18.152+0000 7fd875400640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:18.228 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:12:18.228 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:12:18.229 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:12:18.229 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:12:18.229 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:12:18.229 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:12:18.230 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:12:18.230 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:12:18.689 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 23 16 162960 162944 442.743 332.875 0.00506333 0.00225357 2026-02-23T13:12:18.909 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:18 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1020304103' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:12:19.690 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 24 16 169194 169178 440.529 389.625 0.00340011 0.00226868 2026-02-23T13:12:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:19 trial046 ceph-mon[38575]: pgmap v335: 17 pgs: 17 active+clean; 9.2 GiB data, 31 GiB used, 2.7 TiB / 2.7 TiB avail; 488 MiB/s wr, 7.81k op/s 2026-02-23T13:12:20.689 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 25 16 176547 176531 441.289 459.562 0.00112668 0.00226482 2026-02-23T13:12:20.933 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:12:21.079 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:21.201 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:21.200+0000 7f78f2df5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:21.202 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:21.201+0000 7f78f2df5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:21.217 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:12:21.217 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:12:21.229 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:12:21.230 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:12:21.243 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:12:21.243 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:12:21.256 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:12:21.256 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:12:21.690 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 26 16 183558 183542 441.168 438.188 0.00236285 0.00226539 2026-02-23T13:12:21.820 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:12:21.820 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:12:21.820 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:12:21.820 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:12:21.962 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:21.989 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:21 trial046 ceph-mon[38575]: pgmap v336: 17 pgs: 17 active+clean; 9.2 GiB data, 31 GiB used, 2.7 TiB / 2.7 TiB avail; 352 MiB/s wr, 5.63k op/s 2026-02-23T13:12:21.989 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:21 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3924534445' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:12:22.086 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:22.085+0000 7f0e6b3b1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:22.086 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:22.085+0000 7f0e6b3b1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:22.238 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:12:22.238 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:12:22.287 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":336,"stamp":"2026-02-23T13:12:20.665469+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":9870180896,"num_objects":150600,"num_object_clones":0,"num_object_copies":451800,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":150600,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":150733,"num_write_kb":9640422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":32275980,"kb_used_data":28418812,"kb_used_omap":65,"kb_used_meta":3856958,"kb_avail":2903736820,"statfs":{"total":3006477107200,"available":2973426503680,"internally_reserved":0,"allocated":29100863488,"data_stored":29098606488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":67206,"internal_metadata":3949525370},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4429447168,"num_objects":67588,"num_object_clones":0,"num_object_copies":202764,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67588,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67588,"num_write_kb":4325632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001676"},"pg_stats":[{"pgid":"5.f","version":"80'9503","reported_seq":9517,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:16.666424+0000","last_change":"2026-02-23T13:11:54.596706+0000","last_active":"2026-02-23T13:12:16.666424+0000","last_peered":"2026-02-23T13:12:16.666424+0000","last_clean":"2026-02-23T13:12:16.666424+0000","last_became_active":"2026-02-23T13:11:54.595945+0000","last_became_peered":"2026-02-23T13:11:54.595945+0000","last_unstale":"2026-02-23T13:12:16.666424+0000","last_undegraded":"2026-02-23T13:12:16.666424+0000","last_fullsized":"2026-02-23T13:12:16.666424+0000","mapping_epoch":78,"log_start":"80'9500","ondisk_log_start":"80'9500","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:06.207061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622788608,"num_objects":9503,"num_object_clones":0,"num_object_copies":28509,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9503,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9503,"num_write_kb":608192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"80'9398","reported_seq":9412,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:16.654992+0000","last_change":"2026-02-23T13:11:54.599809+0000","last_active":"2026-02-23T13:12:16.654992+0000","last_peered":"2026-02-23T13:12:16.654992+0000","last_clean":"2026-02-23T13:12:16.654992+0000","last_became_active":"2026-02-23T13:11:54.599064+0000","last_became_peered":"2026-02-23T13:11:54.599064+0000","last_unstale":"2026-02-23T13:12:16.654992+0000","last_undegraded":"2026-02-23T13:12:16.654992+0000","last_fullsized":"2026-02-23T13:12:16.654992+0000","mapping_epoch":78,"log_start":"80'9395","ondisk_log_start":"80'9395","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:11.698138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":615907328,"num_objects":9398,"num_object_clones":0,"num_object_copies":28194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9398,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9398,"num_write_kb":601472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"80'9540","reported_seq":9554,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:16.663245+0000","last_change":"2026-02-23T13:11:54.596174+0000","last_active":"2026-02-23T13:12:16.663245+0000","last_peered":"2026-02-23T13:12:16.663245+0000","last_clean":"2026-02-23T13:12:16.663245+0000","last_became_active":"2026-02-23T13:11:54.595773+0000","last_became_peered":"2026-02-23T13:11:54.595773+0000","last_unstale":"2026-02-23T13:12:16.663245+0000","last_undegraded":"2026-02-23T13:12:16.663245+0000","last_fullsized":"2026-02-23T13:12:16.663245+0000","mapping_epoch":78,"log_start":"80'9537","ondisk_log_start":"80'9537","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.566475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625213440,"num_objects":9540,"num_object_clones":0,"num_object_copies":28620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9540,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9540,"num_write_kb":610560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"80'9227","reported_seq":9241,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:16.771243+0000","last_change":"2026-02-23T13:11:54.595749+0000","last_active":"2026-02-23T13:12:16.771243+0000","last_peered":"2026-02-23T13:12:16.771243+0000","last_clean":"2026-02-23T13:12:16.771243+0000","last_became_active":"2026-02-23T13:11:54.595560+0000","last_became_peered":"2026-02-23T13:11:54.595560+0000","last_unstale":"2026-02-23T13:12:16.771243+0000","last_undegraded":"2026-02-23T13:12:16.771243+0000","last_fullsized":"2026-02-23T13:12:16.771243+0000","mapping_epoch":78,"log_start":"80'9224","ondisk_log_start":"80'9224","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:11.860237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604700672,"num_objects":9227,"num_object_clones":0,"num_object_copies":27681,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9227,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9227,"num_write_kb":590528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"80'9430","reported_seq":9444,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:16.660498+0000","last_change":"2026-02-23T13:11:54.596349+0000","last_active":"2026-02-23T13:12:16.660498+0000","last_peered":"2026-02-23T13:12:16.660498+0000","last_clean":"2026-02-23T13:12:16.660498+0000","last_became_active":"2026-02-23T13:11:54.596133+0000","last_became_peered":"2026-02-23T13:11:54.596133+0000","last_unstale":"2026-02-23T13:12:16.660498+0000","last_undegraded":"2026-02-23T13:12:16.660498+0000","last_fullsized":"2026-02-23T13:12:16.660498+0000","mapping_epoch":78,"log_start":"80'9427","ondisk_log_start":"80'9427","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:03.865476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":618004480,"num_objects":9430,"num_object_clones":0,"num_object_copies":28290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9430,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9430,"num_write_kb":603520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"80'9357","reported_seq":9371,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:16.653992+0000","last_change":"2026-02-23T13:11:54.595383+0000","last_active":"2026-02-23T13:12:16.653992+0000","last_peered":"2026-02-23T13:12:16.653992+0000","last_clean":"2026-02-23T13:12:16.653992+0000","last_became_active":"2026-02-23T13:11:54.595080+0000","last_became_peered":"2026-02-23T13:11:54.595080+0000","last_unstale":"2026-02-23T13:12:16.653992+0000","last_undegraded":"2026-02-23T13:12:16.653992+0000","last_fullsized":"2026-02-23T13:12:16.653992+0000","mapping_epoch":78,"log_start":"80'9354","ondisk_log_start":"80'9354","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:12.934698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":613220352,"num_objects":9357,"num_object_clones":0,"num_object_copies":28071,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9357,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9357,"num_write_kb":598848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"80'9307","reported_seq":9321,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:16.656474+0000","last_change":"2026-02-23T13:11:54.598497+0000","last_active":"2026-02-23T13:12:16.656474+0000","last_peered":"2026-02-23T13:12:16.656474+0000","last_clean":"2026-02-23T13:12:16.656474+0000","last_became_active":"2026-02-23T13:11:54.598325+0000","last_became_peered":"2026-02-23T13:11:54.598325+0000","last_unstale":"2026-02-23T13:12:16.656474+0000","last_undegraded":"2026-02-23T13:12:16.656474+0000","last_fullsized":"2026-02-23T13:12:16.656474+0000","mapping_epoch":78,"log_start":"80'9304","ondisk_log_start":"80'9304","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:57.924450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609943552,"num_objects":9307,"num_object_clones":0,"num_object_copies":27921,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9307,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9307,"num_write_kb":595648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"80'9411","reported_seq":9425,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:16.660685+0000","last_change":"2026-02-23T13:11:54.595376+0000","last_active":"2026-02-23T13:12:16.660685+0000","last_peered":"2026-02-23T13:12:16.660685+0000","last_clean":"2026-02-23T13:12:16.660685+0000","last_became_active":"2026-02-23T13:11:54.595110+0000","last_became_peered":"2026-02-23T13:11:54.595110+0000","last_unstale":"2026-02-23T13:12:16.660685+0000","last_undegraded":"2026-02-23T13:12:16.660685+0000","last_fullsized":"2026-02-23T13:12:16.660685+0000","mapping_epoch":78,"log_start":"80'9408","ondisk_log_start":"80'9408","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:02.754608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":616759296,"num_objects":9411,"num_object_clones":0,"num_object_copies":28233,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9411,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9411,"num_write_kb":602304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"80'9554","reported_seq":9568,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:16.655961+0000","last_change":"2026-02-23T13:11:54.599364+0000","last_active":"2026-02-23T13:12:16.655961+0000","last_peered":"2026-02-23T13:12:16.655961+0000","last_clean":"2026-02-23T13:12:16.655961+0000","last_became_active":"2026-02-23T13:11:54.599155+0000","last_became_peered":"2026-02-23T13:11:54.599155+0000","last_unstale":"2026-02-23T13:12:16.655961+0000","last_undegraded":"2026-02-23T13:12:16.655961+0000","last_fullsized":"2026-02-23T13:12:16.655961+0000","mapping_epoch":78,"log_start":"80'9551","ondisk_log_start":"80'9551","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:14.711414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":626130944,"num_objects":9554,"num_object_clones":0,"num_object_copies":28662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9554,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9554,"num_write_kb":611456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"80'9480","reported_seq":9494,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:16.775669+0000","last_change":"2026-02-23T13:11:54.595872+0000","last_active":"2026-02-23T13:12:16.775669+0000","last_peered":"2026-02-23T13:12:16.775669+0000","last_clean":"2026-02-23T13:12:16.775669+0000","last_became_active":"2026-02-23T13:11:54.595645+0000","last_became_peered":"2026-02-23T13:11:54.595645+0000","last_unstale":"2026-02-23T13:12:16.775669+0000","last_undegraded":"2026-02-23T13:12:16.775669+0000","last_fullsized":"2026-02-23T13:12:16.775669+0000","mapping_epoch":78,"log_start":"80'9477","ondisk_log_start":"80'9477","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.565438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":621281280,"num_objects":9480,"num_object_clones":0,"num_object_copies":28440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9480,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9480,"num_write_kb":606720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"80'9358","reported_seq":9372,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:16.660516+0000","last_change":"2026-02-23T13:11:54.595399+0000","last_active":"2026-02-23T13:12:16.660516+0000","last_peered":"2026-02-23T13:12:16.660516+0000","last_clean":"2026-02-23T13:12:16.660516+0000","last_became_active":"2026-02-23T13:11:54.595144+0000","last_became_peered":"2026-02-23T13:11:54.595144+0000","last_unstale":"2026-02-23T13:12:16.660516+0000","last_undegraded":"2026-02-23T13:12:16.660516+0000","last_fullsized":"2026-02-23T13:12:16.660516+0000","mapping_epoch":78,"log_start":"80'9355","ondisk_log_start":"80'9355","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:16.231133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":613285888,"num_objects":9358,"num_object_clones":0,"num_object_copies":28074,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9358,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9358,"num_write_kb":598912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"80'9473","reported_seq":9487,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:16.662070+0000","last_change":"2026-02-23T13:11:54.596295+0000","last_active":"2026-02-23T13:12:16.662070+0000","last_peered":"2026-02-23T13:12:16.662070+0000","last_clean":"2026-02-23T13:12:16.662070+0000","last_became_active":"2026-02-23T13:11:54.595996+0000","last_became_peered":"2026-02-23T13:11:54.595996+0000","last_unstale":"2026-02-23T13:12:16.662070+0000","last_undegraded":"2026-02-23T13:12:16.662070+0000","last_fullsized":"2026-02-23T13:12:16.662070+0000","mapping_epoch":78,"log_start":"80'9470","ondisk_log_start":"80'9470","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.493149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":620822528,"num_objects":9473,"num_object_clones":0,"num_object_copies":28419,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9473,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9473,"num_write_kb":606272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"80'9362","reported_seq":9376,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:16.656701+0000","last_change":"2026-02-23T13:11:54.599275+0000","last_active":"2026-02-23T13:12:16.656701+0000","last_peered":"2026-02-23T13:12:16.656701+0000","last_clean":"2026-02-23T13:12:16.656701+0000","last_became_active":"2026-02-23T13:11:54.598958+0000","last_became_peered":"2026-02-23T13:11:54.598958+0000","last_unstale":"2026-02-23T13:12:16.656701+0000","last_undegraded":"2026-02-23T13:12:16.656701+0000","last_fullsized":"2026-02-23T13:12:16.656701+0000","mapping_epoch":78,"log_start":"80'9359","ondisk_log_start":"80'9359","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:13.230076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":613548032,"num_objects":9362,"num_object_clones":0,"num_object_copies":28086,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9362,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9362,"num_write_kb":599168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"80'9496","reported_seq":9510,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:16.655562+0000","last_change":"2026-02-23T13:11:54.599032+0000","last_active":"2026-02-23T13:12:16.655562+0000","last_peered":"2026-02-23T13:12:16.655562+0000","last_clean":"2026-02-23T13:12:16.655562+0000","last_became_active":"2026-02-23T13:11:54.598751+0000","last_became_peered":"2026-02-23T13:11:54.598751+0000","last_unstale":"2026-02-23T13:12:16.655562+0000","last_undegraded":"2026-02-23T13:12:16.655562+0000","last_fullsized":"2026-02-23T13:12:16.655562+0000","mapping_epoch":78,"log_start":"80'9493","ondisk_log_start":"80'9493","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:59.904586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622329856,"num_objects":9496,"num_object_clones":0,"num_object_copies":28488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9496,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9496,"num_write_kb":607744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"80'9361","reported_seq":9375,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:16.661751+0000","last_change":"2026-02-23T13:11:54.596162+0000","last_active":"2026-02-23T13:12:16.661751+0000","last_peered":"2026-02-23T13:12:16.661751+0000","last_clean":"2026-02-23T13:12:16.661751+0000","last_became_active":"2026-02-23T13:11:54.595840+0000","last_became_peered":"2026-02-23T13:11:54.595840+0000","last_unstale":"2026-02-23T13:12:16.661751+0000","last_undegraded":"2026-02-23T13:12:16.661751+0000","last_fullsized":"2026-02-23T13:12:16.661751+0000","mapping_epoch":78,"log_start":"80'9358","ondisk_log_start":"80'9358","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:57.412771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":613482496,"num_objects":9361,"num_object_clones":0,"num_object_copies":28083,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9361,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9361,"num_write_kb":599104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"80'9341","reported_seq":9355,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:16.666801+0000","last_change":"2026-02-23T13:11:54.596007+0000","last_active":"2026-02-23T13:12:16.666801+0000","last_peered":"2026-02-23T13:12:16.666801+0000","last_clean":"2026-02-23T13:12:16.666801+0000","last_became_active":"2026-02-23T13:11:54.595287+0000","last_became_peered":"2026-02-23T13:11:54.595287+0000","last_unstale":"2026-02-23T13:12:16.666801+0000","last_undegraded":"2026-02-23T13:12:16.666801+0000","last_fullsized":"2026-02-23T13:12:16.666801+0000","mapping_epoch":78,"log_start":"80'9338","ondisk_log_start":"80'9338","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:03.108821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":612171776,"num_objects":9341,"num_object_clones":0,"num_object_copies":28023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9341,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9341,"num_write_kb":597824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":348,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:11:55.597234+0000","last_change":"2026-02-23T13:11:50.169148+0000","last_active":"2026-02-23T13:11:55.597234+0000","last_peered":"2026-02-23T13:11:55.597234+0000","last_clean":"2026-02-23T13:11:55.597234+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:11:55.597234+0000","last_undegraded":"2026-02-23T13:11:55.597234+0000","last_fullsized":"2026-02-23T13:11:55.597234+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:11:50.169094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:11:50.169094+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:57.448558+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":9869590528,"num_objects":150598,"num_object_clones":0,"num_object_copies":451794,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":150598,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150598,"num_write_kb":9638272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":29622009856,"data_stored":29622009856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":390,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247922,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":9900084,"kb_used_data":8413216,"kb_used_omap":17,"kb_used_meta":1486766,"kb_avail":724103116,"statfs":{"total":751619276800,"available":741481590784,"internally_reserved":0,"allocated":8615133184,"data_stored":8614568046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18190,"internal_metadata":1522448626},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444149,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":7187636,"kb_used_data":6426976,"kb_used_omap":17,"kb_used_meta":760622,"kb_avail":726815564,"statfs":{"total":751619276800,"available":744259137536,"internally_reserved":0,"allocated":6581223424,"data_stored":6580658286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17810,"internal_metadata":778877550},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574967,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":7114288,"kb_used_data":5988316,"kb_used_omap":18,"kb_used_meta":1125933,"kb_avail":726888912,"statfs":{"total":751619276800,"available":744334245888,"internally_reserved":0,"allocated":6132035584,"data_stored":6131473998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18800,"internal_metadata":1152956048},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705784,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":8073972,"kb_used_data":7590304,"kb_used_omap":12,"kb_used_meta":483635,"kb_avail":725929228,"statfs":{"total":751619276800,"available":743351529472,"internally_reserved":0,"allocated":7772471296,"data_stored":7771906158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12406,"internal_metadata":495243146},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":390,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8023900160,"data_stored":8023900160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6169231360,"data_stored":6169231360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6781009920,"data_stored":6781009920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8647868416,"data_stored":8647868416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:12:22.287 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:12:22.288 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 221 2026-02-23T13:12:22.427 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:22.556 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:22.554+0000 7fbc33d6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:22.556 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:22.555+0000 7fbc33d6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:22.690 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 27 16 190836 190820 441.675 454.875 0.00231262 0.00226282 2026-02-23T13:12:22.695 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:12:22.734 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:12:23.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:22 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2958345415' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "221"} : dispatch 2026-02-23T13:12:23.300 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:12:23.447 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:23.577 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:23.576+0000 7f02edfa1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:23.577 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:23.576+0000 7f02edfa1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:23.594 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:12:23.595 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:12:23.607 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:12:23.608 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:12:23.620 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:12:23.620 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:12:23.634 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:12:23.634 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:12:23.690 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 28 16 197910 197894 441.69 442.125 0.00104954 0.00226277 2026-02-23T13:12:24.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:23 trial046 ceph-mon[38575]: from='client.15207 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:12:24.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:23 trial046 ceph-mon[38575]: pgmap v337: 17 pgs: 17 active+clean; 11 GiB data, 36 GiB used, 2.7 TiB / 2.7 TiB avail; 523 MiB/s wr, 8.37k op/s 2026-02-23T13:12:24.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:23 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1408680571' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:12:24.690 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 29 15 205138 205123 442.037 451.812 0.00163769 0.00226097 2026-02-23T13:12:25.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:24 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:12:25.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:24 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:12:25.690 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 30 16 212478 212462 442.591 458.688 0.00192906 0.00225815 2026-02-23T13:12:25.692 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:12:25.831 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:25.985 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:25 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:12:25.985 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:25 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:12:25.985 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:25 trial046 ceph-mon[38575]: pgmap v338: 17 pgs: 17 active+clean; 11 GiB data, 36 GiB used, 2.7 TiB / 2.7 TiB avail; 324 MiB/s wr, 5.18k op/s 2026-02-23T13:12:25.985 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:25 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:12:25.985 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:25 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:12:26.121 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:26.110+0000 7fc3394fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:26.121 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:26.110+0000 7fc3394fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:26.134 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:12:26.134 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:12:26.146 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:12:26.147 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:12:26.159 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:12:26.159 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:12:26.173 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:12:26.173 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:12:26.289 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:12:26 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:12:26] "GET /metrics HTTP/1.1" 200 4208 "" "Prometheus/3.6.0" 2026-02-23T13:12:26.561 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:12:26 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:12:26.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:12:26.690 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 31 16 217682 217666 438.805 325.25 0.0015287 0.00227767 2026-02-23T13:12:27.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:26 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/880534446' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:12:27.690 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 32 16 224609 224593 438.621 432.938 0.00191689 0.00227861 2026-02-23T13:12:27.735 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:12:27.736 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:12:27.736 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:12:27.881 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:27.998 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:27 trial046 ceph-mon[38575]: pgmap v339: 17 pgs: 17 active+clean; 13 GiB data, 40 GiB used, 2.7 TiB / 2.7 TiB avail; 456 MiB/s wr, 7.29k op/s 2026-02-23T13:12:28.310 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:28.265+0000 7f7f4c543640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:28.310 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:28.265+0000 7f7f4c543640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:28.401 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:12:28.402 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:12:28.448 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":339,"stamp":"2026-02-23T13:12:26.666321+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":13685031456,"num_objects":208810,"num_object_clones":0,"num_object_copies":626430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":208810,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":208943,"num_write_kb":13365862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":42358540,"kb_used_data":38537404,"kb_used_omap":63,"kb_used_meta":3820992,"kb_avail":2893654260,"statfs":{"total":3006477107200,"available":2963101962240,"internally_reserved":0,"allocated":39462301696,"data_stored":39460044696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":65387,"internal_metadata":3912695957},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9,5],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5732302848,"num_objects":87468,"num_object_clones":0,"num_object_copies":262404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87468,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87468,"num_write_kb":5597952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001632"},"pg_stats":[{"pgid":"5.f","version":"80'11570","reported_seq":11584,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:21.667123+0000","last_change":"2026-02-23T13:11:54.596706+0000","last_active":"2026-02-23T13:12:21.667123+0000","last_peered":"2026-02-23T13:12:21.667123+0000","last_clean":"2026-02-23T13:12:21.667123+0000","last_became_active":"2026-02-23T13:11:54.595945+0000","last_became_peered":"2026-02-23T13:11:54.595945+0000","last_unstale":"2026-02-23T13:12:21.667123+0000","last_undegraded":"2026-02-23T13:12:21.667123+0000","last_fullsized":"2026-02-23T13:12:21.667123+0000","mapping_epoch":78,"log_start":"80'11567","ondisk_log_start":"80'11567","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:06.207061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":758251520,"num_objects":11570,"num_object_clones":0,"num_object_copies":34710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11570,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11570,"num_write_kb":740480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"80'13518","reported_seq":13532,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:26.654918+0000","last_change":"2026-02-23T13:11:54.599809+0000","last_active":"2026-02-23T13:12:26.654918+0000","last_peered":"2026-02-23T13:12:26.654918+0000","last_clean":"2026-02-23T13:12:26.654918+0000","last_became_active":"2026-02-23T13:11:54.599064+0000","last_became_peered":"2026-02-23T13:11:54.599064+0000","last_unstale":"2026-02-23T13:12:26.654918+0000","last_undegraded":"2026-02-23T13:12:26.654918+0000","last_fullsized":"2026-02-23T13:12:26.654918+0000","mapping_epoch":78,"log_start":"80'13515","ondisk_log_start":"80'13515","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:11.698138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":885915648,"num_objects":13518,"num_object_clones":0,"num_object_copies":40554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13518,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13518,"num_write_kb":865152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"80'13754","reported_seq":13768,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:26.661113+0000","last_change":"2026-02-23T13:11:54.596174+0000","last_active":"2026-02-23T13:12:26.661113+0000","last_peered":"2026-02-23T13:12:26.661113+0000","last_clean":"2026-02-23T13:12:26.661113+0000","last_became_active":"2026-02-23T13:11:54.595773+0000","last_became_peered":"2026-02-23T13:11:54.595773+0000","last_unstale":"2026-02-23T13:12:26.661113+0000","last_undegraded":"2026-02-23T13:12:26.661113+0000","last_fullsized":"2026-02-23T13:12:26.661113+0000","mapping_epoch":78,"log_start":"80'13751","ondisk_log_start":"80'13751","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.566475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":901382144,"num_objects":13754,"num_object_clones":0,"num_object_copies":41262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13754,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13754,"num_write_kb":880256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"80'11292","reported_seq":11306,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:21.772287+0000","last_change":"2026-02-23T13:11:54.595749+0000","last_active":"2026-02-23T13:12:21.772287+0000","last_peered":"2026-02-23T13:12:21.772287+0000","last_clean":"2026-02-23T13:12:21.772287+0000","last_became_active":"2026-02-23T13:11:54.595560+0000","last_became_peered":"2026-02-23T13:11:54.595560+0000","last_unstale":"2026-02-23T13:12:21.772287+0000","last_undegraded":"2026-02-23T13:12:21.772287+0000","last_fullsized":"2026-02-23T13:12:21.772287+0000","mapping_epoch":78,"log_start":"80'11289","ondisk_log_start":"80'11289","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:11.860237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":740032512,"num_objects":11292,"num_object_clones":0,"num_object_copies":33876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11292,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11292,"num_write_kb":722688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"80'13569","reported_seq":13583,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:26.662990+0000","last_change":"2026-02-23T13:11:54.596349+0000","last_active":"2026-02-23T13:12:26.662990+0000","last_peered":"2026-02-23T13:12:26.662990+0000","last_clean":"2026-02-23T13:12:26.662990+0000","last_became_active":"2026-02-23T13:11:54.596133+0000","last_became_peered":"2026-02-23T13:11:54.596133+0000","last_unstale":"2026-02-23T13:12:26.662990+0000","last_undegraded":"2026-02-23T13:12:26.662990+0000","last_fullsized":"2026-02-23T13:12:26.662990+0000","mapping_epoch":78,"log_start":"80'13566","ondisk_log_start":"80'13566","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:03.865476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":889257984,"num_objects":13569,"num_object_clones":0,"num_object_copies":40707,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13569,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13569,"num_write_kb":868416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"80'13466","reported_seq":13480,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:26.664832+0000","last_change":"2026-02-23T13:11:54.595383+0000","last_active":"2026-02-23T13:12:26.664832+0000","last_peered":"2026-02-23T13:12:26.664832+0000","last_clean":"2026-02-23T13:12:26.664832+0000","last_became_active":"2026-02-23T13:11:54.595080+0000","last_became_peered":"2026-02-23T13:11:54.595080+0000","last_unstale":"2026-02-23T13:12:26.664832+0000","last_undegraded":"2026-02-23T13:12:26.664832+0000","last_fullsized":"2026-02-23T13:12:26.664832+0000","mapping_epoch":78,"log_start":"80'13463","ondisk_log_start":"80'13463","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:12.934698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":882507776,"num_objects":13466,"num_object_clones":0,"num_object_copies":40398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13466,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13466,"num_write_kb":861824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"80'13490","reported_seq":13504,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:26.657847+0000","last_change":"2026-02-23T13:11:54.598497+0000","last_active":"2026-02-23T13:12:26.657847+0000","last_peered":"2026-02-23T13:12:26.657847+0000","last_clean":"2026-02-23T13:12:26.657847+0000","last_became_active":"2026-02-23T13:11:54.598325+0000","last_became_peered":"2026-02-23T13:11:54.598325+0000","last_unstale":"2026-02-23T13:12:26.657847+0000","last_undegraded":"2026-02-23T13:12:26.657847+0000","last_fullsized":"2026-02-23T13:12:26.657847+0000","mapping_epoch":78,"log_start":"80'13487","ondisk_log_start":"80'13487","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:57.924450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":884080640,"num_objects":13490,"num_object_clones":0,"num_object_copies":40470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13490,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13490,"num_write_kb":863360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"80'13550","reported_seq":13563,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:26.660840+0000","last_change":"2026-02-23T13:11:54.595376+0000","last_active":"2026-02-23T13:12:26.660840+0000","last_peered":"2026-02-23T13:12:26.660840+0000","last_clean":"2026-02-23T13:12:26.660840+0000","last_became_active":"2026-02-23T13:11:54.595110+0000","last_became_peered":"2026-02-23T13:11:54.595110+0000","last_unstale":"2026-02-23T13:12:26.660840+0000","last_undegraded":"2026-02-23T13:12:26.660840+0000","last_fullsized":"2026-02-23T13:12:26.660840+0000","mapping_epoch":78,"log_start":"80'13547","ondisk_log_start":"80'13547","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:02.754608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":888012800,"num_objects":13550,"num_object_clones":0,"num_object_copies":40650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13550,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13550,"num_write_kb":867200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"80'13758","reported_seq":13772,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:26.660349+0000","last_change":"2026-02-23T13:11:54.599364+0000","last_active":"2026-02-23T13:12:26.660349+0000","last_peered":"2026-02-23T13:12:26.660349+0000","last_clean":"2026-02-23T13:12:26.660349+0000","last_became_active":"2026-02-23T13:11:54.599155+0000","last_became_peered":"2026-02-23T13:11:54.599155+0000","last_unstale":"2026-02-23T13:12:26.660349+0000","last_undegraded":"2026-02-23T13:12:26.660349+0000","last_fullsized":"2026-02-23T13:12:26.660349+0000","mapping_epoch":78,"log_start":"80'13755","ondisk_log_start":"80'13755","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:14.711414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":901644288,"num_objects":13758,"num_object_clones":0,"num_object_copies":41274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13758,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13758,"num_write_kb":880512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"80'11495","reported_seq":11509,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:21.779307+0000","last_change":"2026-02-23T13:11:54.595872+0000","last_active":"2026-02-23T13:12:21.779307+0000","last_peered":"2026-02-23T13:12:21.779307+0000","last_clean":"2026-02-23T13:12:21.779307+0000","last_became_active":"2026-02-23T13:11:54.595645+0000","last_became_peered":"2026-02-23T13:11:54.595645+0000","last_unstale":"2026-02-23T13:12:21.779307+0000","last_undegraded":"2026-02-23T13:12:21.779307+0000","last_fullsized":"2026-02-23T13:12:21.779307+0000","mapping_epoch":78,"log_start":"80'11492","ondisk_log_start":"80'11492","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.565438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":753336320,"num_objects":11495,"num_object_clones":0,"num_object_copies":34485,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11495,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11495,"num_write_kb":735680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"80'13538","reported_seq":13552,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:26.662554+0000","last_change":"2026-02-23T13:11:54.595399+0000","last_active":"2026-02-23T13:12:26.662554+0000","last_peered":"2026-02-23T13:12:26.662554+0000","last_clean":"2026-02-23T13:12:26.662554+0000","last_became_active":"2026-02-23T13:11:54.595144+0000","last_became_peered":"2026-02-23T13:11:54.595144+0000","last_unstale":"2026-02-23T13:12:26.662554+0000","last_undegraded":"2026-02-23T13:12:26.662554+0000","last_fullsized":"2026-02-23T13:12:26.662554+0000","mapping_epoch":78,"log_start":"80'13535","ondisk_log_start":"80'13535","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:16.231133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":887226368,"num_objects":13538,"num_object_clones":0,"num_object_copies":40614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13538,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13538,"num_write_kb":866432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"80'13606","reported_seq":13620,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:26.664108+0000","last_change":"2026-02-23T13:11:54.596295+0000","last_active":"2026-02-23T13:12:26.664108+0000","last_peered":"2026-02-23T13:12:26.664108+0000","last_clean":"2026-02-23T13:12:26.664108+0000","last_became_active":"2026-02-23T13:11:54.595996+0000","last_became_peered":"2026-02-23T13:11:54.595996+0000","last_unstale":"2026-02-23T13:12:26.664108+0000","last_undegraded":"2026-02-23T13:12:26.664108+0000","last_fullsized":"2026-02-23T13:12:26.664108+0000","mapping_epoch":78,"log_start":"80'13603","ondisk_log_start":"80'13603","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.493149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":891682816,"num_objects":13606,"num_object_clones":0,"num_object_copies":40818,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13606,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13606,"num_write_kb":870784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"80'13553","reported_seq":13566,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:26.658389+0000","last_change":"2026-02-23T13:11:54.599275+0000","last_active":"2026-02-23T13:12:26.658389+0000","last_peered":"2026-02-23T13:12:26.658389+0000","last_clean":"2026-02-23T13:12:26.658389+0000","last_became_active":"2026-02-23T13:11:54.598958+0000","last_became_peered":"2026-02-23T13:11:54.598958+0000","last_unstale":"2026-02-23T13:12:26.658389+0000","last_undegraded":"2026-02-23T13:12:26.658389+0000","last_fullsized":"2026-02-23T13:12:26.658389+0000","mapping_epoch":78,"log_start":"80'13550","ondisk_log_start":"80'13550","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:13.230076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":888209408,"num_objects":13553,"num_object_clones":0,"num_object_copies":40659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13553,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13553,"num_write_kb":867392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"80'13637","reported_seq":13651,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:26.657445+0000","last_change":"2026-02-23T13:11:54.599032+0000","last_active":"2026-02-23T13:12:26.657445+0000","last_peered":"2026-02-23T13:12:26.657445+0000","last_clean":"2026-02-23T13:12:26.657445+0000","last_became_active":"2026-02-23T13:11:54.598751+0000","last_became_peered":"2026-02-23T13:11:54.598751+0000","last_unstale":"2026-02-23T13:12:26.657445+0000","last_undegraded":"2026-02-23T13:12:26.657445+0000","last_fullsized":"2026-02-23T13:12:26.657445+0000","mapping_epoch":78,"log_start":"80'13634","ondisk_log_start":"80'13634","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:59.904586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":893714432,"num_objects":13637,"num_object_clones":0,"num_object_copies":40911,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13637,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13637,"num_write_kb":872768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"80'13598","reported_seq":13612,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:26.662374+0000","last_change":"2026-02-23T13:11:54.596162+0000","last_active":"2026-02-23T13:12:26.662374+0000","last_peered":"2026-02-23T13:12:26.662374+0000","last_clean":"2026-02-23T13:12:26.662374+0000","last_became_active":"2026-02-23T13:11:54.595840+0000","last_became_peered":"2026-02-23T13:11:54.595840+0000","last_unstale":"2026-02-23T13:12:26.662374+0000","last_undegraded":"2026-02-23T13:12:26.662374+0000","last_fullsized":"2026-02-23T13:12:26.662374+0000","mapping_epoch":78,"log_start":"80'13595","ondisk_log_start":"80'13595","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:57.412771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":891158528,"num_objects":13598,"num_object_clones":0,"num_object_copies":40794,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13598,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13598,"num_write_kb":870272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"80'11414","reported_seq":11428,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:12:21.664726+0000","last_change":"2026-02-23T13:11:54.596007+0000","last_active":"2026-02-23T13:12:21.664726+0000","last_peered":"2026-02-23T13:12:21.664726+0000","last_clean":"2026-02-23T13:12:21.664726+0000","last_became_active":"2026-02-23T13:11:54.595287+0000","last_became_peered":"2026-02-23T13:11:54.595287+0000","last_unstale":"2026-02-23T13:12:21.664726+0000","last_undegraded":"2026-02-23T13:12:21.664726+0000","last_fullsized":"2026-02-23T13:12:21.664726+0000","mapping_epoch":78,"log_start":"80'11411","ondisk_log_start":"80'11411","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:03.108821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":748027904,"num_objects":11414,"num_object_clones":0,"num_object_copies":34242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11414,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11414,"num_write_kb":730496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":348,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-23T13:11:55.597234+0000","last_change":"2026-02-23T13:11:50.169148+0000","last_active":"2026-02-23T13:11:55.597234+0000","last_peered":"2026-02-23T13:11:55.597234+0000","last_clean":"2026-02-23T13:11:55.597234+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:11:55.597234+0000","last_undegraded":"2026-02-23T13:11:55.597234+0000","last_fullsized":"2026-02-23T13:11:55.597234+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:11:50.169094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:11:50.169094+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:57.448558+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":13684441088,"num_objects":208808,"num_object_clones":0,"num_object_copies":626424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":208808,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208808,"num_write_kb":13363712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":39847329792,"data_stored":39847329792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247924,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":13215604,"kb_used_data":12143776,"kb_used_omap":15,"kb_used_meta":1071792,"kb_avail":720787596,"statfs":{"total":751619276800,"available":738086498304,"internally_reserved":0,"allocated":12435226624,"data_stored":12434661486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15719,"internal_metadata":1097515673},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,3],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444150,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":8618036,"kb_used_data":7785184,"kb_used_omap":17,"kb_used_meta":832814,"kb_avail":725385164,"statfs":{"total":751619276800,"available":742794407936,"internally_reserved":0,"allocated":7972028416,"data_stored":7971463278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17810,"internal_metadata":852802158},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574968,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":8493104,"kb_used_data":7294940,"kb_used_omap":18,"kb_used_meta":1198125,"kb_avail":725510096,"statfs":{"total":751619276800,"available":742922338304,"internally_reserved":0,"allocated":7470018560,"data_stored":7469456974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18800,"internal_metadata":1226880656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705786,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":12031796,"kb_used_data":11313504,"kb_used_omap":12,"kb_used_meta":718259,"kb_avail":721971404,"statfs":{"total":751619276800,"available":739298717696,"internally_reserved":0,"allocated":11585028096,"data_stored":11584462958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13058,"internal_metadata":735497470},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11584864256,"data_stored":11584864256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7516717056,"data_stored":7516717056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8264417280,"data_stored":8264417280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12481331200,"data_stored":12481331200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:12:28.690 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 33 15 230835 230820 437.122 389.188 0.00260271 0.00228645 2026-02-23T13:12:28.816 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:12:28.955 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:29.072 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:29.070+0000 7f3070d83640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:29.072 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:29.070+0000 7f3070d83640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:29.088 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:12:29.088 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:12:29.101 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:12:29.101 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:12:29.114 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:12:29.115 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:12:29.127 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:12:29.127 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:12:29.690 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 34 15 238037 238022 437.503 450.125 0.00287871 0.0022845 2026-02-23T13:12:30.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:29 trial046 ceph-mon[38575]: from='client.15215 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:12:30.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:29 trial046 ceph-mon[38575]: pgmap v340: 17 pgs: 17 active+clean; 13 GiB data, 43 GiB used, 2.7 TiB / 2.7 TiB avail; 386 MiB/s wr, 6.18k op/s 2026-02-23T13:12:30.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:29 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2054366187' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:12:30.690 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 35 16 245452 245436 438.242 463.375 0.00157316 0.00228063 2026-02-23T13:12:31.171 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:12:31.308 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:31.436 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:31.434+0000 7f2fd4ce6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:31.436 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:31.434+0000 7f2fd4ce6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:31.451 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:12:31.452 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:12:31.465 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:12:31.465 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:12:31.477 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:12:31.478 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:12:31.490 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:12:31.490 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:12:31.690 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 36 16 252594 252578 438.467 446.375 0.00148297 0.00227945 2026-02-23T13:12:32.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:31 trial046 ceph-mon[38575]: pgmap v341: 17 pgs: 17 active+clean; 13 GiB data, 43 GiB used, 2.7 TiB / 2.7 TiB avail; 349 MiB/s wr, 5.58k op/s 2026-02-23T13:12:32.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:31 trial046 ceph-mon[38575]: osdmap e81: 4 total, 4 up, 4 in 2026-02-23T13:12:32.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:31 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:12:32.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:31 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2168375518' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:12:32.690 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 37 16 259771 259755 438.738 448.562 0.00223786 0.00227803 2026-02-23T13:12:33.450 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:12:33.450 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:12:33.450 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_3 2026-02-23T13:12:33.451 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:12:33.534 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:12:33.596 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:33.690 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 38 16 267203 267187 439.415 464.5 0.0027566 0.0022745 2026-02-23T13:12:33.779 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:33.997 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:33 trial046 ceph-mon[38575]: pgmap v343: 17 pgs: 17 active+clean; 15 GiB data, 50 GiB used, 2.7 TiB / 2.7 TiB avail; 431 MiB/s wr, 6.90k op/s 2026-02-23T13:12:34.070 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:33.995+0000 7eff3347e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:34.070 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:33.995+0000 7eff3347e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:34.136 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:12:34.136 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:12:34.601 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:34.579+0000 7f0183f17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:34.602 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:34.580+0000 7f0183f17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:34.608 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:12:34.608 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:12:34.621 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:12:34.622 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:12:34.638 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:12:34.638 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:12:34.652 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:12:34.653 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:12:34.691 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 39 16 272943 272927 437.346 358.75 0.0010708 0.00228528 2026-02-23T13:12:35.690 INFO:tasks.radosbench.radosbench.0.trial046.stdout:2026-02-23T13:12:35.690852+0000 min lat: 0.000700939 max lat: 0.0626709 avg lat: 0.00229982 2026-02-23T13:12:35.691 INFO:tasks.radosbench.radosbench.0.trial046.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-23T13:12:35.691 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 40 16 278018 278002 434.342 317.188 0.0308113 0.00229982 2026-02-23T13:12:35.854 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:35 trial046 ceph-mon[38575]: from='client.15221 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:12:35.854 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:35 trial046 ceph-mon[38575]: osdmap e82: 4 total, 4 up, 4 in 2026-02-23T13:12:35.854 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:35 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4084971549' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:12:35.855 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:35 trial046 ceph-mon[38575]: pgmap v345: 17 pgs: 17 active+clean; 15 GiB data, 50 GiB used, 2.7 TiB / 2.7 TiB avail; 341 MiB/s wr, 5.46k op/s 2026-02-23T13:12:35.878 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2026-02-23T13:12:32.667208+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16547643936,"num_objects":252490,"num_object_clones":0,"num_object_copies":757470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252490,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":252623,"num_write_kb":16161382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":52136688,"kb_used_data":47756064,"kb_used_omap":66,"kb_used_meta":4380477,"kb_avail":2883876112,"statfs":{"total":3006477107200,"available":2953089138688,"internally_reserved":0,"allocated":48902209536,"data_stored":48899929025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":67997,"internal_metadata":4485609059},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,5,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4522311680,"num_objects":69005,"num_object_clones":0,"num_object_copies":207015,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69005,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69005,"num_write_kb":4416320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001459"},"pg_stats":[{"pgid":"5.f","version":"81'15934","reported_seq":15950,"reported_epoch":81,"state":"active+clean","last_fresh":"2026-02-23T13:12:31.661600+0000","last_change":"2026-02-23T13:11:54.596706+0000","last_active":"2026-02-23T13:12:31.661600+0000","last_peered":"2026-02-23T13:12:31.661600+0000","last_clean":"2026-02-23T13:12:31.661600+0000","last_became_active":"2026-02-23T13:11:54.595945+0000","last_became_peered":"2026-02-23T13:11:54.595945+0000","last_unstale":"2026-02-23T13:12:31.661600+0000","last_undegraded":"2026-02-23T13:12:31.661600+0000","last_fullsized":"2026-02-23T13:12:31.661600+0000","mapping_epoch":78,"log_start":"81'15931","ondisk_log_start":"81'15931","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:06.207061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1044250624,"num_objects":15934,"num_object_clones":0,"num_object_copies":47802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15934,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15934,"num_write_kb":1019776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"81'15719","reported_seq":15735,"reported_epoch":81,"state":"active+clean","last_fresh":"2026-02-23T13:12:31.656479+0000","last_change":"2026-02-23T13:11:54.599809+0000","last_active":"2026-02-23T13:12:31.656479+0000","last_peered":"2026-02-23T13:12:31.656479+0000","last_clean":"2026-02-23T13:12:31.656479+0000","last_became_active":"2026-02-23T13:11:54.599064+0000","last_became_peered":"2026-02-23T13:11:54.599064+0000","last_unstale":"2026-02-23T13:12:31.656479+0000","last_undegraded":"2026-02-23T13:12:31.656479+0000","last_fullsized":"2026-02-23T13:12:31.656479+0000","mapping_epoch":78,"log_start":"81'15716","ondisk_log_start":"81'15716","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:11.698138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1030160384,"num_objects":15719,"num_object_clones":0,"num_object_copies":47157,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15719,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15719,"num_write_kb":1006016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"81'15994","reported_seq":16010,"reported_epoch":81,"state":"active+clean","last_fresh":"2026-02-23T13:12:31.664639+0000","last_change":"2026-02-23T13:11:54.596174+0000","last_active":"2026-02-23T13:12:31.664639+0000","last_peered":"2026-02-23T13:12:31.664639+0000","last_clean":"2026-02-23T13:12:31.664639+0000","last_became_active":"2026-02-23T13:11:54.595773+0000","last_became_peered":"2026-02-23T13:11:54.595773+0000","last_unstale":"2026-02-23T13:12:31.664639+0000","last_undegraded":"2026-02-23T13:12:31.664639+0000","last_fullsized":"2026-02-23T13:12:31.664639+0000","mapping_epoch":78,"log_start":"81'15991","ondisk_log_start":"81'15991","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.566475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048182784,"num_objects":15994,"num_object_clones":0,"num_object_copies":47982,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15994,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15994,"num_write_kb":1023616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"81'15659","reported_seq":15675,"reported_epoch":81,"state":"active+clean","last_fresh":"2026-02-23T13:12:31.776368+0000","last_change":"2026-02-23T13:11:54.595749+0000","last_active":"2026-02-23T13:12:31.776368+0000","last_peered":"2026-02-23T13:12:31.776368+0000","last_clean":"2026-02-23T13:12:31.776368+0000","last_became_active":"2026-02-23T13:11:54.595560+0000","last_became_peered":"2026-02-23T13:11:54.595560+0000","last_unstale":"2026-02-23T13:12:31.776368+0000","last_undegraded":"2026-02-23T13:12:31.776368+0000","last_fullsized":"2026-02-23T13:12:31.776368+0000","mapping_epoch":78,"log_start":"81'15656","ondisk_log_start":"81'15656","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:11.860237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1026228224,"num_objects":15659,"num_object_clones":0,"num_object_copies":46977,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15659,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15659,"num_write_kb":1002176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"81'15698","reported_seq":15714,"reported_epoch":81,"state":"active+clean","last_fresh":"2026-02-23T13:12:31.662393+0000","last_change":"2026-02-23T13:11:54.596349+0000","last_active":"2026-02-23T13:12:31.662393+0000","last_peered":"2026-02-23T13:12:31.662393+0000","last_clean":"2026-02-23T13:12:31.662393+0000","last_became_active":"2026-02-23T13:11:54.596133+0000","last_became_peered":"2026-02-23T13:11:54.596133+0000","last_unstale":"2026-02-23T13:12:31.662393+0000","last_undegraded":"2026-02-23T13:12:31.662393+0000","last_fullsized":"2026-02-23T13:12:31.662393+0000","mapping_epoch":78,"log_start":"81'15695","ondisk_log_start":"81'15695","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:03.865476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1028784128,"num_objects":15698,"num_object_clones":0,"num_object_copies":47094,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15698,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15698,"num_write_kb":1004672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"81'15647","reported_seq":15663,"reported_epoch":81,"state":"active+clean","last_fresh":"2026-02-23T13:12:31.660756+0000","last_change":"2026-02-23T13:11:54.595383+0000","last_active":"2026-02-23T13:12:31.660756+0000","last_peered":"2026-02-23T13:12:31.660756+0000","last_clean":"2026-02-23T13:12:31.660756+0000","last_became_active":"2026-02-23T13:11:54.595080+0000","last_became_peered":"2026-02-23T13:11:54.595080+0000","last_unstale":"2026-02-23T13:12:31.660756+0000","last_undegraded":"2026-02-23T13:12:31.660756+0000","last_fullsized":"2026-02-23T13:12:31.660756+0000","mapping_epoch":78,"log_start":"81'15644","ondisk_log_start":"81'15644","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:12.934698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1025441792,"num_objects":15647,"num_object_clones":0,"num_object_copies":46941,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15647,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15647,"num_write_kb":1001408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"81'15651","reported_seq":15667,"reported_epoch":81,"state":"active+clean","last_fresh":"2026-02-23T13:12:31.653931+0000","last_change":"2026-02-23T13:11:54.598497+0000","last_active":"2026-02-23T13:12:31.653931+0000","last_peered":"2026-02-23T13:12:31.653931+0000","last_clean":"2026-02-23T13:12:31.653931+0000","last_became_active":"2026-02-23T13:11:54.598325+0000","last_became_peered":"2026-02-23T13:11:54.598325+0000","last_unstale":"2026-02-23T13:12:31.653931+0000","last_undegraded":"2026-02-23T13:12:31.653931+0000","last_fullsized":"2026-02-23T13:12:31.653931+0000","mapping_epoch":78,"log_start":"81'15648","ondisk_log_start":"81'15648","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:57.924450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1025703936,"num_objects":15651,"num_object_clones":0,"num_object_copies":46953,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15651,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15651,"num_write_kb":1001664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"81'15739","reported_seq":15755,"reported_epoch":81,"state":"active+clean","last_fresh":"2026-02-23T13:12:31.659574+0000","last_change":"2026-02-23T13:11:54.595376+0000","last_active":"2026-02-23T13:12:31.659574+0000","last_peered":"2026-02-23T13:12:31.659574+0000","last_clean":"2026-02-23T13:12:31.659574+0000","last_became_active":"2026-02-23T13:11:54.595110+0000","last_became_peered":"2026-02-23T13:11:54.595110+0000","last_unstale":"2026-02-23T13:12:31.659574+0000","last_undegraded":"2026-02-23T13:12:31.659574+0000","last_fullsized":"2026-02-23T13:12:31.659574+0000","mapping_epoch":78,"log_start":"81'15736","ondisk_log_start":"81'15736","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:02.754608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1031471104,"num_objects":15739,"num_object_clones":0,"num_object_copies":47217,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15739,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15739,"num_write_kb":1007296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"81'15995","reported_seq":16011,"reported_epoch":81,"state":"active+clean","last_fresh":"2026-02-23T13:12:31.657539+0000","last_change":"2026-02-23T13:11:54.599364+0000","last_active":"2026-02-23T13:12:31.657539+0000","last_peered":"2026-02-23T13:12:31.657539+0000","last_clean":"2026-02-23T13:12:31.657539+0000","last_became_active":"2026-02-23T13:11:54.599155+0000","last_became_peered":"2026-02-23T13:11:54.599155+0000","last_unstale":"2026-02-23T13:12:31.657539+0000","last_undegraded":"2026-02-23T13:12:31.657539+0000","last_fullsized":"2026-02-23T13:12:31.657539+0000","mapping_epoch":78,"log_start":"81'15992","ondisk_log_start":"81'15992","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:14.711414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048248320,"num_objects":15995,"num_object_clones":0,"num_object_copies":47985,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15995,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15995,"num_write_kb":1023680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"81'15934","reported_seq":15950,"reported_epoch":81,"state":"active+clean","last_fresh":"2026-02-23T13:12:31.779680+0000","last_change":"2026-02-23T13:11:54.595872+0000","last_active":"2026-02-23T13:12:31.779680+0000","last_peered":"2026-02-23T13:12:31.779680+0000","last_clean":"2026-02-23T13:12:31.779680+0000","last_became_active":"2026-02-23T13:11:54.595645+0000","last_became_peered":"2026-02-23T13:11:54.595645+0000","last_unstale":"2026-02-23T13:12:31.779680+0000","last_undegraded":"2026-02-23T13:12:31.779680+0000","last_fullsized":"2026-02-23T13:12:31.779680+0000","mapping_epoch":78,"log_start":"81'15930","ondisk_log_start":"81'15930","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.565438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1044250624,"num_objects":15934,"num_object_clones":0,"num_object_copies":47802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15934,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15934,"num_write_kb":1019776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"81'15641","reported_seq":15657,"reported_epoch":81,"state":"active+clean","last_fresh":"2026-02-23T13:12:31.662555+0000","last_change":"2026-02-23T13:11:54.595399+0000","last_active":"2026-02-23T13:12:31.662555+0000","last_peered":"2026-02-23T13:12:31.662555+0000","last_clean":"2026-02-23T13:12:31.662555+0000","last_became_active":"2026-02-23T13:11:54.595144+0000","last_became_peered":"2026-02-23T13:11:54.595144+0000","last_unstale":"2026-02-23T13:12:31.662555+0000","last_undegraded":"2026-02-23T13:12:31.662555+0000","last_fullsized":"2026-02-23T13:12:31.662555+0000","mapping_epoch":78,"log_start":"81'15638","ondisk_log_start":"81'15638","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:16.231133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1025048576,"num_objects":15641,"num_object_clones":0,"num_object_copies":46923,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15641,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15641,"num_write_kb":1001024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"81'15894","reported_seq":15910,"reported_epoch":81,"state":"active+clean","last_fresh":"2026-02-23T13:12:31.660645+0000","last_change":"2026-02-23T13:11:54.596295+0000","last_active":"2026-02-23T13:12:31.660645+0000","last_peered":"2026-02-23T13:12:31.660645+0000","last_clean":"2026-02-23T13:12:31.660645+0000","last_became_active":"2026-02-23T13:11:54.595996+0000","last_became_peered":"2026-02-23T13:11:54.595996+0000","last_unstale":"2026-02-23T13:12:31.660645+0000","last_undegraded":"2026-02-23T13:12:31.660645+0000","last_fullsized":"2026-02-23T13:12:31.660645+0000","mapping_epoch":78,"log_start":"81'15891","ondisk_log_start":"81'15891","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.493149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1041629184,"num_objects":15894,"num_object_clones":0,"num_object_copies":47682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15894,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15894,"num_write_kb":1017216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"81'15746","reported_seq":15762,"reported_epoch":81,"state":"active+clean","last_fresh":"2026-02-23T13:12:31.661155+0000","last_change":"2026-02-23T13:11:54.599275+0000","last_active":"2026-02-23T13:12:31.661155+0000","last_peered":"2026-02-23T13:12:31.661155+0000","last_clean":"2026-02-23T13:12:31.661155+0000","last_became_active":"2026-02-23T13:11:54.598958+0000","last_became_peered":"2026-02-23T13:11:54.598958+0000","last_unstale":"2026-02-23T13:12:31.661155+0000","last_undegraded":"2026-02-23T13:12:31.661155+0000","last_fullsized":"2026-02-23T13:12:31.661155+0000","mapping_epoch":78,"log_start":"81'15743","ondisk_log_start":"81'15743","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:13.230076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1031929856,"num_objects":15746,"num_object_clones":0,"num_object_copies":47238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15746,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15746,"num_write_kb":1007744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"81'15766","reported_seq":15782,"reported_epoch":81,"state":"active+clean","last_fresh":"2026-02-23T13:12:31.659312+0000","last_change":"2026-02-23T13:11:54.599032+0000","last_active":"2026-02-23T13:12:31.659312+0000","last_peered":"2026-02-23T13:12:31.659312+0000","last_clean":"2026-02-23T13:12:31.659312+0000","last_became_active":"2026-02-23T13:11:54.598751+0000","last_became_peered":"2026-02-23T13:11:54.598751+0000","last_unstale":"2026-02-23T13:12:31.659312+0000","last_undegraded":"2026-02-23T13:12:31.659312+0000","last_fullsized":"2026-02-23T13:12:31.659312+0000","mapping_epoch":78,"log_start":"81'15763","ondisk_log_start":"81'15763","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:59.904586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1033240576,"num_objects":15766,"num_object_clones":0,"num_object_copies":47298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15766,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15766,"num_write_kb":1009024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"81'15734","reported_seq":15750,"reported_epoch":81,"state":"active+clean","last_fresh":"2026-02-23T13:12:31.661913+0000","last_change":"2026-02-23T13:11:54.596162+0000","last_active":"2026-02-23T13:12:31.661913+0000","last_peered":"2026-02-23T13:12:31.661913+0000","last_clean":"2026-02-23T13:12:31.661913+0000","last_became_active":"2026-02-23T13:11:54.595840+0000","last_became_peered":"2026-02-23T13:11:54.595840+0000","last_unstale":"2026-02-23T13:12:31.661913+0000","last_undegraded":"2026-02-23T13:12:31.661913+0000","last_fullsized":"2026-02-23T13:12:31.661913+0000","mapping_epoch":78,"log_start":"81'15731","ondisk_log_start":"81'15731","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:57.412771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1031143424,"num_objects":15734,"num_object_clones":0,"num_object_copies":47202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15734,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15734,"num_write_kb":1006976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"81'15737","reported_seq":15753,"reported_epoch":81,"state":"active+clean","last_fresh":"2026-02-23T13:12:31.663154+0000","last_change":"2026-02-23T13:11:54.596007+0000","last_active":"2026-02-23T13:12:31.663154+0000","last_peered":"2026-02-23T13:12:31.663154+0000","last_clean":"2026-02-23T13:12:31.663154+0000","last_became_active":"2026-02-23T13:11:54.595287+0000","last_became_peered":"2026-02-23T13:11:54.595287+0000","last_unstale":"2026-02-23T13:12:31.663154+0000","last_undegraded":"2026-02-23T13:12:31.663154+0000","last_fullsized":"2026-02-23T13:12:31.663154+0000","mapping_epoch":78,"log_start":"81'15734","ondisk_log_start":"81'15734","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:03.108821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1031340032,"num_objects":15737,"num_object_clones":0,"num_object_copies":47211,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15737,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15737,"num_write_kb":1007168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":350,"reported_epoch":81,"state":"active+clean","last_fresh":"2026-02-23T13:12:30.742419+0000","last_change":"2026-02-23T13:11:50.169148+0000","last_active":"2026-02-23T13:12:30.742419+0000","last_peered":"2026-02-23T13:12:30.742419+0000","last_clean":"2026-02-23T13:12:30.742419+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:12:30.742419+0000","last_undegraded":"2026-02-23T13:12:30.742419+0000","last_fullsized":"2026-02-23T13:12:30.742419+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:11:50.169094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:11:50.169094+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:57.448558+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":16547053568,"num_objects":252488,"num_object_clones":0,"num_object_copies":757464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252488,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252488,"num_write_kb":16159232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49659117568,"data_stored":49659117568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247925,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":15246016,"kb_used_data":14065900,"kb_used_omap":15,"kb_used_meta":1180080,"kb_avail":718757184,"statfs":{"total":751619276800,"available":736007356416,"internally_reserved":0,"allocated":14403481600,"data_stored":14402908625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16371,"internal_metadata":1208401933},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,4],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444152,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":11867648,"kb_used_data":10836268,"kb_used_omap":18,"kb_used_meta":1031341,"kb_avail":722135552,"statfs":{"total":751619276800,"available":739466805248,"internally_reserved":0,"allocated":11096338432,"data_stored":11095765457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19116,"internal_metadata":1056093524},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574970,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":11449980,"kb_used_data":10071336,"kb_used_omap":18,"kb_used_meta":1378605,"kb_avail":722553220,"statfs":{"total":751619276800,"available":739894497280,"internally_reserved":0,"allocated":10313048064,"data_stored":10312478641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19452,"internal_metadata":1411691524},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705787,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":13573044,"kb_used_data":12782560,"kb_used_omap":12,"kb_used_meta":790451,"kb_avail":720430156,"statfs":{"total":751619276800,"available":737720479744,"internally_reserved":0,"allocated":13089341440,"data_stored":13088776302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13058,"internal_metadata":809422078},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13443727360,"data_stored":13443727360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10346758144,"data_stored":10346758144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11382685696,"data_stored":11382685696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14485946368,"data_stored":14485946368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:12:35.880 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_3 pgp_num 36 2026-02-23T13:12:36.025 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:36.106 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:12:36 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:12:36] "GET /metrics HTTP/1.1" 200 4211 "" "Prometheus/3.6.0" 2026-02-23T13:12:36.160 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:36.158+0000 7f870e2df640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:36.160 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:36.158+0000 7f870e2df640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:36.293 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-23T13:12:36.338 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:12:36.561 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:12:36 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:12:36.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:12:36.691 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 41 16 285228 285212 434.738 450.625 0.00124027 0.00229901 2026-02-23T13:12:37.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:36 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1081883414' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_3", "var": "pgp_num", "val": "36"} : dispatch 2026-02-23T13:12:37.353 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:12:37.499 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:37.628 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:37.626+0000 7fb4aef9e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:37.628 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:37.626+0000 7fb4aef9e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:37.628 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:37 trial046 ceph-mon[38575]: pgmap v346: 17 pgs: 17 active+clean; 17 GiB data, 53 GiB used, 2.7 TiB / 2.7 TiB avail; 464 MiB/s wr, 7.43k op/s 2026-02-23T13:12:37.643 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:12:37.644 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:12:37.659 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:12:37.660 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:12:37.673 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:12:37.673 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:12:37.686 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:12:37.686 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:12:37.690 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 42 16 293285 293269 436.376 503.562 0.00243003 0.0022904 2026-02-23T13:12:38.691 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 43 16 301308 301292 437.888 501.438 0.00148688 0.00228249 2026-02-23T13:12:39.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:38 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/56812444' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:12:39.691 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 44 15 309210 309195 439.161 493.938 0.00274925 0.00227584 2026-02-23T13:12:39.732 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:12:39.873 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:39.900 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:39 trial046 ceph-mon[38575]: pgmap v347: 17 pgs: 17 active+clean; 17 GiB data, 56 GiB used, 2.7 TiB / 2.7 TiB avail; 528 MiB/s wr, 8.45k op/s 2026-02-23T13:12:40.009 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:40.007+0000 7f82b2915640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:40.010 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:40.007+0000 7f82b2915640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:40.025 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:12:40.025 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:12:40.038 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:12:40.038 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:12:40.050 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:12:40.051 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:12:40.062 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:12:40.062 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:12:40.691 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 45 16 317028 317012 440.258 488.562 0.00106731 0.00227016 2026-02-23T13:12:41.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:40 trial046 ceph-mon[38575]: osdmap e83: 4 total, 4 up, 4 in 2026-02-23T13:12:41.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:40 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3924854361' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:12:41.339 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:12:41.340 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:12:41.340 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2026-02-23T13:12:41.340 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph tell osd.0 'trim stale osdmaps' 2026-02-23T13:12:41.486 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:41.617 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:41 trial046 ceph-mon[38575]: pgmap v349: 17 pgs: 17 active+clean; 17 GiB data, 56 GiB used, 2.7 TiB / 2.7 TiB avail; 255 MiB/s wr, 4.08k op/s 2026-02-23T13:12:41.617 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:41.615+0000 7ff6440a1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:41.617 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:41.615+0000 7ff6440a1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:41.638 INFO:teuthology.orchestra.run.trial046.stderr:no valid command found; 10 closest matches: 2026-02-23T13:12:41.638 INFO:teuthology.orchestra.run.trial046.stderr:0 2026-02-23T13:12:41.638 INFO:teuthology.orchestra.run.trial046.stderr:1 2026-02-23T13:12:41.638 INFO:teuthology.orchestra.run.trial046.stderr:2 2026-02-23T13:12:41.639 INFO:teuthology.orchestra.run.trial046.stderr:abort 2026-02-23T13:12:41.639 INFO:teuthology.orchestra.run.trial046.stderr:assert 2026-02-23T13:12:41.639 INFO:teuthology.orchestra.run.trial046.stderr:bench [] [] [] [] 2026-02-23T13:12:41.639 INFO:teuthology.orchestra.run.trial046.stderr:bluefs debug_inject_read_zeros 2026-02-23T13:12:41.639 INFO:teuthology.orchestra.run.trial046.stderr:bluefs files list 2026-02-23T13:12:41.639 INFO:teuthology.orchestra.run.trial046.stderr:bluefs stats 2026-02-23T13:12:41.639 INFO:teuthology.orchestra.run.trial046.stderr:bluestore allocator dump block 2026-02-23T13:12:41.639 INFO:teuthology.orchestra.run.trial046.stderr:Error EINVAL: invalid command 2026-02-23T13:12:41.674 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-23T13:12:41.675 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-23T13:12:41.675 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph tell osd.1 'trim stale osdmaps' 2026-02-23T13:12:41.691 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 46 16 324858 324842 441.325 489.375 0.00268453 0.00226471 2026-02-23T13:12:41.821 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:41.944 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:41.942+0000 7fc968bb0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:41.944 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:41.942+0000 7fc968bb0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:41.964 INFO:teuthology.orchestra.run.trial046.stderr:no valid command found; 10 closest matches: 2026-02-23T13:12:41.965 INFO:teuthology.orchestra.run.trial046.stderr:0 2026-02-23T13:12:41.965 INFO:teuthology.orchestra.run.trial046.stderr:1 2026-02-23T13:12:41.965 INFO:teuthology.orchestra.run.trial046.stderr:2 2026-02-23T13:12:41.965 INFO:teuthology.orchestra.run.trial046.stderr:abort 2026-02-23T13:12:41.965 INFO:teuthology.orchestra.run.trial046.stderr:assert 2026-02-23T13:12:41.965 INFO:teuthology.orchestra.run.trial046.stderr:bench [] [] [] [] 2026-02-23T13:12:41.965 INFO:teuthology.orchestra.run.trial046.stderr:bluefs debug_inject_read_zeros 2026-02-23T13:12:41.965 INFO:teuthology.orchestra.run.trial046.stderr:bluefs files list 2026-02-23T13:12:41.965 INFO:teuthology.orchestra.run.trial046.stderr:bluefs stats 2026-02-23T13:12:41.965 INFO:teuthology.orchestra.run.trial046.stderr:bluestore allocator dump block 2026-02-23T13:12:41.965 INFO:teuthology.orchestra.run.trial046.stderr:Error EINVAL: invalid command 2026-02-23T13:12:42.001 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-23T13:12:42.002 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-23T13:12:42.002 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph tell osd.2 'trim stale osdmaps' 2026-02-23T13:12:42.108 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:12:42.192 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:42.258 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:42.322 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:42.320+0000 7fd6fa309640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:42.322 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:42.320+0000 7fd6fa309640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:42.349 INFO:teuthology.orchestra.run.trial046.stderr:no valid command found; 10 closest matches: 2026-02-23T13:12:42.349 INFO:teuthology.orchestra.run.trial046.stderr:0 2026-02-23T13:12:42.349 INFO:teuthology.orchestra.run.trial046.stderr:1 2026-02-23T13:12:42.349 INFO:teuthology.orchestra.run.trial046.stderr:2 2026-02-23T13:12:42.349 INFO:teuthology.orchestra.run.trial046.stderr:abort 2026-02-23T13:12:42.350 INFO:teuthology.orchestra.run.trial046.stderr:assert 2026-02-23T13:12:42.350 INFO:teuthology.orchestra.run.trial046.stderr:bench [] [] [] [] 2026-02-23T13:12:42.350 INFO:teuthology.orchestra.run.trial046.stderr:bluefs debug_inject_read_zeros 2026-02-23T13:12:42.350 INFO:teuthology.orchestra.run.trial046.stderr:bluefs files list 2026-02-23T13:12:42.350 INFO:teuthology.orchestra.run.trial046.stderr:bluefs stats 2026-02-23T13:12:42.350 INFO:teuthology.orchestra.run.trial046.stderr:bluestore allocator dump block 2026-02-23T13:12:42.350 INFO:teuthology.orchestra.run.trial046.stderr:Error EINVAL: invalid command 2026-02-23T13:12:42.391 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-23T13:12:42.392 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-23T13:12:42.392 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph tell osd.3 'trim stale osdmaps' 2026-02-23T13:12:42.396 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:42.393+0000 7ff8b90b6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:42.396 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:42.393+0000 7ff8b90b6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:42.412 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:12:42.412 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:12:42.427 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:12:42.427 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:12:42.441 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:12:42.441 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:12:42.454 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:12:42.454 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:12:42.543 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:42.662 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:42 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/144647404' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:12:42.673 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:42.671+0000 7fba6bfff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:42.674 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:42.671+0000 7fba6bfff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:42.691 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 47 16 332484 332468 442.075 476.625 0.00116042 0.00226081 2026-02-23T13:12:42.694 INFO:teuthology.orchestra.run.trial046.stderr:no valid command found; 10 closest matches: 2026-02-23T13:12:42.695 INFO:teuthology.orchestra.run.trial046.stderr:0 2026-02-23T13:12:42.695 INFO:teuthology.orchestra.run.trial046.stderr:1 2026-02-23T13:12:42.695 INFO:teuthology.orchestra.run.trial046.stderr:2 2026-02-23T13:12:42.695 INFO:teuthology.orchestra.run.trial046.stderr:abort 2026-02-23T13:12:42.695 INFO:teuthology.orchestra.run.trial046.stderr:assert 2026-02-23T13:12:42.695 INFO:teuthology.orchestra.run.trial046.stderr:bench [] [] [] [] 2026-02-23T13:12:42.695 INFO:teuthology.orchestra.run.trial046.stderr:bluefs debug_inject_read_zeros 2026-02-23T13:12:42.695 INFO:teuthology.orchestra.run.trial046.stderr:bluefs files list 2026-02-23T13:12:42.695 INFO:teuthology.orchestra.run.trial046.stderr:bluefs stats 2026-02-23T13:12:42.695 INFO:teuthology.orchestra.run.trial046.stderr:bluestore allocator dump block 2026-02-23T13:12:42.696 INFO:teuthology.orchestra.run.trial046.stderr:Error EINVAL: invalid command 2026-02-23T13:12:42.733 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-23T13:12:42.734 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-23T13:12:43.691 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 48 15 339991 339976 442.64 469.25 0.00137261 0.00225796 2026-02-23T13:12:44.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:43 trial046 ceph-mon[38575]: pgmap v350: 17 pgs: 17 active+clean; 20 GiB data, 64 GiB used, 2.7 TiB / 2.7 TiB avail; 558 MiB/s wr, 8.93k op/s 2026-02-23T13:12:44.502 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:12:44.638 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:44.691 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 49 15 347337 347322 442.976 459.125 0.00129632 0.00225627 2026-02-23T13:12:45.266 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:45.211+0000 7fa517247640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:45.266 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:45.211+0000 7fa517247640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:45.267 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:12:45.267 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:12:45.267 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:12:45.267 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:12:45.267 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:12:45.267 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:12:45.269 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:12:45.269 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:12:45.692 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 50 16 352743 352727 440.872 337.812 0.00261099 0.00226703 2026-02-23T13:12:45.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:45 trial046 ceph-mon[38575]: osdmap e84: 4 total, 4 up, 4 in 2026-02-23T13:12:45.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:45 trial046 ceph-mon[38575]: pgmap v352: 17 pgs: 17 active+clean; 20 GiB data, 64 GiB used, 2.7 TiB / 2.7 TiB avail; 373 MiB/s wr, 5.97k op/s 2026-02-23T13:12:45.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:45 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3738379600' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:12:46.289 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:12:46 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:12:46] "GET /metrics HTTP/1.1" 200 4207 "" "Prometheus/3.6.0" 2026-02-23T13:12:46.470 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:12:46 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:12:46.087Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:12:46.692 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 51 16 359655 359639 440.698 432 0.00185667 0.00226789 2026-02-23T13:12:47.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:46 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:12:47.691 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 52 16 367366 367350 441.49 481.938 0.00197714 0.00226386 2026-02-23T13:12:47.735 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:12:47.735 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:12:47.735 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-23T13:12:47.735 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:12:47.876 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:12:47.895 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:47.903 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:47 trial046 ceph-mon[38575]: osdmap e85: 4 total, 4 up, 4 in 2026-02-23T13:12:47.903 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:47 trial046 ceph-mon[38575]: pgmap v354: 17 pgs: 17 active+clean; 21 GiB data, 68 GiB used, 2.7 TiB / 2.7 TiB avail; 581 MiB/s wr, 9.30k op/s 2026-02-23T13:12:48.021 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:48.019+0000 7f8e9f327640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:48.021 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:48.019+0000 7f8e9f327640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:48.030 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:48.158 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:48.156+0000 7f4470708640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:48.158 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:48.156+0000 7f4470708640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:48.174 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:12:48.174 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:12:48.175 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:12:48.175 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:12:48.188 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:12:48.188 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:12:48.202 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:12:48.202 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:12:48.216 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:12:48.216 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:12:48.227 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":354,"stamp":"2026-02-23T13:12:46.669161+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23002350112,"num_objects":350981,"num_object_clones":0,"num_object_copies":1052943,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":350981,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":351114,"num_write_kb":22464806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53,"ondisk_log_size":53,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":70900212,"kb_used_data":65454756,"kb_used_omap":73,"kb_used_meta":5445302,"kb_avail":2865112588,"statfs":{"total":3006477107200,"available":2933875290112,"internally_reserved":0,"allocated":67025670144,"data_stored":67023303126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":75171,"internal_metadata":5575989853},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[13,3,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4314693632,"num_objects":65837,"num_object_clones":0,"num_object_copies":197511,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65837,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65837,"num_write_kb":4213568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.082109"},"pg_stats":[{"pgid":"5.f","version":"83'20435","reported_seq":20455,"reported_epoch":83,"state":"active+clean","last_fresh":"2026-02-23T13:12:41.667561+0000","last_change":"2026-02-23T13:11:54.596706+0000","last_active":"2026-02-23T13:12:41.667561+0000","last_peered":"2026-02-23T13:12:41.667561+0000","last_clean":"2026-02-23T13:12:41.667561+0000","last_became_active":"2026-02-23T13:11:54.595945+0000","last_became_peered":"2026-02-23T13:11:54.595945+0000","last_unstale":"2026-02-23T13:12:41.667561+0000","last_undegraded":"2026-02-23T13:12:41.667561+0000","last_fullsized":"2026-02-23T13:12:41.667561+0000","mapping_epoch":78,"log_start":"83'20432","ondisk_log_start":"83'20432","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:06.207061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1339228160,"num_objects":20435,"num_object_clones":0,"num_object_copies":61305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20435,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20435,"num_write_kb":1307840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"85'22584","reported_seq":22608,"reported_epoch":85,"state":"active+clean","last_fresh":"2026-02-23T13:12:46.658598+0000","last_change":"2026-02-23T13:11:54.599809+0000","last_active":"2026-02-23T13:12:46.658598+0000","last_peered":"2026-02-23T13:12:46.658598+0000","last_clean":"2026-02-23T13:12:46.658598+0000","last_became_active":"2026-02-23T13:11:54.599064+0000","last_became_peered":"2026-02-23T13:11:54.599064+0000","last_unstale":"2026-02-23T13:12:46.658598+0000","last_undegraded":"2026-02-23T13:12:46.658598+0000","last_fullsized":"2026-02-23T13:12:46.658598+0000","mapping_epoch":78,"log_start":"85'22581","ondisk_log_start":"85'22581","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:11.698138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1480065024,"num_objects":22584,"num_object_clones":0,"num_object_copies":67752,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22584,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22584,"num_write_kb":1445376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"85'22677","reported_seq":22701,"reported_epoch":85,"state":"active+clean","last_fresh":"2026-02-23T13:12:46.659258+0000","last_change":"2026-02-23T13:11:54.596174+0000","last_active":"2026-02-23T13:12:46.659258+0000","last_peered":"2026-02-23T13:12:46.659258+0000","last_clean":"2026-02-23T13:12:46.659258+0000","last_became_active":"2026-02-23T13:11:54.595773+0000","last_became_peered":"2026-02-23T13:11:54.595773+0000","last_unstale":"2026-02-23T13:12:46.659258+0000","last_undegraded":"2026-02-23T13:12:46.659258+0000","last_fullsized":"2026-02-23T13:12:46.659258+0000","mapping_epoch":78,"log_start":"85'22674","ondisk_log_start":"85'22674","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.566475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1486159872,"num_objects":22677,"num_object_clones":0,"num_object_copies":68031,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22677,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22677,"num_write_kb":1451328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"83'20101","reported_seq":20121,"reported_epoch":83,"state":"active+clean","last_fresh":"2026-02-23T13:12:41.776566+0000","last_change":"2026-02-23T13:11:54.595749+0000","last_active":"2026-02-23T13:12:41.776566+0000","last_peered":"2026-02-23T13:12:41.776566+0000","last_clean":"2026-02-23T13:12:41.776566+0000","last_became_active":"2026-02-23T13:11:54.595560+0000","last_became_peered":"2026-02-23T13:11:54.595560+0000","last_unstale":"2026-02-23T13:12:41.776566+0000","last_undegraded":"2026-02-23T13:12:41.776566+0000","last_fullsized":"2026-02-23T13:12:41.776566+0000","mapping_epoch":78,"log_start":"83'20098","ondisk_log_start":"83'20098","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:11.860237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1317339136,"num_objects":20101,"num_object_clones":0,"num_object_copies":60303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20101,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20101,"num_write_kb":1286464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"85'22351","reported_seq":22375,"reported_epoch":85,"state":"active+clean","last_fresh":"2026-02-23T13:12:46.666257+0000","last_change":"2026-02-23T13:11:54.596349+0000","last_active":"2026-02-23T13:12:46.666257+0000","last_peered":"2026-02-23T13:12:46.666257+0000","last_clean":"2026-02-23T13:12:46.666257+0000","last_became_active":"2026-02-23T13:11:54.596133+0000","last_became_peered":"2026-02-23T13:11:54.596133+0000","last_unstale":"2026-02-23T13:12:46.666257+0000","last_undegraded":"2026-02-23T13:12:46.666257+0000","last_fullsized":"2026-02-23T13:12:46.666257+0000","mapping_epoch":78,"log_start":"85'22348","ondisk_log_start":"85'22348","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:03.865476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1464795136,"num_objects":22351,"num_object_clones":0,"num_object_copies":67053,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22351,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22351,"num_write_kb":1430464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"85'22242","reported_seq":22266,"reported_epoch":85,"state":"active+clean","last_fresh":"2026-02-23T13:12:46.664317+0000","last_change":"2026-02-23T13:11:54.595383+0000","last_active":"2026-02-23T13:12:46.664317+0000","last_peered":"2026-02-23T13:12:46.664317+0000","last_clean":"2026-02-23T13:12:46.664317+0000","last_became_active":"2026-02-23T13:11:54.595080+0000","last_became_peered":"2026-02-23T13:11:54.595080+0000","last_unstale":"2026-02-23T13:12:46.664317+0000","last_undegraded":"2026-02-23T13:12:46.664317+0000","last_fullsized":"2026-02-23T13:12:46.664317+0000","mapping_epoch":78,"log_start":"85'22238","ondisk_log_start":"85'22238","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:12.934698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1457651712,"num_objects":22242,"num_object_clones":0,"num_object_copies":66726,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22242,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22242,"num_write_kb":1423488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"85'22389","reported_seq":22413,"reported_epoch":85,"state":"active+clean","last_fresh":"2026-02-23T13:12:46.662139+0000","last_change":"2026-02-23T13:11:54.598497+0000","last_active":"2026-02-23T13:12:46.662139+0000","last_peered":"2026-02-23T13:12:46.662139+0000","last_clean":"2026-02-23T13:12:46.662139+0000","last_became_active":"2026-02-23T13:11:54.598325+0000","last_became_peered":"2026-02-23T13:11:54.598325+0000","last_unstale":"2026-02-23T13:12:46.662139+0000","last_undegraded":"2026-02-23T13:12:46.662139+0000","last_fullsized":"2026-02-23T13:12:46.662139+0000","mapping_epoch":78,"log_start":"85'22385","ondisk_log_start":"85'22385","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:57.924450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1467285504,"num_objects":22389,"num_object_clones":0,"num_object_copies":67167,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22389,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22389,"num_write_kb":1432896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"85'22262","reported_seq":22286,"reported_epoch":85,"state":"active+clean","last_fresh":"2026-02-23T13:12:46.666469+0000","last_change":"2026-02-23T13:11:54.595376+0000","last_active":"2026-02-23T13:12:46.666469+0000","last_peered":"2026-02-23T13:12:46.666469+0000","last_clean":"2026-02-23T13:12:46.666469+0000","last_became_active":"2026-02-23T13:11:54.595110+0000","last_became_peered":"2026-02-23T13:11:54.595110+0000","last_unstale":"2026-02-23T13:12:46.666469+0000","last_undegraded":"2026-02-23T13:12:46.666469+0000","last_fullsized":"2026-02-23T13:12:46.666469+0000","mapping_epoch":78,"log_start":"85'22259","ondisk_log_start":"85'22259","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:02.754608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1458962432,"num_objects":22262,"num_object_clones":0,"num_object_copies":66786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22262,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22262,"num_write_kb":1424768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"85'22848","reported_seq":22872,"reported_epoch":85,"state":"active+clean","last_fresh":"2026-02-23T13:12:46.661709+0000","last_change":"2026-02-23T13:11:54.599364+0000","last_active":"2026-02-23T13:12:46.661709+0000","last_peered":"2026-02-23T13:12:46.661709+0000","last_clean":"2026-02-23T13:12:46.661709+0000","last_became_active":"2026-02-23T13:11:54.599155+0000","last_became_peered":"2026-02-23T13:11:54.599155+0000","last_unstale":"2026-02-23T13:12:46.661709+0000","last_undegraded":"2026-02-23T13:12:46.661709+0000","last_fullsized":"2026-02-23T13:12:46.661709+0000","mapping_epoch":78,"log_start":"85'22845","ondisk_log_start":"85'22845","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:14.711414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1497366528,"num_objects":22848,"num_object_clones":0,"num_object_copies":68544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22848,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22848,"num_write_kb":1462272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"83'20394","reported_seq":20414,"reported_epoch":83,"state":"active+clean","last_fresh":"2026-02-23T13:12:41.776985+0000","last_change":"2026-02-23T13:11:54.595872+0000","last_active":"2026-02-23T13:12:41.776985+0000","last_peered":"2026-02-23T13:12:41.776985+0000","last_clean":"2026-02-23T13:12:41.776985+0000","last_became_active":"2026-02-23T13:11:54.595645+0000","last_became_peered":"2026-02-23T13:11:54.595645+0000","last_unstale":"2026-02-23T13:12:41.776985+0000","last_undegraded":"2026-02-23T13:12:41.776985+0000","last_fullsized":"2026-02-23T13:12:41.776985+0000","mapping_epoch":78,"log_start":"83'20391","ondisk_log_start":"83'20391","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.565438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1336541184,"num_objects":20394,"num_object_clones":0,"num_object_copies":61182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20394,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20394,"num_write_kb":1305216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"85'22370","reported_seq":22394,"reported_epoch":85,"state":"active+clean","last_fresh":"2026-02-23T13:12:46.663949+0000","last_change":"2026-02-23T13:11:54.595399+0000","last_active":"2026-02-23T13:12:46.663949+0000","last_peered":"2026-02-23T13:12:46.663949+0000","last_clean":"2026-02-23T13:12:46.663949+0000","last_became_active":"2026-02-23T13:11:54.595144+0000","last_became_peered":"2026-02-23T13:11:54.595144+0000","last_unstale":"2026-02-23T13:12:46.663949+0000","last_undegraded":"2026-02-23T13:12:46.663949+0000","last_fullsized":"2026-02-23T13:12:46.663949+0000","mapping_epoch":78,"log_start":"85'22367","ondisk_log_start":"85'22367","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:16.231133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466040320,"num_objects":22370,"num_object_clones":0,"num_object_copies":67110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22370,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22370,"num_write_kb":1431680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"85'22633","reported_seq":22656,"reported_epoch":85,"state":"active+clean","last_fresh":"2026-02-23T13:12:46.666884+0000","last_change":"2026-02-23T13:11:54.596295+0000","last_active":"2026-02-23T13:12:46.666884+0000","last_peered":"2026-02-23T13:12:46.666884+0000","last_clean":"2026-02-23T13:12:46.666884+0000","last_became_active":"2026-02-23T13:11:54.595996+0000","last_became_peered":"2026-02-23T13:11:54.595996+0000","last_unstale":"2026-02-23T13:12:46.666884+0000","last_undegraded":"2026-02-23T13:12:46.666884+0000","last_fullsized":"2026-02-23T13:12:46.666884+0000","mapping_epoch":78,"log_start":"85'22630","ondisk_log_start":"85'22630","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.493149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1483276288,"num_objects":22633,"num_object_clones":0,"num_object_copies":67899,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22633,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22633,"num_write_kb":1448512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"85'22470","reported_seq":22494,"reported_epoch":85,"state":"active+clean","last_fresh":"2026-02-23T13:12:46.658700+0000","last_change":"2026-02-23T13:11:54.599275+0000","last_active":"2026-02-23T13:12:46.658700+0000","last_peered":"2026-02-23T13:12:46.658700+0000","last_clean":"2026-02-23T13:12:46.658700+0000","last_became_active":"2026-02-23T13:11:54.598958+0000","last_became_peered":"2026-02-23T13:11:54.598958+0000","last_unstale":"2026-02-23T13:12:46.658700+0000","last_undegraded":"2026-02-23T13:12:46.658700+0000","last_fullsized":"2026-02-23T13:12:46.658700+0000","mapping_epoch":78,"log_start":"85'22467","ondisk_log_start":"85'22467","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:13.230076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1472593920,"num_objects":22470,"num_object_clones":0,"num_object_copies":67410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22470,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22470,"num_write_kb":1438080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"85'22563","reported_seq":22587,"reported_epoch":85,"state":"active+clean","last_fresh":"2026-02-23T13:12:46.655725+0000","last_change":"2026-02-23T13:11:54.599032+0000","last_active":"2026-02-23T13:12:46.655725+0000","last_peered":"2026-02-23T13:12:46.655725+0000","last_clean":"2026-02-23T13:12:46.655725+0000","last_became_active":"2026-02-23T13:11:54.598751+0000","last_became_peered":"2026-02-23T13:11:54.598751+0000","last_unstale":"2026-02-23T13:12:46.655725+0000","last_undegraded":"2026-02-23T13:12:46.655725+0000","last_fullsized":"2026-02-23T13:12:46.655725+0000","mapping_epoch":78,"log_start":"85'22560","ondisk_log_start":"85'22560","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:59.904586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1478688768,"num_objects":22563,"num_object_clones":0,"num_object_copies":67689,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22563,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22563,"num_write_kb":1444032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"85'22402","reported_seq":22426,"reported_epoch":85,"state":"active+clean","last_fresh":"2026-02-23T13:12:46.659469+0000","last_change":"2026-02-23T13:11:54.596162+0000","last_active":"2026-02-23T13:12:46.659469+0000","last_peered":"2026-02-23T13:12:46.659469+0000","last_clean":"2026-02-23T13:12:46.659469+0000","last_became_active":"2026-02-23T13:11:54.595840+0000","last_became_peered":"2026-02-23T13:11:54.595840+0000","last_unstale":"2026-02-23T13:12:46.659469+0000","last_undegraded":"2026-02-23T13:12:46.659469+0000","last_fullsized":"2026-02-23T13:12:46.659469+0000","mapping_epoch":78,"log_start":"85'22399","ondisk_log_start":"85'22399","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:57.412771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468137472,"num_objects":22402,"num_object_clones":0,"num_object_copies":67206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22402,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22402,"num_write_kb":1433728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"83'20258","reported_seq":20278,"reported_epoch":83,"state":"active+clean","last_fresh":"2026-02-23T13:12:41.666498+0000","last_change":"2026-02-23T13:11:54.596007+0000","last_active":"2026-02-23T13:12:41.666498+0000","last_peered":"2026-02-23T13:12:41.666498+0000","last_clean":"2026-02-23T13:12:41.666498+0000","last_became_active":"2026-02-23T13:11:54.595287+0000","last_became_peered":"2026-02-23T13:11:54.595287+0000","last_unstale":"2026-02-23T13:12:41.666498+0000","last_undegraded":"2026-02-23T13:12:41.666498+0000","last_fullsized":"2026-02-23T13:12:41.666498+0000","mapping_epoch":78,"log_start":"83'20255","ondisk_log_start":"83'20255","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:03.108821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1327628288,"num_objects":20258,"num_object_clones":0,"num_object_copies":60774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20258,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20258,"num_write_kb":1296512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":358,"reported_epoch":85,"state":"active+clean","last_fresh":"2026-02-23T13:12:46.587657+0000","last_change":"2026-02-23T13:11:50.169148+0000","last_active":"2026-02-23T13:12:46.587657+0000","last_peered":"2026-02-23T13:12:46.587657+0000","last_clean":"2026-02-23T13:12:46.587657+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:12:46.587657+0000","last_undegraded":"2026-02-23T13:12:46.587657+0000","last_fullsized":"2026-02-23T13:12:46.587657+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:11:50.169094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:11:50.169094+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:57.448558+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":23001759744,"num_objects":350979,"num_object_clones":0,"num_object_copies":1052937,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":350979,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":350979,"num_write_kb":22462656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":67712122880,"data_stored":67712122880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":50,"ondisk_log_size":50,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247928,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":21619364,"kb_used_data":20078288,"kb_used_omap":17,"kb_used_meta":1541038,"kb_avail":712383836,"statfs":{"total":751619276800,"available":729481048064,"internally_reserved":0,"allocated":20560166912,"data_stored":20559570326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18327,"internal_metadata":1578023017},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444154,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":15268824,"kb_used_data":14038916,"kb_used_omap":19,"kb_used_meta":1229868,"kb_avail":718734376,"statfs":{"total":751619276800,"available":735984001024,"internally_reserved":0,"allocated":14375849984,"data_stored":14375261285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20422,"internal_metadata":1259384890},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574972,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":14472596,"kb_used_data":12949568,"kb_used_omap":20,"kb_used_meta":1522987,"kb_avail":719530604,"statfs":{"total":751619276800,"available":736799338496,"internally_reserved":0,"allocated":13260357632,"data_stored":13259772485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20756,"internal_metadata":1559539436},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705790,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":19539428,"kb_used_data":18387984,"kb_used_omap":15,"kb_used_meta":1151408,"kb_avail":714463772,"statfs":{"total":751619276800,"available":731610902528,"internally_reserved":0,"allocated":18829295616,"data_stored":18828699030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15666,"internal_metadata":1179042510},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":19148374016,"data_stored":19148374016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13297778688,"data_stored":13297778688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14633009152,"data_stored":14633009152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20632961024,"data_stored":20632961024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:12:48.229 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 221 2026-02-23T13:12:48.441 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:48.563 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:48.561+0000 7f0b5d68a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:48.564 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:48.562+0000 7f0b5d68a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:48.692 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 53 16 374763 374747 441.882 462.312 0.00259806 0.00226185 2026-02-23T13:12:48.692 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-23T13:12:48.716 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:48 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/166358359' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:12:48.732 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:12:49.692 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 54 16 382019 382003 442.097 453.5 0.00366753 0.00226074 2026-02-23T13:12:50.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:49 trial046 ceph-mon[38575]: from='client.15243 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:12:50.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:49 trial046 ceph-mon[38575]: pgmap v355: 17 pgs: 17 active+clean; 22 GiB data, 71 GiB used, 2.7 TiB / 2.7 TiB avail; 581 MiB/s wr, 9.30k op/s 2026-02-23T13:12:50.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:49 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/607663656' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "221"} : dispatch 2026-02-23T13:12:50.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:49 trial046 ceph-mon[38575]: osdmap e86: 4 total, 4 up, 4 in 2026-02-23T13:12:50.261 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:12:50.404 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:50.531 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:50.529+0000 7f7b9740a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:50.531 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:50.529+0000 7f7b9740a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:50.546 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:12:50.547 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:12:50.559 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:12:50.559 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:12:50.573 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:12:50.573 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:12:50.584 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:12:50.585 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:12:50.692 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 55 16 389026 389010 442.021 437.938 0.00104854 0.00226113 2026-02-23T13:12:51.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:50 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/319282400' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:12:51.692 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 56 16 396441 396425 442.402 463.438 0.00188912 0.0022592 2026-02-23T13:12:52.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:51 trial046 ceph-mon[38575]: pgmap v357: 17 pgs: 17 active+clean; 22 GiB data, 71 GiB used, 2.7 TiB / 2.7 TiB avail; 357 MiB/s wr, 5.72k op/s 2026-02-23T13:12:52.630 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:12:52.692 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 57 16 403881 403865 442.798 465 0.00369585 0.00225717 2026-02-23T13:12:52.773 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:52.903 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:52.901+0000 7ffb0f32f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:52.903 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:52.901+0000 7ffb0f32f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:52.917 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:12:52.918 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:12:52.930 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:12:52.930 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:12:52.942 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:12:52.943 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:12:52.955 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:12:52.955 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:12:53.692 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 58 16 411222 411206 443.074 458.812 0.0015027 0.00225578 2026-02-23T13:12:53.734 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:12:53.734 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-23T13:12:53.874 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:53.991 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:53 trial046 ceph-mon[38575]: pgmap v358: 17 pgs: 17 active+clean; 24 GiB data, 78 GiB used, 2.7 TiB / 2.7 TiB avail; 559 MiB/s wr, 8.95k op/s 2026-02-23T13:12:53.991 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:53 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2591696620' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:12:54.003 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:54.002+0000 7f60d613e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:54.003 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:54.002+0000 7f60d613e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:54.692 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 59 16 418888 418872 443.684 479.125 0.00132395 0.00225264 2026-02-23T13:12:54.724 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.0 to 1 (10000) 2026-02-23T13:12:54.770 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-23T13:12:54.917 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:54.972 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:54 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2143593222' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-23T13:12:55.000 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:12:55.047 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:55.045+0000 7f0a611c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:55.048 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:55.045+0000 7f0a611c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:55.140 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:55.267 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:55.265+0000 7f4565757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:55.267 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:55.265+0000 7f4565757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:55.281 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:12:55.282 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:12:55.296 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:12:55.297 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:12:55.308 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:12:55.309 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:12:55.323 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:12:55.324 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:12:55.692 INFO:tasks.radosbench.radosbench.0.trial046.stdout:2026-02-23T13:12:55.692383+0000 min lat: 0.000681273 max lat: 0.0626709 avg lat: 0.00225259 2026-02-23T13:12:55.693 INFO:tasks.radosbench.radosbench.0.trial046.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-23T13:12:55.693 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 60 16 425995 425979 443.692 444.188 0.00231433 0.00225259 2026-02-23T13:12:55.725 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.1 to 1 (10000) 2026-02-23T13:12:55.769 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-23T13:12:55.907 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:55.977 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:55 trial046 ceph-mon[38575]: pgmap v359: 17 pgs: 17 active+clean; 24 GiB data, 78 GiB used, 2.7 TiB / 2.7 TiB avail; 554 MiB/s wr, 8.86k op/s 2026-02-23T13:12:55.977 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:55 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2143593222' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-23T13:12:55.977 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:55 trial046 ceph-mon[38575]: osdmap e87: 4 total, 4 up, 4 in 2026-02-23T13:12:55.977 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:55 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1715166905' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-23T13:12:55.977 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:55 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1660088900' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:12:56.032 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:56.030+0000 7fa95bf85640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:56.032 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:56.030+0000 7fa95bf85640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:56.289 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:12:56 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:12:56] "GET /metrics HTTP/1.1" 200 4207 "" "Prometheus/3.6.0" 2026-02-23T13:12:56.561 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:12:56 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:12:56.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:12:56.692 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 61 16 432942 432926 443.536 434.188 0.00285522 0.00225343 2026-02-23T13:12:56.730 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.2 to 1 (10000) 2026-02-23T13:12:56.776 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-23T13:12:56.920 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:56.984 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:56 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1715166905' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-23T13:12:56.984 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:56 trial046 ceph-mon[38575]: osdmap e88: 4 total, 4 up, 4 in 2026-02-23T13:12:56.984 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:56 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1860487611' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-23T13:12:57.042 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:57.039+0000 7f0637a90640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:57.042 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:57.040+0000 7f0637a90640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:57.369 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:12:57.518 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:57.632 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:57.630+0000 7f99f4f0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:57.632 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:57.630+0000 7f99f4f0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:57.647 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:12:57.647 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:12:57.663 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:12:57.663 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:12:57.676 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:12:57.677 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:12:57.690 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:12:57.690 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:12:57.692 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 62 16 439990 439974 443.486 440.5 0.00202653 0.00225369 2026-02-23T13:12:57.730 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.3 to 1 (10000) 2026-02-23T13:12:57.779 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-23T13:12:57.779 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:12:57.962 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:57.990 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:57 trial046 ceph-mon[38575]: pgmap v362: 17 pgs: 17 active+clean; 26 GiB data, 82 GiB used, 2.7 TiB / 2.7 TiB avail; 566 MiB/s wr, 9.06k op/s 2026-02-23T13:12:57.990 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:57 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1860487611' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-23T13:12:57.990 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:57 trial046 ceph-mon[38575]: osdmap e89: 4 total, 4 up, 4 in 2026-02-23T13:12:57.990 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:57 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4179515309' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-23T13:12:57.991 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:57 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1627538127' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:12:58.087 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:58.085+0000 7f585c218640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:58.088 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:58.086+0000 7f585c218640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:58.234 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:12:58.234 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:12:58.282 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":364,"stamp":"2026-02-23T13:12:57.730521+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28367716896,"num_objects":432850,"num_object_clones":0,"num_object_copies":1298550,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":432850,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":432983,"num_write_kb":27704422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":88970012,"kb_used_data":82473868,"kb_used_omap":89,"kb_used_meta":6495974,"kb_avail":2847042788,"statfs":{"total":3006477107200,"available":2915371814912,"internally_reserved":0,"allocated":84453240832,"data_stored":84451390012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":92120,"internal_metadata":6651877416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,3],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2389835776,"num_objects":36466,"num_object_clones":0,"num_object_copies":109398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36466,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36466,"num_write_kb":2333824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.060574"},"pg_stats":[{"pgid":"5.f","version":"88'27243","reported_seq":27273,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.672068+0000","last_change":"2026-02-23T13:11:54.596706+0000","last_active":"2026-02-23T13:12:56.672068+0000","last_peered":"2026-02-23T13:12:56.672068+0000","last_clean":"2026-02-23T13:12:56.672068+0000","last_became_active":"2026-02-23T13:11:54.595945+0000","last_became_peered":"2026-02-23T13:11:54.595945+0000","last_unstale":"2026-02-23T13:12:56.672068+0000","last_undegraded":"2026-02-23T13:12:56.672068+0000","last_fullsized":"2026-02-23T13:12:56.672068+0000","mapping_epoch":78,"log_start":"88'27240","ondisk_log_start":"88'27240","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:06.207061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1785397248,"num_objects":27243,"num_object_clones":0,"num_object_copies":81729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27243,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27243,"num_write_kb":1743552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"88'27200","reported_seq":27230,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.659548+0000","last_change":"2026-02-23T13:11:54.599809+0000","last_active":"2026-02-23T13:12:56.659548+0000","last_peered":"2026-02-23T13:12:56.659548+0000","last_clean":"2026-02-23T13:12:56.659548+0000","last_became_active":"2026-02-23T13:11:54.599064+0000","last_became_peered":"2026-02-23T13:11:54.599064+0000","last_unstale":"2026-02-23T13:12:56.659548+0000","last_undegraded":"2026-02-23T13:12:56.659548+0000","last_fullsized":"2026-02-23T13:12:56.659548+0000","mapping_epoch":78,"log_start":"88'27197","ondisk_log_start":"88'27197","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:11.698138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1782579200,"num_objects":27200,"num_object_clones":0,"num_object_copies":81600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27200,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27200,"num_write_kb":1740800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"88'27285","reported_seq":27315,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.661432+0000","last_change":"2026-02-23T13:11:54.596174+0000","last_active":"2026-02-23T13:12:56.661432+0000","last_peered":"2026-02-23T13:12:56.661432+0000","last_clean":"2026-02-23T13:12:56.661432+0000","last_became_active":"2026-02-23T13:11:54.595773+0000","last_became_peered":"2026-02-23T13:11:54.595773+0000","last_unstale":"2026-02-23T13:12:56.661432+0000","last_undegraded":"2026-02-23T13:12:56.661432+0000","last_fullsized":"2026-02-23T13:12:56.661432+0000","mapping_epoch":78,"log_start":"88'27282","ondisk_log_start":"88'27282","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.566475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1788149760,"num_objects":27285,"num_object_clones":0,"num_object_copies":81855,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27285,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27285,"num_write_kb":1746240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"89'26815","reported_seq":26847,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.779621+0000","last_change":"2026-02-23T13:11:54.595749+0000","last_active":"2026-02-23T13:12:56.779621+0000","last_peered":"2026-02-23T13:12:56.779621+0000","last_clean":"2026-02-23T13:12:56.779621+0000","last_became_active":"2026-02-23T13:11:54.595560+0000","last_became_peered":"2026-02-23T13:11:54.595560+0000","last_unstale":"2026-02-23T13:12:56.779621+0000","last_undegraded":"2026-02-23T13:12:56.779621+0000","last_fullsized":"2026-02-23T13:12:56.779621+0000","mapping_epoch":78,"log_start":"89'26812","ondisk_log_start":"89'26812","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:11.860237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1757347840,"num_objects":26815,"num_object_clones":0,"num_object_copies":80445,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26815,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26815,"num_write_kb":1716160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"88'26999","reported_seq":27029,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.665423+0000","last_change":"2026-02-23T13:11:54.596349+0000","last_active":"2026-02-23T13:12:56.665423+0000","last_peered":"2026-02-23T13:12:56.665423+0000","last_clean":"2026-02-23T13:12:56.665423+0000","last_became_active":"2026-02-23T13:11:54.596133+0000","last_became_peered":"2026-02-23T13:11:54.596133+0000","last_unstale":"2026-02-23T13:12:56.665423+0000","last_undegraded":"2026-02-23T13:12:56.665423+0000","last_fullsized":"2026-02-23T13:12:56.665423+0000","mapping_epoch":78,"log_start":"88'26996","ondisk_log_start":"88'26996","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:03.865476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769406464,"num_objects":26999,"num_object_clones":0,"num_object_copies":80997,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26999,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26999,"num_write_kb":1727936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"88'26946","reported_seq":26976,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.665953+0000","last_change":"2026-02-23T13:11:54.595383+0000","last_active":"2026-02-23T13:12:56.665953+0000","last_peered":"2026-02-23T13:12:56.665953+0000","last_clean":"2026-02-23T13:12:56.665953+0000","last_became_active":"2026-02-23T13:11:54.595080+0000","last_became_peered":"2026-02-23T13:11:54.595080+0000","last_unstale":"2026-02-23T13:12:56.665953+0000","last_undegraded":"2026-02-23T13:12:56.665953+0000","last_fullsized":"2026-02-23T13:12:56.665953+0000","mapping_epoch":78,"log_start":"88'26943","ondisk_log_start":"88'26943","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:12.934698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1765933056,"num_objects":26946,"num_object_clones":0,"num_object_copies":80838,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26946,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26946,"num_write_kb":1724544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"88'27011","reported_seq":27041,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.660034+0000","last_change":"2026-02-23T13:11:54.598497+0000","last_active":"2026-02-23T13:12:56.660034+0000","last_peered":"2026-02-23T13:12:56.660034+0000","last_clean":"2026-02-23T13:12:56.660034+0000","last_became_active":"2026-02-23T13:11:54.598325+0000","last_became_peered":"2026-02-23T13:11:54.598325+0000","last_unstale":"2026-02-23T13:12:56.660034+0000","last_undegraded":"2026-02-23T13:12:56.660034+0000","last_fullsized":"2026-02-23T13:12:56.660034+0000","mapping_epoch":78,"log_start":"88'27008","ondisk_log_start":"88'27008","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:57.924450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1770192896,"num_objects":27011,"num_object_clones":0,"num_object_copies":81033,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27011,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27011,"num_write_kb":1728704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"88'26718","reported_seq":26748,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.661998+0000","last_change":"2026-02-23T13:11:54.595376+0000","last_active":"2026-02-23T13:12:56.661998+0000","last_peered":"2026-02-23T13:12:56.661998+0000","last_clean":"2026-02-23T13:12:56.661998+0000","last_became_active":"2026-02-23T13:11:54.595110+0000","last_became_peered":"2026-02-23T13:11:54.595110+0000","last_unstale":"2026-02-23T13:12:56.661998+0000","last_undegraded":"2026-02-23T13:12:56.661998+0000","last_fullsized":"2026-02-23T13:12:56.661998+0000","mapping_epoch":78,"log_start":"88'26715","ondisk_log_start":"88'26715","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:02.754608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1750990848,"num_objects":26718,"num_object_clones":0,"num_object_copies":80154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26718,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26718,"num_write_kb":1709952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"88'27316","reported_seq":27346,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.657865+0000","last_change":"2026-02-23T13:11:54.599364+0000","last_active":"2026-02-23T13:12:56.657865+0000","last_peered":"2026-02-23T13:12:56.657865+0000","last_clean":"2026-02-23T13:12:56.657865+0000","last_became_active":"2026-02-23T13:11:54.599155+0000","last_became_peered":"2026-02-23T13:11:54.599155+0000","last_unstale":"2026-02-23T13:12:56.657865+0000","last_undegraded":"2026-02-23T13:12:56.657865+0000","last_fullsized":"2026-02-23T13:12:56.657865+0000","mapping_epoch":78,"log_start":"88'27313","ondisk_log_start":"88'27313","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:14.711414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1790181376,"num_objects":27316,"num_object_clones":0,"num_object_copies":81948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27316,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27316,"num_write_kb":1748224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"89'27116","reported_seq":27148,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.777888+0000","last_change":"2026-02-23T13:11:54.595872+0000","last_active":"2026-02-23T13:12:56.777888+0000","last_peered":"2026-02-23T13:12:56.777888+0000","last_clean":"2026-02-23T13:12:56.777888+0000","last_became_active":"2026-02-23T13:11:54.595645+0000","last_became_peered":"2026-02-23T13:11:54.595645+0000","last_unstale":"2026-02-23T13:12:56.777888+0000","last_undegraded":"2026-02-23T13:12:56.777888+0000","last_fullsized":"2026-02-23T13:12:56.777888+0000","mapping_epoch":78,"log_start":"89'27113","ondisk_log_start":"89'27113","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.565438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1777074176,"num_objects":27116,"num_object_clones":0,"num_object_copies":81348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27116,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27116,"num_write_kb":1735424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"88'27008","reported_seq":27037,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.665230+0000","last_change":"2026-02-23T13:11:54.595399+0000","last_active":"2026-02-23T13:12:56.665230+0000","last_peered":"2026-02-23T13:12:56.665230+0000","last_clean":"2026-02-23T13:12:56.665230+0000","last_became_active":"2026-02-23T13:11:54.595144+0000","last_became_peered":"2026-02-23T13:11:54.595144+0000","last_unstale":"2026-02-23T13:12:56.665230+0000","last_undegraded":"2026-02-23T13:12:56.665230+0000","last_fullsized":"2026-02-23T13:12:56.665230+0000","mapping_epoch":78,"log_start":"88'27005","ondisk_log_start":"88'27005","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:16.231133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769996288,"num_objects":27008,"num_object_clones":0,"num_object_copies":81024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27008,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27008,"num_write_kb":1728512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"88'27288","reported_seq":27318,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.667282+0000","last_change":"2026-02-23T13:11:54.596295+0000","last_active":"2026-02-23T13:12:56.667282+0000","last_peered":"2026-02-23T13:12:56.667282+0000","last_clean":"2026-02-23T13:12:56.667282+0000","last_became_active":"2026-02-23T13:11:54.595996+0000","last_became_peered":"2026-02-23T13:11:54.595996+0000","last_unstale":"2026-02-23T13:12:56.667282+0000","last_undegraded":"2026-02-23T13:12:56.667282+0000","last_fullsized":"2026-02-23T13:12:56.667282+0000","mapping_epoch":78,"log_start":"88'27285","ondisk_log_start":"88'27285","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.493149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1788346368,"num_objects":27288,"num_object_clones":0,"num_object_copies":81864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27288,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27288,"num_write_kb":1746432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"88'27042","reported_seq":27072,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.662292+0000","last_change":"2026-02-23T13:11:54.599275+0000","last_active":"2026-02-23T13:12:56.662292+0000","last_peered":"2026-02-23T13:12:56.662292+0000","last_clean":"2026-02-23T13:12:56.662292+0000","last_became_active":"2026-02-23T13:11:54.598958+0000","last_became_peered":"2026-02-23T13:11:54.598958+0000","last_unstale":"2026-02-23T13:12:56.662292+0000","last_undegraded":"2026-02-23T13:12:56.662292+0000","last_fullsized":"2026-02-23T13:12:56.662292+0000","mapping_epoch":78,"log_start":"88'27039","ondisk_log_start":"88'27039","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:13.230076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1772224512,"num_objects":27042,"num_object_clones":0,"num_object_copies":81126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27042,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27042,"num_write_kb":1730688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"88'27060","reported_seq":27090,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.660089+0000","last_change":"2026-02-23T13:11:54.599032+0000","last_active":"2026-02-23T13:12:56.660089+0000","last_peered":"2026-02-23T13:12:56.660089+0000","last_clean":"2026-02-23T13:12:56.660089+0000","last_became_active":"2026-02-23T13:11:54.598751+0000","last_became_peered":"2026-02-23T13:11:54.598751+0000","last_unstale":"2026-02-23T13:12:56.660089+0000","last_undegraded":"2026-02-23T13:12:56.660089+0000","last_fullsized":"2026-02-23T13:12:56.660089+0000","mapping_epoch":78,"log_start":"88'27057","ondisk_log_start":"88'27057","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:59.904586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1773404160,"num_objects":27060,"num_object_clones":0,"num_object_copies":81180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27060,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27060,"num_write_kb":1731840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"88'26874","reported_seq":26904,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.666928+0000","last_change":"2026-02-23T13:11:54.596162+0000","last_active":"2026-02-23T13:12:56.666928+0000","last_peered":"2026-02-23T13:12:56.666928+0000","last_clean":"2026-02-23T13:12:56.666928+0000","last_became_active":"2026-02-23T13:11:54.595840+0000","last_became_peered":"2026-02-23T13:11:54.595840+0000","last_unstale":"2026-02-23T13:12:56.666928+0000","last_undegraded":"2026-02-23T13:12:56.666928+0000","last_fullsized":"2026-02-23T13:12:56.666928+0000","mapping_epoch":78,"log_start":"88'26871","ondisk_log_start":"88'26871","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:57.412771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1761214464,"num_objects":26874,"num_object_clones":0,"num_object_copies":80622,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26874,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26874,"num_write_kb":1719936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"88'26927","reported_seq":26957,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.669913+0000","last_change":"2026-02-23T13:11:54.596007+0000","last_active":"2026-02-23T13:12:56.669913+0000","last_peered":"2026-02-23T13:12:56.669913+0000","last_clean":"2026-02-23T13:12:56.669913+0000","last_became_active":"2026-02-23T13:11:54.595287+0000","last_became_peered":"2026-02-23T13:11:54.595287+0000","last_unstale":"2026-02-23T13:12:56.669913+0000","last_undegraded":"2026-02-23T13:12:56.669913+0000","last_fullsized":"2026-02-23T13:12:56.669913+0000","mapping_epoch":78,"log_start":"88'26924","ondisk_log_start":"88'26924","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:03.108821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1764687872,"num_objects":26927,"num_object_clones":0,"num_object_copies":80781,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26927,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26927,"num_write_kb":1723328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":364,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:55.726332+0000","last_change":"2026-02-23T13:11:50.169148+0000","last_active":"2026-02-23T13:12:55.726332+0000","last_peered":"2026-02-23T13:12:55.726332+0000","last_clean":"2026-02-23T13:12:55.726332+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:12:55.726332+0000","last_undegraded":"2026-02-23T13:12:55.726332+0000","last_fullsized":"2026-02-23T13:12:55.726332+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:11:50.169094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:11:50.169094+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:57.448558+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":28367126528,"num_objects":432848,"num_object_clones":0,"num_object_copies":1298544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":432848,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432848,"num_write_kb":27702272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":85118287872,"data_stored":85118287872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247930,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":25964824,"kb_used_data":24171076,"kb_used_omap":21,"kb_used_meta":1793706,"kb_avail":708038376,"statfs":{"total":751619276800,"available":725031297024,"internally_reserved":0,"allocated":24751181824,"data_stored":24750718231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22239,"internal_metadata":1836755233},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444157,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":20383576,"kb_used_data":18860740,"kb_used_omap":24,"kb_used_meta":1522791,"kb_avail":713619624,"statfs":{"total":751619276800,"available":730746494976,"internally_reserved":0,"allocated":19313397760,"data_stored":19312934167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24983,"internal_metadata":1559338601},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574975,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":19050644,"kb_used_data":17220800,"kb_used_omap":24,"kb_used_meta":1829799,"kb_avail":714952556,"statfs":{"total":751619276800,"available":732111417344,"internally_reserved":0,"allocated":17634099200,"data_stored":17633639159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25320,"internal_metadata":1873714456},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705792,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":23570968,"kb_used_data":22221252,"kb_used_omap":19,"kb_used_meta":1349676,"kb_avail":710432232,"statfs":{"total":751619276800,"available":727482605568,"internally_reserved":0,"allocated":22754562048,"data_stored":22754098455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19578,"internal_metadata":1382069126},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23052484608,"data_stored":23052484608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17717723136,"data_stored":17717723136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19503316992,"data_stored":19503316992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24844763136,"data_stored":24844763136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:12:58.284 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:12:58.432 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:58.557 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:58.555+0000 7f016fbd2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:58.557 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:58.555+0000 7f016fbd2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:58.692 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 63 15 446251 446236 442.658 391.375 0.00517248 0.00225787 2026-02-23T13:12:58.702 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:12:58.702 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:12:58.747 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:58 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4179515309' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-23T13:12:58.747 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:58 trial046 ceph-mon[38575]: osdmap e90: 4 total, 4 up, 4 in 2026-02-23T13:12:58.747 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:58 trial046 ceph-mon[38575]: 5.0 scrub starts 2026-02-23T13:12:58.748 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":365,"stamp":"2026-02-23T13:12:58.670742+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28367716896,"num_objects":432850,"num_object_clones":0,"num_object_copies":1298550,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":432850,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":432983,"num_write_kb":27704422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":88970012,"kb_used_data":82473868,"kb_used_omap":89,"kb_used_meta":6495974,"kb_avail":2847042788,"statfs":{"total":3006477107200,"available":2915371814912,"internally_reserved":0,"allocated":84453240832,"data_stored":84451390012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":92120,"internal_metadata":6651877416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,3],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2389835776,"num_objects":36466,"num_object_clones":0,"num_object_copies":109398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36466,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36466,"num_write_kb":2333824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000497"},"pg_stats":[{"pgid":"5.f","version":"88'27243","reported_seq":27273,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.672068+0000","last_change":"2026-02-23T13:11:54.596706+0000","last_active":"2026-02-23T13:12:56.672068+0000","last_peered":"2026-02-23T13:12:56.672068+0000","last_clean":"2026-02-23T13:12:56.672068+0000","last_became_active":"2026-02-23T13:11:54.595945+0000","last_became_peered":"2026-02-23T13:11:54.595945+0000","last_unstale":"2026-02-23T13:12:56.672068+0000","last_undegraded":"2026-02-23T13:12:56.672068+0000","last_fullsized":"2026-02-23T13:12:56.672068+0000","mapping_epoch":78,"log_start":"88'27240","ondisk_log_start":"88'27240","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:06.207061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1785397248,"num_objects":27243,"num_object_clones":0,"num_object_copies":81729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27243,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27243,"num_write_kb":1743552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"88'27200","reported_seq":27230,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.659548+0000","last_change":"2026-02-23T13:11:54.599809+0000","last_active":"2026-02-23T13:12:56.659548+0000","last_peered":"2026-02-23T13:12:56.659548+0000","last_clean":"2026-02-23T13:12:56.659548+0000","last_became_active":"2026-02-23T13:11:54.599064+0000","last_became_peered":"2026-02-23T13:11:54.599064+0000","last_unstale":"2026-02-23T13:12:56.659548+0000","last_undegraded":"2026-02-23T13:12:56.659548+0000","last_fullsized":"2026-02-23T13:12:56.659548+0000","mapping_epoch":78,"log_start":"88'27197","ondisk_log_start":"88'27197","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:11.698138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1782579200,"num_objects":27200,"num_object_clones":0,"num_object_copies":81600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27200,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27200,"num_write_kb":1740800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"88'27285","reported_seq":27315,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.661432+0000","last_change":"2026-02-23T13:11:54.596174+0000","last_active":"2026-02-23T13:12:56.661432+0000","last_peered":"2026-02-23T13:12:56.661432+0000","last_clean":"2026-02-23T13:12:56.661432+0000","last_became_active":"2026-02-23T13:11:54.595773+0000","last_became_peered":"2026-02-23T13:11:54.595773+0000","last_unstale":"2026-02-23T13:12:56.661432+0000","last_undegraded":"2026-02-23T13:12:56.661432+0000","last_fullsized":"2026-02-23T13:12:56.661432+0000","mapping_epoch":78,"log_start":"88'27282","ondisk_log_start":"88'27282","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.566475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1788149760,"num_objects":27285,"num_object_clones":0,"num_object_copies":81855,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27285,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27285,"num_write_kb":1746240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"89'26815","reported_seq":26847,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.779621+0000","last_change":"2026-02-23T13:11:54.595749+0000","last_active":"2026-02-23T13:12:56.779621+0000","last_peered":"2026-02-23T13:12:56.779621+0000","last_clean":"2026-02-23T13:12:56.779621+0000","last_became_active":"2026-02-23T13:11:54.595560+0000","last_became_peered":"2026-02-23T13:11:54.595560+0000","last_unstale":"2026-02-23T13:12:56.779621+0000","last_undegraded":"2026-02-23T13:12:56.779621+0000","last_fullsized":"2026-02-23T13:12:56.779621+0000","mapping_epoch":78,"log_start":"89'26812","ondisk_log_start":"89'26812","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:11.860237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1757347840,"num_objects":26815,"num_object_clones":0,"num_object_copies":80445,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26815,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26815,"num_write_kb":1716160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"88'26999","reported_seq":27029,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.665423+0000","last_change":"2026-02-23T13:11:54.596349+0000","last_active":"2026-02-23T13:12:56.665423+0000","last_peered":"2026-02-23T13:12:56.665423+0000","last_clean":"2026-02-23T13:12:56.665423+0000","last_became_active":"2026-02-23T13:11:54.596133+0000","last_became_peered":"2026-02-23T13:11:54.596133+0000","last_unstale":"2026-02-23T13:12:56.665423+0000","last_undegraded":"2026-02-23T13:12:56.665423+0000","last_fullsized":"2026-02-23T13:12:56.665423+0000","mapping_epoch":78,"log_start":"88'26996","ondisk_log_start":"88'26996","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:03.865476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769406464,"num_objects":26999,"num_object_clones":0,"num_object_copies":80997,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26999,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26999,"num_write_kb":1727936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"88'26946","reported_seq":26976,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.665953+0000","last_change":"2026-02-23T13:11:54.595383+0000","last_active":"2026-02-23T13:12:56.665953+0000","last_peered":"2026-02-23T13:12:56.665953+0000","last_clean":"2026-02-23T13:12:56.665953+0000","last_became_active":"2026-02-23T13:11:54.595080+0000","last_became_peered":"2026-02-23T13:11:54.595080+0000","last_unstale":"2026-02-23T13:12:56.665953+0000","last_undegraded":"2026-02-23T13:12:56.665953+0000","last_fullsized":"2026-02-23T13:12:56.665953+0000","mapping_epoch":78,"log_start":"88'26943","ondisk_log_start":"88'26943","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:12.934698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1765933056,"num_objects":26946,"num_object_clones":0,"num_object_copies":80838,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26946,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26946,"num_write_kb":1724544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"88'27011","reported_seq":27041,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.660034+0000","last_change":"2026-02-23T13:11:54.598497+0000","last_active":"2026-02-23T13:12:56.660034+0000","last_peered":"2026-02-23T13:12:56.660034+0000","last_clean":"2026-02-23T13:12:56.660034+0000","last_became_active":"2026-02-23T13:11:54.598325+0000","last_became_peered":"2026-02-23T13:11:54.598325+0000","last_unstale":"2026-02-23T13:12:56.660034+0000","last_undegraded":"2026-02-23T13:12:56.660034+0000","last_fullsized":"2026-02-23T13:12:56.660034+0000","mapping_epoch":78,"log_start":"88'27008","ondisk_log_start":"88'27008","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:57.924450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1770192896,"num_objects":27011,"num_object_clones":0,"num_object_copies":81033,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27011,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27011,"num_write_kb":1728704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"88'26718","reported_seq":26748,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.661998+0000","last_change":"2026-02-23T13:11:54.595376+0000","last_active":"2026-02-23T13:12:56.661998+0000","last_peered":"2026-02-23T13:12:56.661998+0000","last_clean":"2026-02-23T13:12:56.661998+0000","last_became_active":"2026-02-23T13:11:54.595110+0000","last_became_peered":"2026-02-23T13:11:54.595110+0000","last_unstale":"2026-02-23T13:12:56.661998+0000","last_undegraded":"2026-02-23T13:12:56.661998+0000","last_fullsized":"2026-02-23T13:12:56.661998+0000","mapping_epoch":78,"log_start":"88'26715","ondisk_log_start":"88'26715","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:02.754608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1750990848,"num_objects":26718,"num_object_clones":0,"num_object_copies":80154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26718,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26718,"num_write_kb":1709952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"88'27316","reported_seq":27346,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.657865+0000","last_change":"2026-02-23T13:11:54.599364+0000","last_active":"2026-02-23T13:12:56.657865+0000","last_peered":"2026-02-23T13:12:56.657865+0000","last_clean":"2026-02-23T13:12:56.657865+0000","last_became_active":"2026-02-23T13:11:54.599155+0000","last_became_peered":"2026-02-23T13:11:54.599155+0000","last_unstale":"2026-02-23T13:12:56.657865+0000","last_undegraded":"2026-02-23T13:12:56.657865+0000","last_fullsized":"2026-02-23T13:12:56.657865+0000","mapping_epoch":78,"log_start":"88'27313","ondisk_log_start":"88'27313","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:14.711414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1790181376,"num_objects":27316,"num_object_clones":0,"num_object_copies":81948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27316,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27316,"num_write_kb":1748224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"89'27116","reported_seq":27148,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.777888+0000","last_change":"2026-02-23T13:11:54.595872+0000","last_active":"2026-02-23T13:12:56.777888+0000","last_peered":"2026-02-23T13:12:56.777888+0000","last_clean":"2026-02-23T13:12:56.777888+0000","last_became_active":"2026-02-23T13:11:54.595645+0000","last_became_peered":"2026-02-23T13:11:54.595645+0000","last_unstale":"2026-02-23T13:12:56.777888+0000","last_undegraded":"2026-02-23T13:12:56.777888+0000","last_fullsized":"2026-02-23T13:12:56.777888+0000","mapping_epoch":78,"log_start":"89'27113","ondisk_log_start":"89'27113","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.565438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1777074176,"num_objects":27116,"num_object_clones":0,"num_object_copies":81348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27116,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27116,"num_write_kb":1735424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"88'27008","reported_seq":27037,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.665230+0000","last_change":"2026-02-23T13:11:54.595399+0000","last_active":"2026-02-23T13:12:56.665230+0000","last_peered":"2026-02-23T13:12:56.665230+0000","last_clean":"2026-02-23T13:12:56.665230+0000","last_became_active":"2026-02-23T13:11:54.595144+0000","last_became_peered":"2026-02-23T13:11:54.595144+0000","last_unstale":"2026-02-23T13:12:56.665230+0000","last_undegraded":"2026-02-23T13:12:56.665230+0000","last_fullsized":"2026-02-23T13:12:56.665230+0000","mapping_epoch":78,"log_start":"88'27005","ondisk_log_start":"88'27005","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:16.231133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769996288,"num_objects":27008,"num_object_clones":0,"num_object_copies":81024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27008,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27008,"num_write_kb":1728512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"88'27288","reported_seq":27318,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.667282+0000","last_change":"2026-02-23T13:11:54.596295+0000","last_active":"2026-02-23T13:12:56.667282+0000","last_peered":"2026-02-23T13:12:56.667282+0000","last_clean":"2026-02-23T13:12:56.667282+0000","last_became_active":"2026-02-23T13:11:54.595996+0000","last_became_peered":"2026-02-23T13:11:54.595996+0000","last_unstale":"2026-02-23T13:12:56.667282+0000","last_undegraded":"2026-02-23T13:12:56.667282+0000","last_fullsized":"2026-02-23T13:12:56.667282+0000","mapping_epoch":78,"log_start":"88'27285","ondisk_log_start":"88'27285","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.493149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1788346368,"num_objects":27288,"num_object_clones":0,"num_object_copies":81864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27288,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27288,"num_write_kb":1746432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"88'27042","reported_seq":27072,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.662292+0000","last_change":"2026-02-23T13:11:54.599275+0000","last_active":"2026-02-23T13:12:56.662292+0000","last_peered":"2026-02-23T13:12:56.662292+0000","last_clean":"2026-02-23T13:12:56.662292+0000","last_became_active":"2026-02-23T13:11:54.598958+0000","last_became_peered":"2026-02-23T13:11:54.598958+0000","last_unstale":"2026-02-23T13:12:56.662292+0000","last_undegraded":"2026-02-23T13:12:56.662292+0000","last_fullsized":"2026-02-23T13:12:56.662292+0000","mapping_epoch":78,"log_start":"88'27039","ondisk_log_start":"88'27039","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:13.230076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1772224512,"num_objects":27042,"num_object_clones":0,"num_object_copies":81126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27042,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27042,"num_write_kb":1730688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"88'27060","reported_seq":27090,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.660089+0000","last_change":"2026-02-23T13:11:54.599032+0000","last_active":"2026-02-23T13:12:56.660089+0000","last_peered":"2026-02-23T13:12:56.660089+0000","last_clean":"2026-02-23T13:12:56.660089+0000","last_became_active":"2026-02-23T13:11:54.598751+0000","last_became_peered":"2026-02-23T13:11:54.598751+0000","last_unstale":"2026-02-23T13:12:56.660089+0000","last_undegraded":"2026-02-23T13:12:56.660089+0000","last_fullsized":"2026-02-23T13:12:56.660089+0000","mapping_epoch":78,"log_start":"88'27057","ondisk_log_start":"88'27057","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:59.904586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1773404160,"num_objects":27060,"num_object_clones":0,"num_object_copies":81180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27060,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27060,"num_write_kb":1731840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"88'26874","reported_seq":26904,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.666928+0000","last_change":"2026-02-23T13:11:54.596162+0000","last_active":"2026-02-23T13:12:56.666928+0000","last_peered":"2026-02-23T13:12:56.666928+0000","last_clean":"2026-02-23T13:12:56.666928+0000","last_became_active":"2026-02-23T13:11:54.595840+0000","last_became_peered":"2026-02-23T13:11:54.595840+0000","last_unstale":"2026-02-23T13:12:56.666928+0000","last_undegraded":"2026-02-23T13:12:56.666928+0000","last_fullsized":"2026-02-23T13:12:56.666928+0000","mapping_epoch":78,"log_start":"88'26871","ondisk_log_start":"88'26871","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:57.412771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1761214464,"num_objects":26874,"num_object_clones":0,"num_object_copies":80622,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26874,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26874,"num_write_kb":1719936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"88'26927","reported_seq":26957,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.669913+0000","last_change":"2026-02-23T13:11:54.596007+0000","last_active":"2026-02-23T13:12:56.669913+0000","last_peered":"2026-02-23T13:12:56.669913+0000","last_clean":"2026-02-23T13:12:56.669913+0000","last_became_active":"2026-02-23T13:11:54.595287+0000","last_became_peered":"2026-02-23T13:11:54.595287+0000","last_unstale":"2026-02-23T13:12:56.669913+0000","last_undegraded":"2026-02-23T13:12:56.669913+0000","last_fullsized":"2026-02-23T13:12:56.669913+0000","mapping_epoch":78,"log_start":"88'26924","ondisk_log_start":"88'26924","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:03.108821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1764687872,"num_objects":26927,"num_object_clones":0,"num_object_copies":80781,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26927,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26927,"num_write_kb":1723328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":364,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:55.726332+0000","last_change":"2026-02-23T13:11:50.169148+0000","last_active":"2026-02-23T13:12:55.726332+0000","last_peered":"2026-02-23T13:12:55.726332+0000","last_clean":"2026-02-23T13:12:55.726332+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:12:55.726332+0000","last_undegraded":"2026-02-23T13:12:55.726332+0000","last_fullsized":"2026-02-23T13:12:55.726332+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:11:50.169094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:11:50.169094+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:57.448558+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":28367126528,"num_objects":432848,"num_object_clones":0,"num_object_copies":1298544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":432848,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432848,"num_write_kb":27702272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":85118287872,"data_stored":85118287872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247930,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":25964824,"kb_used_data":24171076,"kb_used_omap":21,"kb_used_meta":1793706,"kb_avail":708038376,"statfs":{"total":751619276800,"available":725031297024,"internally_reserved":0,"allocated":24751181824,"data_stored":24750718231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22239,"internal_metadata":1836755233},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444157,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":20383576,"kb_used_data":18860740,"kb_used_omap":24,"kb_used_meta":1522791,"kb_avail":713619624,"statfs":{"total":751619276800,"available":730746494976,"internally_reserved":0,"allocated":19313397760,"data_stored":19312934167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24983,"internal_metadata":1559338601},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574975,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":19050644,"kb_used_data":17220800,"kb_used_omap":24,"kb_used_meta":1829799,"kb_avail":714952556,"statfs":{"total":751619276800,"available":732111417344,"internally_reserved":0,"allocated":17634099200,"data_stored":17633639159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25320,"internal_metadata":1873714456},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705792,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":23570968,"kb_used_data":22221252,"kb_used_omap":19,"kb_used_meta":1349676,"kb_avail":710432232,"statfs":{"total":751619276800,"available":727482605568,"internally_reserved":0,"allocated":22754562048,"data_stored":22754098455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19578,"internal_metadata":1382069126},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23052484608,"data_stored":23052484608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17717723136,"data_stored":17717723136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19503316992,"data_stored":19503316992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24844763136,"data_stored":24844763136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:12:58.749 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-23T13:12:58.749 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:12:58.749 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-23T13:12:58.749 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:12:58.891 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:59.022 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:59.020+0000 7efd97885640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:59.022 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:59.020+0000 7efd97885640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:59.158 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:12:59.159 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:12:59.206 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":365,"stamp":"2026-02-23T13:12:58.670742+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28367716896,"num_objects":432850,"num_object_clones":0,"num_object_copies":1298550,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":432850,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":432983,"num_write_kb":27704422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":88970012,"kb_used_data":82473868,"kb_used_omap":89,"kb_used_meta":6495974,"kb_avail":2847042788,"statfs":{"total":3006477107200,"available":2915371814912,"internally_reserved":0,"allocated":84453240832,"data_stored":84451390012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":92120,"internal_metadata":6651877416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,3],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2389835776,"num_objects":36466,"num_object_clones":0,"num_object_copies":109398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36466,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36466,"num_write_kb":2333824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000497"},"pg_stats":[{"pgid":"5.f","version":"88'27243","reported_seq":27273,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.672068+0000","last_change":"2026-02-23T13:11:54.596706+0000","last_active":"2026-02-23T13:12:56.672068+0000","last_peered":"2026-02-23T13:12:56.672068+0000","last_clean":"2026-02-23T13:12:56.672068+0000","last_became_active":"2026-02-23T13:11:54.595945+0000","last_became_peered":"2026-02-23T13:11:54.595945+0000","last_unstale":"2026-02-23T13:12:56.672068+0000","last_undegraded":"2026-02-23T13:12:56.672068+0000","last_fullsized":"2026-02-23T13:12:56.672068+0000","mapping_epoch":78,"log_start":"88'27240","ondisk_log_start":"88'27240","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:06.207061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1785397248,"num_objects":27243,"num_object_clones":0,"num_object_copies":81729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27243,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27243,"num_write_kb":1743552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"88'27200","reported_seq":27230,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.659548+0000","last_change":"2026-02-23T13:11:54.599809+0000","last_active":"2026-02-23T13:12:56.659548+0000","last_peered":"2026-02-23T13:12:56.659548+0000","last_clean":"2026-02-23T13:12:56.659548+0000","last_became_active":"2026-02-23T13:11:54.599064+0000","last_became_peered":"2026-02-23T13:11:54.599064+0000","last_unstale":"2026-02-23T13:12:56.659548+0000","last_undegraded":"2026-02-23T13:12:56.659548+0000","last_fullsized":"2026-02-23T13:12:56.659548+0000","mapping_epoch":78,"log_start":"88'27197","ondisk_log_start":"88'27197","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:11.698138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1782579200,"num_objects":27200,"num_object_clones":0,"num_object_copies":81600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27200,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27200,"num_write_kb":1740800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"88'27285","reported_seq":27315,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.661432+0000","last_change":"2026-02-23T13:11:54.596174+0000","last_active":"2026-02-23T13:12:56.661432+0000","last_peered":"2026-02-23T13:12:56.661432+0000","last_clean":"2026-02-23T13:12:56.661432+0000","last_became_active":"2026-02-23T13:11:54.595773+0000","last_became_peered":"2026-02-23T13:11:54.595773+0000","last_unstale":"2026-02-23T13:12:56.661432+0000","last_undegraded":"2026-02-23T13:12:56.661432+0000","last_fullsized":"2026-02-23T13:12:56.661432+0000","mapping_epoch":78,"log_start":"88'27282","ondisk_log_start":"88'27282","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.566475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1788149760,"num_objects":27285,"num_object_clones":0,"num_object_copies":81855,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27285,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27285,"num_write_kb":1746240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"89'26815","reported_seq":26847,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.779621+0000","last_change":"2026-02-23T13:11:54.595749+0000","last_active":"2026-02-23T13:12:56.779621+0000","last_peered":"2026-02-23T13:12:56.779621+0000","last_clean":"2026-02-23T13:12:56.779621+0000","last_became_active":"2026-02-23T13:11:54.595560+0000","last_became_peered":"2026-02-23T13:11:54.595560+0000","last_unstale":"2026-02-23T13:12:56.779621+0000","last_undegraded":"2026-02-23T13:12:56.779621+0000","last_fullsized":"2026-02-23T13:12:56.779621+0000","mapping_epoch":78,"log_start":"89'26812","ondisk_log_start":"89'26812","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:11.860237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1757347840,"num_objects":26815,"num_object_clones":0,"num_object_copies":80445,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26815,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26815,"num_write_kb":1716160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"88'26999","reported_seq":27029,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.665423+0000","last_change":"2026-02-23T13:11:54.596349+0000","last_active":"2026-02-23T13:12:56.665423+0000","last_peered":"2026-02-23T13:12:56.665423+0000","last_clean":"2026-02-23T13:12:56.665423+0000","last_became_active":"2026-02-23T13:11:54.596133+0000","last_became_peered":"2026-02-23T13:11:54.596133+0000","last_unstale":"2026-02-23T13:12:56.665423+0000","last_undegraded":"2026-02-23T13:12:56.665423+0000","last_fullsized":"2026-02-23T13:12:56.665423+0000","mapping_epoch":78,"log_start":"88'26996","ondisk_log_start":"88'26996","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:03.865476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769406464,"num_objects":26999,"num_object_clones":0,"num_object_copies":80997,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26999,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26999,"num_write_kb":1727936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"88'26946","reported_seq":26976,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.665953+0000","last_change":"2026-02-23T13:11:54.595383+0000","last_active":"2026-02-23T13:12:56.665953+0000","last_peered":"2026-02-23T13:12:56.665953+0000","last_clean":"2026-02-23T13:12:56.665953+0000","last_became_active":"2026-02-23T13:11:54.595080+0000","last_became_peered":"2026-02-23T13:11:54.595080+0000","last_unstale":"2026-02-23T13:12:56.665953+0000","last_undegraded":"2026-02-23T13:12:56.665953+0000","last_fullsized":"2026-02-23T13:12:56.665953+0000","mapping_epoch":78,"log_start":"88'26943","ondisk_log_start":"88'26943","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:12.934698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1765933056,"num_objects":26946,"num_object_clones":0,"num_object_copies":80838,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26946,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26946,"num_write_kb":1724544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"88'27011","reported_seq":27041,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.660034+0000","last_change":"2026-02-23T13:11:54.598497+0000","last_active":"2026-02-23T13:12:56.660034+0000","last_peered":"2026-02-23T13:12:56.660034+0000","last_clean":"2026-02-23T13:12:56.660034+0000","last_became_active":"2026-02-23T13:11:54.598325+0000","last_became_peered":"2026-02-23T13:11:54.598325+0000","last_unstale":"2026-02-23T13:12:56.660034+0000","last_undegraded":"2026-02-23T13:12:56.660034+0000","last_fullsized":"2026-02-23T13:12:56.660034+0000","mapping_epoch":78,"log_start":"88'27008","ondisk_log_start":"88'27008","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:57.924450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1770192896,"num_objects":27011,"num_object_clones":0,"num_object_copies":81033,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27011,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27011,"num_write_kb":1728704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"88'26718","reported_seq":26748,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.661998+0000","last_change":"2026-02-23T13:11:54.595376+0000","last_active":"2026-02-23T13:12:56.661998+0000","last_peered":"2026-02-23T13:12:56.661998+0000","last_clean":"2026-02-23T13:12:56.661998+0000","last_became_active":"2026-02-23T13:11:54.595110+0000","last_became_peered":"2026-02-23T13:11:54.595110+0000","last_unstale":"2026-02-23T13:12:56.661998+0000","last_undegraded":"2026-02-23T13:12:56.661998+0000","last_fullsized":"2026-02-23T13:12:56.661998+0000","mapping_epoch":78,"log_start":"88'26715","ondisk_log_start":"88'26715","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:02.754608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1750990848,"num_objects":26718,"num_object_clones":0,"num_object_copies":80154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26718,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26718,"num_write_kb":1709952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"88'27316","reported_seq":27346,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.657865+0000","last_change":"2026-02-23T13:11:54.599364+0000","last_active":"2026-02-23T13:12:56.657865+0000","last_peered":"2026-02-23T13:12:56.657865+0000","last_clean":"2026-02-23T13:12:56.657865+0000","last_became_active":"2026-02-23T13:11:54.599155+0000","last_became_peered":"2026-02-23T13:11:54.599155+0000","last_unstale":"2026-02-23T13:12:56.657865+0000","last_undegraded":"2026-02-23T13:12:56.657865+0000","last_fullsized":"2026-02-23T13:12:56.657865+0000","mapping_epoch":78,"log_start":"88'27313","ondisk_log_start":"88'27313","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:14.711414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1790181376,"num_objects":27316,"num_object_clones":0,"num_object_copies":81948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27316,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27316,"num_write_kb":1748224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"89'27116","reported_seq":27148,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.777888+0000","last_change":"2026-02-23T13:11:54.595872+0000","last_active":"2026-02-23T13:12:56.777888+0000","last_peered":"2026-02-23T13:12:56.777888+0000","last_clean":"2026-02-23T13:12:56.777888+0000","last_became_active":"2026-02-23T13:11:54.595645+0000","last_became_peered":"2026-02-23T13:11:54.595645+0000","last_unstale":"2026-02-23T13:12:56.777888+0000","last_undegraded":"2026-02-23T13:12:56.777888+0000","last_fullsized":"2026-02-23T13:12:56.777888+0000","mapping_epoch":78,"log_start":"89'27113","ondisk_log_start":"89'27113","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.565438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1777074176,"num_objects":27116,"num_object_clones":0,"num_object_copies":81348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27116,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27116,"num_write_kb":1735424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"88'27008","reported_seq":27037,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.665230+0000","last_change":"2026-02-23T13:11:54.595399+0000","last_active":"2026-02-23T13:12:56.665230+0000","last_peered":"2026-02-23T13:12:56.665230+0000","last_clean":"2026-02-23T13:12:56.665230+0000","last_became_active":"2026-02-23T13:11:54.595144+0000","last_became_peered":"2026-02-23T13:11:54.595144+0000","last_unstale":"2026-02-23T13:12:56.665230+0000","last_undegraded":"2026-02-23T13:12:56.665230+0000","last_fullsized":"2026-02-23T13:12:56.665230+0000","mapping_epoch":78,"log_start":"88'27005","ondisk_log_start":"88'27005","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:16.231133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769996288,"num_objects":27008,"num_object_clones":0,"num_object_copies":81024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27008,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27008,"num_write_kb":1728512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"88'27288","reported_seq":27318,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.667282+0000","last_change":"2026-02-23T13:11:54.596295+0000","last_active":"2026-02-23T13:12:56.667282+0000","last_peered":"2026-02-23T13:12:56.667282+0000","last_clean":"2026-02-23T13:12:56.667282+0000","last_became_active":"2026-02-23T13:11:54.595996+0000","last_became_peered":"2026-02-23T13:11:54.595996+0000","last_unstale":"2026-02-23T13:12:56.667282+0000","last_undegraded":"2026-02-23T13:12:56.667282+0000","last_fullsized":"2026-02-23T13:12:56.667282+0000","mapping_epoch":78,"log_start":"88'27285","ondisk_log_start":"88'27285","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.493149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1788346368,"num_objects":27288,"num_object_clones":0,"num_object_copies":81864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27288,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27288,"num_write_kb":1746432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"88'27042","reported_seq":27072,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.662292+0000","last_change":"2026-02-23T13:11:54.599275+0000","last_active":"2026-02-23T13:12:56.662292+0000","last_peered":"2026-02-23T13:12:56.662292+0000","last_clean":"2026-02-23T13:12:56.662292+0000","last_became_active":"2026-02-23T13:11:54.598958+0000","last_became_peered":"2026-02-23T13:11:54.598958+0000","last_unstale":"2026-02-23T13:12:56.662292+0000","last_undegraded":"2026-02-23T13:12:56.662292+0000","last_fullsized":"2026-02-23T13:12:56.662292+0000","mapping_epoch":78,"log_start":"88'27039","ondisk_log_start":"88'27039","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:13.230076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1772224512,"num_objects":27042,"num_object_clones":0,"num_object_copies":81126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27042,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27042,"num_write_kb":1730688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"88'27060","reported_seq":27090,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.660089+0000","last_change":"2026-02-23T13:11:54.599032+0000","last_active":"2026-02-23T13:12:56.660089+0000","last_peered":"2026-02-23T13:12:56.660089+0000","last_clean":"2026-02-23T13:12:56.660089+0000","last_became_active":"2026-02-23T13:11:54.598751+0000","last_became_peered":"2026-02-23T13:11:54.598751+0000","last_unstale":"2026-02-23T13:12:56.660089+0000","last_undegraded":"2026-02-23T13:12:56.660089+0000","last_fullsized":"2026-02-23T13:12:56.660089+0000","mapping_epoch":78,"log_start":"88'27057","ondisk_log_start":"88'27057","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:59.904586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1773404160,"num_objects":27060,"num_object_clones":0,"num_object_copies":81180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27060,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27060,"num_write_kb":1731840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"88'26874","reported_seq":26904,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.666928+0000","last_change":"2026-02-23T13:11:54.596162+0000","last_active":"2026-02-23T13:12:56.666928+0000","last_peered":"2026-02-23T13:12:56.666928+0000","last_clean":"2026-02-23T13:12:56.666928+0000","last_became_active":"2026-02-23T13:11:54.595840+0000","last_became_peered":"2026-02-23T13:11:54.595840+0000","last_unstale":"2026-02-23T13:12:56.666928+0000","last_undegraded":"2026-02-23T13:12:56.666928+0000","last_fullsized":"2026-02-23T13:12:56.666928+0000","mapping_epoch":78,"log_start":"88'26871","ondisk_log_start":"88'26871","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:57.412771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1761214464,"num_objects":26874,"num_object_clones":0,"num_object_copies":80622,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26874,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26874,"num_write_kb":1719936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"88'26927","reported_seq":26957,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:56.669913+0000","last_change":"2026-02-23T13:11:54.596007+0000","last_active":"2026-02-23T13:12:56.669913+0000","last_peered":"2026-02-23T13:12:56.669913+0000","last_clean":"2026-02-23T13:12:56.669913+0000","last_became_active":"2026-02-23T13:11:54.595287+0000","last_became_peered":"2026-02-23T13:11:54.595287+0000","last_unstale":"2026-02-23T13:12:56.669913+0000","last_undegraded":"2026-02-23T13:12:56.669913+0000","last_fullsized":"2026-02-23T13:12:56.669913+0000","mapping_epoch":78,"log_start":"88'26924","ondisk_log_start":"88'26924","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:03.108821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1764687872,"num_objects":26927,"num_object_clones":0,"num_object_copies":80781,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26927,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26927,"num_write_kb":1723328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":364,"reported_epoch":88,"state":"active+clean","last_fresh":"2026-02-23T13:12:55.726332+0000","last_change":"2026-02-23T13:11:50.169148+0000","last_active":"2026-02-23T13:12:55.726332+0000","last_peered":"2026-02-23T13:12:55.726332+0000","last_clean":"2026-02-23T13:12:55.726332+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:12:55.726332+0000","last_undegraded":"2026-02-23T13:12:55.726332+0000","last_fullsized":"2026-02-23T13:12:55.726332+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:11:50.169094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:11:50.169094+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:12:57.448558+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":28367126528,"num_objects":432848,"num_object_clones":0,"num_object_copies":1298544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":432848,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432848,"num_write_kb":27702272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":85118287872,"data_stored":85118287872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247930,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":25964824,"kb_used_data":24171076,"kb_used_omap":21,"kb_used_meta":1793706,"kb_avail":708038376,"statfs":{"total":751619276800,"available":725031297024,"internally_reserved":0,"allocated":24751181824,"data_stored":24750718231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22239,"internal_metadata":1836755233},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444157,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":20383576,"kb_used_data":18860740,"kb_used_omap":24,"kb_used_meta":1522791,"kb_avail":713619624,"statfs":{"total":751619276800,"available":730746494976,"internally_reserved":0,"allocated":19313397760,"data_stored":19312934167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24983,"internal_metadata":1559338601},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574975,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":19050644,"kb_used_data":17220800,"kb_used_omap":24,"kb_used_meta":1829799,"kb_avail":714952556,"statfs":{"total":751619276800,"available":732111417344,"internally_reserved":0,"allocated":17634099200,"data_stored":17633639159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25320,"internal_metadata":1873714456},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705792,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":23570968,"kb_used_data":22221252,"kb_used_omap":19,"kb_used_meta":1349676,"kb_avail":710432232,"statfs":{"total":751619276800,"available":727482605568,"internally_reserved":0,"allocated":22754562048,"data_stored":22754098455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19578,"internal_metadata":1382069126},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23052484608,"data_stored":23052484608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17717723136,"data_stored":17717723136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19503316992,"data_stored":19503316992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24844763136,"data_stored":24844763136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:12:59.208 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 221 2026-02-23T13:12:59.350 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:59.478 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:59.476+0000 7fe71c369640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:59.478 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:12:59.476+0000 7fe71c369640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:12:59.613 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-23T13:12:59.653 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:12:59.692 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 64 16 452535 452519 441.877 392.688 0.00737239 0.00226187 2026-02-23T13:12:59.757 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:12:59.895 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:12:59.922 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:59 trial046 ceph-mon[38575]: from='client.15265 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:12:59.923 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:59 trial046 ceph-mon[38575]: pgmap v365: 17 pgs: 17 active+clean; 26 GiB data, 85 GiB used, 2.7 TiB / 2.7 TiB avail; 570 MiB/s wr, 9.12k op/s 2026-02-23T13:12:59.923 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:59 trial046 ceph-mon[38575]: from='client.15267 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:12:59.923 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:12:59 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/755759202' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "221"} : dispatch 2026-02-23T13:13:00.022 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:00.020+0000 7f96b0f0a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:00.022 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:00.020+0000 7f96b0f0a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:00.036 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:13:00.037 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:13:00.049 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:13:00.050 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:13:00.061 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:13:00.062 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:13:00.074 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:13:00.074 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:13:00.693 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 65 15 459032 459017 441.327 406.125 0.00211813 0.00226471 2026-02-23T13:13:01.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:00 trial046 ceph-mon[38575]: from='client.15269 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:13:01.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:00 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2350832' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:13:01.693 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 66 16 466241 466225 441.465 450.5 0.00165571 0.002264 2026-02-23T13:13:02.038 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:01 trial046 ceph-mon[38575]: 5.0 scrub ok 2026-02-23T13:13:02.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:01 trial046 ceph-mon[38575]: pgmap v366: 17 pgs: 17 active+clean; 26 GiB data, 85 GiB used, 2.7 TiB / 2.7 TiB avail; 383 MiB/s wr, 6.13k op/s 2026-02-23T13:13:02.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:01 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:13:02.125 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:13:02.262 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:02.382 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:02.381+0000 7f922e0b3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:02.383 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:02.382+0000 7f922e0b3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:02.398 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:13:02.398 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:13:02.411 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:13:02.412 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:13:02.423 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:13:02.423 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:13:02.436 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:13:02.436 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:13:02.693 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 67 16 472953 472937 441.137 419.5 0.0011542 0.00226566 2026-02-23T13:13:03.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:02 trial046 ceph-mon[38575]: 1.0 scrub starts 2026-02-23T13:13:03.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:02 trial046 ceph-mon[38575]: 1.0 scrub ok 2026-02-23T13:13:03.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:02 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/819823177' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:13:03.693 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 68 15 479904 479889 441.039 434.5 0.00138783 0.00226618 2026-02-23T13:13:04.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:03 trial046 ceph-mon[38575]: 5.9 scrub starts 2026-02-23T13:13:04.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:03 trial046 ceph-mon[38575]: pgmap v367: 17 pgs: 17 active+clean; 28 GiB data, 91 GiB used, 2.6 TiB / 2.7 TiB avail; 628 MiB/s wr, 10.04k op/s 2026-02-23T13:13:04.481 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:13:04.632 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:04.654 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:13:04.654 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:13:04.654 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_3 2026-02-23T13:13:04.654 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:13:04.693 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 69 15 486294 486279 440.434 399.375 0.00162664 0.00226929 2026-02-23T13:13:04.753 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:04.752+0000 7f8b97191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:04.753 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:04.752+0000 7f8b97191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:04.769 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:13:04.769 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:13:04.785 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:13:04.785 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:13:04.800 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:13:04.801 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:13:04.803 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:04.816 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:13:04.816 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:13:04.921 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:04.920+0000 7fa876173640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:04.921 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:04.921+0000 7fa876173640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:05.062 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:13:05.063 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:13:05.112 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":368,"stamp":"2026-02-23T13:13:04.671561+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30550852128,"num_objects":466162,"num_object_clones":0,"num_object_copies":1398486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":466162,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":466295,"num_write_kb":29836390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":95260428,"kb_used_data":88818236,"kb_used_omap":98,"kb_used_meta":6442013,"kb_avail":2840752372,"statfs":{"total":3006477107200,"available":2908930428928,"internally_reserved":0,"allocated":90949873664,"data_stored":90948117392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":100928,"internal_metadata":6596621760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2778267648,"num_objects":42393,"num_object_clones":0,"num_object_copies":127179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42393,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42393,"num_write_kb":2713152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001080"},"pg_stats":[{"pgid":"5.f","version":"90'29328","reported_seq":29361,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:01.671824+0000","last_change":"2026-02-23T13:11:54.596706+0000","last_active":"2026-02-23T13:13:01.671824+0000","last_peered":"2026-02-23T13:13:01.671824+0000","last_clean":"2026-02-23T13:13:01.671824+0000","last_became_active":"2026-02-23T13:11:54.595945+0000","last_became_peered":"2026-02-23T13:11:54.595945+0000","last_unstale":"2026-02-23T13:13:01.671824+0000","last_undegraded":"2026-02-23T13:13:01.671824+0000","last_fullsized":"2026-02-23T13:13:01.671824+0000","mapping_epoch":78,"log_start":"90'29325","ondisk_log_start":"90'29325","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:06.207061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1922039808,"num_objects":29328,"num_object_clones":0,"num_object_copies":87984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29328,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29328,"num_write_kb":1876992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"90'29346","reported_seq":29380,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:01.654313+0000","last_change":"2026-02-23T13:11:54.599809+0000","last_active":"2026-02-23T13:13:01.654313+0000","last_peered":"2026-02-23T13:13:01.654313+0000","last_clean":"2026-02-23T13:13:01.654313+0000","last_became_active":"2026-02-23T13:11:54.599064+0000","last_became_peered":"2026-02-23T13:11:54.599064+0000","last_unstale":"2026-02-23T13:13:01.654313+0000","last_undegraded":"2026-02-23T13:13:01.654313+0000","last_fullsized":"2026-02-23T13:13:01.654313+0000","mapping_epoch":78,"log_start":"90'29343","ondisk_log_start":"90'29343","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:11.698138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1923219456,"num_objects":29346,"num_object_clones":0,"num_object_copies":88038,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29346,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29346,"num_write_kb":1878144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"90'29393","reported_seq":29427,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:01.663595+0000","last_change":"2026-02-23T13:11:54.596174+0000","last_active":"2026-02-23T13:13:01.663595+0000","last_peered":"2026-02-23T13:13:01.663595+0000","last_clean":"2026-02-23T13:13:01.663595+0000","last_became_active":"2026-02-23T13:11:54.595773+0000","last_became_peered":"2026-02-23T13:11:54.595773+0000","last_unstale":"2026-02-23T13:13:01.663595+0000","last_undegraded":"2026-02-23T13:13:01.663595+0000","last_fullsized":"2026-02-23T13:13:01.663595+0000","mapping_epoch":78,"log_start":"90'29390","ondisk_log_start":"90'29390","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.566475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1926299648,"num_objects":29393,"num_object_clones":0,"num_object_copies":88179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29393,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29393,"num_write_kb":1881152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"90'28878","reported_seq":28912,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:01.778146+0000","last_change":"2026-02-23T13:11:54.595749+0000","last_active":"2026-02-23T13:13:01.778146+0000","last_peered":"2026-02-23T13:13:01.778146+0000","last_clean":"2026-02-23T13:13:01.778146+0000","last_became_active":"2026-02-23T13:11:54.595560+0000","last_became_peered":"2026-02-23T13:11:54.595560+0000","last_unstale":"2026-02-23T13:13:01.778146+0000","last_undegraded":"2026-02-23T13:13:01.778146+0000","last_fullsized":"2026-02-23T13:13:01.778146+0000","mapping_epoch":78,"log_start":"90'28875","ondisk_log_start":"90'28875","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:11.860237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1892548608,"num_objects":28878,"num_object_clones":0,"num_object_copies":86634,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28878,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28878,"num_write_kb":1848192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"90'29103","reported_seq":29136,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:01.664559+0000","last_change":"2026-02-23T13:11:54.596349+0000","last_active":"2026-02-23T13:13:01.664559+0000","last_peered":"2026-02-23T13:13:01.664559+0000","last_clean":"2026-02-23T13:13:01.664559+0000","last_became_active":"2026-02-23T13:11:54.596133+0000","last_became_peered":"2026-02-23T13:11:54.596133+0000","last_unstale":"2026-02-23T13:13:01.664559+0000","last_undegraded":"2026-02-23T13:13:01.664559+0000","last_fullsized":"2026-02-23T13:13:01.664559+0000","mapping_epoch":78,"log_start":"90'29100","ondisk_log_start":"90'29100","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:03.865476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1907294208,"num_objects":29103,"num_object_clones":0,"num_object_copies":87309,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29103,"num_write_kb":1862592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"90'28990","reported_seq":29024,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:01.663613+0000","last_change":"2026-02-23T13:11:54.595383+0000","last_active":"2026-02-23T13:13:01.663613+0000","last_peered":"2026-02-23T13:13:01.663613+0000","last_clean":"2026-02-23T13:13:01.663613+0000","last_became_active":"2026-02-23T13:11:54.595080+0000","last_became_peered":"2026-02-23T13:11:54.595080+0000","last_unstale":"2026-02-23T13:13:01.663613+0000","last_undegraded":"2026-02-23T13:13:01.663613+0000","last_fullsized":"2026-02-23T13:13:01.663613+0000","mapping_epoch":78,"log_start":"90'28987","ondisk_log_start":"90'28987","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:12.934698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1899888640,"num_objects":28990,"num_object_clones":0,"num_object_copies":86970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28990,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28990,"num_write_kb":1855360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"90'29051","reported_seq":29085,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:01.664309+0000","last_change":"2026-02-23T13:11:54.598497+0000","last_active":"2026-02-23T13:13:01.664309+0000","last_peered":"2026-02-23T13:13:01.664309+0000","last_clean":"2026-02-23T13:13:01.664309+0000","last_became_active":"2026-02-23T13:11:54.598325+0000","last_became_peered":"2026-02-23T13:11:54.598325+0000","last_unstale":"2026-02-23T13:13:01.664309+0000","last_undegraded":"2026-02-23T13:13:01.664309+0000","last_fullsized":"2026-02-23T13:13:01.664309+0000","mapping_epoch":78,"log_start":"90'29048","ondisk_log_start":"90'29048","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1903886336,"num_objects":29051,"num_object_clones":0,"num_object_copies":87153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29051,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29051,"num_write_kb":1859264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"90'28824","reported_seq":28858,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:01.667997+0000","last_change":"2026-02-23T13:11:54.595376+0000","last_active":"2026-02-23T13:13:01.667997+0000","last_peered":"2026-02-23T13:13:01.667997+0000","last_clean":"2026-02-23T13:13:01.667997+0000","last_became_active":"2026-02-23T13:11:54.595110+0000","last_became_peered":"2026-02-23T13:11:54.595110+0000","last_unstale":"2026-02-23T13:13:01.667997+0000","last_undegraded":"2026-02-23T13:13:01.667997+0000","last_fullsized":"2026-02-23T13:13:01.667997+0000","mapping_epoch":78,"log_start":"90'28820","ondisk_log_start":"90'28820","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:02.754608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1889009664,"num_objects":28824,"num_object_clones":0,"num_object_copies":86472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28824,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28824,"num_write_kb":1844736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"90'29379","reported_seq":29413,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:01.658523+0000","last_change":"2026-02-23T13:11:54.599364+0000","last_active":"2026-02-23T13:13:01.658523+0000","last_peered":"2026-02-23T13:13:01.658523+0000","last_clean":"2026-02-23T13:13:01.658523+0000","last_became_active":"2026-02-23T13:11:54.599155+0000","last_became_peered":"2026-02-23T13:11:54.599155+0000","last_unstale":"2026-02-23T13:13:01.658523+0000","last_undegraded":"2026-02-23T13:13:01.658523+0000","last_fullsized":"2026-02-23T13:13:01.658523+0000","mapping_epoch":78,"log_start":"90'29376","ondisk_log_start":"90'29376","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:14.711414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1925382144,"num_objects":29379,"num_object_clones":0,"num_object_copies":88137,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29379,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29379,"num_write_kb":1880256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"90'29190","reported_seq":29224,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:01.776878+0000","last_change":"2026-02-23T13:11:54.595872+0000","last_active":"2026-02-23T13:13:01.776878+0000","last_peered":"2026-02-23T13:13:01.776878+0000","last_clean":"2026-02-23T13:13:01.776878+0000","last_became_active":"2026-02-23T13:11:54.595645+0000","last_became_peered":"2026-02-23T13:11:54.595645+0000","last_unstale":"2026-02-23T13:13:01.776878+0000","last_undegraded":"2026-02-23T13:13:01.776878+0000","last_fullsized":"2026-02-23T13:13:01.776878+0000","mapping_epoch":78,"log_start":"90'29187","ondisk_log_start":"90'29187","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.565438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1912995840,"num_objects":29190,"num_object_clones":0,"num_object_copies":87570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29190,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29190,"num_write_kb":1868160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"90'29101","reported_seq":29135,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:01.669808+0000","last_change":"2026-02-23T13:11:54.595399+0000","last_active":"2026-02-23T13:13:01.669808+0000","last_peered":"2026-02-23T13:13:01.669808+0000","last_clean":"2026-02-23T13:13:01.669808+0000","last_became_active":"2026-02-23T13:11:54.595144+0000","last_became_peered":"2026-02-23T13:11:54.595144+0000","last_unstale":"2026-02-23T13:13:01.669808+0000","last_undegraded":"2026-02-23T13:13:01.669808+0000","last_fullsized":"2026-02-23T13:13:01.669808+0000","mapping_epoch":78,"log_start":"90'29098","ondisk_log_start":"90'29098","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:16.231133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1907163136,"num_objects":29101,"num_object_clones":0,"num_object_copies":87303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29101,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29101,"num_write_kb":1862464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"90'29410","reported_seq":29442,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:01.669195+0000","last_change":"2026-02-23T13:11:54.596295+0000","last_active":"2026-02-23T13:13:01.669195+0000","last_peered":"2026-02-23T13:13:01.669195+0000","last_clean":"2026-02-23T13:13:01.669195+0000","last_became_active":"2026-02-23T13:11:54.595996+0000","last_became_peered":"2026-02-23T13:11:54.595996+0000","last_unstale":"2026-02-23T13:13:01.669195+0000","last_undegraded":"2026-02-23T13:13:01.669195+0000","last_fullsized":"2026-02-23T13:13:01.669195+0000","mapping_epoch":78,"log_start":"90'29407","ondisk_log_start":"90'29407","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.493149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1927413760,"num_objects":29410,"num_object_clones":0,"num_object_copies":88230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29410,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29410,"num_write_kb":1882240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"90'29121","reported_seq":29155,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:01.661180+0000","last_change":"2026-02-23T13:11:54.599275+0000","last_active":"2026-02-23T13:13:01.661180+0000","last_peered":"2026-02-23T13:13:01.661180+0000","last_clean":"2026-02-23T13:13:01.661180+0000","last_became_active":"2026-02-23T13:11:54.598958+0000","last_became_peered":"2026-02-23T13:11:54.598958+0000","last_unstale":"2026-02-23T13:13:01.661180+0000","last_undegraded":"2026-02-23T13:13:01.661180+0000","last_fullsized":"2026-02-23T13:13:01.661180+0000","mapping_epoch":78,"log_start":"90'29118","ondisk_log_start":"90'29118","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:13.230076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1908473856,"num_objects":29121,"num_object_clones":0,"num_object_copies":87363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29121,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29121,"num_write_kb":1863744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"90'29063","reported_seq":29097,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:01.662866+0000","last_change":"2026-02-23T13:11:54.599032+0000","last_active":"2026-02-23T13:13:01.662866+0000","last_peered":"2026-02-23T13:13:01.662866+0000","last_clean":"2026-02-23T13:13:01.662866+0000","last_became_active":"2026-02-23T13:11:54.598751+0000","last_became_peered":"2026-02-23T13:11:54.598751+0000","last_unstale":"2026-02-23T13:13:01.662866+0000","last_undegraded":"2026-02-23T13:13:01.662866+0000","last_fullsized":"2026-02-23T13:13:01.662866+0000","mapping_epoch":78,"log_start":"90'29060","ondisk_log_start":"90'29060","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1904672768,"num_objects":29063,"num_object_clones":0,"num_object_copies":87189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29063,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29063,"num_write_kb":1860032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"90'28964","reported_seq":29286,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:01.665584+0000","last_change":"2026-02-23T13:13:00.668240+0000","last_active":"2026-02-23T13:13:01.665584+0000","last_peered":"2026-02-23T13:13:01.665584+0000","last_clean":"2026-02-23T13:13:01.665584+0000","last_became_active":"2026-02-23T13:11:54.595840+0000","last_became_peered":"2026-02-23T13:11:54.595840+0000","last_unstale":"2026-02-23T13:13:01.665584+0000","last_undegraded":"2026-02-23T13:13:01.665584+0000","last_fullsized":"2026-02-23T13:13:01.665584+0000","mapping_epoch":78,"log_start":"90'28961","ondisk_log_start":"90'28961","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'28514","last_scrub_stamp":"2026-02-23T13:13:00.668153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:00.668153+0000","objects_scrubbed":27959,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:20.748829+0000","scrub_duration":2841,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1898184704,"num_objects":28964,"num_object_clones":0,"num_object_copies":86892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28964,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28964,"num_write_kb":1853696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"90'29019","reported_seq":29053,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:01.670634+0000","last_change":"2026-02-23T13:11:54.596007+0000","last_active":"2026-02-23T13:13:01.670634+0000","last_peered":"2026-02-23T13:13:01.670634+0000","last_clean":"2026-02-23T13:13:01.670634+0000","last_became_active":"2026-02-23T13:11:54.595287+0000","last_became_peered":"2026-02-23T13:11:54.595287+0000","last_unstale":"2026-02-23T13:13:01.670634+0000","last_undegraded":"2026-02-23T13:13:01.670634+0000","last_fullsized":"2026-02-23T13:13:01.670634+0000","mapping_epoch":78,"log_start":"90'29016","ondisk_log_start":"90'29016","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:03.108821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1901789184,"num_objects":29019,"num_object_clones":0,"num_object_copies":87057,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29019,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29019,"num_write_kb":1857216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":377,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:01.377662+0000","last_change":"2026-02-23T13:13:01.377596+0000","last_active":"2026-02-23T13:13:01.377662+0000","last_peered":"2026-02-23T13:13:01.377662+0000","last_clean":"2026-02-23T13:13:01.377662+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:13:01.377662+0000","last_undegraded":"2026-02-23T13:13:01.377662+0000","last_fullsized":"2026-02-23T13:13:01.377662+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:13:01.377552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:13:01.377552+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:11.484316+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":30550261760,"num_objects":466160,"num_object_clones":0,"num_object_copies":1398480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":466160,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":466160,"num_write_kb":29834240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":91663368192,"data_stored":91663368192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2296,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247931,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27916340,"kb_used_data":26014048,"kb_used_omap":23,"kb_used_meta":1902248,"kb_avail":706086860,"statfs":{"total":751619276800,"available":723032944640,"internally_reserved":0,"allocated":26638385152,"data_stored":26637945196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24195,"internal_metadata":1947902333},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444158,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":21968500,"kb_used_data":20355424,"kb_used_omap":26,"kb_used_meta":1613029,"kb_avail":712034700,"statfs":{"total":751619276800,"available":729123532800,"internally_reserved":0,"allocated":20843954176,"data_stored":20843514220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26936,"internal_metadata":1651742408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574976,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":19995632,"kb_used_data":18508764,"kb_used_omap":27,"kb_used_meta":1486820,"kb_avail":714007568,"statfs":{"total":751619276800,"available":731143749632,"internally_reserved":0,"allocated":18952974336,"data_stored":18952537932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28263,"internal_metadata":1522504089},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705793,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":25379956,"kb_used_data":23940000,"kb_used_omap":21,"kb_used_meta":1439914,"kb_avail":708623244,"statfs":{"total":751619276800,"available":725630201856,"internally_reserved":0,"allocated":24514560000,"data_stored":24514120044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21534,"internal_metadata":1474472930},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2296,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24828510208,"data_stored":24828510208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19078053888,"data_stored":19078053888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21001601024,"data_stored":21001601024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26755203072,"data_stored":26755203072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:13:05.115 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:13:05.115 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_3 pg_num 46 2026-02-23T13:13:05.255 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:05.384 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:05.383+0000 7f9f8ca74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:05.384 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:05.383+0000 7f9f8ca74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:05.519 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:13:05.560 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:13:05.693 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 70 16 493004 492988 440.132 419.312 0.0017232 0.00227086 2026-02-23T13:13:06.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:05 trial046 ceph-mon[38575]: pgmap v368: 17 pgs: 17 active+clean; 28 GiB data, 91 GiB used, 2.6 TiB / 2.7 TiB avail; 331 MiB/s wr, 5.30k op/s 2026-02-23T13:13:06.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:05 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1706190280' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:13:06.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:05 trial046 ceph-mon[38575]: 5.8 scrub starts 2026-02-23T13:13:06.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:05 trial046 ceph-mon[38575]: 5.9 scrub ok 2026-02-23T13:13:06.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:05 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1397028693' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_3", "var": "pg_num", "val": "46"} : dispatch 2026-02-23T13:13:06.539 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:13:06 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:13:06] "GET /metrics HTTP/1.1" 200 4211 "" "Prometheus/3.6.0" 2026-02-23T13:13:06.561 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:13:06 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:13:06.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:13:06.693 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 71 15 498465 498450 438.741 341.375 0.00497983 0.00227805 2026-02-23T13:13:06.864 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:13:06.886 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:06 trial046 ceph-mon[38575]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:13:06.886 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:06 trial046 ceph-mon[38575]: 5.1 scrub starts 2026-02-23T13:13:06.886 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:06 trial046 ceph-mon[38575]: 5.b scrub starts 2026-02-23T13:13:07.008 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:07.398 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:07.371+0000 7f590ff5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:07.398 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:07.371+0000 7f590ff5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:07.398 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:13:07.399 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:13:07.401 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:13:07.401 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:13:07.417 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:13:07.418 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:13:07.431 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:13:07.431 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:13:07.693 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 72 16 502797 502781 436.407 270.688 0.00102769 0.00229011 2026-02-23T13:13:07.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:07 trial046 ceph-mon[38575]: pgmap v369: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 29 GiB data, 93 GiB used, 2.6 TiB / 2.7 TiB avail; 301 MiB/s wr, 4.82k op/s 2026-02-23T13:13:07.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:07 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/485475576' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:13:08.693 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 73 16 508043 508027 434.92 327.875 0.00104604 0.00229804 2026-02-23T13:13:09.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:08 trial046 ceph-mon[38575]: 5.1 scrub ok 2026-02-23T13:13:09.693 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 74 16 515128 515112 435.026 442.812 0.00157685 0.00229752 2026-02-23T13:13:10.024 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:13:10.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:09 trial046 ceph-mon[38575]: 5.8 scrub ok 2026-02-23T13:13:10.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:09 trial046 ceph-mon[38575]: pgmap v370: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 30 GiB data, 97 GiB used, 2.6 TiB / 2.7 TiB avail; 375 MiB/s wr, 5.99k op/s 2026-02-23T13:13:10.158 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:10.561 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:13:10.561 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-23T13:13:10.693 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 75 16 520368 520352 433.592 327.5 0.000848102 0.00230496 2026-02-23T13:13:10.717 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:10.725 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:10.724+0000 7fb58e3ee640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:10.725 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:10.725+0000 7fb58e3ee640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:10.743 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:13:10.743 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:13:10.756 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:13:10.756 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:13:10.788 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:13:10.789 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:13:10.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:10 trial046 ceph-mon[38575]: 5.b scrub ok 2026-02-23T13:13:10.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:10 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-23T13:13:10.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:10 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:13:10.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:10 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:13:10.809 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:13:10.809 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:13:11.534 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:11.533+0000 7f09bf679640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:11.535 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:11.533+0000 7f09bf679640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:11.693 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 76 16 524710 524694 431.457 271.375 0.00167043 0.00231653 2026-02-23T13:13:11.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:11 trial046 ceph-mon[38575]: pgmap v371: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 30 GiB data, 97 GiB used, 2.6 TiB / 2.7 TiB avail; 341 MiB/s wr, 5.46k op/s 2026-02-23T13:13:11.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:11 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/717656468' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:13:11.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:11 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:13:11.790 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:11 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:13:11.790 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:11 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-23T13:13:11.790 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:11 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-23T13:13:11.790 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:11 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:13:12.601 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.0 to 1 (10000) 2026-02-23T13:13:12.694 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 77 16 530039 530023 430.179 333.062 0.00172958 0.00232342 2026-02-23T13:13:13.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:12 trial046 ceph-mon[38575]: 5.4 scrub starts 2026-02-23T13:13:13.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:12 trial046 ceph-mon[38575]: Adjusting osd_memory_target on trial131 to 43559M 2026-02-23T13:13:13.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:12 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3623962343' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-23T13:13:13.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:12 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:13:13.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:12 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:13:13.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:12 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-23T13:13:13.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:12 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-23T13:13:13.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:12 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:13:13.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:12 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:13:13.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:12 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-23T13:13:13.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:12 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:13:13.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:12 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-23T13:13:13.120 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-23T13:13:13.296 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:13.668 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:13:13.680 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:13.632+0000 7f5721828640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:13.681 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:13.632+0000 7f5721828640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:13.681 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:13 trial046 ceph-mon[38575]: 5.e scrub starts 2026-02-23T13:13:13.681 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:13 trial046 ceph-mon[38575]: Adjusting osd_memory_target on trial046 to 41511M 2026-02-23T13:13:13.681 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:13 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3623962343' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-23T13:13:13.682 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:13 trial046 ceph-mon[38575]: osdmap e91: 4 total, 4 up, 4 in 2026-02-23T13:13:13.682 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:13 trial046 ceph-mon[38575]: pgmap v373: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 32 GiB data, 102 GiB used, 2.6 TiB / 2.7 TiB avail; 365 MiB/s wr, 5.85k op/s 2026-02-23T13:13:13.694 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 78 15 534909 534894 428.566 304.438 0.00243871 0.00233215 2026-02-23T13:13:13.810 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:14.221 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:14.176+0000 7fc451d69640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:14.221 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:14.176+0000 7fc451d69640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:14.221 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:13:14.221 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:13:14.221 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:13:14.221 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:13:14.222 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:13:14.222 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:13:14.238 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:13:14.238 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:13:14.606 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.1 to 1 (10000) 2026-02-23T13:13:14.652 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-23T13:13:14.694 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 79 16 540114 540098 427.258 325.25 0.00193939 0.00233927 2026-02-23T13:13:14.794 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:14.854 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:14 trial046 ceph-mon[38575]: 5.4 scrub ok 2026-02-23T13:13:14.854 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:14 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3166649145' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-23T13:13:14.854 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:14 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2254691614' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:13:14.916 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:14.913+0000 7f91ed20e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:14.916 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:14.914+0000 7f91ed20e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:15.606 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.2 to 1 (10000) 2026-02-23T13:13:15.660 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-23T13:13:15.694 INFO:tasks.radosbench.radosbench.0.trial046.stdout:2026-02-23T13:13:15.693951+0000 min lat: 0.000681273 max lat: 0.0626709 avg lat: 0.0023461 2026-02-23T13:13:15.694 INFO:tasks.radosbench.radosbench.0.trial046.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-23T13:13:15.694 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 80 16 545361 545345 426.016 327.938 0.00137751 0.0023461 2026-02-23T13:13:15.838 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:15.865 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:15 trial046 ceph-mon[38575]: 5.c scrub starts 2026-02-23T13:13:15.865 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:15 trial046 ceph-mon[38575]: 5.2 scrub starts 2026-02-23T13:13:15.865 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:15 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3166649145' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-23T13:13:15.866 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:15 trial046 ceph-mon[38575]: osdmap e92: 4 total, 4 up, 4 in 2026-02-23T13:13:15.866 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:15 trial046 ceph-mon[38575]: 5.a scrub starts 2026-02-23T13:13:15.866 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:15 trial046 ceph-mon[38575]: pgmap v375: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 32 GiB data, 102 GiB used, 2.6 TiB / 2.7 TiB avail; 378 MiB/s wr, 6.05k op/s 2026-02-23T13:13:15.866 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:15 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/559837353' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-23T13:13:15.963 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:15.961+0000 7ff1fe8a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:15.964 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:15.962+0000 7ff1fe8a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:16.289 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:13:16 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:13:16] "GET /metrics HTTP/1.1" 200 4219 "" "Prometheus/3.6.0" 2026-02-23T13:13:16.379 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:13:16.474 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:13:16 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:13:16.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:13:16.527 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:16.610 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.3 to 1 (10000) 2026-02-23T13:13:16.660 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:16.658+0000 7f4481843640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:16.661 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:16 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/559837353' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-23T13:13:16.661 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:16 trial046 ceph-mon[38575]: osdmap e93: 4 total, 4 up, 4 in 2026-02-23T13:13:16.661 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:16 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:13:16.661 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:16 trial046 ceph-mon[38575]: 5.e scrub ok 2026-02-23T13:13:16.661 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:16 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3557687373' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-23T13:13:16.661 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:16.659+0000 7f4481843640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:16.665 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-23T13:13:16.665 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:13:16.676 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:13:16.676 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:13:16.690 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:13:16.690 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:13:16.693 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 81 16 550866 550850 425.004 344.062 0.00199353 0.00235172 2026-02-23T13:13:16.701 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:13:16.702 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:13:16.714 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:13:16.714 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:13:16.813 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:16.935 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:16.933+0000 7f0772bcd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:16.935 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:16.933+0000 7f0772bcd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:17.082 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:13:17.083 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:13:17.129 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":378,"stamp":"2026-02-23T13:13:16.673323+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":34925576736,"num_objects":532915,"num_object_clones":0,"num_object_copies":1598745,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":532915,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":533048,"num_write_kb":34108582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":108011440,"kb_used_data":101711840,"kb_used_omap":100,"kb_used_meta":6299419,"kb_avail":2828001360,"statfs":{"total":3006477107200,"available":2895873392640,"internally_reserved":0,"allocated":104152924160,"data_stored":104151144251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":102934,"internal_metadata":6450605546},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,3,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":542244864,"num_objects":8274,"num_object_clones":0,"num_object_copies":24822,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8274,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8274,"num_write_kb":529536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.072482"},"pg_stats":[{"pgid":"5.f","version":"90'32981","reported_seq":33015,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:11.674325+0000","last_change":"2026-02-23T13:11:54.596706+0000","last_active":"2026-02-23T13:13:11.674325+0000","last_peered":"2026-02-23T13:13:11.674325+0000","last_clean":"2026-02-23T13:13:11.674325+0000","last_became_active":"2026-02-23T13:11:54.595945+0000","last_became_peered":"2026-02-23T13:11:54.595945+0000","last_unstale":"2026-02-23T13:13:11.674325+0000","last_undegraded":"2026-02-23T13:13:11.674325+0000","last_fullsized":"2026-02-23T13:13:11.674325+0000","mapping_epoch":78,"log_start":"90'32978","ondisk_log_start":"90'32978","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2161442816,"num_objects":32981,"num_object_clones":0,"num_object_copies":98943,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32981,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32981,"num_write_kb":2110784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"94'34718","reported_seq":35109,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:16.654499+0000","last_change":"2026-02-23T13:13:16.070635+0000","last_active":"2026-02-23T13:13:16.654499+0000","last_peered":"2026-02-23T13:13:16.654499+0000","last_clean":"2026-02-23T13:13:16.654499+0000","last_became_active":"2026-02-23T13:11:54.599064+0000","last_became_peered":"2026-02-23T13:11:54.599064+0000","last_unstale":"2026-02-23T13:13:16.654499+0000","last_undegraded":"2026-02-23T13:13:16.654499+0000","last_fullsized":"2026-02-23T13:13:16.654499+0000","mapping_epoch":78,"log_start":"94'34715","ondisk_log_start":"94'34715","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'34507","last_scrub_stamp":"2026-02-23T13:13:16.070555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:16.070555+0000","objects_scrubbed":33959,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:37.180440+0000","scrub_duration":3680,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2275278848,"num_objects":34718,"num_object_clones":0,"num_object_copies":104154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34718,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34718,"num_write_kb":2221952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"90'33162","reported_seq":33195,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:11.679878+0000","last_change":"2026-02-23T13:11:54.596174+0000","last_active":"2026-02-23T13:13:11.679878+0000","last_peered":"2026-02-23T13:13:11.679878+0000","last_clean":"2026-02-23T13:13:11.679878+0000","last_became_active":"2026-02-23T13:11:54.595773+0000","last_became_peered":"2026-02-23T13:11:54.595773+0000","last_unstale":"2026-02-23T13:13:11.679878+0000","last_undegraded":"2026-02-23T13:13:11.679878+0000","last_fullsized":"2026-02-23T13:13:11.679878+0000","mapping_epoch":78,"log_start":"90'33159","ondisk_log_start":"90'33159","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.566475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2173304832,"num_objects":33162,"num_object_clones":0,"num_object_copies":99486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33162,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33162,"num_write_kb":2122368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"90'32547","reported_seq":32581,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:11.780417+0000","last_change":"2026-02-23T13:11:54.595749+0000","last_active":"2026-02-23T13:13:11.780417+0000","last_peered":"2026-02-23T13:13:11.780417+0000","last_clean":"2026-02-23T13:13:11.780417+0000","last_became_active":"2026-02-23T13:11:54.595560+0000","last_became_peered":"2026-02-23T13:11:54.595560+0000","last_unstale":"2026-02-23T13:13:11.780417+0000","last_undegraded":"2026-02-23T13:13:11.780417+0000","last_fullsized":"2026-02-23T13:13:11.780417+0000","mapping_epoch":78,"log_start":"90'32544","ondisk_log_start":"90'32544","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:11.860237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2133000192,"num_objects":32547,"num_object_clones":0,"num_object_copies":97641,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32547,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32547,"num_write_kb":2083008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"90'32745","reported_seq":33102,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:11.678558+0000","last_change":"2026-02-23T13:13:09.088406+0000","last_active":"2026-02-23T13:13:11.678558+0000","last_peered":"2026-02-23T13:13:11.678558+0000","last_clean":"2026-02-23T13:13:11.678558+0000","last_became_active":"2026-02-23T13:11:54.596133+0000","last_became_peered":"2026-02-23T13:11:54.596133+0000","last_unstale":"2026-02-23T13:13:11.678558+0000","last_undegraded":"2026-02-23T13:13:11.678558+0000","last_fullsized":"2026-02-23T13:13:11.678558+0000","mapping_epoch":78,"log_start":"90'32742","ondisk_log_start":"90'32742","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31860","last_scrub_stamp":"2026-02-23T13:13:09.088369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:09.088369+0000","objects_scrubbed":31307,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:14.774702+0000","scrub_duration":3283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2145976320,"num_objects":32745,"num_object_clones":0,"num_object_copies":98235,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32745,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32745,"num_write_kb":2095680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"90'32605","reported_seq":32639,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:11.671868+0000","last_change":"2026-02-23T13:11:54.595383+0000","last_active":"2026-02-23T13:13:11.671868+0000","last_peered":"2026-02-23T13:13:11.671868+0000","last_clean":"2026-02-23T13:13:11.671868+0000","last_became_active":"2026-02-23T13:11:54.595080+0000","last_became_peered":"2026-02-23T13:11:54.595080+0000","last_unstale":"2026-02-23T13:13:11.671868+0000","last_undegraded":"2026-02-23T13:13:11.671868+0000","last_fullsized":"2026-02-23T13:13:11.671868+0000","mapping_epoch":78,"log_start":"90'32602","ondisk_log_start":"90'32602","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:12.934698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2136801280,"num_objects":32605,"num_object_clones":0,"num_object_copies":97815,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32605,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32605,"num_write_kb":2086720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"94'34307","reported_seq":34656,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:16.660896+0000","last_change":"2026-02-23T13:13:04.939376+0000","last_active":"2026-02-23T13:13:16.660896+0000","last_peered":"2026-02-23T13:13:16.660896+0000","last_clean":"2026-02-23T13:13:16.660896+0000","last_became_active":"2026-02-23T13:11:54.598325+0000","last_became_peered":"2026-02-23T13:11:54.598325+0000","last_unstale":"2026-02-23T13:13:16.660896+0000","last_undegraded":"2026-02-23T13:13:16.660896+0000","last_fullsized":"2026-02-23T13:13:16.660896+0000","mapping_epoch":78,"log_start":"94'34304","ondisk_log_start":"94'34304","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'30360","last_scrub_stamp":"2026-02-23T13:13:04.939307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:04.939307+0000","objects_scrubbed":29843,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:25.467510+0000","scrub_duration":2554,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2248343552,"num_objects":34307,"num_object_clones":0,"num_object_copies":102921,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34307,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34307,"num_write_kb":2195648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"90'32506","reported_seq":32857,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:11.676216+0000","last_change":"2026-02-23T13:13:08.083112+0000","last_active":"2026-02-23T13:13:11.676216+0000","last_peered":"2026-02-23T13:13:11.676216+0000","last_clean":"2026-02-23T13:13:11.676216+0000","last_became_active":"2026-02-23T13:11:54.595110+0000","last_became_peered":"2026-02-23T13:11:54.595110+0000","last_unstale":"2026-02-23T13:13:11.676216+0000","last_undegraded":"2026-02-23T13:13:11.676216+0000","last_fullsized":"2026-02-23T13:13:11.676216+0000","mapping_epoch":78,"log_start":"90'32503","ondisk_log_start":"90'32503","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31220","last_scrub_stamp":"2026-02-23T13:13:08.083065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:08.083065+0000","objects_scrubbed":30674,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:23.606645+0000","scrub_duration":3240,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2130313216,"num_objects":32506,"num_object_clones":0,"num_object_copies":97518,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32506,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32506,"num_write_kb":2080384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"94'34676","reported_seq":34718,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:16.661353+0000","last_change":"2026-02-23T13:11:54.599364+0000","last_active":"2026-02-23T13:13:16.661353+0000","last_peered":"2026-02-23T13:13:16.661353+0000","last_clean":"2026-02-23T13:13:16.661353+0000","last_became_active":"2026-02-23T13:11:54.599155+0000","last_became_peered":"2026-02-23T13:11:54.599155+0000","last_unstale":"2026-02-23T13:13:16.661353+0000","last_undegraded":"2026-02-23T13:13:16.661353+0000","last_fullsized":"2026-02-23T13:13:16.661353+0000","mapping_epoch":78,"log_start":"94'34673","ondisk_log_start":"94'34673","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2272526336,"num_objects":34676,"num_object_clones":0,"num_object_copies":104028,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34676,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34676,"num_write_kb":2219264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"90'32787","reported_seq":32821,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:11.782006+0000","last_change":"2026-02-23T13:11:54.595872+0000","last_active":"2026-02-23T13:13:11.782006+0000","last_peered":"2026-02-23T13:13:11.782006+0000","last_clean":"2026-02-23T13:13:11.782006+0000","last_became_active":"2026-02-23T13:11:54.595645+0000","last_became_peered":"2026-02-23T13:11:54.595645+0000","last_unstale":"2026-02-23T13:13:11.782006+0000","last_undegraded":"2026-02-23T13:13:11.782006+0000","last_fullsized":"2026-02-23T13:13:11.782006+0000","mapping_epoch":78,"log_start":"90'32784","ondisk_log_start":"90'32784","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.565438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2148728832,"num_objects":32787,"num_object_clones":0,"num_object_copies":98361,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32787,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32787,"num_write_kb":2098368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"90'32722","reported_seq":32756,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:11.665940+0000","last_change":"2026-02-23T13:11:54.595399+0000","last_active":"2026-02-23T13:13:11.665940+0000","last_peered":"2026-02-23T13:13:11.665940+0000","last_clean":"2026-02-23T13:13:11.665940+0000","last_became_active":"2026-02-23T13:11:54.595144+0000","last_became_peered":"2026-02-23T13:11:54.595144+0000","last_unstale":"2026-02-23T13:13:11.665940+0000","last_undegraded":"2026-02-23T13:13:11.665940+0000","last_fullsized":"2026-02-23T13:13:11.665940+0000","mapping_epoch":78,"log_start":"90'32719","ondisk_log_start":"90'32719","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:16.231133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2144468992,"num_objects":32722,"num_object_clones":0,"num_object_copies":98166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32722,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32722,"num_write_kb":2094208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"90'33064","reported_seq":33098,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:11.675294+0000","last_change":"2026-02-23T13:11:54.596295+0000","last_active":"2026-02-23T13:13:11.675294+0000","last_peered":"2026-02-23T13:13:11.675294+0000","last_clean":"2026-02-23T13:13:11.675294+0000","last_became_active":"2026-02-23T13:11:54.595996+0000","last_became_peered":"2026-02-23T13:11:54.595996+0000","last_unstale":"2026-02-23T13:13:11.675294+0000","last_undegraded":"2026-02-23T13:13:11.675294+0000","last_fullsized":"2026-02-23T13:13:11.675294+0000","mapping_epoch":78,"log_start":"90'33061","ondisk_log_start":"90'33061","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.493149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2166882304,"num_objects":33064,"num_object_clones":0,"num_object_copies":99192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33064,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33064,"num_write_kb":2116096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"94'34423","reported_seq":34680,"reported_epoch":94,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:13:16.662499+0000","last_change":"2026-02-23T13:13:14.393096+0000","last_active":"2026-02-23T13:13:16.662499+0000","last_peered":"2026-02-23T13:13:16.662499+0000","last_clean":"2026-02-23T13:13:16.662499+0000","last_became_active":"2026-02-23T13:11:54.598958+0000","last_became_peered":"2026-02-23T13:11:54.598958+0000","last_unstale":"2026-02-23T13:13:16.662499+0000","last_undegraded":"2026-02-23T13:13:16.662499+0000","last_fullsized":"2026-02-23T13:13:16.662499+0000","mapping_epoch":78,"log_start":"94'34420","ondisk_log_start":"94'34420","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":20999,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 3s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2255945728,"num_objects":34423,"num_object_clones":0,"num_object_copies":103269,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34423,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34423,"num_write_kb":2203072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"94'34363","reported_seq":34725,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:16.662354+0000","last_change":"2026-02-23T13:13:08.044115+0000","last_active":"2026-02-23T13:13:16.662354+0000","last_peered":"2026-02-23T13:13:16.662354+0000","last_clean":"2026-02-23T13:13:16.662354+0000","last_became_active":"2026-02-23T13:11:54.598751+0000","last_became_peered":"2026-02-23T13:11:54.598751+0000","last_unstale":"2026-02-23T13:13:16.662354+0000","last_undegraded":"2026-02-23T13:13:16.662354+0000","last_fullsized":"2026-02-23T13:13:16.662354+0000","mapping_epoch":78,"log_start":"94'34360","ondisk_log_start":"94'34360","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31416","last_scrub_stamp":"2026-02-23T13:13:08.044055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:08.044055+0000","objects_scrubbed":31053,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:17.610054+0000","scrub_duration":2694,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2252013568,"num_objects":34363,"num_object_clones":0,"num_object_copies":103089,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34363,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34363,"num_write_kb":2199232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"90'32615","reported_seq":32937,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:11.675796+0000","last_change":"2026-02-23T13:13:00.668240+0000","last_active":"2026-02-23T13:13:11.675796+0000","last_peered":"2026-02-23T13:13:11.675796+0000","last_clean":"2026-02-23T13:13:11.675796+0000","last_became_active":"2026-02-23T13:11:54.595840+0000","last_became_peered":"2026-02-23T13:11:54.595840+0000","last_unstale":"2026-02-23T13:13:11.675796+0000","last_undegraded":"2026-02-23T13:13:11.675796+0000","last_fullsized":"2026-02-23T13:13:11.675796+0000","mapping_epoch":78,"log_start":"90'32612","ondisk_log_start":"90'32612","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'28514","last_scrub_stamp":"2026-02-23T13:13:00.668153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:00.668153+0000","objects_scrubbed":27959,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:20.748829+0000","scrub_duration":2841,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2137456640,"num_objects":32615,"num_object_clones":0,"num_object_copies":97845,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32615,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32615,"num_write_kb":2087360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"90'32692","reported_seq":32797,"reported_epoch":90,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:13:11.675382+0000","last_change":"2026-02-23T13:13:11.192778+0000","last_active":"2026-02-23T13:13:11.675382+0000","last_peered":"2026-02-23T13:13:11.675382+0000","last_clean":"2026-02-23T13:13:11.675382+0000","last_became_active":"2026-02-23T13:11:54.595287+0000","last_became_peered":"2026-02-23T13:11:54.595287+0000","last_unstale":"2026-02-23T13:13:11.675382+0000","last_undegraded":"2026-02-23T13:13:11.675382+0000","last_fullsized":"2026-02-23T13:13:11.675382+0000","mapping_epoch":78,"log_start":"90'32689","ondisk_log_start":"90'32689","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":6649,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2142502912,"num_objects":32692,"num_object_clones":0,"num_object_copies":98076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32692,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32692,"num_write_kb":2092288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":385,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:16.609942+0000","last_change":"2026-02-23T13:13:01.377596+0000","last_active":"2026-02-23T13:13:16.609942+0000","last_peered":"2026-02-23T13:13:16.609942+0000","last_clean":"2026-02-23T13:13:16.609942+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:13:16.609942+0000","last_undegraded":"2026-02-23T13:13:16.609942+0000","last_fullsized":"2026-02-23T13:13:16.609942+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:13:01.377552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:13:01.377552+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:11.484316+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":34924986368,"num_objects":532913,"num_object_clones":0,"num_object_copies":1598739,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":532913,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":532913,"num_write_kb":34106432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":104660926464,"data_stored":104660926464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2356,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247934,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32071768,"kb_used_data":30780420,"kb_used_omap":25,"kb_used_meta":1291302,"kb_avail":701931432,"statfs":{"total":751619276800,"available":718777786368,"internally_reserved":0,"allocated":31519150080,"data_stored":31518686487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26201,"internal_metadata":1322293671},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444160,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":24737460,"kb_used_data":22980896,"kb_used_omap":26,"kb_used_meta":1756517,"kb_avail":709265740,"statfs":{"total":751619276800,"available":726288117760,"internally_reserved":0,"allocated":23532437504,"data_stored":23531997548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26936,"internal_metadata":1798674120},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574978,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":22463728,"kb_used_data":20868572,"kb_used_omap":27,"kb_used_meta":1595108,"kb_avail":711539472,"statfs":{"total":751619276800,"available":728616419328,"internally_reserved":0,"allocated":21369417728,"data_stored":21368981324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28263,"internal_metadata":1633391001},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,3,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705795,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28738484,"kb_used_data":27081952,"kb_used_omap":21,"kb_used_meta":1656490,"kb_avail":705264716,"statfs":{"total":751619276800,"available":722191069184,"internally_reserved":0,"allocated":27731918848,"data_stored":27731478892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21534,"internal_metadata":1696246754},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2356,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27951562752,"data_stored":27951562752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21468741632,"data_stored":21468741632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23632281600,"data_stored":23632281600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":31608340480,"data_stored":31608340480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:13:17.130 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:13:17.271 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:17.403 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:17.400+0000 7fd8b1ac5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:17.403 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:17.401+0000 7fd8b1ac5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:17.549 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:13:17.549 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:13:17.594 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":378,"stamp":"2026-02-23T13:13:16.673323+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":34925576736,"num_objects":532915,"num_object_clones":0,"num_object_copies":1598745,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":532915,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":533048,"num_write_kb":34108582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":108011440,"kb_used_data":101711840,"kb_used_omap":100,"kb_used_meta":6299419,"kb_avail":2828001360,"statfs":{"total":3006477107200,"available":2895873392640,"internally_reserved":0,"allocated":104152924160,"data_stored":104151144251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":102934,"internal_metadata":6450605546},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,3,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":542244864,"num_objects":8274,"num_object_clones":0,"num_object_copies":24822,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8274,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8274,"num_write_kb":529536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.072482"},"pg_stats":[{"pgid":"5.f","version":"90'32981","reported_seq":33015,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:11.674325+0000","last_change":"2026-02-23T13:11:54.596706+0000","last_active":"2026-02-23T13:13:11.674325+0000","last_peered":"2026-02-23T13:13:11.674325+0000","last_clean":"2026-02-23T13:13:11.674325+0000","last_became_active":"2026-02-23T13:11:54.595945+0000","last_became_peered":"2026-02-23T13:11:54.595945+0000","last_unstale":"2026-02-23T13:13:11.674325+0000","last_undegraded":"2026-02-23T13:13:11.674325+0000","last_fullsized":"2026-02-23T13:13:11.674325+0000","mapping_epoch":78,"log_start":"90'32978","ondisk_log_start":"90'32978","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2161442816,"num_objects":32981,"num_object_clones":0,"num_object_copies":98943,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32981,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32981,"num_write_kb":2110784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"94'34718","reported_seq":35109,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:16.654499+0000","last_change":"2026-02-23T13:13:16.070635+0000","last_active":"2026-02-23T13:13:16.654499+0000","last_peered":"2026-02-23T13:13:16.654499+0000","last_clean":"2026-02-23T13:13:16.654499+0000","last_became_active":"2026-02-23T13:11:54.599064+0000","last_became_peered":"2026-02-23T13:11:54.599064+0000","last_unstale":"2026-02-23T13:13:16.654499+0000","last_undegraded":"2026-02-23T13:13:16.654499+0000","last_fullsized":"2026-02-23T13:13:16.654499+0000","mapping_epoch":78,"log_start":"94'34715","ondisk_log_start":"94'34715","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'34507","last_scrub_stamp":"2026-02-23T13:13:16.070555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:16.070555+0000","objects_scrubbed":33959,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:37.180440+0000","scrub_duration":3680,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2275278848,"num_objects":34718,"num_object_clones":0,"num_object_copies":104154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34718,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34718,"num_write_kb":2221952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"90'33162","reported_seq":33195,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:11.679878+0000","last_change":"2026-02-23T13:11:54.596174+0000","last_active":"2026-02-23T13:13:11.679878+0000","last_peered":"2026-02-23T13:13:11.679878+0000","last_clean":"2026-02-23T13:13:11.679878+0000","last_became_active":"2026-02-23T13:11:54.595773+0000","last_became_peered":"2026-02-23T13:11:54.595773+0000","last_unstale":"2026-02-23T13:13:11.679878+0000","last_undegraded":"2026-02-23T13:13:11.679878+0000","last_fullsized":"2026-02-23T13:13:11.679878+0000","mapping_epoch":78,"log_start":"90'33159","ondisk_log_start":"90'33159","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.566475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2173304832,"num_objects":33162,"num_object_clones":0,"num_object_copies":99486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33162,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33162,"num_write_kb":2122368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"90'32547","reported_seq":32581,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:11.780417+0000","last_change":"2026-02-23T13:11:54.595749+0000","last_active":"2026-02-23T13:13:11.780417+0000","last_peered":"2026-02-23T13:13:11.780417+0000","last_clean":"2026-02-23T13:13:11.780417+0000","last_became_active":"2026-02-23T13:11:54.595560+0000","last_became_peered":"2026-02-23T13:11:54.595560+0000","last_unstale":"2026-02-23T13:13:11.780417+0000","last_undegraded":"2026-02-23T13:13:11.780417+0000","last_fullsized":"2026-02-23T13:13:11.780417+0000","mapping_epoch":78,"log_start":"90'32544","ondisk_log_start":"90'32544","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:11.860237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2133000192,"num_objects":32547,"num_object_clones":0,"num_object_copies":97641,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32547,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32547,"num_write_kb":2083008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"90'32745","reported_seq":33102,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:11.678558+0000","last_change":"2026-02-23T13:13:09.088406+0000","last_active":"2026-02-23T13:13:11.678558+0000","last_peered":"2026-02-23T13:13:11.678558+0000","last_clean":"2026-02-23T13:13:11.678558+0000","last_became_active":"2026-02-23T13:11:54.596133+0000","last_became_peered":"2026-02-23T13:11:54.596133+0000","last_unstale":"2026-02-23T13:13:11.678558+0000","last_undegraded":"2026-02-23T13:13:11.678558+0000","last_fullsized":"2026-02-23T13:13:11.678558+0000","mapping_epoch":78,"log_start":"90'32742","ondisk_log_start":"90'32742","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31860","last_scrub_stamp":"2026-02-23T13:13:09.088369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:09.088369+0000","objects_scrubbed":31307,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:14.774702+0000","scrub_duration":3283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2145976320,"num_objects":32745,"num_object_clones":0,"num_object_copies":98235,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32745,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32745,"num_write_kb":2095680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"90'32605","reported_seq":32639,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:11.671868+0000","last_change":"2026-02-23T13:11:54.595383+0000","last_active":"2026-02-23T13:13:11.671868+0000","last_peered":"2026-02-23T13:13:11.671868+0000","last_clean":"2026-02-23T13:13:11.671868+0000","last_became_active":"2026-02-23T13:11:54.595080+0000","last_became_peered":"2026-02-23T13:11:54.595080+0000","last_unstale":"2026-02-23T13:13:11.671868+0000","last_undegraded":"2026-02-23T13:13:11.671868+0000","last_fullsized":"2026-02-23T13:13:11.671868+0000","mapping_epoch":78,"log_start":"90'32602","ondisk_log_start":"90'32602","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:12.934698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2136801280,"num_objects":32605,"num_object_clones":0,"num_object_copies":97815,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32605,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32605,"num_write_kb":2086720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"94'34307","reported_seq":34656,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:16.660896+0000","last_change":"2026-02-23T13:13:04.939376+0000","last_active":"2026-02-23T13:13:16.660896+0000","last_peered":"2026-02-23T13:13:16.660896+0000","last_clean":"2026-02-23T13:13:16.660896+0000","last_became_active":"2026-02-23T13:11:54.598325+0000","last_became_peered":"2026-02-23T13:11:54.598325+0000","last_unstale":"2026-02-23T13:13:16.660896+0000","last_undegraded":"2026-02-23T13:13:16.660896+0000","last_fullsized":"2026-02-23T13:13:16.660896+0000","mapping_epoch":78,"log_start":"94'34304","ondisk_log_start":"94'34304","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'30360","last_scrub_stamp":"2026-02-23T13:13:04.939307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:04.939307+0000","objects_scrubbed":29843,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:25.467510+0000","scrub_duration":2554,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2248343552,"num_objects":34307,"num_object_clones":0,"num_object_copies":102921,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34307,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34307,"num_write_kb":2195648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"90'32506","reported_seq":32857,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:11.676216+0000","last_change":"2026-02-23T13:13:08.083112+0000","last_active":"2026-02-23T13:13:11.676216+0000","last_peered":"2026-02-23T13:13:11.676216+0000","last_clean":"2026-02-23T13:13:11.676216+0000","last_became_active":"2026-02-23T13:11:54.595110+0000","last_became_peered":"2026-02-23T13:11:54.595110+0000","last_unstale":"2026-02-23T13:13:11.676216+0000","last_undegraded":"2026-02-23T13:13:11.676216+0000","last_fullsized":"2026-02-23T13:13:11.676216+0000","mapping_epoch":78,"log_start":"90'32503","ondisk_log_start":"90'32503","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31220","last_scrub_stamp":"2026-02-23T13:13:08.083065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:08.083065+0000","objects_scrubbed":30674,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:23.606645+0000","scrub_duration":3240,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2130313216,"num_objects":32506,"num_object_clones":0,"num_object_copies":97518,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32506,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32506,"num_write_kb":2080384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"94'34676","reported_seq":34718,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:16.661353+0000","last_change":"2026-02-23T13:11:54.599364+0000","last_active":"2026-02-23T13:13:16.661353+0000","last_peered":"2026-02-23T13:13:16.661353+0000","last_clean":"2026-02-23T13:13:16.661353+0000","last_became_active":"2026-02-23T13:11:54.599155+0000","last_became_peered":"2026-02-23T13:11:54.599155+0000","last_unstale":"2026-02-23T13:13:16.661353+0000","last_undegraded":"2026-02-23T13:13:16.661353+0000","last_fullsized":"2026-02-23T13:13:16.661353+0000","mapping_epoch":78,"log_start":"94'34673","ondisk_log_start":"94'34673","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2272526336,"num_objects":34676,"num_object_clones":0,"num_object_copies":104028,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34676,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34676,"num_write_kb":2219264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"90'32787","reported_seq":32821,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:11.782006+0000","last_change":"2026-02-23T13:11:54.595872+0000","last_active":"2026-02-23T13:13:11.782006+0000","last_peered":"2026-02-23T13:13:11.782006+0000","last_clean":"2026-02-23T13:13:11.782006+0000","last_became_active":"2026-02-23T13:11:54.595645+0000","last_became_peered":"2026-02-23T13:11:54.595645+0000","last_unstale":"2026-02-23T13:13:11.782006+0000","last_undegraded":"2026-02-23T13:13:11.782006+0000","last_fullsized":"2026-02-23T13:13:11.782006+0000","mapping_epoch":78,"log_start":"90'32784","ondisk_log_start":"90'32784","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.565438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2148728832,"num_objects":32787,"num_object_clones":0,"num_object_copies":98361,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32787,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32787,"num_write_kb":2098368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"90'32722","reported_seq":32756,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:11.665940+0000","last_change":"2026-02-23T13:11:54.595399+0000","last_active":"2026-02-23T13:13:11.665940+0000","last_peered":"2026-02-23T13:13:11.665940+0000","last_clean":"2026-02-23T13:13:11.665940+0000","last_became_active":"2026-02-23T13:11:54.595144+0000","last_became_peered":"2026-02-23T13:11:54.595144+0000","last_unstale":"2026-02-23T13:13:11.665940+0000","last_undegraded":"2026-02-23T13:13:11.665940+0000","last_fullsized":"2026-02-23T13:13:11.665940+0000","mapping_epoch":78,"log_start":"90'32719","ondisk_log_start":"90'32719","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:16.231133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2144468992,"num_objects":32722,"num_object_clones":0,"num_object_copies":98166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32722,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32722,"num_write_kb":2094208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"90'33064","reported_seq":33098,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:11.675294+0000","last_change":"2026-02-23T13:11:54.596295+0000","last_active":"2026-02-23T13:13:11.675294+0000","last_peered":"2026-02-23T13:13:11.675294+0000","last_clean":"2026-02-23T13:13:11.675294+0000","last_became_active":"2026-02-23T13:11:54.595996+0000","last_became_peered":"2026-02-23T13:11:54.595996+0000","last_unstale":"2026-02-23T13:13:11.675294+0000","last_undegraded":"2026-02-23T13:13:11.675294+0000","last_fullsized":"2026-02-23T13:13:11.675294+0000","mapping_epoch":78,"log_start":"90'33061","ondisk_log_start":"90'33061","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.493149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2166882304,"num_objects":33064,"num_object_clones":0,"num_object_copies":99192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33064,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33064,"num_write_kb":2116096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"94'34423","reported_seq":34680,"reported_epoch":94,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:13:16.662499+0000","last_change":"2026-02-23T13:13:14.393096+0000","last_active":"2026-02-23T13:13:16.662499+0000","last_peered":"2026-02-23T13:13:16.662499+0000","last_clean":"2026-02-23T13:13:16.662499+0000","last_became_active":"2026-02-23T13:11:54.598958+0000","last_became_peered":"2026-02-23T13:11:54.598958+0000","last_unstale":"2026-02-23T13:13:16.662499+0000","last_undegraded":"2026-02-23T13:13:16.662499+0000","last_fullsized":"2026-02-23T13:13:16.662499+0000","mapping_epoch":78,"log_start":"94'34420","ondisk_log_start":"94'34420","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":20999,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 3s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2255945728,"num_objects":34423,"num_object_clones":0,"num_object_copies":103269,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34423,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34423,"num_write_kb":2203072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"94'34363","reported_seq":34725,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:16.662354+0000","last_change":"2026-02-23T13:13:08.044115+0000","last_active":"2026-02-23T13:13:16.662354+0000","last_peered":"2026-02-23T13:13:16.662354+0000","last_clean":"2026-02-23T13:13:16.662354+0000","last_became_active":"2026-02-23T13:11:54.598751+0000","last_became_peered":"2026-02-23T13:11:54.598751+0000","last_unstale":"2026-02-23T13:13:16.662354+0000","last_undegraded":"2026-02-23T13:13:16.662354+0000","last_fullsized":"2026-02-23T13:13:16.662354+0000","mapping_epoch":78,"log_start":"94'34360","ondisk_log_start":"94'34360","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31416","last_scrub_stamp":"2026-02-23T13:13:08.044055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:08.044055+0000","objects_scrubbed":31053,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:17.610054+0000","scrub_duration":2694,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2252013568,"num_objects":34363,"num_object_clones":0,"num_object_copies":103089,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34363,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34363,"num_write_kb":2199232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"90'32615","reported_seq":32937,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:11.675796+0000","last_change":"2026-02-23T13:13:00.668240+0000","last_active":"2026-02-23T13:13:11.675796+0000","last_peered":"2026-02-23T13:13:11.675796+0000","last_clean":"2026-02-23T13:13:11.675796+0000","last_became_active":"2026-02-23T13:11:54.595840+0000","last_became_peered":"2026-02-23T13:11:54.595840+0000","last_unstale":"2026-02-23T13:13:11.675796+0000","last_undegraded":"2026-02-23T13:13:11.675796+0000","last_fullsized":"2026-02-23T13:13:11.675796+0000","mapping_epoch":78,"log_start":"90'32612","ondisk_log_start":"90'32612","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'28514","last_scrub_stamp":"2026-02-23T13:13:00.668153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:00.668153+0000","objects_scrubbed":27959,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:20.748829+0000","scrub_duration":2841,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2137456640,"num_objects":32615,"num_object_clones":0,"num_object_copies":97845,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32615,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32615,"num_write_kb":2087360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"90'32692","reported_seq":32797,"reported_epoch":90,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:13:11.675382+0000","last_change":"2026-02-23T13:13:11.192778+0000","last_active":"2026-02-23T13:13:11.675382+0000","last_peered":"2026-02-23T13:13:11.675382+0000","last_clean":"2026-02-23T13:13:11.675382+0000","last_became_active":"2026-02-23T13:11:54.595287+0000","last_became_peered":"2026-02-23T13:11:54.595287+0000","last_unstale":"2026-02-23T13:13:11.675382+0000","last_undegraded":"2026-02-23T13:13:11.675382+0000","last_fullsized":"2026-02-23T13:13:11.675382+0000","mapping_epoch":78,"log_start":"90'32689","ondisk_log_start":"90'32689","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":6649,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2142502912,"num_objects":32692,"num_object_clones":0,"num_object_copies":98076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32692,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32692,"num_write_kb":2092288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":385,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:16.609942+0000","last_change":"2026-02-23T13:13:01.377596+0000","last_active":"2026-02-23T13:13:16.609942+0000","last_peered":"2026-02-23T13:13:16.609942+0000","last_clean":"2026-02-23T13:13:16.609942+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:13:16.609942+0000","last_undegraded":"2026-02-23T13:13:16.609942+0000","last_fullsized":"2026-02-23T13:13:16.609942+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:13:01.377552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:13:01.377552+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:11.484316+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":34924986368,"num_objects":532913,"num_object_clones":0,"num_object_copies":1598739,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":532913,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":532913,"num_write_kb":34106432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":104660926464,"data_stored":104660926464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2356,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247934,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32071768,"kb_used_data":30780420,"kb_used_omap":25,"kb_used_meta":1291302,"kb_avail":701931432,"statfs":{"total":751619276800,"available":718777786368,"internally_reserved":0,"allocated":31519150080,"data_stored":31518686487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26201,"internal_metadata":1322293671},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444160,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":24737460,"kb_used_data":22980896,"kb_used_omap":26,"kb_used_meta":1756517,"kb_avail":709265740,"statfs":{"total":751619276800,"available":726288117760,"internally_reserved":0,"allocated":23532437504,"data_stored":23531997548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26936,"internal_metadata":1798674120},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574978,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":22463728,"kb_used_data":20868572,"kb_used_omap":27,"kb_used_meta":1595108,"kb_avail":711539472,"statfs":{"total":751619276800,"available":728616419328,"internally_reserved":0,"allocated":21369417728,"data_stored":21368981324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28263,"internal_metadata":1633391001},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,3,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705795,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28738484,"kb_used_data":27081952,"kb_used_omap":21,"kb_used_meta":1656490,"kb_avail":705264716,"statfs":{"total":751619276800,"available":722191069184,"internally_reserved":0,"allocated":27731918848,"data_stored":27731478892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21534,"internal_metadata":1696246754},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2356,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27951562752,"data_stored":27951562752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21468741632,"data_stored":21468741632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23632281600,"data_stored":23632281600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":31608340480,"data_stored":31608340480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:13:17.595 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-23T13:13:17.595 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:13:17.595 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:13:17.694 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 82 16 556832 556816 424.368 372.875 0.00772803 0.00235523 2026-02-23T13:13:17.734 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:17.801 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:17 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3557687373' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-23T13:13:17.801 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:17 trial046 ceph-mon[38575]: osdmap e94: 4 total, 4 up, 4 in 2026-02-23T13:13:17.801 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:17 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3129994085' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:13:17.801 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:17 trial046 ceph-mon[38575]: pgmap v378: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 33 GiB data, 103 GiB used, 2.6 TiB / 2.7 TiB avail; 127 MiB/s wr, 2.03k op/s 2026-02-23T13:13:17.857 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:17.855+0000 7f058f5a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:17.857 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:17.855+0000 7f058f5a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:17.996 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:13:17.997 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:13:18.040 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":378,"stamp":"2026-02-23T13:13:16.673323+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":34925576736,"num_objects":532915,"num_object_clones":0,"num_object_copies":1598745,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":532915,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":533048,"num_write_kb":34108582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":108011440,"kb_used_data":101711840,"kb_used_omap":100,"kb_used_meta":6299419,"kb_avail":2828001360,"statfs":{"total":3006477107200,"available":2895873392640,"internally_reserved":0,"allocated":104152924160,"data_stored":104151144251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":102934,"internal_metadata":6450605546},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,3,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":542244864,"num_objects":8274,"num_object_clones":0,"num_object_copies":24822,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8274,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8274,"num_write_kb":529536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.072482"},"pg_stats":[{"pgid":"5.f","version":"90'32981","reported_seq":33015,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:11.674325+0000","last_change":"2026-02-23T13:11:54.596706+0000","last_active":"2026-02-23T13:13:11.674325+0000","last_peered":"2026-02-23T13:13:11.674325+0000","last_clean":"2026-02-23T13:13:11.674325+0000","last_became_active":"2026-02-23T13:11:54.595945+0000","last_became_peered":"2026-02-23T13:11:54.595945+0000","last_unstale":"2026-02-23T13:13:11.674325+0000","last_undegraded":"2026-02-23T13:13:11.674325+0000","last_fullsized":"2026-02-23T13:13:11.674325+0000","mapping_epoch":78,"log_start":"90'32978","ondisk_log_start":"90'32978","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2161442816,"num_objects":32981,"num_object_clones":0,"num_object_copies":98943,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32981,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32981,"num_write_kb":2110784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"94'34718","reported_seq":35109,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:16.654499+0000","last_change":"2026-02-23T13:13:16.070635+0000","last_active":"2026-02-23T13:13:16.654499+0000","last_peered":"2026-02-23T13:13:16.654499+0000","last_clean":"2026-02-23T13:13:16.654499+0000","last_became_active":"2026-02-23T13:11:54.599064+0000","last_became_peered":"2026-02-23T13:11:54.599064+0000","last_unstale":"2026-02-23T13:13:16.654499+0000","last_undegraded":"2026-02-23T13:13:16.654499+0000","last_fullsized":"2026-02-23T13:13:16.654499+0000","mapping_epoch":78,"log_start":"94'34715","ondisk_log_start":"94'34715","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'34507","last_scrub_stamp":"2026-02-23T13:13:16.070555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:16.070555+0000","objects_scrubbed":33959,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:37.180440+0000","scrub_duration":3680,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2275278848,"num_objects":34718,"num_object_clones":0,"num_object_copies":104154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34718,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34718,"num_write_kb":2221952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"90'33162","reported_seq":33195,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:11.679878+0000","last_change":"2026-02-23T13:11:54.596174+0000","last_active":"2026-02-23T13:13:11.679878+0000","last_peered":"2026-02-23T13:13:11.679878+0000","last_clean":"2026-02-23T13:13:11.679878+0000","last_became_active":"2026-02-23T13:11:54.595773+0000","last_became_peered":"2026-02-23T13:11:54.595773+0000","last_unstale":"2026-02-23T13:13:11.679878+0000","last_undegraded":"2026-02-23T13:13:11.679878+0000","last_fullsized":"2026-02-23T13:13:11.679878+0000","mapping_epoch":78,"log_start":"90'33159","ondisk_log_start":"90'33159","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.566475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2173304832,"num_objects":33162,"num_object_clones":0,"num_object_copies":99486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33162,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33162,"num_write_kb":2122368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"90'32547","reported_seq":32581,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:11.780417+0000","last_change":"2026-02-23T13:11:54.595749+0000","last_active":"2026-02-23T13:13:11.780417+0000","last_peered":"2026-02-23T13:13:11.780417+0000","last_clean":"2026-02-23T13:13:11.780417+0000","last_became_active":"2026-02-23T13:11:54.595560+0000","last_became_peered":"2026-02-23T13:11:54.595560+0000","last_unstale":"2026-02-23T13:13:11.780417+0000","last_undegraded":"2026-02-23T13:13:11.780417+0000","last_fullsized":"2026-02-23T13:13:11.780417+0000","mapping_epoch":78,"log_start":"90'32544","ondisk_log_start":"90'32544","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:11.860237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2133000192,"num_objects":32547,"num_object_clones":0,"num_object_copies":97641,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32547,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32547,"num_write_kb":2083008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"90'32745","reported_seq":33102,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:11.678558+0000","last_change":"2026-02-23T13:13:09.088406+0000","last_active":"2026-02-23T13:13:11.678558+0000","last_peered":"2026-02-23T13:13:11.678558+0000","last_clean":"2026-02-23T13:13:11.678558+0000","last_became_active":"2026-02-23T13:11:54.596133+0000","last_became_peered":"2026-02-23T13:11:54.596133+0000","last_unstale":"2026-02-23T13:13:11.678558+0000","last_undegraded":"2026-02-23T13:13:11.678558+0000","last_fullsized":"2026-02-23T13:13:11.678558+0000","mapping_epoch":78,"log_start":"90'32742","ondisk_log_start":"90'32742","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31860","last_scrub_stamp":"2026-02-23T13:13:09.088369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:09.088369+0000","objects_scrubbed":31307,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:14.774702+0000","scrub_duration":3283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2145976320,"num_objects":32745,"num_object_clones":0,"num_object_copies":98235,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32745,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32745,"num_write_kb":2095680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"90'32605","reported_seq":32639,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:11.671868+0000","last_change":"2026-02-23T13:11:54.595383+0000","last_active":"2026-02-23T13:13:11.671868+0000","last_peered":"2026-02-23T13:13:11.671868+0000","last_clean":"2026-02-23T13:13:11.671868+0000","last_became_active":"2026-02-23T13:11:54.595080+0000","last_became_peered":"2026-02-23T13:11:54.595080+0000","last_unstale":"2026-02-23T13:13:11.671868+0000","last_undegraded":"2026-02-23T13:13:11.671868+0000","last_fullsized":"2026-02-23T13:13:11.671868+0000","mapping_epoch":78,"log_start":"90'32602","ondisk_log_start":"90'32602","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:12.934698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2136801280,"num_objects":32605,"num_object_clones":0,"num_object_copies":97815,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32605,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32605,"num_write_kb":2086720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"94'34307","reported_seq":34656,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:16.660896+0000","last_change":"2026-02-23T13:13:04.939376+0000","last_active":"2026-02-23T13:13:16.660896+0000","last_peered":"2026-02-23T13:13:16.660896+0000","last_clean":"2026-02-23T13:13:16.660896+0000","last_became_active":"2026-02-23T13:11:54.598325+0000","last_became_peered":"2026-02-23T13:11:54.598325+0000","last_unstale":"2026-02-23T13:13:16.660896+0000","last_undegraded":"2026-02-23T13:13:16.660896+0000","last_fullsized":"2026-02-23T13:13:16.660896+0000","mapping_epoch":78,"log_start":"94'34304","ondisk_log_start":"94'34304","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'30360","last_scrub_stamp":"2026-02-23T13:13:04.939307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:04.939307+0000","objects_scrubbed":29843,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:25.467510+0000","scrub_duration":2554,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2248343552,"num_objects":34307,"num_object_clones":0,"num_object_copies":102921,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34307,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34307,"num_write_kb":2195648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"90'32506","reported_seq":32857,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:11.676216+0000","last_change":"2026-02-23T13:13:08.083112+0000","last_active":"2026-02-23T13:13:11.676216+0000","last_peered":"2026-02-23T13:13:11.676216+0000","last_clean":"2026-02-23T13:13:11.676216+0000","last_became_active":"2026-02-23T13:11:54.595110+0000","last_became_peered":"2026-02-23T13:11:54.595110+0000","last_unstale":"2026-02-23T13:13:11.676216+0000","last_undegraded":"2026-02-23T13:13:11.676216+0000","last_fullsized":"2026-02-23T13:13:11.676216+0000","mapping_epoch":78,"log_start":"90'32503","ondisk_log_start":"90'32503","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31220","last_scrub_stamp":"2026-02-23T13:13:08.083065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:08.083065+0000","objects_scrubbed":30674,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:23.606645+0000","scrub_duration":3240,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2130313216,"num_objects":32506,"num_object_clones":0,"num_object_copies":97518,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32506,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32506,"num_write_kb":2080384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"94'34676","reported_seq":34718,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:16.661353+0000","last_change":"2026-02-23T13:11:54.599364+0000","last_active":"2026-02-23T13:13:16.661353+0000","last_peered":"2026-02-23T13:13:16.661353+0000","last_clean":"2026-02-23T13:13:16.661353+0000","last_became_active":"2026-02-23T13:11:54.599155+0000","last_became_peered":"2026-02-23T13:11:54.599155+0000","last_unstale":"2026-02-23T13:13:16.661353+0000","last_undegraded":"2026-02-23T13:13:16.661353+0000","last_fullsized":"2026-02-23T13:13:16.661353+0000","mapping_epoch":78,"log_start":"94'34673","ondisk_log_start":"94'34673","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2272526336,"num_objects":34676,"num_object_clones":0,"num_object_copies":104028,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34676,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34676,"num_write_kb":2219264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"90'32787","reported_seq":32821,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:11.782006+0000","last_change":"2026-02-23T13:11:54.595872+0000","last_active":"2026-02-23T13:13:11.782006+0000","last_peered":"2026-02-23T13:13:11.782006+0000","last_clean":"2026-02-23T13:13:11.782006+0000","last_became_active":"2026-02-23T13:11:54.595645+0000","last_became_peered":"2026-02-23T13:11:54.595645+0000","last_unstale":"2026-02-23T13:13:11.782006+0000","last_undegraded":"2026-02-23T13:13:11.782006+0000","last_fullsized":"2026-02-23T13:13:11.782006+0000","mapping_epoch":78,"log_start":"90'32784","ondisk_log_start":"90'32784","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.565438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2148728832,"num_objects":32787,"num_object_clones":0,"num_object_copies":98361,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32787,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32787,"num_write_kb":2098368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"90'32722","reported_seq":32756,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:11.665940+0000","last_change":"2026-02-23T13:11:54.595399+0000","last_active":"2026-02-23T13:13:11.665940+0000","last_peered":"2026-02-23T13:13:11.665940+0000","last_clean":"2026-02-23T13:13:11.665940+0000","last_became_active":"2026-02-23T13:11:54.595144+0000","last_became_peered":"2026-02-23T13:11:54.595144+0000","last_unstale":"2026-02-23T13:13:11.665940+0000","last_undegraded":"2026-02-23T13:13:11.665940+0000","last_fullsized":"2026-02-23T13:13:11.665940+0000","mapping_epoch":78,"log_start":"90'32719","ondisk_log_start":"90'32719","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:16.231133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2144468992,"num_objects":32722,"num_object_clones":0,"num_object_copies":98166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32722,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32722,"num_write_kb":2094208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"90'33064","reported_seq":33098,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:11.675294+0000","last_change":"2026-02-23T13:11:54.596295+0000","last_active":"2026-02-23T13:13:11.675294+0000","last_peered":"2026-02-23T13:13:11.675294+0000","last_clean":"2026-02-23T13:13:11.675294+0000","last_became_active":"2026-02-23T13:11:54.595996+0000","last_became_peered":"2026-02-23T13:11:54.595996+0000","last_unstale":"2026-02-23T13:13:11.675294+0000","last_undegraded":"2026-02-23T13:13:11.675294+0000","last_fullsized":"2026-02-23T13:13:11.675294+0000","mapping_epoch":78,"log_start":"90'33061","ondisk_log_start":"90'33061","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:13:21.493149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2166882304,"num_objects":33064,"num_object_clones":0,"num_object_copies":99192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33064,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33064,"num_write_kb":2116096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"94'34423","reported_seq":34680,"reported_epoch":94,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:13:16.662499+0000","last_change":"2026-02-23T13:13:14.393096+0000","last_active":"2026-02-23T13:13:16.662499+0000","last_peered":"2026-02-23T13:13:16.662499+0000","last_clean":"2026-02-23T13:13:16.662499+0000","last_became_active":"2026-02-23T13:11:54.598958+0000","last_became_peered":"2026-02-23T13:11:54.598958+0000","last_unstale":"2026-02-23T13:13:16.662499+0000","last_undegraded":"2026-02-23T13:13:16.662499+0000","last_fullsized":"2026-02-23T13:13:16.662499+0000","mapping_epoch":78,"log_start":"94'34420","ondisk_log_start":"94'34420","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":20999,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 3s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2255945728,"num_objects":34423,"num_object_clones":0,"num_object_copies":103269,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34423,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34423,"num_write_kb":2203072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"94'34363","reported_seq":34725,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:16.662354+0000","last_change":"2026-02-23T13:13:08.044115+0000","last_active":"2026-02-23T13:13:16.662354+0000","last_peered":"2026-02-23T13:13:16.662354+0000","last_clean":"2026-02-23T13:13:16.662354+0000","last_became_active":"2026-02-23T13:11:54.598751+0000","last_became_peered":"2026-02-23T13:11:54.598751+0000","last_unstale":"2026-02-23T13:13:16.662354+0000","last_undegraded":"2026-02-23T13:13:16.662354+0000","last_fullsized":"2026-02-23T13:13:16.662354+0000","mapping_epoch":78,"log_start":"94'34360","ondisk_log_start":"94'34360","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31416","last_scrub_stamp":"2026-02-23T13:13:08.044055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:08.044055+0000","objects_scrubbed":31053,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:17.610054+0000","scrub_duration":2694,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2252013568,"num_objects":34363,"num_object_clones":0,"num_object_copies":103089,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34363,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34363,"num_write_kb":2199232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"90'32615","reported_seq":32937,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-23T13:13:11.675796+0000","last_change":"2026-02-23T13:13:00.668240+0000","last_active":"2026-02-23T13:13:11.675796+0000","last_peered":"2026-02-23T13:13:11.675796+0000","last_clean":"2026-02-23T13:13:11.675796+0000","last_became_active":"2026-02-23T13:11:54.595840+0000","last_became_peered":"2026-02-23T13:11:54.595840+0000","last_unstale":"2026-02-23T13:13:11.675796+0000","last_undegraded":"2026-02-23T13:13:11.675796+0000","last_fullsized":"2026-02-23T13:13:11.675796+0000","mapping_epoch":78,"log_start":"90'32612","ondisk_log_start":"90'32612","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'28514","last_scrub_stamp":"2026-02-23T13:13:00.668153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:00.668153+0000","objects_scrubbed":27959,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:20.748829+0000","scrub_duration":2841,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2137456640,"num_objects":32615,"num_object_clones":0,"num_object_copies":97845,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32615,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32615,"num_write_kb":2087360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"90'32692","reported_seq":32797,"reported_epoch":90,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:13:11.675382+0000","last_change":"2026-02-23T13:13:11.192778+0000","last_active":"2026-02-23T13:13:11.675382+0000","last_peered":"2026-02-23T13:13:11.675382+0000","last_clean":"2026-02-23T13:13:11.675382+0000","last_became_active":"2026-02-23T13:11:54.595287+0000","last_became_peered":"2026-02-23T13:11:54.595287+0000","last_unstale":"2026-02-23T13:13:11.675382+0000","last_undegraded":"2026-02-23T13:13:11.675382+0000","last_fullsized":"2026-02-23T13:13:11.675382+0000","mapping_epoch":78,"log_start":"90'32689","ondisk_log_start":"90'32689","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":6649,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2142502912,"num_objects":32692,"num_object_clones":0,"num_object_copies":98076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32692,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32692,"num_write_kb":2092288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":385,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:16.609942+0000","last_change":"2026-02-23T13:13:01.377596+0000","last_active":"2026-02-23T13:13:16.609942+0000","last_peered":"2026-02-23T13:13:16.609942+0000","last_clean":"2026-02-23T13:13:16.609942+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:13:16.609942+0000","last_undegraded":"2026-02-23T13:13:16.609942+0000","last_fullsized":"2026-02-23T13:13:16.609942+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:13:01.377552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:13:01.377552+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:11.484316+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":34924986368,"num_objects":532913,"num_object_clones":0,"num_object_copies":1598739,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":532913,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":532913,"num_write_kb":34106432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":104660926464,"data_stored":104660926464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2356,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247934,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32071768,"kb_used_data":30780420,"kb_used_omap":25,"kb_used_meta":1291302,"kb_avail":701931432,"statfs":{"total":751619276800,"available":718777786368,"internally_reserved":0,"allocated":31519150080,"data_stored":31518686487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26201,"internal_metadata":1322293671},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444160,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":24737460,"kb_used_data":22980896,"kb_used_omap":26,"kb_used_meta":1756517,"kb_avail":709265740,"statfs":{"total":751619276800,"available":726288117760,"internally_reserved":0,"allocated":23532437504,"data_stored":23531997548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26936,"internal_metadata":1798674120},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574978,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":22463728,"kb_used_data":20868572,"kb_used_omap":27,"kb_used_meta":1595108,"kb_avail":711539472,"statfs":{"total":751619276800,"available":728616419328,"internally_reserved":0,"allocated":21369417728,"data_stored":21368981324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28263,"internal_metadata":1633391001},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,3,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705795,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28738484,"kb_used_data":27081952,"kb_used_omap":21,"kb_used_meta":1656490,"kb_avail":705264716,"statfs":{"total":751619276800,"available":722191069184,"internally_reserved":0,"allocated":27731918848,"data_stored":27731478892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21534,"internal_metadata":1696246754},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2356,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27951562752,"data_stored":27951562752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21468741632,"data_stored":21468741632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23632281600,"data_stored":23632281600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":31608340480,"data_stored":31608340480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:13:18.694 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 83 16 562869 562853 423.801 377.312 0.00184062 0.00235837 2026-02-23T13:13:18.763 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:13:18.907 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:18.932 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:18 trial046 ceph-mon[38575]: 5.c scrub ok 2026-02-23T13:13:18.933 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:18 trial046 ceph-mon[38575]: from='client.15299 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:13:18.933 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:18 trial046 ceph-mon[38575]: 5.7 scrub starts 2026-02-23T13:13:18.933 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:18 trial046 ceph-mon[38575]: from='client.15301 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:13:18.933 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:18 trial046 ceph-mon[38575]: 5.2 scrub ok 2026-02-23T13:13:19.032 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:19.030+0000 7fc36c915640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:19.032 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:19.030+0000 7fc36c915640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:19.049 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:13:19.049 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:13:19.063 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:13:19.063 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:13:19.076 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:13:19.076 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:13:19.090 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:13:19.090 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:13:19.694 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 84 16 569208 569192 423.472 396.188 0.000966652 0.00236018 2026-02-23T13:13:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:19 trial046 ceph-mon[38575]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:13:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:19 trial046 ceph-mon[38575]: 5.a scrub ok 2026-02-23T13:13:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:19 trial046 ceph-mon[38575]: pgmap v379: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 34 GiB data, 107 GiB used, 2.6 TiB / 2.7 TiB avail; 273 MiB/s wr, 4.37k op/s 2026-02-23T13:13:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:19 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/675686224' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:13:20.694 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 85 16 575625 575609 423.208 401.062 0.00147529 0.00236169 2026-02-23T13:13:21.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:20 trial046 ceph-mon[38575]: 5.f scrub starts 2026-02-23T13:13:21.135 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:13:21.276 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:21.694 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 86 16 581166 581150 422.313 346.312 0.00210906 0.00236672 2026-02-23T13:13:21.742 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:21.657+0000 7fdd6c73b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:21.742 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:21.658+0000 7fdd6c73b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:21.742 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:13:21.742 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:13:21.743 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:13:21.743 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:13:21.743 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:13:21.743 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:13:21.743 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:13:21.744 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:13:21.788 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:21 trial046 ceph-mon[38575]: pgmap v380: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 34 GiB data, 107 GiB used, 2.6 TiB / 2.7 TiB avail; 270 MiB/s wr, 4.32k op/s 2026-02-23T13:13:21.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:21 trial046 ceph-mon[38575]: 5.7 scrub ok 2026-02-23T13:13:22.694 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 87 15 586533 586518 421.315 335.5 0.00166588 0.00237233 2026-02-23T13:13:22.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:22 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3655696583' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:13:23.041 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:13:23.042 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:13:23.042 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_3 2026-02-23T13:13:23.042 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:13:23.175 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:23.298 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:23.296+0000 7fb0e79b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:23.298 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:23.296+0000 7fb0e79b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:23.434 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:13:23.434 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:13:23.486 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":381,"stamp":"2026-02-23T13:13:22.674189+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":38086640160,"num_objects":581149,"num_object_clones":0,"num_object_copies":1743447,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":581149,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":581282,"num_write_kb":37195558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53,"ondisk_log_size":53,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":118153612,"kb_used_data":111290364,"kb_used_omap":108,"kb_used_meta":6863059,"kb_avail":2817859188,"statfs":{"total":3006477107200,"available":2885487808512,"internally_reserved":0,"allocated":113961332736,"data_stored":113959450400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":111410,"internal_metadata":7027772622},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3703308288,"num_objects":56508,"num_object_clones":0,"num_object_copies":169524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56508,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56508,"num_write_kb":3616512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001126"},"pg_stats":[{"pgid":"5.f","version":"94'36496","reported_seq":36776,"reported_epoch":94,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:13:21.650764+0000","last_change":"2026-02-23T13:13:19.151506+0000","last_active":"2026-02-23T13:13:21.650764+0000","last_peered":"2026-02-23T13:13:21.650764+0000","last_clean":"2026-02-23T13:13:21.650764+0000","last_became_active":"2026-02-23T13:11:54.595945+0000","last_became_peered":"2026-02-23T13:11:54.595945+0000","last_unstale":"2026-02-23T13:13:21.650764+0000","last_undegraded":"2026-02-23T13:13:21.650764+0000","last_fullsized":"2026-02-23T13:13:21.650764+0000","mapping_epoch":78,"log_start":"94'36491","ondisk_log_start":"94'36491","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":23399,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 3s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2391801856,"num_objects":36496,"num_object_clones":0,"num_object_copies":109488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36496,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36496,"num_write_kb":2335744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"94'36616","reported_seq":37007,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:21.642533+0000","last_change":"2026-02-23T13:13:16.070635+0000","last_active":"2026-02-23T13:13:21.642533+0000","last_peered":"2026-02-23T13:13:21.642533+0000","last_clean":"2026-02-23T13:13:21.642533+0000","last_became_active":"2026-02-23T13:11:54.599064+0000","last_became_peered":"2026-02-23T13:11:54.599064+0000","last_unstale":"2026-02-23T13:13:21.642533+0000","last_undegraded":"2026-02-23T13:13:21.642533+0000","last_fullsized":"2026-02-23T13:13:21.642533+0000","mapping_epoch":78,"log_start":"94'36613","ondisk_log_start":"94'36613","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'34507","last_scrub_stamp":"2026-02-23T13:13:16.070555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:16.070555+0000","objects_scrubbed":33959,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:37.180440+0000","scrub_duration":3680,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2399666176,"num_objects":36616,"num_object_clones":0,"num_object_copies":109848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36616,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36616,"num_write_kb":2343424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"94'36636","reported_seq":36678,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:21.641596+0000","last_change":"2026-02-23T13:11:54.596174+0000","last_active":"2026-02-23T13:13:21.641596+0000","last_peered":"2026-02-23T13:13:21.641596+0000","last_clean":"2026-02-23T13:13:21.641596+0000","last_became_active":"2026-02-23T13:11:54.595773+0000","last_became_peered":"2026-02-23T13:11:54.595773+0000","last_unstale":"2026-02-23T13:13:21.641596+0000","last_undegraded":"2026-02-23T13:13:21.641596+0000","last_fullsized":"2026-02-23T13:13:21.641596+0000","mapping_epoch":78,"log_start":"94'36633","ondisk_log_start":"94'36633","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2400976896,"num_objects":36636,"num_object_clones":0,"num_object_copies":109908,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36636,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36636,"num_write_kb":2344704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"94'36008","reported_seq":36398,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:21.778074+0000","last_change":"2026-02-23T13:13:17.030615+0000","last_active":"2026-02-23T13:13:21.778074+0000","last_peered":"2026-02-23T13:13:21.778074+0000","last_clean":"2026-02-23T13:13:21.778074+0000","last_became_active":"2026-02-23T13:11:54.595560+0000","last_became_peered":"2026-02-23T13:11:54.595560+0000","last_unstale":"2026-02-23T13:13:21.778074+0000","last_undegraded":"2026-02-23T13:13:21.778074+0000","last_fullsized":"2026-02-23T13:13:21.778074+0000","mapping_epoch":78,"log_start":"94'36005","ondisk_log_start":"94'36005","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34247","last_scrub_stamp":"2026-02-23T13:13:17.030566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:17.030566+0000","objects_scrubbed":33782,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:44.233824+0000","scrub_duration":2702,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359820288,"num_objects":36008,"num_object_clones":0,"num_object_copies":108024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36008,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36008,"num_write_kb":2304512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"94'36185","reported_seq":36550,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:21.646181+0000","last_change":"2026-02-23T13:13:09.088406+0000","last_active":"2026-02-23T13:13:21.646181+0000","last_peered":"2026-02-23T13:13:21.646181+0000","last_clean":"2026-02-23T13:13:21.646181+0000","last_became_active":"2026-02-23T13:11:54.596133+0000","last_became_peered":"2026-02-23T13:11:54.596133+0000","last_unstale":"2026-02-23T13:13:21.646181+0000","last_undegraded":"2026-02-23T13:13:21.646181+0000","last_fullsized":"2026-02-23T13:13:21.646181+0000","mapping_epoch":78,"log_start":"94'36182","ondisk_log_start":"94'36182","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31860","last_scrub_stamp":"2026-02-23T13:13:09.088369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:09.088369+0000","objects_scrubbed":31307,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:14.774702+0000","scrub_duration":3283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2371420160,"num_objects":36185,"num_object_clones":0,"num_object_copies":108555,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36185,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36185,"num_write_kb":2315840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"94'36183","reported_seq":36576,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:21.644647+0000","last_change":"2026-02-23T13:13:18.263885+0000","last_active":"2026-02-23T13:13:21.644647+0000","last_peered":"2026-02-23T13:13:21.644647+0000","last_clean":"2026-02-23T13:13:21.644647+0000","last_became_active":"2026-02-23T13:11:54.595080+0000","last_became_peered":"2026-02-23T13:11:54.595080+0000","last_unstale":"2026-02-23T13:13:21.644647+0000","last_undegraded":"2026-02-23T13:13:21.644647+0000","last_fullsized":"2026-02-23T13:13:21.644647+0000","mapping_epoch":78,"log_start":"94'36180","ondisk_log_start":"94'36180","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34829","last_scrub_stamp":"2026-02-23T13:13:18.263833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:18.263833+0000","objects_scrubbed":34171,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:35.520181+0000","scrub_duration":3597,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2371289088,"num_objects":36183,"num_object_clones":0,"num_object_copies":108549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36183,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36183,"num_write_kb":2315712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"94'36219","reported_seq":36568,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:21.647468+0000","last_change":"2026-02-23T13:13:04.939376+0000","last_active":"2026-02-23T13:13:21.647468+0000","last_peered":"2026-02-23T13:13:21.647468+0000","last_clean":"2026-02-23T13:13:21.647468+0000","last_became_active":"2026-02-23T13:11:54.598325+0000","last_became_peered":"2026-02-23T13:11:54.598325+0000","last_unstale":"2026-02-23T13:13:21.647468+0000","last_undegraded":"2026-02-23T13:13:21.647468+0000","last_fullsized":"2026-02-23T13:13:21.647468+0000","mapping_epoch":78,"log_start":"94'36216","ondisk_log_start":"94'36216","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'30360","last_scrub_stamp":"2026-02-23T13:13:04.939307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:04.939307+0000","objects_scrubbed":29843,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:25.467510+0000","scrub_duration":2554,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2373648384,"num_objects":36219,"num_object_clones":0,"num_object_copies":108657,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36219,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36219,"num_write_kb":2318016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"94'36105","reported_seq":36464,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:21.644906+0000","last_change":"2026-02-23T13:13:08.083112+0000","last_active":"2026-02-23T13:13:21.644906+0000","last_peered":"2026-02-23T13:13:21.644906+0000","last_clean":"2026-02-23T13:13:21.644906+0000","last_became_active":"2026-02-23T13:11:54.595110+0000","last_became_peered":"2026-02-23T13:11:54.595110+0000","last_unstale":"2026-02-23T13:13:21.644906+0000","last_undegraded":"2026-02-23T13:13:21.644906+0000","last_fullsized":"2026-02-23T13:13:21.644906+0000","mapping_epoch":78,"log_start":"94'36102","ondisk_log_start":"94'36102","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31220","last_scrub_stamp":"2026-02-23T13:13:08.083065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:08.083065+0000","objects_scrubbed":30674,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:23.606645+0000","scrub_duration":3240,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2366177280,"num_objects":36105,"num_object_clones":0,"num_object_copies":108315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36105,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36105,"num_write_kb":2310720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"94'36597","reported_seq":37006,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:21.645038+0000","last_change":"2026-02-23T13:13:21.209650+0000","last_active":"2026-02-23T13:13:21.645038+0000","last_peered":"2026-02-23T13:13:21.645038+0000","last_clean":"2026-02-23T13:13:21.645038+0000","last_became_active":"2026-02-23T13:11:54.599155+0000","last_became_peered":"2026-02-23T13:11:54.599155+0000","last_unstale":"2026-02-23T13:13:21.645038+0000","last_undegraded":"2026-02-23T13:13:21.645038+0000","last_fullsized":"2026-02-23T13:13:21.645038+0000","mapping_epoch":78,"log_start":"94'36594","ondisk_log_start":"94'36594","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'36425","last_scrub_stamp":"2026-02-23T13:13:21.209611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:21.209611+0000","objects_scrubbed":35661,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:41.420198+0000","scrub_duration":3833,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2398420992,"num_objects":36597,"num_object_clones":0,"num_object_copies":109791,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36597,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36597,"num_write_kb":2342208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"94'36263","reported_seq":36304,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:21.808785+0000","last_change":"2026-02-23T13:11:54.595872+0000","last_active":"2026-02-23T13:13:21.808785+0000","last_peered":"2026-02-23T13:13:21.808785+0000","last_clean":"2026-02-23T13:13:21.808785+0000","last_became_active":"2026-02-23T13:11:54.595645+0000","last_became_peered":"2026-02-23T13:11:54.595645+0000","last_unstale":"2026-02-23T13:13:21.808785+0000","last_undegraded":"2026-02-23T13:13:21.808785+0000","last_fullsized":"2026-02-23T13:13:21.808785+0000","mapping_epoch":78,"log_start":"94'36260","ondisk_log_start":"94'36260","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2376531968,"num_objects":36263,"num_object_clones":0,"num_object_copies":108789,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36263,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36263,"num_write_kb":2320832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"94'36275","reported_seq":36317,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:21.648084+0000","last_change":"2026-02-23T13:11:54.595399+0000","last_active":"2026-02-23T13:13:21.648084+0000","last_peered":"2026-02-23T13:13:21.648084+0000","last_clean":"2026-02-23T13:13:21.648084+0000","last_became_active":"2026-02-23T13:11:54.595144+0000","last_became_peered":"2026-02-23T13:11:54.595144+0000","last_unstale":"2026-02-23T13:13:21.648084+0000","last_undegraded":"2026-02-23T13:13:21.648084+0000","last_fullsized":"2026-02-23T13:13:21.648084+0000","mapping_epoch":78,"log_start":"94'36272","ondisk_log_start":"94'36272","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2377318400,"num_objects":36275,"num_object_clones":0,"num_object_copies":108825,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36275,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36275,"num_write_kb":2321600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"94'36596","reported_seq":36638,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:21.644998+0000","last_change":"2026-02-23T13:11:54.596295+0000","last_active":"2026-02-23T13:13:21.644998+0000","last_peered":"2026-02-23T13:13:21.644998+0000","last_clean":"2026-02-23T13:13:21.644998+0000","last_became_active":"2026-02-23T13:11:54.595996+0000","last_became_peered":"2026-02-23T13:11:54.595996+0000","last_unstale":"2026-02-23T13:13:21.644998+0000","last_undegraded":"2026-02-23T13:13:21.644998+0000","last_fullsized":"2026-02-23T13:13:21.644998+0000","mapping_epoch":78,"log_start":"94'36593","ondisk_log_start":"94'36593","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2398355456,"num_objects":36596,"num_object_clones":0,"num_object_copies":109788,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36596,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36596,"num_write_kb":2342144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"94'36289","reported_seq":36685,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:21.645114+0000","last_change":"2026-02-23T13:13:18.223410+0000","last_active":"2026-02-23T13:13:21.645114+0000","last_peered":"2026-02-23T13:13:21.645114+0000","last_clean":"2026-02-23T13:13:21.645114+0000","last_became_active":"2026-02-23T13:11:54.598958+0000","last_became_peered":"2026-02-23T13:11:54.598958+0000","last_unstale":"2026-02-23T13:13:21.645114+0000","last_undegraded":"2026-02-23T13:13:21.645114+0000","last_fullsized":"2026-02-23T13:13:21.645114+0000","mapping_epoch":78,"log_start":"94'36286","ondisk_log_start":"94'36286","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34997","last_scrub_stamp":"2026-02-23T13:13:18.223228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:18.223228+0000","objects_scrubbed":34269,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:30.400168+0000","scrub_duration":3831,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2378235904,"num_objects":36289,"num_object_clones":0,"num_object_copies":108867,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36289,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36289,"num_write_kb":2322496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"94'36204","reported_seq":36566,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:21.643626+0000","last_change":"2026-02-23T13:13:08.044115+0000","last_active":"2026-02-23T13:13:21.643626+0000","last_peered":"2026-02-23T13:13:21.643626+0000","last_clean":"2026-02-23T13:13:21.643626+0000","last_became_active":"2026-02-23T13:11:54.598751+0000","last_became_peered":"2026-02-23T13:11:54.598751+0000","last_unstale":"2026-02-23T13:13:21.643626+0000","last_undegraded":"2026-02-23T13:13:21.643626+0000","last_fullsized":"2026-02-23T13:13:21.643626+0000","mapping_epoch":78,"log_start":"94'36201","ondisk_log_start":"94'36201","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31416","last_scrub_stamp":"2026-02-23T13:13:08.044055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:08.044055+0000","objects_scrubbed":31053,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:17.610054+0000","scrub_duration":2694,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2372665344,"num_objects":36204,"num_object_clones":0,"num_object_copies":108612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36204,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36204,"num_write_kb":2317056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"94'36215","reported_seq":36545,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:21.643193+0000","last_change":"2026-02-23T13:13:00.668240+0000","last_active":"2026-02-23T13:13:21.643193+0000","last_peered":"2026-02-23T13:13:21.643193+0000","last_clean":"2026-02-23T13:13:21.643193+0000","last_became_active":"2026-02-23T13:11:54.595840+0000","last_became_peered":"2026-02-23T13:11:54.595840+0000","last_unstale":"2026-02-23T13:13:21.643193+0000","last_undegraded":"2026-02-23T13:13:21.643193+0000","last_fullsized":"2026-02-23T13:13:21.643193+0000","mapping_epoch":78,"log_start":"94'36212","ondisk_log_start":"94'36212","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'28514","last_scrub_stamp":"2026-02-23T13:13:00.668153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:00.668153+0000","objects_scrubbed":27959,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:20.748829+0000","scrub_duration":2841,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2373386240,"num_objects":36215,"num_object_clones":0,"num_object_copies":108645,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36215,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36215,"num_write_kb":2317760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"94'36260","reported_seq":36640,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:21.648074+0000","last_change":"2026-02-23T13:13:13.604684+0000","last_active":"2026-02-23T13:13:21.648074+0000","last_peered":"2026-02-23T13:13:21.648074+0000","last_clean":"2026-02-23T13:13:21.648074+0000","last_became_active":"2026-02-23T13:11:54.595287+0000","last_became_peered":"2026-02-23T13:11:54.595287+0000","last_unstale":"2026-02-23T13:13:21.648074+0000","last_undegraded":"2026-02-23T13:13:21.648074+0000","last_fullsized":"2026-02-23T13:13:21.648074+0000","mapping_epoch":78,"log_start":"94'36257","ondisk_log_start":"94'36257","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'33325","last_scrub_stamp":"2026-02-23T13:13:13.604647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:13.604647+0000","objects_scrubbed":32944,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:25.477441+0000","scrub_duration":2412,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2376335360,"num_objects":36260,"num_object_clones":0,"num_object_copies":108780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36260,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36260,"num_write_kb":2320640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":385,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:16.609942+0000","last_change":"2026-02-23T13:13:01.377596+0000","last_active":"2026-02-23T13:13:16.609942+0000","last_peered":"2026-02-23T13:13:16.609942+0000","last_clean":"2026-02-23T13:13:16.609942+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:13:16.609942+0000","last_undegraded":"2026-02-23T13:13:16.609942+0000","last_fullsized":"2026-02-23T13:13:16.609942+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:13:01.377552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:13:01.377552+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:11.484316+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":38086049792,"num_objects":581147,"num_object_clones":0,"num_object_copies":1743441,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":581147,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":581147,"num_write_kb":37193408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114272894976,"data_stored":114272894976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":50,"ondisk_log_size":50,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2356,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247935,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":33854820,"kb_used_data":32473232,"kb_used_omap":26,"kb_used_meta":1381541,"kb_avail":700148380,"statfs":{"total":751619276800,"available":716951941120,"internally_reserved":0,"allocated":33252589568,"data_stored":33252118096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26847,"internal_metadata":1414698785},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444162,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27362020,"kb_used_data":25443024,"kb_used_omap":28,"kb_used_meta":1918947,"kb_avail":706641180,"statfs":{"total":751619276800,"available":723600568320,"internally_reserved":0,"allocated":26053656576,"data_stored":26053185104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29550,"internal_metadata":1965001874},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574980,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":24892448,"kb_used_data":23152908,"kb_used_omap":30,"kb_used_meta":1739489,"kb_avail":709110752,"statfs":{"total":751619276800,"available":726129410048,"internally_reserved":0,"allocated":23708577792,"data_stored":23708109872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30871,"internal_metadata":1781237609},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705797,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32044324,"kb_used_data":30221200,"kb_used_omap":23,"kb_used_meta":1823080,"kb_avail":701958876,"statfs":{"total":751619276800,"available":718805889024,"internally_reserved":0,"allocated":30946508800,"data_stored":30946037328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24142,"internal_metadata":1866834354},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2356,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":30957830144,"data_stored":30957830144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23795662848,"data_stored":23795662848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":26168524800,"data_stored":26168524800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33350877184,"data_stored":33350877184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:13:23.487 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:13:23.487 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_3 pg_num 56 2026-02-23T13:13:23.640 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:23.694 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 88 16 593245 593229 421.294 419.438 0.000985177 0.00237244 2026-02-23T13:13:23.695 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:23 trial046 ceph-mon[38575]: pgmap v381: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 35 GiB data, 113 GiB used, 2.6 TiB / 2.7 TiB avail; 441 MiB/s wr, 7.06k op/s 2026-02-23T13:13:23.768 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:23.767+0000 7f33f8a7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:23.768 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:23.767+0000 7f33f8a7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:23.910 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:13:23.954 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:13:24.461 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:13:24.610 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:24.694 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 89 16 599871 599855 421.213 414.125 0.00190618 0.00237286 2026-02-23T13:13:24.742 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:24.740+0000 7f6c20da0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:24.742 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:24 trial046 ceph-mon[38575]: 5.f scrub ok 2026-02-23T13:13:24.743 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:24 trial046 ceph-mon[38575]: 5.6 scrub starts 2026-02-23T13:13:24.743 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:24 trial046 ceph-mon[38575]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:13:24.743 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:24 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1242304354' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_3", "var": "pg_num", "val": "56"} : dispatch 2026-02-23T13:13:24.743 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:24.740+0000 7f6c20da0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:24.757 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:13:24.757 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:13:24.774 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:13:24.774 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:13:24.790 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:13:24.791 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:13:24.802 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:13:24.803 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:13:25.695 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Total time run: 90.0049 2026-02-23T13:13:25.695 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Total writes made: 605729 2026-02-23T13:13:25.695 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Write size: 65536 2026-02-23T13:13:25.695 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Object size: 65536 2026-02-23T13:13:25.695 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Bandwidth (MB/sec): 420.622 2026-02-23T13:13:25.696 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Stddev Bandwidth: 60.4897 2026-02-23T13:13:25.696 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Max bandwidth (MB/sec): 530.812 2026-02-23T13:13:25.696 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Min bandwidth (MB/sec): 270.688 2026-02-23T13:13:25.696 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Average IOPS: 6729 2026-02-23T13:13:25.696 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Stddev IOPS: 967.836 2026-02-23T13:13:25.696 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Max IOPS: 8493 2026-02-23T13:13:25.696 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Min IOPS: 4331 2026-02-23T13:13:25.696 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Average Latency(s): 0.00237618 2026-02-23T13:13:25.696 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Stddev Latency(s): 0.00216312 2026-02-23T13:13:25.696 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Max latency(s): 0.0626709 2026-02-23T13:13:25.696 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Min latency(s): 0.000681273 2026-02-23T13:13:25.699 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Cleaning up (deleting benchmark objects) 2026-02-23T13:13:26.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:25 trial046 ceph-mon[38575]: 5.5 scrub starts 2026-02-23T13:13:26.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:25 trial046 ceph-mon[38575]: pgmap v382: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 35 GiB data, 113 GiB used, 2.6 TiB / 2.7 TiB avail; 389 MiB/s wr, 6.23k op/s 2026-02-23T13:13:26.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:25 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4060433094' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:13:26.539 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:13:26 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:13:26] "GET /metrics HTTP/1.1" 200 4219 "" "Prometheus/3.6.0" 2026-02-23T13:13:26.560 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:13:26 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:13:26.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:13:26.846 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:13:26.868 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:26 trial046 ceph-mon[38575]: 5.3 scrub starts 2026-02-23T13:13:26.987 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:27.106 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:27.104+0000 7f5ce4a51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:27.106 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:27.104+0000 7f5ce4a51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:27.123 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:13:27.123 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:13:27.135 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:13:27.135 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:13:27.150 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:13:27.150 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:13:27.164 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:13:27.164 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:13:28.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:27 trial046 ceph-mon[38575]: 5.6 scrub ok 2026-02-23T13:13:28.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:27 trial046 ceph-mon[38575]: pgmap v383: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 36 GiB data, 114 GiB used, 2.6 TiB / 2.7 TiB avail; 399 MiB/s wr, 6.56k op/s 2026-02-23T13:13:28.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:27 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1214367812' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:13:28.955 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:13:28.955 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:13:28.955 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_3 2026-02-23T13:13:28.956 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:13:28.980 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:28 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:13:28.981 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:28 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:13:29.095 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:29.207 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:13:29.373 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:29.529 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:29.507+0000 7f800b8e1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:29.530 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:29.507+0000 7f800b8e1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:29.633 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:13:29.634 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:13:29.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:29 trial046 ceph-mon[38575]: 5.5 scrub ok 2026-02-23T13:13:29.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:29 trial046 ceph-mon[38575]: pgmap v384: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 37 GiB data, 117 GiB used, 2.6 TiB / 2.7 TiB avail; 85 B/s rd, 379 MiB/s wr, 6.56k op/s 2026-02-23T13:13:30.201 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:30.164+0000 7fbe7f1b0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:30.201 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:30.164+0000 7fbe7f1b0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:30.202 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:13:30.202 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:13:30.215 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:13:30.216 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:13:30.228 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:13:30.228 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:13:30.241 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:13:30.242 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:13:30.526 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":384,"stamp":"2026-02-23T13:13:28.675027+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":39307444792,"num_objects":599778,"num_object_clones":0,"num_object_copies":1799334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":599778,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":611819,"num_write_kb":38768807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":122753560,"kb_used_data":115529224,"kb_used_omap":108,"kb_used_meta":7224019,"kb_avail":2813259240,"statfs":{"total":3006477107200,"available":2880777461760,"internally_reserved":0,"allocated":118301925376,"data_stored":118300030824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":111410,"internal_metadata":7397395662},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,4],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4381868056,"num_objects":66863,"num_object_clones":0,"num_object_copies":200589,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66863,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":78771,"num_write_kb":4660225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001704"},"pg_stats":[{"pgid":"5.f","version":"94'38497","reported_seq":38913,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:26.659030+0000","last_change":"2026-02-23T13:13:23.096196+0000","last_active":"2026-02-23T13:13:26.659030+0000","last_peered":"2026-02-23T13:13:26.659030+0000","last_clean":"2026-02-23T13:13:26.659030+0000","last_became_active":"2026-02-23T13:11:54.595945+0000","last_became_peered":"2026-02-23T13:11:54.595945+0000","last_unstale":"2026-02-23T13:13:26.659030+0000","last_undegraded":"2026-02-23T13:13:26.659030+0000","last_fullsized":"2026-02-23T13:13:26.659030+0000","mapping_epoch":78,"log_start":"94'38494","ondisk_log_start":"94'38494","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'37044","last_scrub_stamp":"2026-02-23T13:13:23.096162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:23.096162+0000","objects_scrubbed":36289,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:30.719300+0000","scrub_duration":3945,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2474704896,"num_objects":37761,"num_object_clones":0,"num_object_copies":113283,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37761,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38497,"num_write_kb":2440256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"94'38518","reported_seq":38909,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:26.659625+0000","last_change":"2026-02-23T13:13:16.070635+0000","last_active":"2026-02-23T13:13:26.659625+0000","last_peered":"2026-02-23T13:13:26.659625+0000","last_clean":"2026-02-23T13:13:26.659625+0000","last_became_active":"2026-02-23T13:11:54.599064+0000","last_became_peered":"2026-02-23T13:11:54.599064+0000","last_unstale":"2026-02-23T13:13:26.659625+0000","last_undegraded":"2026-02-23T13:13:26.659625+0000","last_fullsized":"2026-02-23T13:13:26.659625+0000","mapping_epoch":78,"log_start":"94'38515","ondisk_log_start":"94'38515","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'34507","last_scrub_stamp":"2026-02-23T13:13:16.070555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:16.070555+0000","objects_scrubbed":33959,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:37.180440+0000","scrub_duration":3680,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2476474368,"num_objects":37788,"num_object_clones":0,"num_object_copies":113364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37788,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38518,"num_write_kb":2441792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"94'38544","reported_seq":38586,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:26.682009+0000","last_change":"2026-02-23T13:11:54.596174+0000","last_active":"2026-02-23T13:13:26.682009+0000","last_peered":"2026-02-23T13:13:26.682009+0000","last_clean":"2026-02-23T13:13:26.682009+0000","last_became_active":"2026-02-23T13:11:54.595773+0000","last_became_peered":"2026-02-23T13:11:54.595773+0000","last_unstale":"2026-02-23T13:13:26.682009+0000","last_undegraded":"2026-02-23T13:13:26.682009+0000","last_fullsized":"2026-02-23T13:13:26.682009+0000","mapping_epoch":78,"log_start":"94'38541","ondisk_log_start":"94'38541","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2477195288,"num_objects":37800,"num_object_clones":0,"num_object_copies":113400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37800,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":38544,"num_write_kb":2442945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"94'37899","reported_seq":38289,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:26.808157+0000","last_change":"2026-02-23T13:13:17.030615+0000","last_active":"2026-02-23T13:13:26.808157+0000","last_peered":"2026-02-23T13:13:26.808157+0000","last_clean":"2026-02-23T13:13:26.808157+0000","last_became_active":"2026-02-23T13:11:54.595560+0000","last_became_peered":"2026-02-23T13:11:54.595560+0000","last_unstale":"2026-02-23T13:13:26.808157+0000","last_undegraded":"2026-02-23T13:13:26.808157+0000","last_fullsized":"2026-02-23T13:13:26.808157+0000","mapping_epoch":78,"log_start":"94'37896","ondisk_log_start":"94'37896","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34247","last_scrub_stamp":"2026-02-23T13:13:17.030566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:17.030566+0000","objects_scrubbed":33782,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:44.233824+0000","scrub_duration":2702,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2430664704,"num_objects":37089,"num_object_clones":0,"num_object_copies":111267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37089,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37899,"num_write_kb":2399616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"94'38102","reported_seq":38467,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:26.683301+0000","last_change":"2026-02-23T13:13:09.088406+0000","last_active":"2026-02-23T13:13:26.683301+0000","last_peered":"2026-02-23T13:13:26.683301+0000","last_clean":"2026-02-23T13:13:26.683301+0000","last_became_active":"2026-02-23T13:11:54.596133+0000","last_became_peered":"2026-02-23T13:11:54.596133+0000","last_unstale":"2026-02-23T13:13:26.683301+0000","last_undegraded":"2026-02-23T13:13:26.683301+0000","last_fullsized":"2026-02-23T13:13:26.683301+0000","mapping_epoch":78,"log_start":"94'38099","ondisk_log_start":"94'38099","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31860","last_scrub_stamp":"2026-02-23T13:13:09.088369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:09.088369+0000","objects_scrubbed":31307,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:14.774702+0000","scrub_duration":3283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2449473536,"num_objects":37376,"num_object_clones":0,"num_object_copies":112128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37376,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38102,"num_write_kb":2415296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"94'38054","reported_seq":38447,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:26.681033+0000","last_change":"2026-02-23T13:13:18.263885+0000","last_active":"2026-02-23T13:13:26.681033+0000","last_peered":"2026-02-23T13:13:26.681033+0000","last_clean":"2026-02-23T13:13:26.681033+0000","last_became_active":"2026-02-23T13:11:54.595080+0000","last_became_peered":"2026-02-23T13:11:54.595080+0000","last_unstale":"2026-02-23T13:13:26.681033+0000","last_undegraded":"2026-02-23T13:13:26.681033+0000","last_fullsized":"2026-02-23T13:13:26.681033+0000","mapping_epoch":78,"log_start":"94'38051","ondisk_log_start":"94'38051","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34829","last_scrub_stamp":"2026-02-23T13:13:18.263833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:18.263833+0000","objects_scrubbed":34171,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:35.520181+0000","scrub_duration":3597,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2445017088,"num_objects":37308,"num_object_clones":0,"num_object_copies":111924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37308,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38054,"num_write_kb":2411584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"94'38100","reported_seq":38449,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:26.661218+0000","last_change":"2026-02-23T13:13:04.939376+0000","last_active":"2026-02-23T13:13:26.661218+0000","last_peered":"2026-02-23T13:13:26.661218+0000","last_clean":"2026-02-23T13:13:26.661218+0000","last_became_active":"2026-02-23T13:11:54.598325+0000","last_became_peered":"2026-02-23T13:11:54.598325+0000","last_unstale":"2026-02-23T13:13:26.661218+0000","last_undegraded":"2026-02-23T13:13:26.661218+0000","last_fullsized":"2026-02-23T13:13:26.661218+0000","mapping_epoch":78,"log_start":"94'38097","ondisk_log_start":"94'38097","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'30360","last_scrub_stamp":"2026-02-23T13:13:04.939307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:04.939307+0000","objects_scrubbed":29843,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:25.467510+0000","scrub_duration":2554,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2451439616,"num_objects":37406,"num_object_clones":0,"num_object_copies":112218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37406,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38100,"num_write_kb":2416192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"94'38039","reported_seq":38398,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:26.681870+0000","last_change":"2026-02-23T13:13:08.083112+0000","last_active":"2026-02-23T13:13:26.681870+0000","last_peered":"2026-02-23T13:13:26.681870+0000","last_clean":"2026-02-23T13:13:26.681870+0000","last_became_active":"2026-02-23T13:11:54.595110+0000","last_became_peered":"2026-02-23T13:11:54.595110+0000","last_unstale":"2026-02-23T13:13:26.681870+0000","last_undegraded":"2026-02-23T13:13:26.681870+0000","last_fullsized":"2026-02-23T13:13:26.681870+0000","mapping_epoch":78,"log_start":"94'38036","ondisk_log_start":"94'38036","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31220","last_scrub_stamp":"2026-02-23T13:13:08.083065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:08.083065+0000","objects_scrubbed":30674,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:23.606645+0000","scrub_duration":3240,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2444558336,"num_objects":37301,"num_object_clones":0,"num_object_copies":111903,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37301,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38039,"num_write_kb":2410880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"94'38462","reported_seq":38870,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:26.667226+0000","last_change":"2026-02-23T13:13:21.209650+0000","last_active":"2026-02-23T13:13:26.667226+0000","last_peered":"2026-02-23T13:13:26.667226+0000","last_clean":"2026-02-23T13:13:26.667226+0000","last_became_active":"2026-02-23T13:11:54.599155+0000","last_became_peered":"2026-02-23T13:11:54.599155+0000","last_unstale":"2026-02-23T13:13:26.667226+0000","last_undegraded":"2026-02-23T13:13:26.667226+0000","last_fullsized":"2026-02-23T13:13:26.667226+0000","mapping_epoch":78,"log_start":"94'38459","ondisk_log_start":"94'38459","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'36425","last_scrub_stamp":"2026-02-23T13:13:21.209611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:21.209611+0000","objects_scrubbed":35661,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:41.420198+0000","scrub_duration":3833,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2475425792,"num_objects":37772,"num_object_clones":0,"num_object_copies":113316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37772,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38462,"num_write_kb":2439488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"94'38131","reported_seq":38556,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:26.805946+0000","last_change":"2026-02-23T13:13:26.394617+0000","last_active":"2026-02-23T13:13:26.805946+0000","last_peered":"2026-02-23T13:13:26.805946+0000","last_clean":"2026-02-23T13:13:26.805946+0000","last_became_active":"2026-02-23T13:11:54.595645+0000","last_became_peered":"2026-02-23T13:11:54.595645+0000","last_unstale":"2026-02-23T13:13:26.805946+0000","last_undegraded":"2026-02-23T13:13:26.805946+0000","last_fullsized":"2026-02-23T13:13:26.805946+0000","mapping_epoch":78,"log_start":"94'38128","ondisk_log_start":"94'38128","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'37974","last_scrub_stamp":"2026-02-23T13:13:26.394522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:26.394522+0000","objects_scrubbed":37376,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:55.787953+0000","scrub_duration":3046,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2444296192,"num_objects":37297,"num_object_clones":0,"num_object_copies":111891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37297,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38131,"num_write_kb":2413696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"94'38191","reported_seq":38441,"reported_epoch":94,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:13:26.688746+0000","last_change":"2026-02-23T13:13:24.537682+0000","last_active":"2026-02-23T13:13:26.688746+0000","last_peered":"2026-02-23T13:13:26.688746+0000","last_clean":"2026-02-23T13:13:26.688746+0000","last_became_active":"2026-02-23T13:11:54.595144+0000","last_became_peered":"2026-02-23T13:11:54.595144+0000","last_unstale":"2026-02-23T13:13:26.688746+0000","last_undegraded":"2026-02-23T13:13:26.688746+0000","last_fullsized":"2026-02-23T13:13:26.688746+0000","mapping_epoch":78,"log_start":"94'38188","ondisk_log_start":"94'38188","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":20549,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 3s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2453078016,"num_objects":37431,"num_object_clones":0,"num_object_copies":112293,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37431,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38191,"num_write_kb":2419904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"94'38490","reported_seq":38641,"reported_epoch":94,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:13:26.683285+0000","last_change":"2026-02-23T13:13:25.583169+0000","last_active":"2026-02-23T13:13:26.683285+0000","last_peered":"2026-02-23T13:13:26.683285+0000","last_clean":"2026-02-23T13:13:26.683285+0000","last_became_active":"2026-02-23T13:11:54.595996+0000","last_became_peered":"2026-02-23T13:11:54.595996+0000","last_unstale":"2026-02-23T13:13:26.683285+0000","last_undegraded":"2026-02-23T13:13:26.683285+0000","last_fullsized":"2026-02-23T13:13:26.683285+0000","mapping_epoch":78,"log_start":"94'38487","ondisk_log_start":"94'38487","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":10549,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2473590784,"num_objects":37744,"num_object_clones":0,"num_object_copies":113232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37744,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38490,"num_write_kb":2439488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"94'38205","reported_seq":38599,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:26.665457+0000","last_change":"2026-02-23T13:13:18.223410+0000","last_active":"2026-02-23T13:13:26.665457+0000","last_peered":"2026-02-23T13:13:26.665457+0000","last_clean":"2026-02-23T13:13:26.665457+0000","last_became_active":"2026-02-23T13:11:54.598958+0000","last_became_peered":"2026-02-23T13:11:54.598958+0000","last_unstale":"2026-02-23T13:13:26.665457+0000","last_undegraded":"2026-02-23T13:13:26.665457+0000","last_fullsized":"2026-02-23T13:13:26.665457+0000","mapping_epoch":78,"log_start":"94'38202","ondisk_log_start":"94'38202","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34997","last_scrub_stamp":"2026-02-23T13:13:18.223228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:18.223228+0000","objects_scrubbed":34269,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:30.400168+0000","scrub_duration":3831,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2456223744,"num_objects":37479,"num_object_clones":0,"num_object_copies":112437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37479,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38205,"num_write_kb":2421888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"94'38136","reported_seq":38498,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:26.664094+0000","last_change":"2026-02-23T13:13:08.044115+0000","last_active":"2026-02-23T13:13:26.664094+0000","last_peered":"2026-02-23T13:13:26.664094+0000","last_clean":"2026-02-23T13:13:26.664094+0000","last_became_active":"2026-02-23T13:11:54.598751+0000","last_became_peered":"2026-02-23T13:11:54.598751+0000","last_unstale":"2026-02-23T13:13:26.664094+0000","last_undegraded":"2026-02-23T13:13:26.664094+0000","last_fullsized":"2026-02-23T13:13:26.664094+0000","mapping_epoch":78,"log_start":"94'38133","ondisk_log_start":"94'38133","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31416","last_scrub_stamp":"2026-02-23T13:13:08.044055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:08.044055+0000","objects_scrubbed":31053,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:17.610054+0000","scrub_duration":2694,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2448162816,"num_objects":37356,"num_object_clones":0,"num_object_copies":112068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37356,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38136,"num_write_kb":2415744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"94'38137","reported_seq":38467,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:26.687949+0000","last_change":"2026-02-23T13:13:00.668240+0000","last_active":"2026-02-23T13:13:26.687949+0000","last_peered":"2026-02-23T13:13:26.687949+0000","last_clean":"2026-02-23T13:13:26.687949+0000","last_became_active":"2026-02-23T13:11:54.595840+0000","last_became_peered":"2026-02-23T13:11:54.595840+0000","last_unstale":"2026-02-23T13:13:26.687949+0000","last_undegraded":"2026-02-23T13:13:26.687949+0000","last_fullsized":"2026-02-23T13:13:26.687949+0000","mapping_epoch":78,"log_start":"94'38134","ondisk_log_start":"94'38134","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'28514","last_scrub_stamp":"2026-02-23T13:13:00.668153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:00.668153+0000","objects_scrubbed":27959,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:20.748829+0000","scrub_duration":2841,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2451374080,"num_objects":37405,"num_object_clones":0,"num_object_copies":112215,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37405,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38137,"num_write_kb":2417344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"94'38179","reported_seq":38560,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:26.674317+0000","last_change":"2026-02-23T13:13:13.604684+0000","last_active":"2026-02-23T13:13:26.674317+0000","last_peered":"2026-02-23T13:13:26.674317+0000","last_clean":"2026-02-23T13:13:26.674317+0000","last_became_active":"2026-02-23T13:11:54.595287+0000","last_became_peered":"2026-02-23T13:11:54.595287+0000","last_unstale":"2026-02-23T13:13:26.674317+0000","last_undegraded":"2026-02-23T13:13:26.674317+0000","last_fullsized":"2026-02-23T13:13:26.674317+0000","mapping_epoch":78,"log_start":"94'38176","ondisk_log_start":"94'38176","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'33325","last_scrub_stamp":"2026-02-23T13:13:13.604647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:13.604647+0000","objects_scrubbed":32944,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:25.477441+0000","scrub_duration":2412,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2455175168,"num_objects":37463,"num_object_clones":0,"num_object_copies":112389,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37463,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38179,"num_write_kb":2420544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":385,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:16.609942+0000","last_change":"2026-02-23T13:13:01.377596+0000","last_active":"2026-02-23T13:13:16.609942+0000","last_peered":"2026-02-23T13:13:16.609942+0000","last_clean":"2026-02-23T13:13:16.609942+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:13:16.609942+0000","last_undegraded":"2026-02-23T13:13:16.609942+0000","last_fullsized":"2026-02-23T13:13:16.609942+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:13:01.377552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:13:01.377552+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:11.484316+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":39306854424,"num_objects":599776,"num_object_clones":0,"num_object_copies":1799328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":599776,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":611684,"num_write_kb":38766657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":117909237760,"data_stored":117909225544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2356,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247936,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":35209896,"kb_used_data":33719956,"kb_used_omap":26,"kb_used_meta":1489829,"kb_avail":698793304,"statfs":{"total":751619276800,"available":715564343296,"internally_reserved":0,"allocated":34529234944,"data_stored":34528759400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26847,"internal_metadata":1525585697},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444163,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28521768,"kb_used_data":26530580,"kb_used_omap":28,"kb_used_meta":1991139,"kb_avail":705481432,"statfs":{"total":751619276800,"available":722412986368,"internally_reserved":0,"allocated":27167313920,"data_stored":27166838376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29550,"internal_metadata":2038926482},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574981,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":25892192,"kb_used_data":24044364,"kb_used_omap":30,"kb_used_meta":1847777,"kb_avail":708111008,"statfs":{"total":751619276800,"available":725105672192,"internally_reserved":0,"allocated":24621428736,"data_stored":24620960816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30871,"internal_metadata":1892124521},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705798,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":33129704,"kb_used_data":31234324,"kb_used_omap":23,"kb_used_meta":1895272,"kb_avail":700873496,"statfs":{"total":751619276800,"available":717694459904,"internally_reserved":0,"allocated":31983947776,"data_stored":31983472232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24142,"internal_metadata":1940758962},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,4],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2356,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31956537344,"data_stored":31956533272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24501747712,"data_stored":24501747712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27019841536,"data_stored":27019837464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":34431111168,"data_stored":34431107096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:13:30.528 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:13:30.528 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_3 pg_num 66 2026-02-23T13:13:30.666 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:30.783 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:30.781+0000 7f8ab26a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:30.784 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:30 trial046 ceph-mon[38575]: from='client.15317 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:13:30.784 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:30 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/990064519' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:13:30.784 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:30.781+0000 7f8ab26a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:30.918 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:13:30.956 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:13:32.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:31 trial046 ceph-mon[38575]: 5.3 scrub ok 2026-02-23T13:13:32.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:31 trial046 ceph-mon[38575]: pgmap v385: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 37 GiB data, 117 GiB used, 2.6 TiB / 2.7 TiB avail; 85 B/s rd, 286 MiB/s wr, 5.07k op/s 2026-02-23T13:13:32.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:31 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:13:32.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:31 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:13:32.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:31 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:13:32.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:31 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1810487001' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_3", "var": "pg_num", "val": "66"} : dispatch 2026-02-23T13:13:32.613 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:13:32.755 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:32.873 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:32.871+0000 7f2e47550640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:32.874 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:32.872+0000 7f2e47550640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:32.889 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:32 trial046 ceph-mon[38575]: 5.d scrub starts 2026-02-23T13:13:32.890 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:13:32.890 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:13:32.902 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:13:32.902 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:13:32.914 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:13:32.915 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:13:32.927 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:13:32.927 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:13:34.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:33 trial046 ceph-mon[38575]: pgmap v386: 17 pgs: 17 active+clean; 35 GiB data, 112 GiB used, 2.6 TiB / 2.7 TiB avail; 85 B/s rd, 286 MiB/s wr, 7.77k op/s 2026-02-23T13:13:34.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:33 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:13:34.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:33 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:13:34.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:33 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3406139260' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:13:34.972 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:13:35.109 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:35.229 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:35.227+0000 7f3c83040640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:35.230 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:35.227+0000 7f3c83040640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:35.246 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:13:35.247 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:13:35.259 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:13:35.260 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:13:35.272 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:13:35.272 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:13:35.284 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:13:35.284 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:13:35.957 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:13:35.958 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:13:35.958 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:13:35.958 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:13:35.981 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:35 trial046 ceph-mon[38575]: pgmap v387: 17 pgs: 17 active+clean; 35 GiB data, 112 GiB used, 2.6 TiB / 2.7 TiB avail; 85 B/s rd, 128 MiB/s wr, 5.24k op/s 2026-02-23T13:13:35.981 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:35 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1441370675' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:13:36.102 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:36.228 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:36.226+0000 7ff294168640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:36.229 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:36.227+0000 7ff294168640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:36.289 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:13:36 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:13:36] "GET /metrics HTTP/1.1" 200 4238 "" "Prometheus/3.6.0" 2026-02-23T13:13:36.360 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:13:36.360 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:13:36.403 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":387,"stamp":"2026-02-23T13:13:34.675919+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":37183816248,"num_objects":567374,"num_object_clones":0,"num_object_copies":1702122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":567374,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":644223,"num_write_kb":38768807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":117202136,"kb_used_data":109815240,"kb_used_omap":110,"kb_used_meta":7386577,"kb_avail":2818810664,"statfs":{"total":3006477107200,"available":2886462119936,"internally_reserved":0,"allocated":112450805760,"data_stored":112448911208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":112711,"internal_metadata":7563855801},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,6,6],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-902823912,"num_objects":-13775,"num_object_clones":0,"num_object_copies":-41325,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-13775,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":62941,"num_write_kb":1573249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001730"},"pg_stats":[{"pgid":"5.f","version":"94'40533","reported_seq":40949,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:31.675994+0000","last_change":"2026-02-23T13:13:23.096196+0000","last_active":"2026-02-23T13:13:31.675994+0000","last_peered":"2026-02-23T13:13:31.675994+0000","last_clean":"2026-02-23T13:13:31.675994+0000","last_became_active":"2026-02-23T13:11:54.595945+0000","last_became_peered":"2026-02-23T13:11:54.595945+0000","last_unstale":"2026-02-23T13:13:31.675994+0000","last_undegraded":"2026-02-23T13:13:31.675994+0000","last_fullsized":"2026-02-23T13:13:31.675994+0000","mapping_epoch":78,"log_start":"94'40530","ondisk_log_start":"94'40530","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'37044","last_scrub_stamp":"2026-02-23T13:13:23.096162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:23.096162+0000","objects_scrubbed":36289,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:30.719300+0000","scrub_duration":3945,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2341273600,"num_objects":35725,"num_object_clones":0,"num_object_copies":107175,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35725,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40533,"num_write_kb":2440256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"94'40548","reported_seq":40939,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:31.662713+0000","last_change":"2026-02-23T13:13:16.070635+0000","last_active":"2026-02-23T13:13:31.662713+0000","last_peered":"2026-02-23T13:13:31.662713+0000","last_clean":"2026-02-23T13:13:31.662713+0000","last_became_active":"2026-02-23T13:11:54.599064+0000","last_became_peered":"2026-02-23T13:11:54.599064+0000","last_unstale":"2026-02-23T13:13:31.662713+0000","last_undegraded":"2026-02-23T13:13:31.662713+0000","last_fullsized":"2026-02-23T13:13:31.662713+0000","mapping_epoch":78,"log_start":"94'40545","ondisk_log_start":"94'40545","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'34507","last_scrub_stamp":"2026-02-23T13:13:16.070555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:16.070555+0000","objects_scrubbed":33959,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:37.180440+0000","scrub_duration":3680,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2343436288,"num_objects":35758,"num_object_clones":0,"num_object_copies":107274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35758,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40548,"num_write_kb":2441792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"94'40635","reported_seq":40678,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:31.687968+0000","last_change":"2026-02-23T13:11:54.596174+0000","last_active":"2026-02-23T13:13:31.687968+0000","last_peered":"2026-02-23T13:13:31.687968+0000","last_clean":"2026-02-23T13:13:31.687968+0000","last_became_active":"2026-02-23T13:11:54.595773+0000","last_became_peered":"2026-02-23T13:11:54.595773+0000","last_unstale":"2026-02-23T13:13:31.687968+0000","last_undegraded":"2026-02-23T13:13:31.687968+0000","last_fullsized":"2026-02-23T13:13:31.687968+0000","mapping_epoch":78,"log_start":"94'40632","ondisk_log_start":"94'40632","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:11:53.586576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2340159512,"num_objects":35709,"num_object_clones":0,"num_object_copies":107127,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35709,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":40635,"num_write_kb":2442945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"94'39888","reported_seq":40278,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:31.806227+0000","last_change":"2026-02-23T13:13:17.030615+0000","last_active":"2026-02-23T13:13:31.806227+0000","last_peered":"2026-02-23T13:13:31.806227+0000","last_clean":"2026-02-23T13:13:31.806227+0000","last_became_active":"2026-02-23T13:11:54.595560+0000","last_became_peered":"2026-02-23T13:11:54.595560+0000","last_unstale":"2026-02-23T13:13:31.806227+0000","last_undegraded":"2026-02-23T13:13:31.806227+0000","last_fullsized":"2026-02-23T13:13:31.806227+0000","mapping_epoch":78,"log_start":"94'39885","ondisk_log_start":"94'39885","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34247","last_scrub_stamp":"2026-02-23T13:13:17.030566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:17.030566+0000","objects_scrubbed":33782,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:44.233824+0000","scrub_duration":2702,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2300313600,"num_objects":35100,"num_object_clones":0,"num_object_copies":105300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35100,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39888,"num_write_kb":2399616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"94'40200","reported_seq":40565,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:31.684777+0000","last_change":"2026-02-23T13:13:09.088406+0000","last_active":"2026-02-23T13:13:31.684777+0000","last_peered":"2026-02-23T13:13:31.684777+0000","last_clean":"2026-02-23T13:13:31.684777+0000","last_became_active":"2026-02-23T13:11:54.596133+0000","last_became_peered":"2026-02-23T13:11:54.596133+0000","last_unstale":"2026-02-23T13:13:31.684777+0000","last_undegraded":"2026-02-23T13:13:31.684777+0000","last_fullsized":"2026-02-23T13:13:31.684777+0000","mapping_epoch":78,"log_start":"94'40197","ondisk_log_start":"94'40197","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31860","last_scrub_stamp":"2026-02-23T13:13:09.088369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:09.088369+0000","objects_scrubbed":31307,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:14.774702+0000","scrub_duration":3283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2311979008,"num_objects":35278,"num_object_clones":0,"num_object_copies":105834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35278,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40200,"num_write_kb":2415296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"94'40090","reported_seq":40483,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:31.680794+0000","last_change":"2026-02-23T13:13:18.263885+0000","last_active":"2026-02-23T13:13:31.680794+0000","last_peered":"2026-02-23T13:13:31.680794+0000","last_clean":"2026-02-23T13:13:31.680794+0000","last_became_active":"2026-02-23T13:11:54.595080+0000","last_became_peered":"2026-02-23T13:11:54.595080+0000","last_unstale":"2026-02-23T13:13:31.680794+0000","last_undegraded":"2026-02-23T13:13:31.680794+0000","last_fullsized":"2026-02-23T13:13:31.680794+0000","mapping_epoch":78,"log_start":"94'40087","ondisk_log_start":"94'40087","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34829","last_scrub_stamp":"2026-02-23T13:13:18.263833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:18.263833+0000","objects_scrubbed":34171,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:35.520181+0000","scrub_duration":3597,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2311585792,"num_objects":35272,"num_object_clones":0,"num_object_copies":105816,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35272,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40090,"num_write_kb":2411584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"94'40069","reported_seq":40418,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:31.664283+0000","last_change":"2026-02-23T13:13:04.939376+0000","last_active":"2026-02-23T13:13:31.664283+0000","last_peered":"2026-02-23T13:13:31.664283+0000","last_clean":"2026-02-23T13:13:31.664283+0000","last_became_active":"2026-02-23T13:11:54.598325+0000","last_became_peered":"2026-02-23T13:11:54.598325+0000","last_unstale":"2026-02-23T13:13:31.664283+0000","last_undegraded":"2026-02-23T13:13:31.664283+0000","last_fullsized":"2026-02-23T13:13:31.664283+0000","mapping_epoch":78,"log_start":"94'40066","ondisk_log_start":"94'40066","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'30360","last_scrub_stamp":"2026-02-23T13:13:04.939307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:04.939307+0000","objects_scrubbed":29843,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:25.467510+0000","scrub_duration":2554,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2322399232,"num_objects":35437,"num_object_clones":0,"num_object_copies":106311,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35437,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40069,"num_write_kb":2416192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"94'40060","reported_seq":40419,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:31.686147+0000","last_change":"2026-02-23T13:13:08.083112+0000","last_active":"2026-02-23T13:13:31.686147+0000","last_peered":"2026-02-23T13:13:31.686147+0000","last_clean":"2026-02-23T13:13:31.686147+0000","last_became_active":"2026-02-23T13:11:54.595110+0000","last_became_peered":"2026-02-23T13:11:54.595110+0000","last_unstale":"2026-02-23T13:13:31.686147+0000","last_undegraded":"2026-02-23T13:13:31.686147+0000","last_fullsized":"2026-02-23T13:13:31.686147+0000","mapping_epoch":78,"log_start":"94'40057","ondisk_log_start":"94'40057","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31220","last_scrub_stamp":"2026-02-23T13:13:08.083065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:08.083065+0000","objects_scrubbed":30674,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:23.606645+0000","scrub_duration":3240,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2312110080,"num_objects":35280,"num_object_clones":0,"num_object_copies":105840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35280,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40060,"num_write_kb":2410880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"94'40492","reported_seq":40901,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:31.665687+0000","last_change":"2026-02-23T13:13:21.209650+0000","last_active":"2026-02-23T13:13:31.665687+0000","last_peered":"2026-02-23T13:13:31.665687+0000","last_clean":"2026-02-23T13:13:31.665687+0000","last_became_active":"2026-02-23T13:11:54.599155+0000","last_became_peered":"2026-02-23T13:11:54.599155+0000","last_unstale":"2026-02-23T13:13:31.665687+0000","last_undegraded":"2026-02-23T13:13:31.665687+0000","last_fullsized":"2026-02-23T13:13:31.665687+0000","mapping_epoch":78,"log_start":"94'40489","ondisk_log_start":"94'40489","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'36425","last_scrub_stamp":"2026-02-23T13:13:21.209611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:21.209611+0000","objects_scrubbed":35661,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:41.420198+0000","scrub_duration":3833,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2342387712,"num_objects":35742,"num_object_clones":0,"num_object_copies":107226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35742,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40492,"num_write_kb":2439488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"94'40171","reported_seq":40596,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:31.806478+0000","last_change":"2026-02-23T13:13:26.394617+0000","last_active":"2026-02-23T13:13:31.806478+0000","last_peered":"2026-02-23T13:13:31.806478+0000","last_clean":"2026-02-23T13:13:31.806478+0000","last_became_active":"2026-02-23T13:11:54.595645+0000","last_became_peered":"2026-02-23T13:11:54.595645+0000","last_unstale":"2026-02-23T13:13:31.806478+0000","last_undegraded":"2026-02-23T13:13:31.806478+0000","last_fullsized":"2026-02-23T13:13:31.806478+0000","mapping_epoch":78,"log_start":"94'40168","ondisk_log_start":"94'40168","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'37974","last_scrub_stamp":"2026-02-23T13:13:26.394522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:26.394522+0000","objects_scrubbed":37376,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:55.787953+0000","scrub_duration":3046,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2310602752,"num_objects":35257,"num_object_clones":0,"num_object_copies":105771,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35257,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40171,"num_write_kb":2413696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"94'40195","reported_seq":40619,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:31.689680+0000","last_change":"2026-02-23T13:13:28.610333+0000","last_active":"2026-02-23T13:13:31.689680+0000","last_peered":"2026-02-23T13:13:31.689680+0000","last_clean":"2026-02-23T13:13:31.689680+0000","last_became_active":"2026-02-23T13:11:54.595144+0000","last_became_peered":"2026-02-23T13:11:54.595144+0000","last_unstale":"2026-02-23T13:13:31.689680+0000","last_undegraded":"2026-02-23T13:13:31.689680+0000","last_fullsized":"2026-02-23T13:13:31.689680+0000","mapping_epoch":78,"log_start":"94'40192","ondisk_log_start":"94'40192","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'38921","last_scrub_stamp":"2026-02-23T13:13:28.610251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:28.610251+0000","objects_scrubbed":37355,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:29.459459+0000","scrub_duration":4072,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2321743872,"num_objects":35427,"num_object_clones":0,"num_object_copies":106281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35427,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40195,"num_write_kb":2419904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"94'40507","reported_seq":40933,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:31.686276+0000","last_change":"2026-02-23T13:13:30.117925+0000","last_active":"2026-02-23T13:13:31.686276+0000","last_peered":"2026-02-23T13:13:31.686276+0000","last_clean":"2026-02-23T13:13:31.686276+0000","last_became_active":"2026-02-23T13:11:54.595996+0000","last_became_peered":"2026-02-23T13:11:54.595996+0000","last_unstale":"2026-02-23T13:13:31.686276+0000","last_undegraded":"2026-02-23T13:13:31.686276+0000","last_fullsized":"2026-02-23T13:13:31.686276+0000","mapping_epoch":78,"log_start":"94'40504","ondisk_log_start":"94'40504","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'39783","last_scrub_stamp":"2026-02-23T13:13:30.117805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:30.117805+0000","objects_scrubbed":37328,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:56.078765+0000","scrub_duration":4535,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2341404672,"num_objects":35727,"num_object_clones":0,"num_object_copies":107181,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35727,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40507,"num_write_kb":2439488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"94'40172","reported_seq":40568,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:31.667835+0000","last_change":"2026-02-23T13:13:18.223410+0000","last_active":"2026-02-23T13:13:31.667835+0000","last_peered":"2026-02-23T13:13:31.667835+0000","last_clean":"2026-02-23T13:13:31.667835+0000","last_became_active":"2026-02-23T13:11:54.598958+0000","last_became_peered":"2026-02-23T13:11:54.598958+0000","last_unstale":"2026-02-23T13:13:31.667835+0000","last_undegraded":"2026-02-23T13:13:31.667835+0000","last_fullsized":"2026-02-23T13:13:31.667835+0000","mapping_epoch":78,"log_start":"94'40169","ondisk_log_start":"94'40169","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34997","last_scrub_stamp":"2026-02-23T13:13:18.223228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:18.223228+0000","objects_scrubbed":34269,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:30.400168+0000","scrub_duration":3831,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2327314432,"num_objects":35512,"num_object_clones":0,"num_object_copies":106536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35512,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40172,"num_write_kb":2421888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"94'40225","reported_seq":40587,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:31.665663+0000","last_change":"2026-02-23T13:13:08.044115+0000","last_active":"2026-02-23T13:13:31.665663+0000","last_peered":"2026-02-23T13:13:31.665663+0000","last_clean":"2026-02-23T13:13:31.665663+0000","last_became_active":"2026-02-23T13:11:54.598751+0000","last_became_peered":"2026-02-23T13:11:54.598751+0000","last_unstale":"2026-02-23T13:13:31.665663+0000","last_undegraded":"2026-02-23T13:13:31.665663+0000","last_fullsized":"2026-02-23T13:13:31.665663+0000","mapping_epoch":78,"log_start":"94'40222","ondisk_log_start":"94'40222","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31416","last_scrub_stamp":"2026-02-23T13:13:08.044055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:08.044055+0000","objects_scrubbed":31053,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:17.610054+0000","scrub_duration":2694,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2311258112,"num_objects":35267,"num_object_clones":0,"num_object_copies":105801,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35267,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40225,"num_write_kb":2415744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"94'40177","reported_seq":40507,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:31.687082+0000","last_change":"2026-02-23T13:13:00.668240+0000","last_active":"2026-02-23T13:13:31.687082+0000","last_peered":"2026-02-23T13:13:31.687082+0000","last_clean":"2026-02-23T13:13:31.687082+0000","last_became_active":"2026-02-23T13:11:54.595840+0000","last_became_peered":"2026-02-23T13:11:54.595840+0000","last_unstale":"2026-02-23T13:13:31.687082+0000","last_undegraded":"2026-02-23T13:13:31.687082+0000","last_fullsized":"2026-02-23T13:13:31.687082+0000","mapping_epoch":78,"log_start":"94'40174","ondisk_log_start":"94'40174","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'28514","last_scrub_stamp":"2026-02-23T13:13:00.668153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:00.668153+0000","objects_scrubbed":27959,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:20.748829+0000","scrub_duration":2841,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2317680640,"num_objects":35365,"num_object_clones":0,"num_object_copies":106095,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35365,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40177,"num_write_kb":2417344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"94'40126","reported_seq":40507,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:31.676589+0000","last_change":"2026-02-23T13:13:13.604684+0000","last_active":"2026-02-23T13:13:31.676589+0000","last_peered":"2026-02-23T13:13:31.676589+0000","last_clean":"2026-02-23T13:13:31.676589+0000","last_became_active":"2026-02-23T13:11:54.595287+0000","last_became_peered":"2026-02-23T13:11:54.595287+0000","last_unstale":"2026-02-23T13:13:31.676589+0000","last_undegraded":"2026-02-23T13:13:31.676589+0000","last_fullsized":"2026-02-23T13:13:31.676589+0000","mapping_epoch":78,"log_start":"94'40123","ondisk_log_start":"94'40123","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'33325","last_scrub_stamp":"2026-02-23T13:13:13.604647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:13.604647+0000","objects_scrubbed":32944,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:25.477441+0000","scrub_duration":2412,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2327576576,"num_objects":35516,"num_object_clones":0,"num_object_copies":106548,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35516,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40126,"num_write_kb":2420544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":385,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:16.609942+0000","last_change":"2026-02-23T13:13:01.377596+0000","last_active":"2026-02-23T13:13:16.609942+0000","last_peered":"2026-02-23T13:13:16.609942+0000","last_clean":"2026-02-23T13:13:16.609942+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:13:16.609942+0000","last_undegraded":"2026-02-23T13:13:16.609942+0000","last_fullsized":"2026-02-23T13:13:16.609942+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:13:01.377552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:13:01.377552+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:11.484316+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":37183225880,"num_objects":567372,"num_object_clones":0,"num_object_copies":1702116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":567372,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":644088,"num_write_kb":38766657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":111535075328,"data_stored":111535063112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2356,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247937,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":33447144,"kb_used_data":31921172,"kb_used_omap":26,"kb_used_meta":1525925,"kb_avail":700556056,"statfs":{"total":751619276800,"available":717369401344,"internally_reserved":0,"allocated":32687280128,"data_stored":32686804584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26847,"internal_metadata":1562548001},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444164,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27203688,"kb_used_data":25158356,"kb_used_omap":29,"kb_used_meta":2045282,"kb_avail":706799512,"statfs":{"total":751619276800,"available":723762700288,"internally_reserved":0,"allocated":25762156544,"data_stored":25761681000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30199,"internal_metadata":2094369289},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574982,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":24673696,"kb_used_data":22789644,"kb_used_omap":30,"kb_used_meta":1883873,"kb_avail":709329504,"statfs":{"total":751619276800,"available":726353412096,"internally_reserved":0,"allocated":23336595456,"data_stored":23336127536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31523,"internal_metadata":1929086173},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705799,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":31877608,"kb_used_data":29946068,"kb_used_omap":23,"kb_used_meta":1931496,"kb_avail":702125592,"statfs":{"total":751619276800,"available":718976606208,"internally_reserved":0,"allocated":30664773632,"data_stored":30664298088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24142,"internal_metadata":1977852338},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,6,6],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2356,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":30222061568,"data_stored":30222057496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23178117120,"data_stored":23178117120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25560289280,"data_stored":25560285208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32574607360,"data_stored":32574603288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:13:36.406 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:13:36.406 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 231 2026-02-23T13:13:36.560 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:13:36 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:13:36.087Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:13:36.586 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:36.714 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:36.713+0000 7f2a84e32640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:36.714 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:36.713+0000 7f2a84e32640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:36.855 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:13:36.861 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:36 trial046 ceph-mon[38575]: 5.d scrub ok 2026-02-23T13:13:36.895 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:13:37.324 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:13:37.464 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:37.579 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:37.577+0000 7f13bbfa7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:37.579 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:37.577+0000 7f13bbfa7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:37.594 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:13:37.594 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:13:37.608 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:13:37.609 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:13:37.623 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:13:37.623 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:13:37.635 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:13:37.635 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:13:38.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:37 trial046 ceph-mon[38575]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:13:38.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:37 trial046 ceph-mon[38575]: pgmap v388: 17 pgs: 17 active+clean; 34 GiB data, 110 GiB used, 2.6 TiB / 2.7 TiB avail; 85 B/s rd, 128 MiB/s wr, 6.26k op/s 2026-02-23T13:13:38.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:37 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2440402126' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "231"} : dispatch 2026-02-23T13:13:38.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:37 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/681777107' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:13:39.680 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:13:39.814 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:39.936 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:39.934+0000 7f961ce76640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:39.936 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:39.934+0000 7f961ce76640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:39.952 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:13:39.953 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:13:39.968 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:13:39.968 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:13:39.969 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:39 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:13:39.969 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:39 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:13:39.969 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:39 trial046 ceph-mon[38575]: pgmap v389: 17 pgs: 17 active+clean; 32 GiB data, 105 GiB used, 2.6 TiB / 2.7 TiB avail; 85 B/s rd, 88 MiB/s wr, 7.64k op/s 2026-02-23T13:13:39.981 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:13:39.981 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:13:39.993 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:13:39.993 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:13:41.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:40 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2862614750' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:13:41.896 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:13:41.896 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:13:41.897 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:13:41.897 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:13:42.033 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:13:42.038 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:42.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:41 trial046 ceph-mon[38575]: pgmap v390: 17 pgs: 17 active+clean; 32 GiB data, 105 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 5.89k op/s 2026-02-23T13:13:42.175 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:42.378 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:42.325+0000 7fe7e88a8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:42.378 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:42.325+0000 7fe7e88a8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:42.460 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:42.459+0000 7fd0a4ad5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:42.460 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:42.459+0000 7fd0a4ad5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:42.465 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:13:42.465 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:13:42.476 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:13:42.476 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:13:42.491 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:13:42.491 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:13:42.506 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:13:42.506 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:13:42.511 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":390,"stamp":"2026-02-23T13:13:40.676740+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":34673852984,"num_objects":529075,"num_object_clones":0,"num_object_copies":1587225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":529075,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":682522,"num_write_kb":38768807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":109581208,"kb_used_data":102038664,"kb_used_omap":110,"kb_used_meta":7542225,"kb_avail":2826431592,"statfs":{"total":3006477107200,"available":2894265950208,"internally_reserved":0,"allocated":104487591936,"data_stored":104485697384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":113363,"internal_metadata":7723238701},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4633591808,"num_objects":-70703,"num_object_clones":0,"num_object_copies":-212109,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-70703,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70703,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001712"},"pg_stats":[{"pgid":"5.f","version":"94'42955","reported_seq":43371,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:36.669145+0000","last_change":"2026-02-23T13:13:23.096196+0000","last_active":"2026-02-23T13:13:36.669145+0000","last_peered":"2026-02-23T13:13:36.669145+0000","last_clean":"2026-02-23T13:13:36.669145+0000","last_became_active":"2026-02-23T13:11:54.595945+0000","last_became_peered":"2026-02-23T13:11:54.595945+0000","last_unstale":"2026-02-23T13:13:36.669145+0000","last_undegraded":"2026-02-23T13:13:36.669145+0000","last_fullsized":"2026-02-23T13:13:36.669145+0000","mapping_epoch":78,"log_start":"94'42952","ondisk_log_start":"94'42952","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'37044","last_scrub_stamp":"2026-02-23T13:13:23.096162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:23.096162+0000","objects_scrubbed":36289,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:30.719300+0000","scrub_duration":3945,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2182545408,"num_objects":33303,"num_object_clones":0,"num_object_copies":99909,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33303,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42955,"num_write_kb":2440256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"94'42953","reported_seq":43342,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:36.667726+0000","last_change":"2026-02-23T13:13:16.070635+0000","last_active":"2026-02-23T13:13:36.667726+0000","last_peered":"2026-02-23T13:13:36.667726+0000","last_clean":"2026-02-23T13:13:36.667726+0000","last_became_active":"2026-02-23T13:11:54.599064+0000","last_became_peered":"2026-02-23T13:11:54.599064+0000","last_unstale":"2026-02-23T13:13:36.667726+0000","last_undegraded":"2026-02-23T13:13:36.667726+0000","last_fullsized":"2026-02-23T13:13:36.667726+0000","mapping_epoch":78,"log_start":"94'42950","ondisk_log_start":"94'42950","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'34507","last_scrub_stamp":"2026-02-23T13:13:16.070555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:16.070555+0000","objects_scrubbed":33959,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:37.180440+0000","scrub_duration":3680,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2185822208,"num_objects":33353,"num_object_clones":0,"num_object_copies":100059,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33353,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42953,"num_write_kb":2441792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"94'43027","reported_seq":43425,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:36.690574+0000","last_change":"2026-02-23T13:13:35.762276+0000","last_active":"2026-02-23T13:13:36.690574+0000","last_peered":"2026-02-23T13:13:36.690574+0000","last_clean":"2026-02-23T13:13:36.690574+0000","last_became_active":"2026-02-23T13:11:54.595773+0000","last_became_peered":"2026-02-23T13:11:54.595773+0000","last_unstale":"2026-02-23T13:13:36.690574+0000","last_undegraded":"2026-02-23T13:13:36.690574+0000","last_fullsized":"2026-02-23T13:13:36.690574+0000","mapping_epoch":78,"log_start":"94'43024","ondisk_log_start":"94'43024","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'42527","last_scrub_stamp":"2026-02-23T13:13:35.762219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:35.762219+0000","objects_scrubbed":34717,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:36.846836+0000","scrub_duration":4038,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2183397400,"num_objects":33317,"num_object_clones":0,"num_object_copies":99951,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33317,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":43027,"num_write_kb":2442945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"94'42232","reported_seq":42622,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:36.804828+0000","last_change":"2026-02-23T13:13:17.030615+0000","last_active":"2026-02-23T13:13:36.804828+0000","last_peered":"2026-02-23T13:13:36.804828+0000","last_clean":"2026-02-23T13:13:36.804828+0000","last_became_active":"2026-02-23T13:11:54.595560+0000","last_became_peered":"2026-02-23T13:11:54.595560+0000","last_unstale":"2026-02-23T13:13:36.804828+0000","last_undegraded":"2026-02-23T13:13:36.804828+0000","last_fullsized":"2026-02-23T13:13:36.804828+0000","mapping_epoch":78,"log_start":"94'42229","ondisk_log_start":"94'42229","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34247","last_scrub_stamp":"2026-02-23T13:13:17.030566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:17.030566+0000","objects_scrubbed":33782,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:44.233824+0000","scrub_duration":2702,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2146697216,"num_objects":32756,"num_object_clones":0,"num_object_copies":98268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32756,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42232,"num_write_kb":2399616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"94'42560","reported_seq":42925,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:36.688533+0000","last_change":"2026-02-23T13:13:09.088406+0000","last_active":"2026-02-23T13:13:36.688533+0000","last_peered":"2026-02-23T13:13:36.688533+0000","last_clean":"2026-02-23T13:13:36.688533+0000","last_became_active":"2026-02-23T13:11:54.596133+0000","last_became_peered":"2026-02-23T13:11:54.596133+0000","last_unstale":"2026-02-23T13:13:36.688533+0000","last_undegraded":"2026-02-23T13:13:36.688533+0000","last_fullsized":"2026-02-23T13:13:36.688533+0000","mapping_epoch":78,"log_start":"94'42557","ondisk_log_start":"94'42557","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31860","last_scrub_stamp":"2026-02-23T13:13:09.088369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:09.088369+0000","objects_scrubbed":31307,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:14.774702+0000","scrub_duration":3283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2157314048,"num_objects":32918,"num_object_clones":0,"num_object_copies":98754,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32918,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42560,"num_write_kb":2415296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"94'42400","reported_seq":42793,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:36.690645+0000","last_change":"2026-02-23T13:13:18.263885+0000","last_active":"2026-02-23T13:13:36.690645+0000","last_peered":"2026-02-23T13:13:36.690645+0000","last_clean":"2026-02-23T13:13:36.690645+0000","last_became_active":"2026-02-23T13:11:54.595080+0000","last_became_peered":"2026-02-23T13:11:54.595080+0000","last_unstale":"2026-02-23T13:13:36.690645+0000","last_undegraded":"2026-02-23T13:13:36.690645+0000","last_fullsized":"2026-02-23T13:13:36.690645+0000","mapping_epoch":78,"log_start":"94'42397","ondisk_log_start":"94'42397","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34829","last_scrub_stamp":"2026-02-23T13:13:18.263833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:18.263833+0000","objects_scrubbed":34171,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:35.520181+0000","scrub_duration":3597,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2160197632,"num_objects":32962,"num_object_clones":0,"num_object_copies":98886,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32962,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42400,"num_write_kb":2411584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"94'42438","reported_seq":42787,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:36.664041+0000","last_change":"2026-02-23T13:13:04.939376+0000","last_active":"2026-02-23T13:13:36.664041+0000","last_peered":"2026-02-23T13:13:36.664041+0000","last_clean":"2026-02-23T13:13:36.664041+0000","last_became_active":"2026-02-23T13:11:54.598325+0000","last_became_peered":"2026-02-23T13:11:54.598325+0000","last_unstale":"2026-02-23T13:13:36.664041+0000","last_undegraded":"2026-02-23T13:13:36.664041+0000","last_fullsized":"2026-02-23T13:13:36.664041+0000","mapping_epoch":78,"log_start":"94'42435","ondisk_log_start":"94'42435","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'30360","last_scrub_stamp":"2026-02-23T13:13:04.939307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:04.939307+0000","objects_scrubbed":29843,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:25.467510+0000","scrub_duration":2554,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2167144448,"num_objects":33068,"num_object_clones":0,"num_object_copies":99204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33068,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42438,"num_write_kb":2416192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"94'42362","reported_seq":42721,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:36.687013+0000","last_change":"2026-02-23T13:13:08.083112+0000","last_active":"2026-02-23T13:13:36.687013+0000","last_peered":"2026-02-23T13:13:36.687013+0000","last_clean":"2026-02-23T13:13:36.687013+0000","last_became_active":"2026-02-23T13:11:54.595110+0000","last_became_peered":"2026-02-23T13:11:54.595110+0000","last_unstale":"2026-02-23T13:13:36.687013+0000","last_undegraded":"2026-02-23T13:13:36.687013+0000","last_fullsized":"2026-02-23T13:13:36.687013+0000","mapping_epoch":78,"log_start":"94'42359","ondisk_log_start":"94'42359","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31220","last_scrub_stamp":"2026-02-23T13:13:08.083065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:08.083065+0000","objects_scrubbed":30674,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:23.606645+0000","scrub_duration":3240,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2161246208,"num_objects":32978,"num_object_clones":0,"num_object_copies":98934,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32978,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42362,"num_write_kb":2410880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"94'42994","reported_seq":43403,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:36.666112+0000","last_change":"2026-02-23T13:13:21.209650+0000","last_active":"2026-02-23T13:13:36.666112+0000","last_peered":"2026-02-23T13:13:36.666112+0000","last_clean":"2026-02-23T13:13:36.666112+0000","last_became_active":"2026-02-23T13:11:54.599155+0000","last_became_peered":"2026-02-23T13:11:54.599155+0000","last_unstale":"2026-02-23T13:13:36.666112+0000","last_undegraded":"2026-02-23T13:13:36.666112+0000","last_fullsized":"2026-02-23T13:13:36.666112+0000","mapping_epoch":78,"log_start":"94'42991","ondisk_log_start":"94'42991","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'36425","last_scrub_stamp":"2026-02-23T13:13:21.209611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:21.209611+0000","objects_scrubbed":35661,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:41.420198+0000","scrub_duration":3833,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2178416640,"num_objects":33240,"num_object_clones":0,"num_object_copies":99720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33240,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42994,"num_write_kb":2439488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"94'42531","reported_seq":42956,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:36.804739+0000","last_change":"2026-02-23T13:13:26.394617+0000","last_active":"2026-02-23T13:13:36.804739+0000","last_peered":"2026-02-23T13:13:36.804739+0000","last_clean":"2026-02-23T13:13:36.804739+0000","last_became_active":"2026-02-23T13:11:54.595645+0000","last_became_peered":"2026-02-23T13:11:54.595645+0000","last_unstale":"2026-02-23T13:13:36.804739+0000","last_undegraded":"2026-02-23T13:13:36.804739+0000","last_fullsized":"2026-02-23T13:13:36.804739+0000","mapping_epoch":78,"log_start":"94'42528","ondisk_log_start":"94'42528","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'37974","last_scrub_stamp":"2026-02-23T13:13:26.394522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:26.394522+0000","objects_scrubbed":37376,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:55.787953+0000","scrub_duration":3046,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2155937792,"num_objects":32897,"num_object_clones":0,"num_object_copies":98691,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32897,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42531,"num_write_kb":2413696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"94'42585","reported_seq":43010,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:36.687069+0000","last_change":"2026-02-23T13:13:28.610333+0000","last_active":"2026-02-23T13:13:36.687069+0000","last_peered":"2026-02-23T13:13:36.687069+0000","last_clean":"2026-02-23T13:13:36.687069+0000","last_became_active":"2026-02-23T13:11:54.595144+0000","last_became_peered":"2026-02-23T13:11:54.595144+0000","last_unstale":"2026-02-23T13:13:36.687069+0000","last_undegraded":"2026-02-23T13:13:36.687069+0000","last_fullsized":"2026-02-23T13:13:36.687069+0000","mapping_epoch":78,"log_start":"94'42582","ondisk_log_start":"94'42582","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'38921","last_scrub_stamp":"2026-02-23T13:13:28.610251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:28.610251+0000","objects_scrubbed":37355,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:29.459459+0000","scrub_duration":4072,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2165112832,"num_objects":33037,"num_object_clones":0,"num_object_copies":99111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33037,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42585,"num_write_kb":2419904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"94'42891","reported_seq":43317,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:36.690499+0000","last_change":"2026-02-23T13:13:30.117925+0000","last_active":"2026-02-23T13:13:36.690499+0000","last_peered":"2026-02-23T13:13:36.690499+0000","last_clean":"2026-02-23T13:13:36.690499+0000","last_became_active":"2026-02-23T13:11:54.595996+0000","last_became_peered":"2026-02-23T13:11:54.595996+0000","last_unstale":"2026-02-23T13:13:36.690499+0000","last_undegraded":"2026-02-23T13:13:36.690499+0000","last_fullsized":"2026-02-23T13:13:36.690499+0000","mapping_epoch":78,"log_start":"94'42888","ondisk_log_start":"94'42888","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'39783","last_scrub_stamp":"2026-02-23T13:13:30.117805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:30.117805+0000","objects_scrubbed":37328,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:56.078765+0000","scrub_duration":4535,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2185166848,"num_objects":33343,"num_object_clones":0,"num_object_copies":100029,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33343,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42891,"num_write_kb":2439488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"94'42618","reported_seq":43014,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:36.663409+0000","last_change":"2026-02-23T13:13:18.223410+0000","last_active":"2026-02-23T13:13:36.663409+0000","last_peered":"2026-02-23T13:13:36.663409+0000","last_clean":"2026-02-23T13:13:36.663409+0000","last_became_active":"2026-02-23T13:11:54.598958+0000","last_became_peered":"2026-02-23T13:11:54.598958+0000","last_unstale":"2026-02-23T13:13:36.663409+0000","last_undegraded":"2026-02-23T13:13:36.663409+0000","last_fullsized":"2026-02-23T13:13:36.663409+0000","mapping_epoch":78,"log_start":"94'42615","ondisk_log_start":"94'42615","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34997","last_scrub_stamp":"2026-02-23T13:13:18.223228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:18.223228+0000","objects_scrubbed":34269,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:30.400168+0000","scrub_duration":3831,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2167013376,"num_objects":33066,"num_object_clones":0,"num_object_copies":99198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33066,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42618,"num_write_kb":2421888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"94'42657","reported_seq":43019,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:36.652579+0000","last_change":"2026-02-23T13:13:08.044115+0000","last_active":"2026-02-23T13:13:36.652579+0000","last_peered":"2026-02-23T13:13:36.652579+0000","last_clean":"2026-02-23T13:13:36.652579+0000","last_became_active":"2026-02-23T13:11:54.598751+0000","last_became_peered":"2026-02-23T13:11:54.598751+0000","last_unstale":"2026-02-23T13:13:36.652579+0000","last_undegraded":"2026-02-23T13:13:36.652579+0000","last_fullsized":"2026-02-23T13:13:36.652579+0000","mapping_epoch":78,"log_start":"94'42654","ondisk_log_start":"94'42654","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31416","last_scrub_stamp":"2026-02-23T13:13:08.044055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:08.044055+0000","objects_scrubbed":31053,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:17.610054+0000","scrub_duration":2694,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2151874560,"num_objects":32835,"num_object_clones":0,"num_object_copies":98505,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32835,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42657,"num_write_kb":2415744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"94'42597","reported_seq":42927,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:36.686218+0000","last_change":"2026-02-23T13:13:00.668240+0000","last_active":"2026-02-23T13:13:36.686218+0000","last_peered":"2026-02-23T13:13:36.686218+0000","last_clean":"2026-02-23T13:13:36.686218+0000","last_became_active":"2026-02-23T13:11:54.595840+0000","last_became_peered":"2026-02-23T13:11:54.595840+0000","last_unstale":"2026-02-23T13:13:36.686218+0000","last_undegraded":"2026-02-23T13:13:36.686218+0000","last_fullsized":"2026-02-23T13:13:36.686218+0000","mapping_epoch":78,"log_start":"94'42594","ondisk_log_start":"94'42594","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'28514","last_scrub_stamp":"2026-02-23T13:13:00.668153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:00.668153+0000","objects_scrubbed":27959,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:20.748829+0000","scrub_duration":2841,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159083520,"num_objects":32945,"num_object_clones":0,"num_object_copies":98835,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32945,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42597,"num_write_kb":2417344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"94'42587","reported_seq":42968,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:36.676502+0000","last_change":"2026-02-23T13:13:13.604684+0000","last_active":"2026-02-23T13:13:36.676502+0000","last_peered":"2026-02-23T13:13:36.676502+0000","last_clean":"2026-02-23T13:13:36.676502+0000","last_became_active":"2026-02-23T13:11:54.595287+0000","last_became_peered":"2026-02-23T13:11:54.595287+0000","last_unstale":"2026-02-23T13:13:36.676502+0000","last_undegraded":"2026-02-23T13:13:36.676502+0000","last_fullsized":"2026-02-23T13:13:36.676502+0000","mapping_epoch":78,"log_start":"94'42584","ondisk_log_start":"94'42584","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'33325","last_scrub_stamp":"2026-02-23T13:13:13.604647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:13.604647+0000","objects_scrubbed":32944,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:25.477441+0000","scrub_duration":2412,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2166292480,"num_objects":33055,"num_object_clones":0,"num_object_copies":99165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33055,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42587,"num_write_kb":2420544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":385,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:16.609942+0000","last_change":"2026-02-23T13:13:01.377596+0000","last_active":"2026-02-23T13:13:16.609942+0000","last_peered":"2026-02-23T13:13:16.609942+0000","last_clean":"2026-02-23T13:13:16.609942+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:13:16.609942+0000","last_undegraded":"2026-02-23T13:13:16.609942+0000","last_fullsized":"2026-02-23T13:13:16.609942+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:13:01.377552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:13:01.377552+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:11.484316+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":34673262616,"num_objects":529073,"num_object_clones":0,"num_object_copies":1587219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":529073,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":682387,"num_write_kb":38766657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":104001908736,"data_stored":104001896520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2368,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247938,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":31409256,"kb_used_data":29756948,"kb_used_omap":26,"kb_used_meta":1652261,"kb_avail":702593944,"statfs":{"total":751619276800,"available":719456198656,"internally_reserved":0,"allocated":30471114752,"data_stored":30470639208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27499,"internal_metadata":1691915413},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444165,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":25405864,"kb_used_data":23439444,"kb_used_omap":29,"kb_used_meta":1966306,"kb_avail":708597336,"statfs":{"total":751619276800,"available":725603672064,"internally_reserved":0,"allocated":24001990656,"data_stored":24001515112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30199,"internal_metadata":2013497865},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574983,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":23207840,"kb_used_data":21287820,"kb_used_omap":30,"kb_used_meta":1919969,"kb_avail":710795360,"statfs":{"total":751619276800,"available":727854448640,"internally_reserved":0,"allocated":21798727680,"data_stored":21798259760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31523,"internal_metadata":1966048477},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705800,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":29558248,"kb_used_data":27554452,"kb_used_omap":23,"kb_used_meta":2003688,"kb_avail":704444952,"statfs":{"total":751619276800,"available":721351630848,"internally_reserved":0,"allocated":28215758848,"data_stored":28215283304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24142,"internal_metadata":2051776946},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2368,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28183171072,"data_stored":28183167000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21610758144,"data_stored":21610758144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23830663168,"data_stored":23830659096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":30377316352,"data_stored":30377312280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:13:42.512 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:13:42.512 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 241 2026-02-23T13:13:42.519 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:13:42.519 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:13:42.660 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:42.784 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:42.782+0000 7fa31fade640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:42.785 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:42.783+0000 7fa31fade640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:42.921 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:13:42.939 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:42 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/792224240' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:13:42.965 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:13:44.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:43 trial046 ceph-mon[38575]: from='client.15335 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:13:44.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:43 trial046 ceph-mon[38575]: pgmap v391: 17 pgs: 17 active+clean; 29 GiB data, 96 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 9.73k op/s 2026-02-23T13:13:44.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:43 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/746313452' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "241"} : dispatch 2026-02-23T13:13:44.563 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:13:44.705 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:44.822 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:44.820+0000 7f89394e7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:44.823 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:44.820+0000 7f89394e7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:44.837 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:13:44.837 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:13:44.852 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:13:44.852 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:13:44.863 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:13:44.864 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:13:44.875 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:13:44.875 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:13:46.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:45 trial046 ceph-mon[38575]: pgmap v392: 17 pgs: 17 active+clean; 29 GiB data, 96 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 7.03k op/s 2026-02-23T13:13:46.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:45 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/460458876' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:13:46.468 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:13:46 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:13:46.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:13:46.539 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:13:46 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:13:46] "GET /metrics HTTP/1.1" 200 4226 "" "Prometheus/3.6.0" 2026-02-23T13:13:46.917 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:13:46.942 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:46 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:13:47.056 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:47.537 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:47.515+0000 7f61ef0c0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:47.537 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:47.516+0000 7f61ef0c0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:47.540 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:13:47.541 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:13:47.553 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:13:47.554 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:13:47.567 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:13:47.567 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:13:47.580 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:13:47.580 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:13:47.895 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:47 trial046 ceph-mon[38575]: pgmap v393: 17 pgs: 17 active+clean; 29 GiB data, 94 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 8.12k op/s 2026-02-23T13:13:47.895 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:47 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2497794726' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:13:47.966 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:13:47.967 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:13:47.967 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:13:47.967 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:13:48.332 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:48.804 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:48.777+0000 7f41a7b64640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:48.804 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:48.777+0000 7f41a7b64640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:48.918 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:13:48.919 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:13:49.488 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":394,"stamp":"2026-02-23T13:13:48.677852+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28927263288,"num_objects":441389,"num_object_clones":0,"num_object_copies":1324167,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":441389,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":770208,"num_write_kb":38768807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":92682520,"kb_used_data":85187656,"kb_used_omap":112,"kb_used_meta":7494351,"kb_avail":2843330280,"statfs":{"total":3006477107200,"available":2911570206720,"internally_reserved":0,"allocated":87232159744,"data_stored":87230265192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":115104,"internal_metadata":7674216032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7460028416,"num_objects":-113831,"num_object_clones":0,"num_object_copies":-341493,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-113831,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113831,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001671"},"pg_stats":[{"pgid":"5.f","version":"94'48518","reported_seq":48934,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:46.671084+0000","last_change":"2026-02-23T13:13:23.096196+0000","last_active":"2026-02-23T13:13:46.671084+0000","last_peered":"2026-02-23T13:13:46.671084+0000","last_clean":"2026-02-23T13:13:46.671084+0000","last_became_active":"2026-02-23T13:11:54.595945+0000","last_became_peered":"2026-02-23T13:11:54.595945+0000","last_unstale":"2026-02-23T13:13:46.671084+0000","last_undegraded":"2026-02-23T13:13:46.671084+0000","last_fullsized":"2026-02-23T13:13:46.671084+0000","mapping_epoch":78,"log_start":"94'48515","ondisk_log_start":"94'48515","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'37044","last_scrub_stamp":"2026-02-23T13:13:23.096162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:23.096162+0000","objects_scrubbed":36289,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:30.719300+0000","scrub_duration":3945,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1817968640,"num_objects":27740,"num_object_clones":0,"num_object_copies":83220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27740,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48518,"num_write_kb":2440256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"94'48400","reported_seq":48791,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:46.663315+0000","last_change":"2026-02-23T13:13:16.070635+0000","last_active":"2026-02-23T13:13:46.663315+0000","last_peered":"2026-02-23T13:13:46.663315+0000","last_clean":"2026-02-23T13:13:46.663315+0000","last_became_active":"2026-02-23T13:11:54.599064+0000","last_became_peered":"2026-02-23T13:11:54.599064+0000","last_unstale":"2026-02-23T13:13:46.663315+0000","last_undegraded":"2026-02-23T13:13:46.663315+0000","last_fullsized":"2026-02-23T13:13:46.663315+0000","mapping_epoch":78,"log_start":"94'48397","ondisk_log_start":"94'48397","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'34507","last_scrub_stamp":"2026-02-23T13:13:16.070555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:16.070555+0000","objects_scrubbed":33959,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:37.180440+0000","scrub_duration":3680,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1828847616,"num_objects":27906,"num_object_clones":0,"num_object_copies":83718,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27906,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48400,"num_write_kb":2441792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"94'48585","reported_seq":48984,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:46.691108+0000","last_change":"2026-02-23T13:13:35.762276+0000","last_active":"2026-02-23T13:13:46.691108+0000","last_peered":"2026-02-23T13:13:46.691108+0000","last_clean":"2026-02-23T13:13:46.691108+0000","last_became_active":"2026-02-23T13:11:54.595773+0000","last_became_peered":"2026-02-23T13:11:54.595773+0000","last_unstale":"2026-02-23T13:13:46.691108+0000","last_undegraded":"2026-02-23T13:13:46.691108+0000","last_fullsized":"2026-02-23T13:13:46.691108+0000","mapping_epoch":78,"log_start":"94'48582","ondisk_log_start":"94'48582","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'42527","last_scrub_stamp":"2026-02-23T13:13:35.762219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:35.762219+0000","objects_scrubbed":34717,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:36.846836+0000","scrub_duration":4038,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1819148312,"num_objects":27759,"num_object_clones":0,"num_object_copies":83277,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27759,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":48585,"num_write_kb":2442945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"94'47619","reported_seq":48009,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:46.805100+0000","last_change":"2026-02-23T13:13:17.030615+0000","last_active":"2026-02-23T13:13:46.805100+0000","last_peered":"2026-02-23T13:13:46.805100+0000","last_clean":"2026-02-23T13:13:46.805100+0000","last_became_active":"2026-02-23T13:11:54.595560+0000","last_became_peered":"2026-02-23T13:11:54.595560+0000","last_unstale":"2026-02-23T13:13:46.805100+0000","last_undegraded":"2026-02-23T13:13:46.805100+0000","last_fullsized":"2026-02-23T13:13:46.805100+0000","mapping_epoch":78,"log_start":"94'47616","ondisk_log_start":"94'47616","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34247","last_scrub_stamp":"2026-02-23T13:13:17.030566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:17.030566+0000","objects_scrubbed":33782,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:44.233824+0000","scrub_duration":2702,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1793654784,"num_objects":27369,"num_object_clones":0,"num_object_copies":82107,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27369,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47619,"num_write_kb":2399616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"94'48051","reported_seq":48416,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:46.687153+0000","last_change":"2026-02-23T13:13:09.088406+0000","last_active":"2026-02-23T13:13:46.687153+0000","last_peered":"2026-02-23T13:13:46.687153+0000","last_clean":"2026-02-23T13:13:46.687153+0000","last_became_active":"2026-02-23T13:11:54.596133+0000","last_became_peered":"2026-02-23T13:11:54.596133+0000","last_unstale":"2026-02-23T13:13:46.687153+0000","last_undegraded":"2026-02-23T13:13:46.687153+0000","last_fullsized":"2026-02-23T13:13:46.687153+0000","mapping_epoch":78,"log_start":"94'48048","ondisk_log_start":"94'48048","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31860","last_scrub_stamp":"2026-02-23T13:13:09.088369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:09.088369+0000","objects_scrubbed":31307,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:14.774702+0000","scrub_duration":3283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1797455872,"num_objects":27427,"num_object_clones":0,"num_object_copies":82281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27427,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48051,"num_write_kb":2415296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"94'47925","reported_seq":48318,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:46.690332+0000","last_change":"2026-02-23T13:13:18.263885+0000","last_active":"2026-02-23T13:13:46.690332+0000","last_peered":"2026-02-23T13:13:46.690332+0000","last_clean":"2026-02-23T13:13:46.690332+0000","last_became_active":"2026-02-23T13:11:54.595080+0000","last_became_peered":"2026-02-23T13:11:54.595080+0000","last_unstale":"2026-02-23T13:13:46.690332+0000","last_undegraded":"2026-02-23T13:13:46.690332+0000","last_fullsized":"2026-02-23T13:13:46.690332+0000","mapping_epoch":78,"log_start":"94'47922","ondisk_log_start":"94'47922","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34829","last_scrub_stamp":"2026-02-23T13:13:18.263833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:18.263833+0000","objects_scrubbed":34171,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:35.520181+0000","scrub_duration":3597,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1798111232,"num_objects":27437,"num_object_clones":0,"num_object_copies":82311,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27437,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47925,"num_write_kb":2411584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"94'47910","reported_seq":48259,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:46.665714+0000","last_change":"2026-02-23T13:13:04.939376+0000","last_active":"2026-02-23T13:13:46.665714+0000","last_peered":"2026-02-23T13:13:46.665714+0000","last_clean":"2026-02-23T13:13:46.665714+0000","last_became_active":"2026-02-23T13:11:54.598325+0000","last_became_peered":"2026-02-23T13:11:54.598325+0000","last_unstale":"2026-02-23T13:13:46.665714+0000","last_undegraded":"2026-02-23T13:13:46.665714+0000","last_fullsized":"2026-02-23T13:13:46.665714+0000","mapping_epoch":78,"log_start":"94'47907","ondisk_log_start":"94'47907","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'30360","last_scrub_stamp":"2026-02-23T13:13:04.939307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:04.939307+0000","objects_scrubbed":29843,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:25.467510+0000","scrub_duration":2554,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1808531456,"num_objects":27596,"num_object_clones":0,"num_object_copies":82788,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27596,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47910,"num_write_kb":2416192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"94'47909","reported_seq":48268,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:46.689897+0000","last_change":"2026-02-23T13:13:08.083112+0000","last_active":"2026-02-23T13:13:46.689897+0000","last_peered":"2026-02-23T13:13:46.689897+0000","last_clean":"2026-02-23T13:13:46.689897+0000","last_became_active":"2026-02-23T13:11:54.595110+0000","last_became_peered":"2026-02-23T13:11:54.595110+0000","last_unstale":"2026-02-23T13:13:46.689897+0000","last_undegraded":"2026-02-23T13:13:46.689897+0000","last_fullsized":"2026-02-23T13:13:46.689897+0000","mapping_epoch":78,"log_start":"94'47906","ondisk_log_start":"94'47906","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31220","last_scrub_stamp":"2026-02-23T13:13:08.083065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:08.083065+0000","objects_scrubbed":30674,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:23.606645+0000","scrub_duration":3240,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1797718016,"num_objects":27431,"num_object_clones":0,"num_object_copies":82293,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27431,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47909,"num_write_kb":2410880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"94'48546","reported_seq":48955,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:46.668718+0000","last_change":"2026-02-23T13:13:21.209650+0000","last_active":"2026-02-23T13:13:46.668718+0000","last_peered":"2026-02-23T13:13:46.668718+0000","last_clean":"2026-02-23T13:13:46.668718+0000","last_became_active":"2026-02-23T13:11:54.599155+0000","last_became_peered":"2026-02-23T13:11:54.599155+0000","last_unstale":"2026-02-23T13:13:46.668718+0000","last_undegraded":"2026-02-23T13:13:46.668718+0000","last_fullsized":"2026-02-23T13:13:46.668718+0000","mapping_epoch":78,"log_start":"94'48543","ondisk_log_start":"94'48543","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'36425","last_scrub_stamp":"2026-02-23T13:13:21.209611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:21.209611+0000","objects_scrubbed":35661,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:41.420198+0000","scrub_duration":3833,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1814560768,"num_objects":27688,"num_object_clones":0,"num_object_copies":83064,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27688,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48546,"num_write_kb":2439488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"94'48020","reported_seq":48445,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:46.809323+0000","last_change":"2026-02-23T13:13:26.394617+0000","last_active":"2026-02-23T13:13:46.809323+0000","last_peered":"2026-02-23T13:13:46.809323+0000","last_clean":"2026-02-23T13:13:46.809323+0000","last_became_active":"2026-02-23T13:11:54.595645+0000","last_became_peered":"2026-02-23T13:11:54.595645+0000","last_unstale":"2026-02-23T13:13:46.809323+0000","last_undegraded":"2026-02-23T13:13:46.809323+0000","last_fullsized":"2026-02-23T13:13:46.809323+0000","mapping_epoch":78,"log_start":"94'48017","ondisk_log_start":"94'48017","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'37974","last_scrub_stamp":"2026-02-23T13:13:26.394522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:26.394522+0000","objects_scrubbed":37376,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:55.787953+0000","scrub_duration":3046,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1796210688,"num_objects":27408,"num_object_clones":0,"num_object_copies":82224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27408,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48020,"num_write_kb":2413696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"94'48016","reported_seq":48441,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:46.690425+0000","last_change":"2026-02-23T13:13:28.610333+0000","last_active":"2026-02-23T13:13:46.690425+0000","last_peered":"2026-02-23T13:13:46.690425+0000","last_clean":"2026-02-23T13:13:46.690425+0000","last_became_active":"2026-02-23T13:11:54.595144+0000","last_became_peered":"2026-02-23T13:11:54.595144+0000","last_unstale":"2026-02-23T13:13:46.690425+0000","last_undegraded":"2026-02-23T13:13:46.690425+0000","last_fullsized":"2026-02-23T13:13:46.690425+0000","mapping_epoch":78,"log_start":"94'48013","ondisk_log_start":"94'48013","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'38921","last_scrub_stamp":"2026-02-23T13:13:28.610251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:28.610251+0000","objects_scrubbed":37355,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:29.459459+0000","scrub_duration":4072,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1809186816,"num_objects":27606,"num_object_clones":0,"num_object_copies":82818,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27606,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48016,"num_write_kb":2419904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"94'48469","reported_seq":48895,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:46.684135+0000","last_change":"2026-02-23T13:13:30.117925+0000","last_active":"2026-02-23T13:13:46.684135+0000","last_peered":"2026-02-23T13:13:46.684135+0000","last_clean":"2026-02-23T13:13:46.684135+0000","last_became_active":"2026-02-23T13:11:54.595996+0000","last_became_peered":"2026-02-23T13:11:54.595996+0000","last_unstale":"2026-02-23T13:13:46.684135+0000","last_undegraded":"2026-02-23T13:13:46.684135+0000","last_fullsized":"2026-02-23T13:13:46.684135+0000","mapping_epoch":78,"log_start":"94'48466","ondisk_log_start":"94'48466","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'39783","last_scrub_stamp":"2026-02-23T13:13:30.117805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:30.117805+0000","objects_scrubbed":37328,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:56.078765+0000","scrub_duration":4535,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1819607040,"num_objects":27765,"num_object_clones":0,"num_object_copies":83295,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27765,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48469,"num_write_kb":2439488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"94'48039","reported_seq":48435,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:46.662193+0000","last_change":"2026-02-23T13:13:18.223410+0000","last_active":"2026-02-23T13:13:46.662193+0000","last_peered":"2026-02-23T13:13:46.662193+0000","last_clean":"2026-02-23T13:13:46.662193+0000","last_became_active":"2026-02-23T13:11:54.598958+0000","last_became_peered":"2026-02-23T13:11:54.598958+0000","last_unstale":"2026-02-23T13:13:46.662193+0000","last_undegraded":"2026-02-23T13:13:46.662193+0000","last_fullsized":"2026-02-23T13:13:46.662193+0000","mapping_epoch":78,"log_start":"94'48036","ondisk_log_start":"94'48036","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34997","last_scrub_stamp":"2026-02-23T13:13:18.223228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:18.223228+0000","objects_scrubbed":34269,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:30.400168+0000","scrub_duration":3831,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1811742720,"num_objects":27645,"num_object_clones":0,"num_object_copies":82935,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27645,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48039,"num_write_kb":2421888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"94'48092","reported_seq":48454,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:46.667053+0000","last_change":"2026-02-23T13:13:08.044115+0000","last_active":"2026-02-23T13:13:46.667053+0000","last_peered":"2026-02-23T13:13:46.667053+0000","last_clean":"2026-02-23T13:13:46.667053+0000","last_became_active":"2026-02-23T13:11:54.598751+0000","last_became_peered":"2026-02-23T13:11:54.598751+0000","last_unstale":"2026-02-23T13:13:46.667053+0000","last_undegraded":"2026-02-23T13:13:46.667053+0000","last_fullsized":"2026-02-23T13:13:46.667053+0000","mapping_epoch":78,"log_start":"94'48089","ondisk_log_start":"94'48089","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31416","last_scrub_stamp":"2026-02-23T13:13:08.044055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:08.044055+0000","objects_scrubbed":31053,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:17.610054+0000","scrub_duration":2694,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1795686400,"num_objects":27400,"num_object_clones":0,"num_object_copies":82200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27400,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48092,"num_write_kb":2415744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"94'47962","reported_seq":48292,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:46.688156+0000","last_change":"2026-02-23T13:13:00.668240+0000","last_active":"2026-02-23T13:13:46.688156+0000","last_peered":"2026-02-23T13:13:46.688156+0000","last_clean":"2026-02-23T13:13:46.688156+0000","last_became_active":"2026-02-23T13:11:54.595840+0000","last_became_peered":"2026-02-23T13:11:54.595840+0000","last_unstale":"2026-02-23T13:13:46.688156+0000","last_undegraded":"2026-02-23T13:13:46.688156+0000","last_fullsized":"2026-02-23T13:13:46.688156+0000","mapping_epoch":78,"log_start":"94'47959","ondisk_log_start":"94'47959","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'28514","last_scrub_stamp":"2026-02-23T13:13:00.668153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:00.668153+0000","objects_scrubbed":27959,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:20.748829+0000","scrub_duration":2841,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1807482880,"num_objects":27580,"num_object_clones":0,"num_object_copies":82740,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27580,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47962,"num_write_kb":2417344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"94'48012","reported_seq":48393,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:46.677498+0000","last_change":"2026-02-23T13:13:13.604684+0000","last_active":"2026-02-23T13:13:46.677498+0000","last_peered":"2026-02-23T13:13:46.677498+0000","last_clean":"2026-02-23T13:13:46.677498+0000","last_became_active":"2026-02-23T13:11:54.595287+0000","last_became_peered":"2026-02-23T13:11:54.595287+0000","last_unstale":"2026-02-23T13:13:46.677498+0000","last_undegraded":"2026-02-23T13:13:46.677498+0000","last_fullsized":"2026-02-23T13:13:46.677498+0000","mapping_epoch":78,"log_start":"94'48009","ondisk_log_start":"94'48009","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'33325","last_scrub_stamp":"2026-02-23T13:13:13.604647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:13.604647+0000","objects_scrubbed":32944,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:25.477441+0000","scrub_duration":2412,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1810759680,"num_objects":27630,"num_object_clones":0,"num_object_copies":82890,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27630,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48012,"num_write_kb":2420544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":385,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:16.609942+0000","last_change":"2026-02-23T13:13:01.377596+0000","last_active":"2026-02-23T13:13:16.609942+0000","last_peered":"2026-02-23T13:13:16.609942+0000","last_clean":"2026-02-23T13:13:16.609942+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:13:16.609942+0000","last_undegraded":"2026-02-23T13:13:16.609942+0000","last_fullsized":"2026-02-23T13:13:16.609942+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:13:01.377552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:13:01.377552+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:11.484316+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":28926672920,"num_objects":441387,"num_object_clones":0,"num_object_copies":1324161,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":441387,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":770073,"num_write_kb":38766657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":86759583744,"data_stored":86759571528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2368,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247940,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":26610088,"kb_used_data":24831380,"kb_used_omap":26,"kb_used_meta":1778597,"kb_avail":707393112,"statfs":{"total":751619276800,"available":724370546688,"internally_reserved":0,"allocated":25427333120,"data_stored":25426857576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27499,"internal_metadata":1821283477},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444167,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":21566632,"kb_used_data":19581972,"kb_used_omap":30,"kb_used_meta":1984417,"kb_avail":712436568,"statfs":{"total":751619276800,"available":729535045632,"internally_reserved":0,"allocated":20051939328,"data_stored":20051463784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31288,"internal_metadata":2032043464},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574985,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":19792864,"kb_used_data":17782604,"kb_used_omap":30,"kb_used_meta":2010209,"kb_avail":714210336,"statfs":{"total":751619276800,"available":731351384064,"internally_reserved":0,"allocated":18209386496,"data_stored":18208918576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31523,"internal_metadata":2058454237},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705802,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":24712936,"kb_used_data":22991700,"kb_used_omap":24,"kb_used_meta":1721127,"kb_avail":709290264,"statfs":{"total":751619276800,"available":726313230336,"internally_reserved":0,"allocated":23543500800,"data_stored":23543025256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24794,"internal_metadata":1762434854},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2368,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23509929984,"data_stored":23509925912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":18027053056,"data_stored":18027053056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19887296512,"data_stored":19887292440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25335304192,"data_stored":25335300120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:13:49.490 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:13:49.490 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 251 2026-02-23T13:13:49.667 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:49.842 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:49 trial046 ceph-mon[38575]: pgmap v394: 17 pgs: 17 active+clean; 27 GiB data, 88 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 9.48k op/s 2026-02-23T13:13:50.086 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:50.062+0000 7f4b8200a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:50.087 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:50.063+0000 7f4b8200a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:50.196 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:13:50.310 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:13:50.769 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:50.770 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:13:51.027 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:50 trial046 ceph-mon[38575]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:13:51.028 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:50 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3631849060' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "251"} : dispatch 2026-02-23T13:13:51.251 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:51.200+0000 7fa19253c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:51.251 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:51.200+0000 7fa19253c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:51.251 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:13:51.251 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:13:51.252 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:13:51.252 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:13:51.259 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:13:51.259 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:13:51.271 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:13:51.272 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:13:52.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:51 trial046 ceph-mon[38575]: pgmap v395: 17 pgs: 17 active+clean; 27 GiB data, 88 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 7.31k op/s 2026-02-23T13:13:52.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:51 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2252933569' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:13:53.636 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:13:53.777 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:53.990 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:53 trial046 ceph-mon[38575]: pgmap v396: 17 pgs: 17 active+clean; 25 GiB data, 82 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 10.05k op/s 2026-02-23T13:13:54.124 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:54.116+0000 7f5204218640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:54.124 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:54.117+0000 7f5204218640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:54.133 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:13:54.133 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:13:54.146 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:13:54.147 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:13:54.160 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:13:54.160 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:13:54.173 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:13:54.173 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:13:55.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:54 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3474264751' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:13:55.771 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:13:55.771 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:13:55.771 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:13:55.771 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:13:55.911 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:56.029 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:55 trial046 ceph-mon[38575]: pgmap v397: 17 pgs: 17 active+clean; 25 GiB data, 82 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 6.21k op/s 2026-02-23T13:13:56.038 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:56.037+0000 7f8d7cad9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:56.038 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:56.037+0000 7f8d7cad9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:56.180 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:13:56.180 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:13:56.222 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":397,"stamp":"2026-02-23T13:13:54.678686+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26769949240,"num_objects":408471,"num_object_clones":0,"num_object_copies":1225413,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":408471,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":803126,"num_write_kb":38768807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53,"ondisk_log_size":53,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":86344152,"kb_used_data":78723208,"kb_used_omap":113,"kb_used_meta":7620750,"kb_avail":2849668648,"statfs":{"total":3006477107200,"available":2918060695552,"internally_reserved":0,"allocated":80612564992,"data_stored":80610670440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":116184,"internal_metadata":7803648552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9,3,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4881252352,"num_objects":-74482,"num_object_clones":0,"num_object_copies":-223446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-74482,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74482,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001677"},"pg_stats":[{"pgid":"5.f","version":"94'50552","reported_seq":50967,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:51.676296+0000","last_change":"2026-02-23T13:13:23.096196+0000","last_active":"2026-02-23T13:13:51.676296+0000","last_peered":"2026-02-23T13:13:51.676296+0000","last_clean":"2026-02-23T13:13:51.676296+0000","last_became_active":"2026-02-23T13:11:54.595945+0000","last_became_peered":"2026-02-23T13:11:54.595945+0000","last_unstale":"2026-02-23T13:13:51.676296+0000","last_undegraded":"2026-02-23T13:13:51.676296+0000","last_fullsized":"2026-02-23T13:13:51.676296+0000","mapping_epoch":78,"log_start":"94'50549","ondisk_log_start":"94'50549","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'37044","last_scrub_stamp":"2026-02-23T13:13:23.096162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:23.096162+0000","objects_scrubbed":36289,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:30.719300+0000","scrub_duration":3945,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1684668416,"num_objects":25706,"num_object_clones":0,"num_object_copies":77118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25706,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50552,"num_write_kb":2440256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"94'50467","reported_seq":50858,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:51.665963+0000","last_change":"2026-02-23T13:13:16.070635+0000","last_active":"2026-02-23T13:13:51.665963+0000","last_peered":"2026-02-23T13:13:51.665963+0000","last_clean":"2026-02-23T13:13:51.665963+0000","last_became_active":"2026-02-23T13:11:54.599064+0000","last_became_peered":"2026-02-23T13:11:54.599064+0000","last_unstale":"2026-02-23T13:13:51.665963+0000","last_undegraded":"2026-02-23T13:13:51.665963+0000","last_fullsized":"2026-02-23T13:13:51.665963+0000","mapping_epoch":78,"log_start":"94'50464","ondisk_log_start":"94'50464","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'34507","last_scrub_stamp":"2026-02-23T13:13:16.070555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:16.070555+0000","objects_scrubbed":33959,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:37.180440+0000","scrub_duration":3680,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1693384704,"num_objects":25839,"num_object_clones":0,"num_object_copies":77517,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25839,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50467,"num_write_kb":2441792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"94'50616","reported_seq":51015,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:51.691350+0000","last_change":"2026-02-23T13:13:35.762276+0000","last_active":"2026-02-23T13:13:51.691350+0000","last_peered":"2026-02-23T13:13:51.691350+0000","last_clean":"2026-02-23T13:13:51.691350+0000","last_became_active":"2026-02-23T13:11:54.595773+0000","last_became_peered":"2026-02-23T13:11:54.595773+0000","last_unstale":"2026-02-23T13:13:51.691350+0000","last_undegraded":"2026-02-23T13:13:51.691350+0000","last_fullsized":"2026-02-23T13:13:51.691350+0000","mapping_epoch":78,"log_start":"94'50612","ondisk_log_start":"94'50612","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'42527","last_scrub_stamp":"2026-02-23T13:13:35.762219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:35.762219+0000","objects_scrubbed":34717,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:36.846836+0000","scrub_duration":4038,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1686044696,"num_objects":25728,"num_object_clones":0,"num_object_copies":77184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25728,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":50616,"num_write_kb":2442945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"94'49668","reported_seq":50058,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:51.811800+0000","last_change":"2026-02-23T13:13:17.030615+0000","last_active":"2026-02-23T13:13:51.811800+0000","last_peered":"2026-02-23T13:13:51.811800+0000","last_clean":"2026-02-23T13:13:51.811800+0000","last_became_active":"2026-02-23T13:11:54.595560+0000","last_became_peered":"2026-02-23T13:11:54.595560+0000","last_unstale":"2026-02-23T13:13:51.811800+0000","last_undegraded":"2026-02-23T13:13:51.811800+0000","last_fullsized":"2026-02-23T13:13:51.811800+0000","mapping_epoch":78,"log_start":"94'49665","ondisk_log_start":"94'49665","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34247","last_scrub_stamp":"2026-02-23T13:13:17.030566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:17.030566+0000","objects_scrubbed":33782,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:44.233824+0000","scrub_duration":2702,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1659371520,"num_objects":25320,"num_object_clones":0,"num_object_copies":75960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25320,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49668,"num_write_kb":2399616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"94'50084","reported_seq":50449,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:51.689164+0000","last_change":"2026-02-23T13:13:09.088406+0000","last_active":"2026-02-23T13:13:51.689164+0000","last_peered":"2026-02-23T13:13:51.689164+0000","last_clean":"2026-02-23T13:13:51.689164+0000","last_became_active":"2026-02-23T13:11:54.596133+0000","last_became_peered":"2026-02-23T13:11:54.596133+0000","last_unstale":"2026-02-23T13:13:51.689164+0000","last_undegraded":"2026-02-23T13:13:51.689164+0000","last_fullsized":"2026-02-23T13:13:51.689164+0000","mapping_epoch":78,"log_start":"94'50081","ondisk_log_start":"94'50081","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31860","last_scrub_stamp":"2026-02-23T13:13:09.088369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:09.088369+0000","objects_scrubbed":31307,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:14.774702+0000","scrub_duration":3283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1664221184,"num_objects":25394,"num_object_clones":0,"num_object_copies":76182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25394,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50084,"num_write_kb":2415296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"94'49904","reported_seq":50297,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:51.689470+0000","last_change":"2026-02-23T13:13:18.263885+0000","last_active":"2026-02-23T13:13:51.689470+0000","last_peered":"2026-02-23T13:13:51.689470+0000","last_clean":"2026-02-23T13:13:51.689470+0000","last_became_active":"2026-02-23T13:11:54.595080+0000","last_became_peered":"2026-02-23T13:11:54.595080+0000","last_unstale":"2026-02-23T13:13:51.689470+0000","last_undegraded":"2026-02-23T13:13:51.689470+0000","last_fullsized":"2026-02-23T13:13:51.689470+0000","mapping_epoch":78,"log_start":"94'49901","ondisk_log_start":"94'49901","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34829","last_scrub_stamp":"2026-02-23T13:13:18.263833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:18.263833+0000","objects_scrubbed":34171,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:35.520181+0000","scrub_duration":3597,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1668415488,"num_objects":25458,"num_object_clones":0,"num_object_copies":76374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25458,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49904,"num_write_kb":2411584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"94'49965","reported_seq":50314,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:51.661778+0000","last_change":"2026-02-23T13:13:04.939376+0000","last_active":"2026-02-23T13:13:51.661778+0000","last_peered":"2026-02-23T13:13:51.661778+0000","last_clean":"2026-02-23T13:13:51.661778+0000","last_became_active":"2026-02-23T13:11:54.598325+0000","last_became_peered":"2026-02-23T13:11:54.598325+0000","last_unstale":"2026-02-23T13:13:51.661778+0000","last_undegraded":"2026-02-23T13:13:51.661778+0000","last_fullsized":"2026-02-23T13:13:51.661778+0000","mapping_epoch":78,"log_start":"94'49962","ondisk_log_start":"94'49962","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'30360","last_scrub_stamp":"2026-02-23T13:13:04.939307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:04.939307+0000","objects_scrubbed":29843,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:25.467510+0000","scrub_duration":2554,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1673854976,"num_objects":25541,"num_object_clones":0,"num_object_copies":76623,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25541,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49965,"num_write_kb":2416192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"94'49981","reported_seq":50340,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:51.687868+0000","last_change":"2026-02-23T13:13:08.083112+0000","last_active":"2026-02-23T13:13:51.687868+0000","last_peered":"2026-02-23T13:13:51.687868+0000","last_clean":"2026-02-23T13:13:51.687868+0000","last_became_active":"2026-02-23T13:11:54.595110+0000","last_became_peered":"2026-02-23T13:11:54.595110+0000","last_unstale":"2026-02-23T13:13:51.687868+0000","last_undegraded":"2026-02-23T13:13:51.687868+0000","last_fullsized":"2026-02-23T13:13:51.687868+0000","mapping_epoch":78,"log_start":"94'49978","ondisk_log_start":"94'49978","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31220","last_scrub_stamp":"2026-02-23T13:13:08.083065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:08.083065+0000","objects_scrubbed":30674,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:23.606645+0000","scrub_duration":3240,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1661927424,"num_objects":25359,"num_object_clones":0,"num_object_copies":76077,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25359,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49981,"num_write_kb":2410880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"94'50620","reported_seq":51029,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:51.668797+0000","last_change":"2026-02-23T13:13:21.209650+0000","last_active":"2026-02-23T13:13:51.668797+0000","last_peered":"2026-02-23T13:13:51.668797+0000","last_clean":"2026-02-23T13:13:51.668797+0000","last_became_active":"2026-02-23T13:11:54.599155+0000","last_became_peered":"2026-02-23T13:11:54.599155+0000","last_unstale":"2026-02-23T13:13:51.668797+0000","last_undegraded":"2026-02-23T13:13:51.668797+0000","last_fullsized":"2026-02-23T13:13:51.668797+0000","mapping_epoch":78,"log_start":"94'50617","ondisk_log_start":"94'50617","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'36425","last_scrub_stamp":"2026-02-23T13:13:21.209611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:21.209611+0000","objects_scrubbed":35661,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:41.420198+0000","scrub_duration":3833,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1678639104,"num_objects":25614,"num_object_clones":0,"num_object_copies":76842,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25614,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50620,"num_write_kb":2439488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"94'50124","reported_seq":50549,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:51.805212+0000","last_change":"2026-02-23T13:13:26.394617+0000","last_active":"2026-02-23T13:13:51.805212+0000","last_peered":"2026-02-23T13:13:51.805212+0000","last_clean":"2026-02-23T13:13:51.805212+0000","last_became_active":"2026-02-23T13:11:54.595645+0000","last_became_peered":"2026-02-23T13:11:54.595645+0000","last_unstale":"2026-02-23T13:13:51.805212+0000","last_undegraded":"2026-02-23T13:13:51.805212+0000","last_fullsized":"2026-02-23T13:13:51.805212+0000","mapping_epoch":78,"log_start":"94'50121","ondisk_log_start":"94'50121","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'37974","last_scrub_stamp":"2026-02-23T13:13:26.394522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:26.394522+0000","objects_scrubbed":37376,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:55.787953+0000","scrub_duration":3046,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1658322944,"num_objects":25304,"num_object_clones":0,"num_object_copies":75912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25304,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50124,"num_write_kb":2413696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"94'50077","reported_seq":50502,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:51.679046+0000","last_change":"2026-02-23T13:13:28.610333+0000","last_active":"2026-02-23T13:13:51.679046+0000","last_peered":"2026-02-23T13:13:51.679046+0000","last_clean":"2026-02-23T13:13:51.679046+0000","last_became_active":"2026-02-23T13:11:54.595144+0000","last_became_peered":"2026-02-23T13:11:54.595144+0000","last_unstale":"2026-02-23T13:13:51.679046+0000","last_undegraded":"2026-02-23T13:13:51.679046+0000","last_fullsized":"2026-02-23T13:13:51.679046+0000","mapping_epoch":78,"log_start":"94'50074","ondisk_log_start":"94'50074","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'38921","last_scrub_stamp":"2026-02-23T13:13:28.610251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:28.610251+0000","objects_scrubbed":37355,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:29.459459+0000","scrub_duration":4072,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1674117120,"num_objects":25545,"num_object_clones":0,"num_object_copies":76635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25545,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50077,"num_write_kb":2419904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"94'50507","reported_seq":50933,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:51.688003+0000","last_change":"2026-02-23T13:13:30.117925+0000","last_active":"2026-02-23T13:13:51.688003+0000","last_peered":"2026-02-23T13:13:51.688003+0000","last_clean":"2026-02-23T13:13:51.688003+0000","last_became_active":"2026-02-23T13:11:54.595996+0000","last_became_peered":"2026-02-23T13:11:54.595996+0000","last_unstale":"2026-02-23T13:13:51.688003+0000","last_undegraded":"2026-02-23T13:13:51.688003+0000","last_fullsized":"2026-02-23T13:13:51.688003+0000","mapping_epoch":78,"log_start":"94'50504","ondisk_log_start":"94'50504","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'39783","last_scrub_stamp":"2026-02-23T13:13:30.117805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:30.117805+0000","objects_scrubbed":37328,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:56.078765+0000","scrub_duration":4535,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1686044672,"num_objects":25727,"num_object_clones":0,"num_object_copies":77181,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25727,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50507,"num_write_kb":2439488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"94'50119","reported_seq":50515,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:51.669239+0000","last_change":"2026-02-23T13:13:18.223410+0000","last_active":"2026-02-23T13:13:51.669239+0000","last_peered":"2026-02-23T13:13:51.669239+0000","last_clean":"2026-02-23T13:13:51.669239+0000","last_became_active":"2026-02-23T13:11:54.598958+0000","last_became_peered":"2026-02-23T13:11:54.598958+0000","last_unstale":"2026-02-23T13:13:51.669239+0000","last_undegraded":"2026-02-23T13:13:51.669239+0000","last_fullsized":"2026-02-23T13:13:51.669239+0000","mapping_epoch":78,"log_start":"94'50115","ondisk_log_start":"94'50115","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34997","last_scrub_stamp":"2026-02-23T13:13:18.223228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:18.223228+0000","objects_scrubbed":34269,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:30.400168+0000","scrub_duration":3831,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1675427840,"num_objects":25565,"num_object_clones":0,"num_object_copies":76695,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25565,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50119,"num_write_kb":2421888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"94'50146","reported_seq":50508,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:51.654921+0000","last_change":"2026-02-23T13:13:08.044115+0000","last_active":"2026-02-23T13:13:51.654921+0000","last_peered":"2026-02-23T13:13:51.654921+0000","last_clean":"2026-02-23T13:13:51.654921+0000","last_became_active":"2026-02-23T13:11:54.598751+0000","last_became_peered":"2026-02-23T13:11:54.598751+0000","last_unstale":"2026-02-23T13:13:51.654921+0000","last_undegraded":"2026-02-23T13:13:51.654921+0000","last_fullsized":"2026-02-23T13:13:51.654921+0000","mapping_epoch":78,"log_start":"94'50143","ondisk_log_start":"94'50143","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31416","last_scrub_stamp":"2026-02-23T13:13:08.044055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:08.044055+0000","objects_scrubbed":31053,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:17.610054+0000","scrub_duration":2694,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1661075456,"num_objects":25346,"num_object_clones":0,"num_object_copies":76038,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25346,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50146,"num_write_kb":2415744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"94'50029","reported_seq":50359,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:51.686847+0000","last_change":"2026-02-23T13:13:00.668240+0000","last_active":"2026-02-23T13:13:51.686847+0000","last_peered":"2026-02-23T13:13:51.686847+0000","last_clean":"2026-02-23T13:13:51.686847+0000","last_became_active":"2026-02-23T13:11:54.595840+0000","last_became_peered":"2026-02-23T13:11:54.595840+0000","last_unstale":"2026-02-23T13:13:51.686847+0000","last_undegraded":"2026-02-23T13:13:51.686847+0000","last_fullsized":"2026-02-23T13:13:51.686847+0000","mapping_epoch":78,"log_start":"94'50026","ondisk_log_start":"94'50026","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'28514","last_scrub_stamp":"2026-02-23T13:13:00.668153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:00.668153+0000","objects_scrubbed":27959,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:20.748829+0000","scrub_duration":2841,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1672019968,"num_objects":25513,"num_object_clones":0,"num_object_copies":76539,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25513,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50029,"num_write_kb":2417344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"94'50132","reported_seq":50513,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:51.673397+0000","last_change":"2026-02-23T13:13:13.604684+0000","last_active":"2026-02-23T13:13:51.673397+0000","last_peered":"2026-02-23T13:13:51.673397+0000","last_clean":"2026-02-23T13:13:51.673397+0000","last_became_active":"2026-02-23T13:11:54.595287+0000","last_became_peered":"2026-02-23T13:11:54.595287+0000","last_unstale":"2026-02-23T13:13:51.673397+0000","last_undegraded":"2026-02-23T13:13:51.673397+0000","last_fullsized":"2026-02-23T13:13:51.673397+0000","mapping_epoch":78,"log_start":"94'50129","ondisk_log_start":"94'50129","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'33325","last_scrub_stamp":"2026-02-23T13:13:13.604647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:13.604647+0000","objects_scrubbed":32944,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:25.477441+0000","scrub_duration":2412,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1671823360,"num_objects":25510,"num_object_clones":0,"num_object_copies":76530,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25510,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50132,"num_write_kb":2420544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":385,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:16.609942+0000","last_change":"2026-02-23T13:13:01.377596+0000","last_active":"2026-02-23T13:13:16.609942+0000","last_peered":"2026-02-23T13:13:16.609942+0000","last_clean":"2026-02-23T13:13:16.609942+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:13:16.609942+0000","last_undegraded":"2026-02-23T13:13:16.609942+0000","last_fullsized":"2026-02-23T13:13:16.609942+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:13:01.377552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:13:01.377552+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:11.484316+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":26769358872,"num_objects":408469,"num_object_clones":0,"num_object_copies":1225407,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":408469,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":802991,"num_write_kb":38766657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":80293408768,"data_stored":80293396552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":50,"ondisk_log_size":50,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2368,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247941,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":24766184,"kb_used_data":22933396,"kb_used_omap":26,"kb_used_meta":1832741,"kb_avail":709237016,"statfs":{"total":751619276800,"available":726258704384,"internally_reserved":0,"allocated":23483797504,"data_stored":23483321960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27499,"internal_metadata":1876726933},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,3,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444168,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":20108008,"kb_used_data":18087444,"kb_used_omap":30,"kb_used_meta":2020513,"kb_avail":713895192,"statfs":{"total":751619276800,"available":731028676608,"internally_reserved":0,"allocated":18521542656,"data_stored":18521067112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31288,"internal_metadata":2069005768},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574986,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":18405344,"kb_used_data":16413068,"kb_used_omap":31,"kb_used_meta":1992224,"kb_avail":715597856,"statfs":{"total":751619276800,"available":732772204544,"internally_reserved":0,"allocated":16806981632,"data_stored":16806513712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32603,"internal_metadata":2040037541},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705803,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":23064616,"kb_used_data":21289300,"kb_used_omap":24,"kb_used_meta":1775271,"kb_avail":710938584,"statfs":{"total":751619276800,"available":728001110016,"internally_reserved":0,"allocated":21800243200,"data_stored":21799767656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24794,"internal_metadata":1817878310},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2368,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21765230592,"data_stored":21765226520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16677863424,"data_stored":16677863424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18403037184,"data_stored":18403033112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":23447277568,"data_stored":23447273496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:13:56.224 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:13:56.224 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 261 2026-02-23T13:13:56.289 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:13:56 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:13:56] "GET /metrics HTTP/1.1" 200 4226 "" "Prometheus/3.6.0" 2026-02-23T13:13:56.362 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:56.433 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:13:56.496 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:56.495+0000 7f4bd94c9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:56.497 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:56.496+0000 7f4bd94c9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:56.560 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:13:56 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:13:56.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:13:56.574 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:56.639 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:13:56.680 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:13:56.705 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:56.704+0000 7f1c5d6f4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:56.705 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:56.704+0000 7f1c5d6f4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:56.719 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:13:56.719 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:13:56.733 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:13:56.733 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:13:56.747 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:13:56.748 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:13:56.763 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:13:56.764 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:13:56.940 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:56 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3128087056' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "261"} : dispatch 2026-02-23T13:13:56.940 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:56 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/175540677' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:13:58.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:57 trial046 ceph-mon[38575]: from='client.15353 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:13:58.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:57 trial046 ceph-mon[38575]: pgmap v398: 17 pgs: 17 active+clean; 24 GiB data, 80 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 7.31k op/s 2026-02-23T13:13:58.805 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:13:58.942 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:13:59.062 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:59.061+0000 7f4dd08d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:59.062 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:13:59.061+0000 7f4dd08d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:13:59.077 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:13:59.077 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:13:59.090 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:13:59.090 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:13:59.104 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:13:59.104 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:13:59.116 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:13:59.116 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:14:00.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:59 trial046 ceph-mon[38575]: pgmap v399: 17 pgs: 17 active+clean; 22 GiB data, 74 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 8.70k op/s 2026-02-23T13:14:00.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:13:59 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1226983211' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:14:01.159 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:14:01.302 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:01.423 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:01.422+0000 7faccaa4c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:01.423 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:01.423+0000 7faccaa4c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:01.438 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:14:01.439 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:14:01.452 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:14:01.452 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:14:01.465 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:14:01.465 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:14:01.478 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:14:01.478 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:14:01.681 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:14:01.681 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:14:01.681 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:14:01.681 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:14:01.819 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:01.943 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:01.942+0000 7f62bc5df640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:01.943 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:01.942+0000 7f62bc5df640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:02.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:01 trial046 ceph-mon[38575]: pgmap v400: 17 pgs: 17 active+clean; 22 GiB data, 74 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 6.31k op/s 2026-02-23T13:14:02.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:01 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:14:02.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:01 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/31995195' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:14:02.078 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:14:02.079 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:14:02.123 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":400,"stamp":"2026-02-23T13:14:00.679457+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23961010744,"num_objects":365610,"num_object_clones":0,"num_object_copies":1096830,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":365610,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":845987,"num_write_kb":38768807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":77118424,"kb_used_data":70525448,"kb_used_omap":101,"kb_used_meta":6592602,"kb_avail":2858894376,"statfs":{"total":3006477107200,"available":2927507841024,"internally_reserved":0,"allocated":72218058752,"data_stored":72216164200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":103825,"internal_metadata":6750825071},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,3],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4966252544,"num_objects":-75779,"num_object_clones":0,"num_object_copies":-227337,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-75779,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75779,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001604"},"pg_stats":[{"pgid":"5.f","version":"94'53340","reported_seq":53756,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:56.668136+0000","last_change":"2026-02-23T13:13:23.096196+0000","last_active":"2026-02-23T13:13:56.668136+0000","last_peered":"2026-02-23T13:13:56.668136+0000","last_clean":"2026-02-23T13:13:56.668136+0000","last_became_active":"2026-02-23T13:11:54.595945+0000","last_became_peered":"2026-02-23T13:11:54.595945+0000","last_unstale":"2026-02-23T13:13:56.668136+0000","last_undegraded":"2026-02-23T13:13:56.668136+0000","last_fullsized":"2026-02-23T13:13:56.668136+0000","mapping_epoch":78,"log_start":"94'53337","ondisk_log_start":"94'53337","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'37044","last_scrub_stamp":"2026-02-23T13:13:23.096162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:23.096162+0000","objects_scrubbed":36289,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:30.719300+0000","scrub_duration":3945,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1501954048,"num_objects":22918,"num_object_clones":0,"num_object_copies":68754,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22918,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53340,"num_write_kb":2440256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"94'53133","reported_seq":53524,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:56.664626+0000","last_change":"2026-02-23T13:13:16.070635+0000","last_active":"2026-02-23T13:13:56.664626+0000","last_peered":"2026-02-23T13:13:56.664626+0000","last_clean":"2026-02-23T13:13:56.664626+0000","last_became_active":"2026-02-23T13:11:54.599064+0000","last_became_peered":"2026-02-23T13:11:54.599064+0000","last_unstale":"2026-02-23T13:13:56.664626+0000","last_undegraded":"2026-02-23T13:13:56.664626+0000","last_fullsized":"2026-02-23T13:13:56.664626+0000","mapping_epoch":78,"log_start":"94'53130","ondisk_log_start":"94'53130","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'34507","last_scrub_stamp":"2026-02-23T13:13:16.070555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:16.070555+0000","objects_scrubbed":33959,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:37.180440+0000","scrub_duration":3680,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1518665728,"num_objects":23173,"num_object_clones":0,"num_object_copies":69519,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23173,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53133,"num_write_kb":2441792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"94'53357","reported_seq":53756,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:56.683973+0000","last_change":"2026-02-23T13:13:35.762276+0000","last_active":"2026-02-23T13:13:56.683973+0000","last_peered":"2026-02-23T13:13:56.683973+0000","last_clean":"2026-02-23T13:13:56.683973+0000","last_became_active":"2026-02-23T13:11:54.595773+0000","last_became_peered":"2026-02-23T13:11:54.595773+0000","last_unstale":"2026-02-23T13:13:56.683973+0000","last_undegraded":"2026-02-23T13:13:56.683973+0000","last_fullsized":"2026-02-23T13:13:56.683973+0000","mapping_epoch":78,"log_start":"94'53354","ondisk_log_start":"94'53354","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'42527","last_scrub_stamp":"2026-02-23T13:13:35.762219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:35.762219+0000","objects_scrubbed":34717,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:36.846836+0000","scrub_duration":4038,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1506410520,"num_objects":22987,"num_object_clones":0,"num_object_copies":68961,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22987,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":53357,"num_write_kb":2442945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"94'52404","reported_seq":52794,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:56.811180+0000","last_change":"2026-02-23T13:13:17.030615+0000","last_active":"2026-02-23T13:13:56.811180+0000","last_peered":"2026-02-23T13:13:56.811180+0000","last_clean":"2026-02-23T13:13:56.811180+0000","last_became_active":"2026-02-23T13:11:54.595560+0000","last_became_peered":"2026-02-23T13:11:54.595560+0000","last_unstale":"2026-02-23T13:13:56.811180+0000","last_undegraded":"2026-02-23T13:13:56.811180+0000","last_fullsized":"2026-02-23T13:13:56.811180+0000","mapping_epoch":78,"log_start":"94'52401","ondisk_log_start":"94'52401","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34247","last_scrub_stamp":"2026-02-23T13:13:17.030566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:17.030566+0000","objects_scrubbed":33782,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:44.233824+0000","scrub_duration":2702,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1480065024,"num_objects":22584,"num_object_clones":0,"num_object_copies":67752,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22584,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52404,"num_write_kb":2399616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"94'52676","reported_seq":53041,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:56.688068+0000","last_change":"2026-02-23T13:13:09.088406+0000","last_active":"2026-02-23T13:13:56.688068+0000","last_peered":"2026-02-23T13:13:56.688068+0000","last_clean":"2026-02-23T13:13:56.688068+0000","last_became_active":"2026-02-23T13:11:54.596133+0000","last_became_peered":"2026-02-23T13:11:54.596133+0000","last_unstale":"2026-02-23T13:13:56.688068+0000","last_undegraded":"2026-02-23T13:13:56.688068+0000","last_fullsized":"2026-02-23T13:13:56.688068+0000","mapping_epoch":78,"log_start":"94'52673","ondisk_log_start":"94'52673","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31860","last_scrub_stamp":"2026-02-23T13:13:09.088369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:09.088369+0000","objects_scrubbed":31307,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:14.774702+0000","scrub_duration":3283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1494351872,"num_objects":22802,"num_object_clones":0,"num_object_copies":68406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22802,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52676,"num_write_kb":2415296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"94'52533","reported_seq":52926,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:56.690996+0000","last_change":"2026-02-23T13:13:18.263885+0000","last_active":"2026-02-23T13:13:56.690996+0000","last_peered":"2026-02-23T13:13:56.690996+0000","last_clean":"2026-02-23T13:13:56.690996+0000","last_became_active":"2026-02-23T13:11:54.595080+0000","last_became_peered":"2026-02-23T13:11:54.595080+0000","last_unstale":"2026-02-23T13:13:56.690996+0000","last_undegraded":"2026-02-23T13:13:56.690996+0000","last_fullsized":"2026-02-23T13:13:56.690996+0000","mapping_epoch":78,"log_start":"94'52530","ondisk_log_start":"94'52530","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34829","last_scrub_stamp":"2026-02-23T13:13:18.263833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:18.263833+0000","objects_scrubbed":34171,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:35.520181+0000","scrub_duration":3597,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1496121344,"num_objects":22829,"num_object_clones":0,"num_object_copies":68487,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22829,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52533,"num_write_kb":2411584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"94'52616","reported_seq":52965,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:56.668634+0000","last_change":"2026-02-23T13:13:04.939376+0000","last_active":"2026-02-23T13:13:56.668634+0000","last_peered":"2026-02-23T13:13:56.668634+0000","last_clean":"2026-02-23T13:13:56.668634+0000","last_became_active":"2026-02-23T13:11:54.598325+0000","last_became_peered":"2026-02-23T13:11:54.598325+0000","last_unstale":"2026-02-23T13:13:56.668634+0000","last_undegraded":"2026-02-23T13:13:56.668634+0000","last_fullsized":"2026-02-23T13:13:56.668634+0000","mapping_epoch":78,"log_start":"94'52613","ondisk_log_start":"94'52613","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'30360","last_scrub_stamp":"2026-02-23T13:13:04.939307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:04.939307+0000","objects_scrubbed":29843,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:25.467510+0000","scrub_duration":2554,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1500119040,"num_objects":22890,"num_object_clones":0,"num_object_copies":68670,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22890,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52616,"num_write_kb":2416192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"94'52656","reported_seq":53015,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:56.690495+0000","last_change":"2026-02-23T13:13:08.083112+0000","last_active":"2026-02-23T13:13:56.690495+0000","last_peered":"2026-02-23T13:13:56.690495+0000","last_clean":"2026-02-23T13:13:56.690495+0000","last_became_active":"2026-02-23T13:11:54.595110+0000","last_became_peered":"2026-02-23T13:11:54.595110+0000","last_unstale":"2026-02-23T13:13:56.690495+0000","last_undegraded":"2026-02-23T13:13:56.690495+0000","last_fullsized":"2026-02-23T13:13:56.690495+0000","mapping_epoch":78,"log_start":"94'52653","ondisk_log_start":"94'52653","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31220","last_scrub_stamp":"2026-02-23T13:13:08.083065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:08.083065+0000","objects_scrubbed":30674,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:23.606645+0000","scrub_duration":3240,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1486618624,"num_objects":22684,"num_object_clones":0,"num_object_copies":68052,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22684,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52656,"num_write_kb":2410880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"94'53289","reported_seq":53698,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:56.663440+0000","last_change":"2026-02-23T13:13:21.209650+0000","last_active":"2026-02-23T13:13:56.663440+0000","last_peered":"2026-02-23T13:13:56.663440+0000","last_clean":"2026-02-23T13:13:56.663440+0000","last_became_active":"2026-02-23T13:11:54.599155+0000","last_became_peered":"2026-02-23T13:11:54.599155+0000","last_unstale":"2026-02-23T13:13:56.663440+0000","last_undegraded":"2026-02-23T13:13:56.663440+0000","last_fullsized":"2026-02-23T13:13:56.663440+0000","mapping_epoch":78,"log_start":"94'53286","ondisk_log_start":"94'53286","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'36425","last_scrub_stamp":"2026-02-23T13:13:21.209611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:21.209611+0000","objects_scrubbed":35661,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:41.420198+0000","scrub_duration":3833,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1503723520,"num_objects":22945,"num_object_clones":0,"num_object_copies":68835,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22945,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53289,"num_write_kb":2439488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"94'52917","reported_seq":53342,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:56.809653+0000","last_change":"2026-02-23T13:13:26.394617+0000","last_active":"2026-02-23T13:13:56.809653+0000","last_peered":"2026-02-23T13:13:56.809653+0000","last_clean":"2026-02-23T13:13:56.809653+0000","last_became_active":"2026-02-23T13:11:54.595645+0000","last_became_peered":"2026-02-23T13:11:54.595645+0000","last_unstale":"2026-02-23T13:13:56.809653+0000","last_undegraded":"2026-02-23T13:13:56.809653+0000","last_fullsized":"2026-02-23T13:13:56.809653+0000","mapping_epoch":78,"log_start":"94'52914","ondisk_log_start":"94'52914","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'37974","last_scrub_stamp":"2026-02-23T13:13:26.394522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:26.394522+0000","objects_scrubbed":37376,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:55.787953+0000","scrub_duration":3046,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1475280896,"num_objects":22511,"num_object_clones":0,"num_object_copies":67533,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22511,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52917,"num_write_kb":2413696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"94'52695","reported_seq":53119,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:56.692625+0000","last_change":"2026-02-23T13:13:28.610333+0000","last_active":"2026-02-23T13:13:56.692625+0000","last_peered":"2026-02-23T13:13:56.692625+0000","last_clean":"2026-02-23T13:13:56.692625+0000","last_became_active":"2026-02-23T13:11:54.595144+0000","last_became_peered":"2026-02-23T13:11:54.595144+0000","last_unstale":"2026-02-23T13:13:56.692625+0000","last_undegraded":"2026-02-23T13:13:56.692625+0000","last_fullsized":"2026-02-23T13:13:56.692625+0000","mapping_epoch":78,"log_start":"94'52692","ondisk_log_start":"94'52692","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'38921","last_scrub_stamp":"2026-02-23T13:13:28.610251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:28.610251+0000","objects_scrubbed":37355,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:29.459459+0000","scrub_duration":4072,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1502543872,"num_objects":22927,"num_object_clones":0,"num_object_copies":68781,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22927,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52695,"num_write_kb":2419904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"94'53212","reported_seq":53637,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:56.691039+0000","last_change":"2026-02-23T13:13:30.117925+0000","last_active":"2026-02-23T13:13:56.691039+0000","last_peered":"2026-02-23T13:13:56.691039+0000","last_clean":"2026-02-23T13:13:56.691039+0000","last_became_active":"2026-02-23T13:11:54.595996+0000","last_became_peered":"2026-02-23T13:11:54.595996+0000","last_unstale":"2026-02-23T13:13:56.691039+0000","last_undegraded":"2026-02-23T13:13:56.691039+0000","last_fullsized":"2026-02-23T13:13:56.691039+0000","mapping_epoch":78,"log_start":"94'53209","ondisk_log_start":"94'53209","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'39783","last_scrub_stamp":"2026-02-23T13:13:30.117805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:30.117805+0000","objects_scrubbed":37328,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:56.078765+0000","scrub_duration":4535,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1508769792,"num_objects":23022,"num_object_clones":0,"num_object_copies":69066,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23022,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53212,"num_write_kb":2439488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"94'52792","reported_seq":53187,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:56.665099+0000","last_change":"2026-02-23T13:13:18.223410+0000","last_active":"2026-02-23T13:13:56.665099+0000","last_peered":"2026-02-23T13:13:56.665099+0000","last_clean":"2026-02-23T13:13:56.665099+0000","last_became_active":"2026-02-23T13:11:54.598958+0000","last_became_peered":"2026-02-23T13:11:54.598958+0000","last_unstale":"2026-02-23T13:13:56.665099+0000","last_undegraded":"2026-02-23T13:13:56.665099+0000","last_fullsized":"2026-02-23T13:13:56.665099+0000","mapping_epoch":78,"log_start":"94'52789","ondisk_log_start":"94'52789","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34997","last_scrub_stamp":"2026-02-23T13:13:18.223228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:18.223228+0000","objects_scrubbed":34269,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:30.400168+0000","scrub_duration":3831,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1500250112,"num_objects":22892,"num_object_clones":0,"num_object_copies":68676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22892,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52792,"num_write_kb":2421888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"94'52720","reported_seq":53082,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:56.653929+0000","last_change":"2026-02-23T13:13:08.044115+0000","last_active":"2026-02-23T13:13:56.653929+0000","last_peered":"2026-02-23T13:13:56.653929+0000","last_clean":"2026-02-23T13:13:56.653929+0000","last_became_active":"2026-02-23T13:11:54.598751+0000","last_became_peered":"2026-02-23T13:11:54.598751+0000","last_unstale":"2026-02-23T13:13:56.653929+0000","last_undegraded":"2026-02-23T13:13:56.653929+0000","last_fullsized":"2026-02-23T13:13:56.653929+0000","mapping_epoch":78,"log_start":"94'52717","ondisk_log_start":"94'52717","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31416","last_scrub_stamp":"2026-02-23T13:13:08.044055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:08.044055+0000","objects_scrubbed":31053,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:17.610054+0000","scrub_duration":2694,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1492385792,"num_objects":22772,"num_object_clones":0,"num_object_copies":68316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22772,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52720,"num_write_kb":2415744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"94'52738","reported_seq":53067,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:56.692915+0000","last_change":"2026-02-23T13:13:00.668240+0000","last_active":"2026-02-23T13:13:56.692915+0000","last_peered":"2026-02-23T13:13:56.692915+0000","last_clean":"2026-02-23T13:13:56.692915+0000","last_became_active":"2026-02-23T13:11:54.595840+0000","last_became_peered":"2026-02-23T13:11:54.595840+0000","last_unstale":"2026-02-23T13:13:56.692915+0000","last_undegraded":"2026-02-23T13:13:56.692915+0000","last_fullsized":"2026-02-23T13:13:56.692915+0000","mapping_epoch":78,"log_start":"94'52735","ondisk_log_start":"94'52735","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'28514","last_scrub_stamp":"2026-02-23T13:13:00.668153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:00.668153+0000","objects_scrubbed":27959,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:20.748829+0000","scrub_duration":2841,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1494482944,"num_objects":22804,"num_object_clones":0,"num_object_copies":68412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22804,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52738,"num_write_kb":2417344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"94'52774","reported_seq":53155,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:56.677537+0000","last_change":"2026-02-23T13:13:13.604684+0000","last_active":"2026-02-23T13:13:56.677537+0000","last_peered":"2026-02-23T13:13:56.677537+0000","last_clean":"2026-02-23T13:13:56.677537+0000","last_became_active":"2026-02-23T13:11:54.595287+0000","last_became_peered":"2026-02-23T13:11:54.595287+0000","last_unstale":"2026-02-23T13:13:56.677537+0000","last_undegraded":"2026-02-23T13:13:56.677537+0000","last_fullsized":"2026-02-23T13:13:56.677537+0000","mapping_epoch":78,"log_start":"94'52771","ondisk_log_start":"94'52771","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'33325","last_scrub_stamp":"2026-02-23T13:13:13.604647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:13.604647+0000","objects_scrubbed":32944,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:25.477441+0000","scrub_duration":2412,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1498677248,"num_objects":22868,"num_object_clones":0,"num_object_copies":68604,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22868,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52774,"num_write_kb":2420544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":385,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:16.609942+0000","last_change":"2026-02-23T13:13:01.377596+0000","last_active":"2026-02-23T13:13:16.609942+0000","last_peered":"2026-02-23T13:13:16.609942+0000","last_clean":"2026-02-23T13:13:16.609942+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:13:16.609942+0000","last_undegraded":"2026-02-23T13:13:16.609942+0000","last_fullsized":"2026-02-23T13:13:16.609942+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:13:01.377552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:13:01.377552+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:11.484316+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":23960420376,"num_objects":365608,"num_object_clones":0,"num_object_copies":1096824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":365608,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":845852,"num_write_kb":38766657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":71865282560,"data_stored":71865270344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2368,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247942,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":22490600,"kb_used_data":20585556,"kb_used_omap":26,"kb_used_meta":1904933,"kb_avail":711512600,"statfs":{"total":751619276800,"available":728588902400,"internally_reserved":0,"allocated":21079609344,"data_stored":21079133800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27499,"internal_metadata":1950651541},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444169,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":17024360,"kb_used_data":16213268,"kb_used_omap":18,"kb_used_meta":811053,"kb_avail":716978840,"statfs":{"total":751619276800,"available":734186332160,"internally_reserved":0,"allocated":16602386432,"data_stored":16601910888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18929,"internal_metadata":830518799},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574987,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":16740128,"kb_used_data":14693708,"kb_used_omap":31,"kb_used_meta":2046368,"kb_avail":717263072,"statfs":{"total":751619276800,"available":734477385728,"internally_reserved":0,"allocated":15046356992,"data_stored":15045889072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32603,"internal_metadata":2095480997},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705804,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":20863336,"kb_used_data":19032916,"kb_used_omap":24,"kb_used_meta":1830247,"kb_avail":713139864,"statfs":{"total":751619276800,"available":730255220736,"internally_reserved":0,"allocated":19489705984,"data_stored":19489230440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24794,"internal_metadata":1874173734},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2368,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":19486150656,"data_stored":19486146584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14921105408,"data_stored":14921105408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16462516224,"data_stored":16462512152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20995510272,"data_stored":20995506200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:14:02.124 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:14:02.124 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 271 2026-02-23T13:14:02.265 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:02.397 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:02.396+0000 7f26fab6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:02.397 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:02.397+0000 7f26fab6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:02.533 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:14:02.571 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:14:03.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:02 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/39991288' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "271"} : dispatch 2026-02-23T13:14:03.520 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:14:03.656 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:03.779 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:03.777+0000 7f5654166640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:03.779 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:03.777+0000 7f5654166640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:03.793 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:14:03.793 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:14:03.794 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:03 trial046 ceph-mon[38575]: from='client.15363 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:14:03.794 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:03 trial046 ceph-mon[38575]: pgmap v401: 17 pgs: 17 active+clean; 20 GiB data, 65 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 9.82k op/s 2026-02-23T13:14:03.806 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:14:03.806 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:14:03.820 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:14:03.821 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:14:03.832 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:14:03.833 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:14:05.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:04 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1312452802' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:14:05.876 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:14:06.011 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:06.038 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:05 trial046 ceph-mon[38575]: pgmap v402: 17 pgs: 17 active+clean; 20 GiB data, 65 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 7.08k op/s 2026-02-23T13:14:06.349 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:06.347+0000 7fe204719640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:06.349 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:06.347+0000 7fe204719640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:06.349 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:14:06 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:14:06] "GET /metrics HTTP/1.1" 200 4228 "" "Prometheus/3.6.0" 2026-02-23T13:14:06.364 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:14:06.364 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:14:06.377 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:14:06.377 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:14:06.392 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:14:06.392 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:14:06.404 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:14:06.404 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:14:06.560 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:14:06 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:14:06.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:14:07.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:06 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/720613481' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:14:07.572 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:14:07.573 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:14:07.573 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-23T13:14:07.573 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:14:07.717 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:07.889 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:07.887+0000 7fbb95a7e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:07.889 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:07 trial046 ceph-mon[38575]: pgmap v403: 17 pgs: 17 active+clean; 19 GiB data, 63 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 8.15k op/s 2026-02-23T13:14:07.890 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:07.887+0000 7fbb95a7e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:08.028 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:14:08.028 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:14:08.162 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":403,"stamp":"2026-02-23T13:14:06.680235+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":20357186104,"num_objects":310620,"num_object_clones":0,"num_object_copies":931860,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":310620,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":900977,"num_write_kb":38768807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":66305880,"kb_used_data":60506888,"kb_used_omap":77,"kb_used_meta":5798642,"kb_avail":2869706920,"statfs":{"total":3006477107200,"available":2938579886080,"internally_reserved":0,"allocated":61959053312,"data_stored":61957158760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":79109,"internal_metadata":5937810171},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6412763136,"num_objects":-97851,"num_object_clones":0,"num_object_copies":-293553,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-97851,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97851,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001548"},"pg_stats":[{"pgid":"5.f","version":"94'55891","reported_seq":56307,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:01.675000+0000","last_change":"2026-02-23T13:13:23.096196+0000","last_active":"2026-02-23T13:14:01.675000+0000","last_peered":"2026-02-23T13:14:01.675000+0000","last_clean":"2026-02-23T13:14:01.675000+0000","last_became_active":"2026-02-23T13:11:54.595945+0000","last_became_peered":"2026-02-23T13:11:54.595945+0000","last_unstale":"2026-02-23T13:14:01.675000+0000","last_undegraded":"2026-02-23T13:14:01.675000+0000","last_fullsized":"2026-02-23T13:14:01.675000+0000","mapping_epoch":78,"log_start":"94'55888","ondisk_log_start":"94'55888","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'37044","last_scrub_stamp":"2026-02-23T13:13:23.096162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:23.096162+0000","objects_scrubbed":36289,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:30.719300+0000","scrub_duration":3945,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1334771712,"num_objects":20367,"num_object_clones":0,"num_object_copies":61101,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20367,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55891,"num_write_kb":2440256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"94'58406","reported_seq":58797,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:06.665186+0000","last_change":"2026-02-23T13:13:16.070635+0000","last_active":"2026-02-23T13:14:06.665186+0000","last_peered":"2026-02-23T13:14:06.665186+0000","last_clean":"2026-02-23T13:14:06.665186+0000","last_became_active":"2026-02-23T13:11:54.599064+0000","last_became_peered":"2026-02-23T13:11:54.599064+0000","last_unstale":"2026-02-23T13:14:06.665186+0000","last_undegraded":"2026-02-23T13:14:06.665186+0000","last_fullsized":"2026-02-23T13:14:06.665186+0000","mapping_epoch":78,"log_start":"94'58403","ondisk_log_start":"94'58403","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'34507","last_scrub_stamp":"2026-02-23T13:13:16.070555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:16.070555+0000","objects_scrubbed":33959,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:37.180440+0000","scrub_duration":3680,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1173094400,"num_objects":17900,"num_object_clones":0,"num_object_copies":53700,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17900,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58406,"num_write_kb":2441792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"94'56034","reported_seq":56433,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:01.688658+0000","last_change":"2026-02-23T13:13:35.762276+0000","last_active":"2026-02-23T13:14:01.688658+0000","last_peered":"2026-02-23T13:14:01.688658+0000","last_clean":"2026-02-23T13:14:01.688658+0000","last_became_active":"2026-02-23T13:11:54.595773+0000","last_became_peered":"2026-02-23T13:11:54.595773+0000","last_unstale":"2026-02-23T13:14:01.688658+0000","last_undegraded":"2026-02-23T13:14:01.688658+0000","last_fullsized":"2026-02-23T13:14:01.688658+0000","mapping_epoch":78,"log_start":"94'56031","ondisk_log_start":"94'56031","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'42527","last_scrub_stamp":"2026-02-23T13:13:35.762219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:35.762219+0000","objects_scrubbed":34717,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:36.846836+0000","scrub_duration":4038,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1330970648,"num_objects":20310,"num_object_clones":0,"num_object_copies":60930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20310,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":56034,"num_write_kb":2442945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"94'55042","reported_seq":55431,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:01.811642+0000","last_change":"2026-02-23T13:13:17.030615+0000","last_active":"2026-02-23T13:14:01.811642+0000","last_peered":"2026-02-23T13:14:01.811642+0000","last_clean":"2026-02-23T13:14:01.811642+0000","last_became_active":"2026-02-23T13:11:54.595560+0000","last_became_peered":"2026-02-23T13:11:54.595560+0000","last_unstale":"2026-02-23T13:14:01.811642+0000","last_undegraded":"2026-02-23T13:14:01.811642+0000","last_fullsized":"2026-02-23T13:14:01.811642+0000","mapping_epoch":78,"log_start":"94'55039","ondisk_log_start":"94'55039","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34247","last_scrub_stamp":"2026-02-23T13:13:17.030566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:17.030566+0000","objects_scrubbed":33782,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:44.233824+0000","scrub_duration":2702,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1307181056,"num_objects":19946,"num_object_clones":0,"num_object_copies":59838,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19946,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55042,"num_write_kb":2399616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"94'55286","reported_seq":55651,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:01.693358+0000","last_change":"2026-02-23T13:13:09.088406+0000","last_active":"2026-02-23T13:14:01.693358+0000","last_peered":"2026-02-23T13:14:01.693358+0000","last_clean":"2026-02-23T13:14:01.693358+0000","last_became_active":"2026-02-23T13:11:54.596133+0000","last_became_peered":"2026-02-23T13:11:54.596133+0000","last_unstale":"2026-02-23T13:14:01.693358+0000","last_undegraded":"2026-02-23T13:14:01.693358+0000","last_fullsized":"2026-02-23T13:14:01.693358+0000","mapping_epoch":78,"log_start":"94'55283","ondisk_log_start":"94'55283","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31860","last_scrub_stamp":"2026-02-23T13:13:09.088369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:09.088369+0000","objects_scrubbed":31307,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:14.774702+0000","scrub_duration":3283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1323302912,"num_objects":20192,"num_object_clones":0,"num_object_copies":60576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20192,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55286,"num_write_kb":2415296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"94'55174","reported_seq":55567,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:01.692009+0000","last_change":"2026-02-23T13:13:18.263885+0000","last_active":"2026-02-23T13:14:01.692009+0000","last_peered":"2026-02-23T13:14:01.692009+0000","last_clean":"2026-02-23T13:14:01.692009+0000","last_became_active":"2026-02-23T13:11:54.595080+0000","last_became_peered":"2026-02-23T13:11:54.595080+0000","last_unstale":"2026-02-23T13:14:01.692009+0000","last_undegraded":"2026-02-23T13:14:01.692009+0000","last_fullsized":"2026-02-23T13:14:01.692009+0000","mapping_epoch":78,"log_start":"94'55171","ondisk_log_start":"94'55171","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34829","last_scrub_stamp":"2026-02-23T13:13:18.263833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:18.263833+0000","objects_scrubbed":34171,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:35.520181+0000","scrub_duration":3597,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1323040768,"num_objects":20188,"num_object_clones":0,"num_object_copies":60564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20188,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55174,"num_write_kb":2411584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"94'57768","reported_seq":58118,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:06.671247+0000","last_change":"2026-02-23T13:13:04.939376+0000","last_active":"2026-02-23T13:14:06.671247+0000","last_peered":"2026-02-23T13:14:06.671247+0000","last_clean":"2026-02-23T13:14:06.671247+0000","last_became_active":"2026-02-23T13:11:54.598325+0000","last_became_peered":"2026-02-23T13:11:54.598325+0000","last_unstale":"2026-02-23T13:14:06.671247+0000","last_undegraded":"2026-02-23T13:14:06.671247+0000","last_fullsized":"2026-02-23T13:14:06.671247+0000","mapping_epoch":78,"log_start":"94'57765","ondisk_log_start":"94'57765","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'30360","last_scrub_stamp":"2026-02-23T13:13:04.939307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:04.939307+0000","objects_scrubbed":29843,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:25.467510+0000","scrub_duration":2554,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1162477568,"num_objects":17738,"num_object_clones":0,"num_object_copies":53214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17738,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57768,"num_write_kb":2416192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"94'55245","reported_seq":55603,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:01.693478+0000","last_change":"2026-02-23T13:13:08.083112+0000","last_active":"2026-02-23T13:14:01.693478+0000","last_peered":"2026-02-23T13:14:01.693478+0000","last_clean":"2026-02-23T13:14:01.693478+0000","last_became_active":"2026-02-23T13:11:54.595110+0000","last_became_peered":"2026-02-23T13:11:54.595110+0000","last_unstale":"2026-02-23T13:14:01.693478+0000","last_undegraded":"2026-02-23T13:14:01.693478+0000","last_fullsized":"2026-02-23T13:14:01.693478+0000","mapping_epoch":78,"log_start":"94'55242","ondisk_log_start":"94'55242","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31220","last_scrub_stamp":"2026-02-23T13:13:08.083065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:08.083065+0000","objects_scrubbed":30674,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:23.606645+0000","scrub_duration":3240,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1316945920,"num_objects":20095,"num_object_clones":0,"num_object_copies":60285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20095,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55245,"num_write_kb":2410880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"94'58598","reported_seq":59005,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:06.670955+0000","last_change":"2026-02-23T13:13:21.209650+0000","last_active":"2026-02-23T13:14:06.670955+0000","last_peered":"2026-02-23T13:14:06.670955+0000","last_clean":"2026-02-23T13:14:06.670955+0000","last_became_active":"2026-02-23T13:11:54.599155+0000","last_became_peered":"2026-02-23T13:11:54.599155+0000","last_unstale":"2026-02-23T13:14:06.670955+0000","last_undegraded":"2026-02-23T13:14:06.670955+0000","last_fullsized":"2026-02-23T13:14:06.670955+0000","mapping_epoch":78,"log_start":"94'58594","ondisk_log_start":"94'58594","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'36425","last_scrub_stamp":"2026-02-23T13:13:21.209611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:21.209611+0000","objects_scrubbed":35661,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:41.420198+0000","scrub_duration":3833,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1155792896,"num_objects":17636,"num_object_clones":0,"num_object_copies":52908,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17636,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58598,"num_write_kb":2439488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"94'55494","reported_seq":55918,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:01.811299+0000","last_change":"2026-02-23T13:13:26.394617+0000","last_active":"2026-02-23T13:14:01.811299+0000","last_peered":"2026-02-23T13:14:01.811299+0000","last_clean":"2026-02-23T13:14:01.811299+0000","last_became_active":"2026-02-23T13:11:54.595645+0000","last_became_peered":"2026-02-23T13:11:54.595645+0000","last_unstale":"2026-02-23T13:14:01.811299+0000","last_undegraded":"2026-02-23T13:14:01.811299+0000","last_fullsized":"2026-02-23T13:14:01.811299+0000","mapping_epoch":78,"log_start":"94'55491","ondisk_log_start":"94'55491","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'37974","last_scrub_stamp":"2026-02-23T13:13:26.394522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:26.394522+0000","objects_scrubbed":37376,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:55.787953+0000","scrub_duration":3046,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1306394624,"num_objects":19934,"num_object_clones":0,"num_object_copies":59802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19934,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55494,"num_write_kb":2413696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"94'55303","reported_seq":55728,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:01.683888+0000","last_change":"2026-02-23T13:13:28.610333+0000","last_active":"2026-02-23T13:14:01.683888+0000","last_peered":"2026-02-23T13:14:01.683888+0000","last_clean":"2026-02-23T13:14:01.683888+0000","last_became_active":"2026-02-23T13:11:54.595144+0000","last_became_peered":"2026-02-23T13:11:54.595144+0000","last_unstale":"2026-02-23T13:14:01.683888+0000","last_undegraded":"2026-02-23T13:14:01.683888+0000","last_fullsized":"2026-02-23T13:14:01.683888+0000","mapping_epoch":78,"log_start":"94'55300","ondisk_log_start":"94'55300","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'38921","last_scrub_stamp":"2026-02-23T13:13:28.610251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:28.610251+0000","objects_scrubbed":37355,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:29.459459+0000","scrub_duration":4072,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1331625984,"num_objects":20319,"num_object_clones":0,"num_object_copies":60957,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20319,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55303,"num_write_kb":2419904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"94'55852","reported_seq":56278,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:01.687763+0000","last_change":"2026-02-23T13:13:30.117925+0000","last_active":"2026-02-23T13:14:01.687763+0000","last_peered":"2026-02-23T13:14:01.687763+0000","last_clean":"2026-02-23T13:14:01.687763+0000","last_became_active":"2026-02-23T13:11:54.595996+0000","last_became_peered":"2026-02-23T13:11:54.595996+0000","last_unstale":"2026-02-23T13:14:01.687763+0000","last_undegraded":"2026-02-23T13:14:01.687763+0000","last_fullsized":"2026-02-23T13:14:01.687763+0000","mapping_epoch":78,"log_start":"94'55849","ondisk_log_start":"94'55849","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'39783","last_scrub_stamp":"2026-02-23T13:13:30.117805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:30.117805+0000","objects_scrubbed":37328,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:56.078765+0000","scrub_duration":4535,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1335754752,"num_objects":20382,"num_object_clones":0,"num_object_copies":61146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20382,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55852,"num_write_kb":2439488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"94'57951","reported_seq":58347,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:06.665132+0000","last_change":"2026-02-23T13:13:18.223410+0000","last_active":"2026-02-23T13:14:06.665132+0000","last_peered":"2026-02-23T13:14:06.665132+0000","last_clean":"2026-02-23T13:14:06.665132+0000","last_became_active":"2026-02-23T13:11:54.598958+0000","last_became_peered":"2026-02-23T13:11:54.598958+0000","last_unstale":"2026-02-23T13:14:06.665132+0000","last_undegraded":"2026-02-23T13:14:06.665132+0000","last_fullsized":"2026-02-23T13:14:06.665132+0000","mapping_epoch":78,"log_start":"94'57948","ondisk_log_start":"94'57948","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34997","last_scrub_stamp":"2026-02-23T13:13:18.223228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:18.223228+0000","objects_scrubbed":34269,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:30.400168+0000","scrub_duration":3831,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1162149888,"num_objects":17733,"num_object_clones":0,"num_object_copies":53199,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17733,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57951,"num_write_kb":2421888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"94'57973","reported_seq":58335,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:06.658173+0000","last_change":"2026-02-23T13:13:08.044115+0000","last_active":"2026-02-23T13:14:06.658173+0000","last_peered":"2026-02-23T13:14:06.658173+0000","last_clean":"2026-02-23T13:14:06.658173+0000","last_became_active":"2026-02-23T13:11:54.598751+0000","last_became_peered":"2026-02-23T13:11:54.598751+0000","last_unstale":"2026-02-23T13:14:06.658173+0000","last_undegraded":"2026-02-23T13:14:06.658173+0000","last_fullsized":"2026-02-23T13:14:06.658173+0000","mapping_epoch":78,"log_start":"94'57970","ondisk_log_start":"94'57970","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31416","last_scrub_stamp":"2026-02-23T13:13:08.044055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:08.044055+0000","objects_scrubbed":31053,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:17.610054+0000","scrub_duration":2694,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1148125184,"num_objects":17519,"num_object_clones":0,"num_object_copies":52557,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17519,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57973,"num_write_kb":2415744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"94'55377","reported_seq":55708,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:01.692082+0000","last_change":"2026-02-23T13:13:00.668240+0000","last_active":"2026-02-23T13:14:01.692082+0000","last_peered":"2026-02-23T13:14:01.692082+0000","last_clean":"2026-02-23T13:14:01.692082+0000","last_became_active":"2026-02-23T13:11:54.595840+0000","last_became_peered":"2026-02-23T13:11:54.595840+0000","last_unstale":"2026-02-23T13:14:01.692082+0000","last_undegraded":"2026-02-23T13:14:01.692082+0000","last_fullsized":"2026-02-23T13:14:01.692082+0000","mapping_epoch":78,"log_start":"94'55374","ondisk_log_start":"94'55374","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'28514","last_scrub_stamp":"2026-02-23T13:13:00.668153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:00.668153+0000","objects_scrubbed":27959,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:20.748829+0000","scrub_duration":2841,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1321533440,"num_objects":20165,"num_object_clones":0,"num_object_copies":60495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20165,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55377,"num_write_kb":2417344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"94'55448","reported_seq":55829,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:01.676143+0000","last_change":"2026-02-23T13:13:13.604684+0000","last_active":"2026-02-23T13:14:01.676143+0000","last_peered":"2026-02-23T13:14:01.676143+0000","last_clean":"2026-02-23T13:14:01.676143+0000","last_became_active":"2026-02-23T13:11:54.595287+0000","last_became_peered":"2026-02-23T13:11:54.595287+0000","last_unstale":"2026-02-23T13:14:01.676143+0000","last_undegraded":"2026-02-23T13:14:01.676143+0000","last_fullsized":"2026-02-23T13:14:01.676143+0000","mapping_epoch":78,"log_start":"94'55445","ondisk_log_start":"94'55445","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'33325","last_scrub_stamp":"2026-02-23T13:13:13.604647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:13.604647+0000","objects_scrubbed":32944,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:25.477441+0000","scrub_duration":2412,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1323433984,"num_objects":20194,"num_object_clones":0,"num_object_copies":60582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20194,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55448,"num_write_kb":2420544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":385,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:13:16.609942+0000","last_change":"2026-02-23T13:13:01.377596+0000","last_active":"2026-02-23T13:13:16.609942+0000","last_peered":"2026-02-23T13:13:16.609942+0000","last_clean":"2026-02-23T13:13:16.609942+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:13:16.609942+0000","last_undegraded":"2026-02-23T13:13:16.609942+0000","last_fullsized":"2026-02-23T13:13:16.609942+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:13:01.377552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:13:01.377552+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:11.484316+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":20356595736,"num_objects":310618,"num_object_clones":0,"num_object_copies":931854,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":310618,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":900842,"num_write_kb":38766657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61246287872,"data_stored":61246275656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1683,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247944,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":16937192,"kb_used_data":15916500,"kb_used_omap":16,"kb_used_meta":1020655,"kb_avail":717066008,"statfs":{"total":751619276800,"available":734275592192,"internally_reserved":0,"allocated":16298496000,"data_stored":16298020456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16750,"internal_metadata":1045151378},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444170,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":15196008,"kb_used_data":14330708,"kb_used_omap":18,"kb_used_meta":865197,"kb_avail":718807192,"statfs":{"total":751619276800,"available":736058564608,"internally_reserved":0,"allocated":14674644992,"data_stored":14674169448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18929,"internal_metadata":885962255},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574988,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":15039584,"kb_used_data":13011084,"kb_used_omap":18,"kb_used_meta":2028397,"kb_avail":718963616,"statfs":{"total":751619276800,"available":736218742784,"internally_reserved":0,"allocated":13323350016,"data_stored":13322882096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18636,"internal_metadata":2077079348},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705805,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":19133096,"kb_used_data":17248596,"kb_used_omap":24,"kb_used_meta":1884391,"kb_avail":714870104,"statfs":{"total":751619276800,"available":732026986496,"internally_reserved":0,"allocated":17662562304,"data_stored":17662086760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24794,"internal_metadata":1929617190},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1683,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17241935872,"data_stored":17241931800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13188792320,"data_stored":13188792320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14569181184,"data_stored":14569177112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16246378496,"data_stored":16246374424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:14:08.164 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 271 2026-02-23T13:14:08.308 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:08.445 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:14:08.739 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:08.686+0000 7f71e5303640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:08.739 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:08.687+0000 7f71e5303640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:08.769 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:08.818 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-23T13:14:09.225 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:14:09.605 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:09.588+0000 7f4740a33640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:09.605 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:09.588+0000 7f4740a33640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:09.616 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:14:09.617 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:14:09.631 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:14:09.631 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:14:09.643 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:14:09.644 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:14:09.659 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:14:09.659 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:14:09.931 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:09 trial046 ceph-mon[38575]: from='client.15371 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:14:09.931 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:09 trial046 ceph-mon[38575]: pgmap v404: 17 pgs: 17 active+clean; 17 GiB data, 55 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 9.35k op/s 2026-02-23T13:14:09.931 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:09 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1617938637' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "271"} : dispatch 2026-02-23T13:14:09.932 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:09 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2187744737' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:14:12.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:11 trial046 ceph-mon[38575]: pgmap v405: 17 pgs: 17 active+clean; 17 GiB data, 55 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 6.89k op/s 2026-02-23T13:14:12.185 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:14:12.325 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:12.714 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:14:12.715 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:12.688+0000 7f85fa924640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:12.715 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:12.688+0000 7f85fa924640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:12.715 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:14:12.719 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:14:12.719 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:14:12.733 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:14:12.733 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:14:12.746 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:14:12.746 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:14:13.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:12 trial046 ceph-mon[38575]: 1.0 scrub starts 2026-02-23T13:14:13.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:12 trial046 ceph-mon[38575]: 1.0 scrub ok 2026-02-23T13:14:13.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:12 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-23T13:14:13.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:12 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2862528032' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:14:14.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:13 trial046 ceph-mon[38575]: pgmap v406: 17 pgs: 17 active+clean; 15 GiB data, 48 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 10.06k op/s 2026-02-23T13:14:14.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:13 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:14:14.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:13 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-23T13:14:14.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:13 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:14:14.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:13 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-23T13:14:14.226 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:14:14.227 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:14:14.227 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_3 2026-02-23T13:14:14.227 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:14:14.375 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:14.499 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:14.497+0000 7f846ea02640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:14.500 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:14.498+0000 7f846ea02640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:14.642 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:14:14.643 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:14:14.689 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":406,"stamp":"2026-02-23T13:14:12.681073+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16044589624,"num_objects":244815,"num_object_clones":0,"num_object_copies":734445,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":244815,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":966782,"num_write_kb":38768807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":50521688,"kb_used_data":47302600,"kb_used_omap":66,"kb_used_meta":3218941,"kb_avail":2885491112,"statfs":{"total":3006477107200,"available":2954742898688,"internally_reserved":0,"allocated":48437862400,"data_stored":48435967848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":68405,"internal_metadata":3296195787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7916421120,"num_objects":-120795,"num_object_clones":0,"num_object_copies":-362385,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-120795,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120795,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001615"},"pg_stats":[{"pgid":"5.f","version":"94'60775","reported_seq":61191,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:11.679577+0000","last_change":"2026-02-23T13:13:23.096196+0000","last_active":"2026-02-23T13:14:11.679577+0000","last_peered":"2026-02-23T13:14:11.679577+0000","last_clean":"2026-02-23T13:14:11.679577+0000","last_became_active":"2026-02-23T13:11:54.595945+0000","last_became_peered":"2026-02-23T13:11:54.595945+0000","last_unstale":"2026-02-23T13:14:11.679577+0000","last_undegraded":"2026-02-23T13:14:11.679577+0000","last_fullsized":"2026-02-23T13:14:11.679577+0000","mapping_epoch":78,"log_start":"94'60772","ondisk_log_start":"94'60772","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'37044","last_scrub_stamp":"2026-02-23T13:13:23.096162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:23.096162+0000","objects_scrubbed":36289,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:30.719300+0000","scrub_duration":3945,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1014693888,"num_objects":15483,"num_object_clones":0,"num_object_copies":46449,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15483,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60775,"num_write_kb":2440256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"94'60829","reported_seq":61220,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:11.670278+0000","last_change":"2026-02-23T13:13:16.070635+0000","last_active":"2026-02-23T13:14:11.670278+0000","last_peered":"2026-02-23T13:14:11.670278+0000","last_clean":"2026-02-23T13:14:11.670278+0000","last_became_active":"2026-02-23T13:11:54.599064+0000","last_became_peered":"2026-02-23T13:11:54.599064+0000","last_unstale":"2026-02-23T13:14:11.670278+0000","last_undegraded":"2026-02-23T13:14:11.670278+0000","last_fullsized":"2026-02-23T13:14:11.670278+0000","mapping_epoch":78,"log_start":"94'60826","ondisk_log_start":"94'60826","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'34507","last_scrub_stamp":"2026-02-23T13:13:16.070555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:16.070555+0000","objects_scrubbed":33959,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:37.180440+0000","scrub_duration":3680,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1014300672,"num_objects":15477,"num_object_clones":0,"num_object_copies":46431,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15477,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60829,"num_write_kb":2441792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"94'60940","reported_seq":61339,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:11.696085+0000","last_change":"2026-02-23T13:13:35.762276+0000","last_active":"2026-02-23T13:14:11.696085+0000","last_peered":"2026-02-23T13:14:11.696085+0000","last_clean":"2026-02-23T13:14:11.696085+0000","last_became_active":"2026-02-23T13:11:54.595773+0000","last_became_peered":"2026-02-23T13:11:54.595773+0000","last_unstale":"2026-02-23T13:14:11.696085+0000","last_undegraded":"2026-02-23T13:14:11.696085+0000","last_fullsized":"2026-02-23T13:14:11.696085+0000","mapping_epoch":78,"log_start":"94'60937","ondisk_log_start":"94'60937","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'42527","last_scrub_stamp":"2026-02-23T13:13:35.762219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:35.762219+0000","objects_scrubbed":34717,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:36.846836+0000","scrub_duration":4038,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1009451032,"num_objects":15404,"num_object_clones":0,"num_object_copies":46212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15404,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":60940,"num_write_kb":2442945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"94'59866","reported_seq":60255,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:11.812199+0000","last_change":"2026-02-23T13:13:17.030615+0000","last_active":"2026-02-23T13:14:11.812199+0000","last_peered":"2026-02-23T13:14:11.812199+0000","last_clean":"2026-02-23T13:14:11.812199+0000","last_became_active":"2026-02-23T13:11:54.595560+0000","last_became_peered":"2026-02-23T13:11:54.595560+0000","last_unstale":"2026-02-23T13:14:11.812199+0000","last_undegraded":"2026-02-23T13:14:11.812199+0000","last_fullsized":"2026-02-23T13:14:11.812199+0000","mapping_epoch":78,"log_start":"94'59863","ondisk_log_start":"94'59863","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34247","last_scrub_stamp":"2026-02-23T13:13:17.030566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:17.030566+0000","objects_scrubbed":33782,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:44.233824+0000","scrub_duration":2702,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":991035392,"num_objects":15122,"num_object_clones":0,"num_object_copies":45366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59866,"num_write_kb":2399616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"94'60192","reported_seq":60557,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:11.693022+0000","last_change":"2026-02-23T13:13:09.088406+0000","last_active":"2026-02-23T13:14:11.693022+0000","last_peered":"2026-02-23T13:14:11.693022+0000","last_clean":"2026-02-23T13:14:11.693022+0000","last_became_active":"2026-02-23T13:11:54.596133+0000","last_became_peered":"2026-02-23T13:11:54.596133+0000","last_unstale":"2026-02-23T13:14:11.693022+0000","last_undegraded":"2026-02-23T13:14:11.693022+0000","last_fullsized":"2026-02-23T13:14:11.693022+0000","mapping_epoch":78,"log_start":"94'60189","ondisk_log_start":"94'60189","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31860","last_scrub_stamp":"2026-02-23T13:13:09.088369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:09.088369+0000","objects_scrubbed":31307,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:14.774702+0000","scrub_duration":3283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1001783296,"num_objects":15286,"num_object_clones":0,"num_object_copies":45858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15286,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60192,"num_write_kb":2415296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"94'60007","reported_seq":60400,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:11.688544+0000","last_change":"2026-02-23T13:13:18.263885+0000","last_active":"2026-02-23T13:14:11.688544+0000","last_peered":"2026-02-23T13:14:11.688544+0000","last_clean":"2026-02-23T13:14:11.688544+0000","last_became_active":"2026-02-23T13:11:54.595080+0000","last_became_peered":"2026-02-23T13:11:54.595080+0000","last_unstale":"2026-02-23T13:14:11.688544+0000","last_undegraded":"2026-02-23T13:14:11.688544+0000","last_fullsized":"2026-02-23T13:14:11.688544+0000","mapping_epoch":78,"log_start":"94'60004","ondisk_log_start":"94'60004","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34829","last_scrub_stamp":"2026-02-23T13:13:18.263833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:18.263833+0000","objects_scrubbed":34171,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:35.520181+0000","scrub_duration":3597,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1006305280,"num_objects":15355,"num_object_clones":0,"num_object_copies":46065,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60007,"num_write_kb":2411584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"94'60205","reported_seq":60555,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:11.669540+0000","last_change":"2026-02-23T13:13:04.939376+0000","last_active":"2026-02-23T13:14:11.669540+0000","last_peered":"2026-02-23T13:14:11.669540+0000","last_clean":"2026-02-23T13:14:11.669540+0000","last_became_active":"2026-02-23T13:11:54.598325+0000","last_became_peered":"2026-02-23T13:11:54.598325+0000","last_unstale":"2026-02-23T13:14:11.669540+0000","last_undegraded":"2026-02-23T13:14:11.669540+0000","last_fullsized":"2026-02-23T13:14:11.669540+0000","mapping_epoch":78,"log_start":"94'60202","ondisk_log_start":"94'60202","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'30360","last_scrub_stamp":"2026-02-23T13:13:04.939307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:04.939307+0000","objects_scrubbed":29843,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:25.467510+0000","scrub_duration":2554,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1002766336,"num_objects":15301,"num_object_clones":0,"num_object_copies":45903,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15301,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60205,"num_write_kb":2416192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"94'59998","reported_seq":60357,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:11.689956+0000","last_change":"2026-02-23T13:13:08.083112+0000","last_active":"2026-02-23T13:14:11.689956+0000","last_peered":"2026-02-23T13:14:11.689956+0000","last_clean":"2026-02-23T13:14:11.689956+0000","last_became_active":"2026-02-23T13:11:54.595110+0000","last_became_peered":"2026-02-23T13:11:54.595110+0000","last_unstale":"2026-02-23T13:14:11.689956+0000","last_undegraded":"2026-02-23T13:14:11.689956+0000","last_fullsized":"2026-02-23T13:14:11.689956+0000","mapping_epoch":78,"log_start":"94'59995","ondisk_log_start":"94'59995","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31220","last_scrub_stamp":"2026-02-23T13:13:08.083065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:08.083065+0000","objects_scrubbed":30674,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:23.606645+0000","scrub_duration":3240,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1005453312,"num_objects":15342,"num_object_clones":0,"num_object_copies":46026,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15342,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59998,"num_write_kb":2410880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"94'61048","reported_seq":61458,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:11.668096+0000","last_change":"2026-02-23T13:13:21.209650+0000","last_active":"2026-02-23T13:14:11.668096+0000","last_peered":"2026-02-23T13:14:11.668096+0000","last_clean":"2026-02-23T13:14:11.668096+0000","last_became_active":"2026-02-23T13:11:54.599155+0000","last_became_peered":"2026-02-23T13:11:54.599155+0000","last_unstale":"2026-02-23T13:14:11.668096+0000","last_undegraded":"2026-02-23T13:14:11.668096+0000","last_fullsized":"2026-02-23T13:14:11.668096+0000","mapping_epoch":78,"log_start":"94'61045","ondisk_log_start":"94'61045","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'36425","last_scrub_stamp":"2026-02-23T13:13:21.209611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:21.209611+0000","objects_scrubbed":35661,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:41.420198+0000","scrub_duration":3833,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":995229696,"num_objects":15186,"num_object_clones":0,"num_object_copies":45558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15186,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61048,"num_write_kb":2439488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"94'60400","reported_seq":60826,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:11.811375+0000","last_change":"2026-02-23T13:13:26.394617+0000","last_active":"2026-02-23T13:14:11.811375+0000","last_peered":"2026-02-23T13:14:11.811375+0000","last_clean":"2026-02-23T13:14:11.811375+0000","last_became_active":"2026-02-23T13:11:54.595645+0000","last_became_peered":"2026-02-23T13:11:54.595645+0000","last_unstale":"2026-02-23T13:14:11.811375+0000","last_undegraded":"2026-02-23T13:14:11.811375+0000","last_fullsized":"2026-02-23T13:14:11.811375+0000","mapping_epoch":78,"log_start":"94'60397","ondisk_log_start":"94'60397","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'37974","last_scrub_stamp":"2026-02-23T13:13:26.394522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:26.394522+0000","objects_scrubbed":37376,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:55.787953+0000","scrub_duration":3046,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":984875008,"num_objects":15028,"num_object_clones":0,"num_object_copies":45084,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15028,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60400,"num_write_kb":2413696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"94'60271","reported_seq":60695,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:11.692287+0000","last_change":"2026-02-23T13:13:28.610333+0000","last_active":"2026-02-23T13:14:11.692287+0000","last_peered":"2026-02-23T13:14:11.692287+0000","last_clean":"2026-02-23T13:14:11.692287+0000","last_became_active":"2026-02-23T13:11:54.595144+0000","last_became_peered":"2026-02-23T13:11:54.595144+0000","last_unstale":"2026-02-23T13:14:11.692287+0000","last_undegraded":"2026-02-23T13:14:11.692287+0000","last_fullsized":"2026-02-23T13:14:11.692287+0000","mapping_epoch":78,"log_start":"94'60268","ondisk_log_start":"94'60268","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'38921","last_scrub_stamp":"2026-02-23T13:13:28.610251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:28.610251+0000","objects_scrubbed":37355,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:29.459459+0000","scrub_duration":4072,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1006043136,"num_objects":15351,"num_object_clones":0,"num_object_copies":46053,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15351,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60271,"num_write_kb":2419904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"94'60835","reported_seq":61261,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:11.693946+0000","last_change":"2026-02-23T13:13:30.117925+0000","last_active":"2026-02-23T13:14:11.693946+0000","last_peered":"2026-02-23T13:14:11.693946+0000","last_clean":"2026-02-23T13:14:11.693946+0000","last_became_active":"2026-02-23T13:11:54.595996+0000","last_became_peered":"2026-02-23T13:11:54.595996+0000","last_unstale":"2026-02-23T13:14:11.693946+0000","last_undegraded":"2026-02-23T13:14:11.693946+0000","last_fullsized":"2026-02-23T13:14:11.693946+0000","mapping_epoch":78,"log_start":"94'60832","ondisk_log_start":"94'60832","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'39783","last_scrub_stamp":"2026-02-23T13:13:30.117805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:30.117805+0000","objects_scrubbed":37328,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:56.078765+0000","scrub_duration":4535,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1009188864,"num_objects":15399,"num_object_clones":0,"num_object_copies":46197,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15399,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60835,"num_write_kb":2439488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"94'60384","reported_seq":60777,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:11.669921+0000","last_change":"2026-02-23T13:13:18.223410+0000","last_active":"2026-02-23T13:14:11.669921+0000","last_peered":"2026-02-23T13:14:11.669921+0000","last_clean":"2026-02-23T13:14:11.669921+0000","last_became_active":"2026-02-23T13:11:54.598958+0000","last_became_peered":"2026-02-23T13:11:54.598958+0000","last_unstale":"2026-02-23T13:14:11.669921+0000","last_undegraded":"2026-02-23T13:14:11.669921+0000","last_fullsized":"2026-02-23T13:14:11.669921+0000","mapping_epoch":78,"log_start":"94'60380","ondisk_log_start":"94'60380","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34997","last_scrub_stamp":"2026-02-23T13:13:18.223228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:18.223228+0000","objects_scrubbed":34269,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:30.400168+0000","scrub_duration":3831,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1002700800,"num_objects":15300,"num_object_clones":0,"num_object_copies":45900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15300,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60384,"num_write_kb":2421888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"94'60378","reported_seq":60740,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:11.665359+0000","last_change":"2026-02-23T13:13:08.044115+0000","last_active":"2026-02-23T13:14:11.665359+0000","last_peered":"2026-02-23T13:14:11.665359+0000","last_clean":"2026-02-23T13:14:11.665359+0000","last_became_active":"2026-02-23T13:11:54.598751+0000","last_became_peered":"2026-02-23T13:11:54.598751+0000","last_unstale":"2026-02-23T13:14:11.665359+0000","last_undegraded":"2026-02-23T13:14:11.665359+0000","last_fullsized":"2026-02-23T13:14:11.665359+0000","mapping_epoch":78,"log_start":"94'60375","ondisk_log_start":"94'60375","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31416","last_scrub_stamp":"2026-02-23T13:13:08.044055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:08.044055+0000","objects_scrubbed":31053,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:17.610054+0000","scrub_duration":2694,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":990511104,"num_objects":15114,"num_object_clones":0,"num_object_copies":45342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60378,"num_write_kb":2415744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"94'60247","reported_seq":60578,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:11.688119+0000","last_change":"2026-02-23T13:13:00.668240+0000","last_active":"2026-02-23T13:14:11.688119+0000","last_peered":"2026-02-23T13:14:11.688119+0000","last_clean":"2026-02-23T13:14:11.688119+0000","last_became_active":"2026-02-23T13:11:54.595840+0000","last_became_peered":"2026-02-23T13:11:54.595840+0000","last_unstale":"2026-02-23T13:14:11.688119+0000","last_undegraded":"2026-02-23T13:14:11.688119+0000","last_fullsized":"2026-02-23T13:14:11.688119+0000","mapping_epoch":78,"log_start":"94'60244","ondisk_log_start":"94'60244","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'28514","last_scrub_stamp":"2026-02-23T13:13:00.668153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:00.668153+0000","objects_scrubbed":27959,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:20.748829+0000","scrub_duration":2841,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1002373120,"num_objects":15295,"num_object_clones":0,"num_object_copies":45885,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15295,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60247,"num_write_kb":2417344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"94'60272","reported_seq":60653,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:11.677777+0000","last_change":"2026-02-23T13:13:13.604684+0000","last_active":"2026-02-23T13:14:11.677777+0000","last_peered":"2026-02-23T13:14:11.677777+0000","last_clean":"2026-02-23T13:14:11.677777+0000","last_became_active":"2026-02-23T13:11:54.595287+0000","last_became_peered":"2026-02-23T13:11:54.595287+0000","last_unstale":"2026-02-23T13:14:11.677777+0000","last_undegraded":"2026-02-23T13:14:11.677777+0000","last_fullsized":"2026-02-23T13:14:11.677777+0000","mapping_epoch":78,"log_start":"94'60269","ondisk_log_start":"94'60269","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'33325","last_scrub_stamp":"2026-02-23T13:13:13.604647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:13.604647+0000","objects_scrubbed":32944,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:25.477441+0000","scrub_duration":2412,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1007288320,"num_objects":15370,"num_object_clones":0,"num_object_copies":46110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15370,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60272,"num_write_kb":2420544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":393,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:11.656044+0000","last_change":"2026-02-23T13:14:11.656044+0000","last_active":"2026-02-23T13:14:11.656044+0000","last_peered":"2026-02-23T13:14:11.656044+0000","last_clean":"2026-02-23T13:14:11.656044+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:14:11.656044+0000","last_undegraded":"2026-02-23T13:14:11.656044+0000","last_fullsized":"2026-02-23T13:14:11.656044+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:14:11.656003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:14:11.656003+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:24.978553+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":16043999256,"num_objects":244813,"num_object_clones":0,"num_object_copies":734439,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":244813,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":966647,"num_write_kb":38766657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":48117002240,"data_stored":48116990024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1745,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247945,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":14817192,"kb_used_data":13742356,"kb_used_omap":16,"kb_used_meta":1074799,"kb_avail":719186008,"statfs":{"total":751619276800,"available":736446472192,"internally_reserved":0,"allocated":14072172544,"data_stored":14071697000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16750,"internal_metadata":1100594834},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444172,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":11460264,"kb_used_data":10918740,"kb_used_omap":18,"kb_used_meta":541485,"kb_avail":722542936,"statfs":{"total":751619276800,"available":739883966464,"internally_reserved":0,"allocated":11180789760,"data_stored":11180314216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18929,"internal_metadata":554481167},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574990,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":10912416,"kb_used_data":9894604,"kb_used_omap":18,"kb_used_meta":1017773,"kb_avail":723090784,"statfs":{"total":751619276800,"available":740444962816,"internally_reserved":0,"allocated":10132074496,"data_stored":10131606576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18636,"internal_metadata":1042200372},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705807,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":13331816,"kb_used_data":12746900,"kb_used_omap":13,"kb_used_meta":584882,"kb_avail":720671384,"statfs":{"total":751619276800,"available":737967497216,"internally_reserved":0,"allocated":13052825600,"data_stored":13052350056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14090,"internal_metadata":598919414},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1745,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13049139200,"data_stored":13049135128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9981001728,"data_stored":9981001728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11026239488,"data_stored":11026235416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14060621824,"data_stored":14060617752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:14:14.692 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:14:14.693 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_3 pg_num 76 2026-02-23T13:14:14.843 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:14.968 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:14.966+0000 7fb82c090640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:14.968 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:14.966+0000 7fb82c090640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:15.111 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:14:15.151 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:14:15.324 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:14:15.467 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:15.856 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:15 trial046 ceph-mon[38575]: from='client.15379 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:14:15.856 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:15 trial046 ceph-mon[38575]: pgmap v407: 17 pgs: 17 active+clean; 15 GiB data, 48 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 6.55k op/s 2026-02-23T13:14:15.856 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:15 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3803197820' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_3", "var": "pg_num", "val": "76"} : dispatch 2026-02-23T13:14:15.932 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:15.908+0000 7fefb2f9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:15.932 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:15.908+0000 7fefb2f9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:15.938 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:14:15.938 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:14:15.951 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:14:15.951 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:14:15.964 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:14:15.964 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:14:15.976 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:14:15.976 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:14:16.164 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:14:16 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:14:16] "GET /metrics HTTP/1.1" 200 4228 "" "Prometheus/3.6.0" 2026-02-23T13:14:16.469 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:14:16 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:14:16.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:14:17.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:16 trial046 ceph-mon[38575]: 5.b scrub starts 2026-02-23T13:14:17.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:16 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:14:17.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:16 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2270336336' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:14:18.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:17 trial046 ceph-mon[38575]: pgmap v408: 17 pgs: 17 active+clean; 14 GiB data, 45 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 7.97k op/s 2026-02-23T13:14:18.187 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:14:18.331 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:18.730 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:18.704+0000 7f8c036ca640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:18.730 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:18.705+0000 7f8c036ca640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:18.730 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:14:18.731 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:14:18.740 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:14:18.740 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:14:18.752 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:14:18.752 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:14:18.752 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:18 trial046 ceph-mon[38575]: 5.b scrub ok 2026-02-23T13:14:18.767 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:14:18.768 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:14:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:19 trial046 ceph-mon[38575]: pgmap v409: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 13 GiB data, 42 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 8.73k op/s 2026-02-23T13:14:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:19 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2518239147' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:14:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:19 trial046 ceph-mon[38575]: 5.1 scrub starts 2026-02-23T13:14:20.153 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:14:20.153 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:14:20.153 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_3 2026-02-23T13:14:20.153 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:14:20.296 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:20.426 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:20.424+0000 7fcc44990640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:20.426 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:20.424+0000 7fcc44990640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:20.563 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:14:20.563 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:14:20.608 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":409,"stamp":"2026-02-23T13:14:18.681887+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":13487637048,"num_objects":205799,"num_object_clones":0,"num_object_copies":617397,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":205799,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":1005798,"num_write_kb":38768807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":43524760,"kb_used_data":40106888,"kb_used_omap":66,"kb_used_meta":3417469,"kb_avail":2892488040,"statfs":{"total":3006477107200,"available":2961907752960,"internally_reserved":0,"allocated":41069453312,"data_stored":41067558760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":68467,"internal_metadata":3499488397},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6869549056,"num_objects":-104821,"num_object_clones":0,"num_object_copies":-314463,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-104821,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104821,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001652"},"pg_stats":[{"pgid":"5.f","version":"94'63272","reported_seq":63688,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:16.679973+0000","last_change":"2026-02-23T13:13:23.096196+0000","last_active":"2026-02-23T13:14:16.679973+0000","last_peered":"2026-02-23T13:14:16.679973+0000","last_clean":"2026-02-23T13:14:16.679973+0000","last_became_active":"2026-02-23T13:11:54.595945+0000","last_became_peered":"2026-02-23T13:11:54.595945+0000","last_unstale":"2026-02-23T13:14:16.679973+0000","last_undegraded":"2026-02-23T13:14:16.679973+0000","last_fullsized":"2026-02-23T13:14:16.679973+0000","mapping_epoch":78,"log_start":"94'63269","ondisk_log_start":"94'63269","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'37044","last_scrub_stamp":"2026-02-23T13:13:23.096162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:23.096162+0000","objects_scrubbed":36289,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:30.719300+0000","scrub_duration":3945,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851050496,"num_objects":12986,"num_object_clones":0,"num_object_copies":38958,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12986,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63272,"num_write_kb":2440256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"94'63309","reported_seq":63701,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:16.669662+0000","last_change":"2026-02-23T13:13:16.070635+0000","last_active":"2026-02-23T13:14:16.669662+0000","last_peered":"2026-02-23T13:14:16.669662+0000","last_clean":"2026-02-23T13:14:16.669662+0000","last_became_active":"2026-02-23T13:11:54.599064+0000","last_became_peered":"2026-02-23T13:11:54.599064+0000","last_unstale":"2026-02-23T13:14:16.669662+0000","last_undegraded":"2026-02-23T13:14:16.669662+0000","last_fullsized":"2026-02-23T13:14:16.669662+0000","mapping_epoch":78,"log_start":"94'63306","ondisk_log_start":"94'63306","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'34507","last_scrub_stamp":"2026-02-23T13:13:16.070555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:16.070555+0000","objects_scrubbed":33959,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:37.180440+0000","scrub_duration":3680,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851771392,"num_objects":12997,"num_object_clones":0,"num_object_copies":38991,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12997,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63309,"num_write_kb":2441792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"94'63382","reported_seq":63782,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:16.694207+0000","last_change":"2026-02-23T13:13:35.762276+0000","last_active":"2026-02-23T13:14:16.694207+0000","last_peered":"2026-02-23T13:14:16.694207+0000","last_clean":"2026-02-23T13:14:16.694207+0000","last_became_active":"2026-02-23T13:11:54.595773+0000","last_became_peered":"2026-02-23T13:11:54.595773+0000","last_unstale":"2026-02-23T13:14:16.694207+0000","last_undegraded":"2026-02-23T13:14:16.694207+0000","last_fullsized":"2026-02-23T13:14:16.694207+0000","mapping_epoch":78,"log_start":"94'63379","ondisk_log_start":"94'63379","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'42527","last_scrub_stamp":"2026-02-23T13:13:35.762219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:35.762219+0000","objects_scrubbed":34717,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:36.846836+0000","scrub_duration":4038,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":849412120,"num_objects":12962,"num_object_clones":0,"num_object_copies":38886,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12962,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":63382,"num_write_kb":2442945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"94'62264","reported_seq":62654,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:16.806778+0000","last_change":"2026-02-23T13:13:17.030615+0000","last_active":"2026-02-23T13:14:16.806778+0000","last_peered":"2026-02-23T13:14:16.806778+0000","last_clean":"2026-02-23T13:14:16.806778+0000","last_became_active":"2026-02-23T13:11:54.595560+0000","last_became_peered":"2026-02-23T13:11:54.595560+0000","last_unstale":"2026-02-23T13:14:16.806778+0000","last_undegraded":"2026-02-23T13:14:16.806778+0000","last_fullsized":"2026-02-23T13:14:16.806778+0000","mapping_epoch":78,"log_start":"94'62261","ondisk_log_start":"94'62261","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34247","last_scrub_stamp":"2026-02-23T13:13:17.030566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:17.030566+0000","objects_scrubbed":33782,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:44.233824+0000","scrub_duration":2702,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":833880064,"num_objects":12724,"num_object_clones":0,"num_object_copies":38172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12724,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62264,"num_write_kb":2399616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"94'62634","reported_seq":63074,"reported_epoch":94,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:14:16.698740+0000","last_change":"2026-02-23T13:14:15.715447+0000","last_active":"2026-02-23T13:14:16.698740+0000","last_peered":"2026-02-23T13:14:16.698740+0000","last_clean":"2026-02-23T13:14:16.698740+0000","last_became_active":"2026-02-23T13:11:54.596133+0000","last_became_peered":"2026-02-23T13:11:54.596133+0000","last_unstale":"2026-02-23T13:14:16.698740+0000","last_undegraded":"2026-02-23T13:14:16.698740+0000","last_fullsized":"2026-02-23T13:14:16.698740+0000","mapping_epoch":78,"log_start":"94'62631","ondisk_log_start":"94'62631","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31860","last_scrub_stamp":"2026-02-23T13:13:09.088369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:09.088369+0000","objects_scrubbed":7049,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"scrubbing for 1s","scrub_duration":3283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841744384,"num_objects":12844,"num_object_clones":0,"num_object_copies":38532,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12844,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62634,"num_write_kb":2415296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"94'62573","reported_seq":62966,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:16.695728+0000","last_change":"2026-02-23T13:13:18.263885+0000","last_active":"2026-02-23T13:14:16.695728+0000","last_peered":"2026-02-23T13:14:16.695728+0000","last_clean":"2026-02-23T13:14:16.695728+0000","last_became_active":"2026-02-23T13:11:54.595080+0000","last_became_peered":"2026-02-23T13:11:54.595080+0000","last_unstale":"2026-02-23T13:14:16.695728+0000","last_undegraded":"2026-02-23T13:14:16.695728+0000","last_fullsized":"2026-02-23T13:14:16.695728+0000","mapping_epoch":78,"log_start":"94'62570","ondisk_log_start":"94'62570","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34829","last_scrub_stamp":"2026-02-23T13:13:18.263833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:18.263833+0000","objects_scrubbed":34171,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:35.520181+0000","scrub_duration":3597,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838139904,"num_objects":12789,"num_object_clones":0,"num_object_copies":38367,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12789,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62573,"num_write_kb":2411584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"94'62660","reported_seq":63010,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:16.665886+0000","last_change":"2026-02-23T13:13:04.939376+0000","last_active":"2026-02-23T13:14:16.665886+0000","last_peered":"2026-02-23T13:14:16.665886+0000","last_clean":"2026-02-23T13:14:16.665886+0000","last_became_active":"2026-02-23T13:11:54.598325+0000","last_became_peered":"2026-02-23T13:11:54.598325+0000","last_unstale":"2026-02-23T13:14:16.665886+0000","last_undegraded":"2026-02-23T13:14:16.665886+0000","last_fullsized":"2026-02-23T13:14:16.665886+0000","mapping_epoch":78,"log_start":"94'62657","ondisk_log_start":"94'62657","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'30360","last_scrub_stamp":"2026-02-23T13:13:04.939307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:04.939307+0000","objects_scrubbed":29843,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:25.467510+0000","scrub_duration":2554,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841875456,"num_objects":12846,"num_object_clones":0,"num_object_copies":38538,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12846,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62660,"num_write_kb":2416192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"94'62365","reported_seq":62724,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:16.695545+0000","last_change":"2026-02-23T13:13:08.083112+0000","last_active":"2026-02-23T13:14:16.695545+0000","last_peered":"2026-02-23T13:14:16.695545+0000","last_clean":"2026-02-23T13:14:16.695545+0000","last_became_active":"2026-02-23T13:11:54.595110+0000","last_became_peered":"2026-02-23T13:11:54.595110+0000","last_unstale":"2026-02-23T13:14:16.695545+0000","last_undegraded":"2026-02-23T13:14:16.695545+0000","last_fullsized":"2026-02-23T13:14:16.695545+0000","mapping_epoch":78,"log_start":"94'62362","ondisk_log_start":"94'62362","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31220","last_scrub_stamp":"2026-02-23T13:13:08.083065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:08.083065+0000","objects_scrubbed":30674,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:23.606645+0000","scrub_duration":3240,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":850329600,"num_objects":12975,"num_object_clones":0,"num_object_copies":38925,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12975,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62365,"num_write_kb":2410880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"94'63401","reported_seq":63810,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:16.669621+0000","last_change":"2026-02-23T13:13:21.209650+0000","last_active":"2026-02-23T13:14:16.669621+0000","last_peered":"2026-02-23T13:14:16.669621+0000","last_clean":"2026-02-23T13:14:16.669621+0000","last_became_active":"2026-02-23T13:11:54.599155+0000","last_became_peered":"2026-02-23T13:11:54.599155+0000","last_unstale":"2026-02-23T13:14:16.669621+0000","last_undegraded":"2026-02-23T13:14:16.669621+0000","last_fullsized":"2026-02-23T13:14:16.669621+0000","mapping_epoch":78,"log_start":"94'63398","ondisk_log_start":"94'63398","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'36425","last_scrub_stamp":"2026-02-23T13:13:21.209611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:21.209611+0000","objects_scrubbed":35661,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:41.420198+0000","scrub_duration":3833,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841023488,"num_objects":12833,"num_object_clones":0,"num_object_copies":38499,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12833,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63401,"num_write_kb":2439488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"94'62814","reported_seq":63240,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:16.810818+0000","last_change":"2026-02-23T13:13:26.394617+0000","last_active":"2026-02-23T13:14:16.810818+0000","last_peered":"2026-02-23T13:14:16.810818+0000","last_clean":"2026-02-23T13:14:16.810818+0000","last_became_active":"2026-02-23T13:11:54.595645+0000","last_became_peered":"2026-02-23T13:11:54.595645+0000","last_unstale":"2026-02-23T13:14:16.810818+0000","last_undegraded":"2026-02-23T13:14:16.810818+0000","last_fullsized":"2026-02-23T13:14:16.810818+0000","mapping_epoch":78,"log_start":"94'62811","ondisk_log_start":"94'62811","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'37974","last_scrub_stamp":"2026-02-23T13:13:26.394522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:26.394522+0000","objects_scrubbed":37376,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:55.787953+0000","scrub_duration":3046,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826671104,"num_objects":12614,"num_object_clones":0,"num_object_copies":37842,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12614,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62814,"num_write_kb":2413696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"94'62727","reported_seq":63152,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:16.697660+0000","last_change":"2026-02-23T13:13:28.610333+0000","last_active":"2026-02-23T13:14:16.697660+0000","last_peered":"2026-02-23T13:14:16.697660+0000","last_clean":"2026-02-23T13:14:16.697660+0000","last_became_active":"2026-02-23T13:11:54.595144+0000","last_became_peered":"2026-02-23T13:11:54.595144+0000","last_unstale":"2026-02-23T13:14:16.697660+0000","last_undegraded":"2026-02-23T13:14:16.697660+0000","last_fullsized":"2026-02-23T13:14:16.697660+0000","mapping_epoch":78,"log_start":"94'62724","ondisk_log_start":"94'62724","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'38921","last_scrub_stamp":"2026-02-23T13:13:28.610251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:28.610251+0000","objects_scrubbed":37355,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:29.459459+0000","scrub_duration":4072,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845086720,"num_objects":12895,"num_object_clones":0,"num_object_copies":38685,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12895,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62727,"num_write_kb":2419904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"94'63352","reported_seq":63778,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:16.694628+0000","last_change":"2026-02-23T13:13:30.117925+0000","last_active":"2026-02-23T13:14:16.694628+0000","last_peered":"2026-02-23T13:14:16.694628+0000","last_clean":"2026-02-23T13:14:16.694628+0000","last_became_active":"2026-02-23T13:11:54.595996+0000","last_became_peered":"2026-02-23T13:11:54.595996+0000","last_unstale":"2026-02-23T13:14:16.694628+0000","last_undegraded":"2026-02-23T13:14:16.694628+0000","last_fullsized":"2026-02-23T13:14:16.694628+0000","mapping_epoch":78,"log_start":"94'63349","ondisk_log_start":"94'63349","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'39783","last_scrub_stamp":"2026-02-23T13:13:30.117805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:30.117805+0000","objects_scrubbed":37328,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:56.078765+0000","scrub_duration":4535,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":844234752,"num_objects":12882,"num_object_clones":0,"num_object_copies":38646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12882,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63352,"num_write_kb":2439488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"94'62808","reported_seq":63204,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:16.657038+0000","last_change":"2026-02-23T13:13:18.223410+0000","last_active":"2026-02-23T13:14:16.657038+0000","last_peered":"2026-02-23T13:14:16.657038+0000","last_clean":"2026-02-23T13:14:16.657038+0000","last_became_active":"2026-02-23T13:11:54.598958+0000","last_became_peered":"2026-02-23T13:11:54.598958+0000","last_unstale":"2026-02-23T13:14:16.657038+0000","last_undegraded":"2026-02-23T13:14:16.657038+0000","last_fullsized":"2026-02-23T13:14:16.657038+0000","mapping_epoch":78,"log_start":"94'62805","ondisk_log_start":"94'62805","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34997","last_scrub_stamp":"2026-02-23T13:13:18.223228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:18.223228+0000","objects_scrubbed":34269,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:30.400168+0000","scrub_duration":3831,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843841536,"num_objects":12876,"num_object_clones":0,"num_object_copies":38628,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12876,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62808,"num_write_kb":2421888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"94'62760","reported_seq":63122,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:16.669806+0000","last_change":"2026-02-23T13:13:08.044115+0000","last_active":"2026-02-23T13:14:16.669806+0000","last_peered":"2026-02-23T13:14:16.669806+0000","last_clean":"2026-02-23T13:14:16.669806+0000","last_became_active":"2026-02-23T13:11:54.598751+0000","last_became_peered":"2026-02-23T13:11:54.598751+0000","last_unstale":"2026-02-23T13:14:16.669806+0000","last_undegraded":"2026-02-23T13:14:16.669806+0000","last_fullsized":"2026-02-23T13:14:16.669806+0000","mapping_epoch":78,"log_start":"94'62757","ondisk_log_start":"94'62757","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31416","last_scrub_stamp":"2026-02-23T13:13:08.044055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:08.044055+0000","objects_scrubbed":31053,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:17.610054+0000","scrub_duration":2694,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":834404352,"num_objects":12732,"num_object_clones":0,"num_object_copies":38196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12732,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62760,"num_write_kb":2415744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"94'62612","reported_seq":62943,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:16.697309+0000","last_change":"2026-02-23T13:13:00.668240+0000","last_active":"2026-02-23T13:14:16.697309+0000","last_peered":"2026-02-23T13:14:16.697309+0000","last_clean":"2026-02-23T13:14:16.697309+0000","last_became_active":"2026-02-23T13:11:54.595840+0000","last_became_peered":"2026-02-23T13:11:54.595840+0000","last_unstale":"2026-02-23T13:14:16.697309+0000","last_undegraded":"2026-02-23T13:14:16.697309+0000","last_fullsized":"2026-02-23T13:14:16.697309+0000","mapping_epoch":78,"log_start":"94'62609","ondisk_log_start":"94'62609","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'28514","last_scrub_stamp":"2026-02-23T13:13:00.668153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:00.668153+0000","objects_scrubbed":27959,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:20.748829+0000","scrub_duration":2841,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":847380480,"num_objects":12930,"num_object_clones":0,"num_object_copies":38790,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12930,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62612,"num_write_kb":2417344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"94'62730","reported_seq":63111,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:16.679398+0000","last_change":"2026-02-23T13:13:13.604684+0000","last_active":"2026-02-23T13:14:16.679398+0000","last_peered":"2026-02-23T13:14:16.679398+0000","last_clean":"2026-02-23T13:14:16.679398+0000","last_became_active":"2026-02-23T13:11:54.595287+0000","last_became_peered":"2026-02-23T13:11:54.595287+0000","last_unstale":"2026-02-23T13:14:16.679398+0000","last_undegraded":"2026-02-23T13:14:16.679398+0000","last_fullsized":"2026-02-23T13:14:16.679398+0000","mapping_epoch":78,"log_start":"94'62727","ondisk_log_start":"94'62727","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'33325","last_scrub_stamp":"2026-02-23T13:13:13.604647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:13.604647+0000","objects_scrubbed":32944,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:25.477441+0000","scrub_duration":2412,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":846200832,"num_objects":12912,"num_object_clones":0,"num_object_copies":38736,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12912,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62730,"num_write_kb":2420544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":393,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:11.656044+0000","last_change":"2026-02-23T13:14:11.656044+0000","last_active":"2026-02-23T13:14:11.656044+0000","last_peered":"2026-02-23T13:14:11.656044+0000","last_clean":"2026-02-23T13:14:11.656044+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:14:11.656044+0000","last_undegraded":"2026-02-23T13:14:11.656044+0000","last_fullsized":"2026-02-23T13:14:11.656044+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:14:11.656003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:14:11.656003+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:24.978553+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":13487046680,"num_objects":205797,"num_object_clones":0,"num_object_copies":617391,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":205797,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1005663,"num_write_kb":38766657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40449290240,"data_stored":40449278024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1745,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247946,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":12674024,"kb_used_data":11545044,"kb_used_omap":16,"kb_used_meta":1128943,"kb_avail":721329176,"statfs":{"total":751619276800,"available":738641076224,"internally_reserved":0,"allocated":11822125056,"data_stored":11821649512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16812,"internal_metadata":1156038228},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444173,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":9767528,"kb_used_data":9171732,"kb_used_omap":18,"kb_used_meta":595629,"kb_avail":724235672,"statfs":{"total":751619276800,"available":741617328128,"internally_reserved":0,"allocated":9391853568,"data_stored":9391378024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18929,"internal_metadata":609924623},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574991,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":9424672,"kb_used_data":8352652,"kb_used_omap":18,"kb_used_meta":1071917,"kb_avail":724578528,"statfs":{"total":751619276800,"available":741968412672,"internally_reserved":0,"allocated":8553115648,"data_stored":8552647728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18636,"internal_metadata":1097643828},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705808,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":11658536,"kb_used_data":11037460,"kb_used_omap":13,"kb_used_meta":620978,"kb_avail":722344664,"statfs":{"total":751619276800,"available":739680935936,"internally_reserved":0,"allocated":11302359040,"data_stored":11301883496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14090,"internal_metadata":635881718},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1745,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10970664960,"data_stored":10970660888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8392278016,"data_stored":8392278016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9270530048,"data_stored":9270525976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11815817216,"data_stored":11815813144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:14:20.609 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:14:20.609 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_3 pg_num 86 2026-02-23T13:14:20.750 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:20.808 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:14:20.813 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:20 trial046 ceph-mon[38575]: 5.1 scrub ok 2026-02-23T13:14:20.890 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:20.888+0000 7eff28a7c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:20.890 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:20.888+0000 7eff28a7c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:20.951 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:21.043 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:14:21.069 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:21.067+0000 7f8d37a67640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:21.070 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:21.068+0000 7f8d37a67640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:21.084 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:14:21.085 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:14:21.085 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:14:21.097 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:14:21.097 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:14:21.109 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:14:21.110 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:14:21.122 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:14:21.122 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:14:22.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:21 trial046 ceph-mon[38575]: from='client.15387 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:14:22.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:21 trial046 ceph-mon[38575]: pgmap v410: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 13 GiB data, 42 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 6.43k op/s 2026-02-23T13:14:22.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:21 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4261684133' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_3", "var": "pg_num", "val": "86"} : dispatch 2026-02-23T13:14:22.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:21 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/490519100' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:14:23.165 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:14:23.309 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:23.751 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:14:23.751 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:14:23.751 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:14:23.752 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:23.676+0000 7fdd2e70b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:23.752 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:23.676+0000 7fdd2e70b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:23.752 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:14:23.752 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:14:23.752 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:14:23.753 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:14:23.753 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:14:23.934 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:23 trial046 ceph-mon[38575]: pgmap v411: 17 pgs: 17 active+clean; 10 GiB data, 35 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 9.72k op/s 2026-02-23T13:14:23.934 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:23 trial046 ceph-mon[38575]: 5.0 scrub starts 2026-02-23T13:14:23.934 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:23 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2160033653' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:14:26.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:25 trial046 ceph-mon[38575]: 5.0 scrub ok 2026-02-23T13:14:26.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:25 trial046 ceph-mon[38575]: pgmap v412: 17 pgs: 17 active+clean; 10 GiB data, 35 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 6.54k op/s 2026-02-23T13:14:26.085 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:14:26.085 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:14:26.085 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_3 2026-02-23T13:14:26.086 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:14:26.225 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:26.290 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:14:26 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:14:26] "GET /metrics HTTP/1.1" 200 4228 "" "Prometheus/3.6.0" 2026-02-23T13:14:26.293 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:14:26.350 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:26.348+0000 7f3d7dc45640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:26.350 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:26.348+0000 7f3d7dc45640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:26.438 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:26.495 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:14:26.495 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:14:26.541 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":412,"stamp":"2026-02-23T13:14:24.682732+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":10897261112,"num_objects":166273,"num_object_clones":0,"num_object_copies":498819,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":166273,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":1045324,"num_write_kb":38768807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":36646104,"kb_used_data":33047880,"kb_used_omap":67,"kb_used_meta":3597948,"kb_avail":2899366696,"statfs":{"total":3006477107200,"available":2968951496704,"internally_reserved":0,"allocated":33841029120,"data_stored":33839134568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":68653,"internal_metadata":3684299731},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5147328512,"num_objects":-78542,"num_object_clones":0,"num_object_copies":-235626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-78542,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78542,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001659"},"pg_stats":[{"pgid":"5.f","version":"94'65748","reported_seq":66164,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:21.678259+0000","last_change":"2026-02-23T13:13:23.096196+0000","last_active":"2026-02-23T13:14:21.678259+0000","last_peered":"2026-02-23T13:14:21.678259+0000","last_clean":"2026-02-23T13:14:21.678259+0000","last_became_active":"2026-02-23T13:11:54.595945+0000","last_became_peered":"2026-02-23T13:11:54.595945+0000","last_unstale":"2026-02-23T13:14:21.678259+0000","last_undegraded":"2026-02-23T13:14:21.678259+0000","last_fullsized":"2026-02-23T13:14:21.678259+0000","mapping_epoch":78,"log_start":"94'65745","ondisk_log_start":"94'65745","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'37044","last_scrub_stamp":"2026-02-23T13:13:23.096162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:23.096162+0000","objects_scrubbed":36289,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:30.719300+0000","scrub_duration":3945,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":688783360,"num_objects":10510,"num_object_clones":0,"num_object_copies":31530,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10510,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65748,"num_write_kb":2440256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"94'65775","reported_seq":66167,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:21.671870+0000","last_change":"2026-02-23T13:13:16.070635+0000","last_active":"2026-02-23T13:14:21.671870+0000","last_peered":"2026-02-23T13:14:21.671870+0000","last_clean":"2026-02-23T13:14:21.671870+0000","last_became_active":"2026-02-23T13:11:54.599064+0000","last_became_peered":"2026-02-23T13:11:54.599064+0000","last_unstale":"2026-02-23T13:14:21.671870+0000","last_undegraded":"2026-02-23T13:14:21.671870+0000","last_fullsized":"2026-02-23T13:14:21.671870+0000","mapping_epoch":78,"log_start":"94'65772","ondisk_log_start":"94'65772","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'34507","last_scrub_stamp":"2026-02-23T13:13:16.070555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:16.070555+0000","objects_scrubbed":33959,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:37.180440+0000","scrub_duration":3680,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":690159616,"num_objects":10531,"num_object_clones":0,"num_object_copies":31593,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10531,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65775,"num_write_kb":2441792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"94'65890","reported_seq":66290,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:21.695294+0000","last_change":"2026-02-23T13:13:35.762276+0000","last_active":"2026-02-23T13:14:21.695294+0000","last_peered":"2026-02-23T13:14:21.695294+0000","last_clean":"2026-02-23T13:14:21.695294+0000","last_became_active":"2026-02-23T13:11:54.595773+0000","last_became_peered":"2026-02-23T13:11:54.595773+0000","last_unstale":"2026-02-23T13:14:21.695294+0000","last_undegraded":"2026-02-23T13:14:21.695294+0000","last_fullsized":"2026-02-23T13:14:21.695294+0000","mapping_epoch":78,"log_start":"94'65887","ondisk_log_start":"94'65887","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'42527","last_scrub_stamp":"2026-02-23T13:13:35.762219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:35.762219+0000","objects_scrubbed":34717,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:36.846836+0000","scrub_duration":4038,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":685047832,"num_objects":10454,"num_object_clones":0,"num_object_copies":31362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10454,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":65890,"num_write_kb":2442945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"94'64730","reported_seq":65120,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:21.812849+0000","last_change":"2026-02-23T13:13:17.030615+0000","last_active":"2026-02-23T13:14:21.812849+0000","last_peered":"2026-02-23T13:14:21.812849+0000","last_clean":"2026-02-23T13:14:21.812849+0000","last_became_active":"2026-02-23T13:11:54.595560+0000","last_became_peered":"2026-02-23T13:11:54.595560+0000","last_unstale":"2026-02-23T13:14:21.812849+0000","last_undegraded":"2026-02-23T13:14:21.812849+0000","last_fullsized":"2026-02-23T13:14:21.812849+0000","mapping_epoch":78,"log_start":"94'64727","ondisk_log_start":"94'64727","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34247","last_scrub_stamp":"2026-02-23T13:13:17.030566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:17.030566+0000","objects_scrubbed":33782,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:44.233824+0000","scrub_duration":2702,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672268288,"num_objects":10258,"num_object_clones":0,"num_object_copies":30774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10258,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64730,"num_write_kb":2399616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"94'65152","reported_seq":65655,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:21.696956+0000","last_change":"2026-02-23T13:14:17.419169+0000","last_active":"2026-02-23T13:14:21.696956+0000","last_peered":"2026-02-23T13:14:21.696956+0000","last_clean":"2026-02-23T13:14:21.696956+0000","last_became_active":"2026-02-23T13:11:54.596133+0000","last_became_peered":"2026-02-23T13:11:54.596133+0000","last_unstale":"2026-02-23T13:14:21.696956+0000","last_undegraded":"2026-02-23T13:14:21.696956+0000","last_fullsized":"2026-02-23T13:14:21.696956+0000","mapping_epoch":78,"log_start":"94'65149","ondisk_log_start":"94'65149","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'62966","last_scrub_stamp":"2026-02-23T13:14:17.419090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:14:17.419090+0000","objects_scrubbed":12857,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:28.592731+0000","scrub_duration":1703,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":676724736,"num_objects":10326,"num_object_clones":0,"num_object_copies":30978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10326,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65152,"num_write_kb":2415296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"94'65047","reported_seq":65440,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:21.693583+0000","last_change":"2026-02-23T13:13:18.263885+0000","last_active":"2026-02-23T13:14:21.693583+0000","last_peered":"2026-02-23T13:14:21.693583+0000","last_clean":"2026-02-23T13:14:21.693583+0000","last_became_active":"2026-02-23T13:11:54.595080+0000","last_became_peered":"2026-02-23T13:11:54.595080+0000","last_unstale":"2026-02-23T13:14:21.693583+0000","last_undegraded":"2026-02-23T13:14:21.693583+0000","last_fullsized":"2026-02-23T13:14:21.693583+0000","mapping_epoch":78,"log_start":"94'65044","ondisk_log_start":"94'65044","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34829","last_scrub_stamp":"2026-02-23T13:13:18.263833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:18.263833+0000","objects_scrubbed":34171,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:35.520181+0000","scrub_duration":3597,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":676003840,"num_objects":10315,"num_object_clones":0,"num_object_copies":30945,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10315,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65047,"num_write_kb":2411584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"94'65188","reported_seq":65537,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:21.672550+0000","last_change":"2026-02-23T13:13:04.939376+0000","last_active":"2026-02-23T13:14:21.672550+0000","last_peered":"2026-02-23T13:14:21.672550+0000","last_clean":"2026-02-23T13:14:21.672550+0000","last_became_active":"2026-02-23T13:11:54.598325+0000","last_became_peered":"2026-02-23T13:11:54.598325+0000","last_unstale":"2026-02-23T13:14:21.672550+0000","last_undegraded":"2026-02-23T13:14:21.672550+0000","last_fullsized":"2026-02-23T13:14:21.672550+0000","mapping_epoch":78,"log_start":"94'65185","ondisk_log_start":"94'65185","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'30360","last_scrub_stamp":"2026-02-23T13:13:04.939307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:04.939307+0000","objects_scrubbed":29843,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:25.467510+0000","scrub_duration":2554,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":676200448,"num_objects":10318,"num_object_clones":0,"num_object_copies":30954,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10318,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65188,"num_write_kb":2416192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"94'64793","reported_seq":65152,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:21.696909+0000","last_change":"2026-02-23T13:13:08.083112+0000","last_active":"2026-02-23T13:14:21.696909+0000","last_peered":"2026-02-23T13:14:21.696909+0000","last_clean":"2026-02-23T13:14:21.696909+0000","last_became_active":"2026-02-23T13:11:54.595110+0000","last_became_peered":"2026-02-23T13:11:54.595110+0000","last_unstale":"2026-02-23T13:14:21.696909+0000","last_undegraded":"2026-02-23T13:14:21.696909+0000","last_fullsized":"2026-02-23T13:14:21.696909+0000","mapping_epoch":78,"log_start":"94'64790","ondisk_log_start":"94'64790","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31220","last_scrub_stamp":"2026-02-23T13:13:08.083065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:08.083065+0000","objects_scrubbed":30674,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:23.606645+0000","scrub_duration":3240,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":691208192,"num_objects":10547,"num_object_clones":0,"num_object_copies":31641,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10547,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64793,"num_write_kb":2410880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"94'65851","reported_seq":66261,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:21.671135+0000","last_change":"2026-02-23T13:13:21.209650+0000","last_active":"2026-02-23T13:14:21.671135+0000","last_peered":"2026-02-23T13:14:21.671135+0000","last_clean":"2026-02-23T13:14:21.671135+0000","last_became_active":"2026-02-23T13:11:54.599155+0000","last_became_peered":"2026-02-23T13:11:54.599155+0000","last_unstale":"2026-02-23T13:14:21.671135+0000","last_undegraded":"2026-02-23T13:14:21.671135+0000","last_fullsized":"2026-02-23T13:14:21.671135+0000","mapping_epoch":78,"log_start":"94'65848","ondisk_log_start":"94'65848","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'36425","last_scrub_stamp":"2026-02-23T13:13:21.209611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:21.209611+0000","objects_scrubbed":35661,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:41.420198+0000","scrub_duration":3833,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":680460288,"num_objects":10383,"num_object_clones":0,"num_object_copies":31149,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10383,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65851,"num_write_kb":2439488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"94'65235","reported_seq":65661,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:21.811522+0000","last_change":"2026-02-23T13:13:26.394617+0000","last_active":"2026-02-23T13:14:21.811522+0000","last_peered":"2026-02-23T13:14:21.811522+0000","last_clean":"2026-02-23T13:14:21.811522+0000","last_became_active":"2026-02-23T13:11:54.595645+0000","last_became_peered":"2026-02-23T13:11:54.595645+0000","last_unstale":"2026-02-23T13:14:21.811522+0000","last_undegraded":"2026-02-23T13:14:21.811522+0000","last_fullsized":"2026-02-23T13:14:21.811522+0000","mapping_epoch":78,"log_start":"94'65232","ondisk_log_start":"94'65232","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'37974","last_scrub_stamp":"2026-02-23T13:13:26.394522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:26.394522+0000","objects_scrubbed":37376,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:55.787953+0000","scrub_duration":3046,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668008448,"num_objects":10193,"num_object_clones":0,"num_object_copies":30579,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10193,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65235,"num_write_kb":2413696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"94'65240","reported_seq":65665,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:21.691752+0000","last_change":"2026-02-23T13:13:28.610333+0000","last_active":"2026-02-23T13:14:21.691752+0000","last_peered":"2026-02-23T13:14:21.691752+0000","last_clean":"2026-02-23T13:14:21.691752+0000","last_became_active":"2026-02-23T13:11:54.595144+0000","last_became_peered":"2026-02-23T13:11:54.595144+0000","last_unstale":"2026-02-23T13:14:21.691752+0000","last_undegraded":"2026-02-23T13:14:21.691752+0000","last_fullsized":"2026-02-23T13:14:21.691752+0000","mapping_epoch":78,"log_start":"94'65237","ondisk_log_start":"94'65237","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'38921","last_scrub_stamp":"2026-02-23T13:13:28.610251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:28.610251+0000","objects_scrubbed":37355,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:29.459459+0000","scrub_duration":4072,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":680394752,"num_objects":10382,"num_object_clones":0,"num_object_copies":31146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10382,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65240,"num_write_kb":2419904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"94'65836","reported_seq":66262,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:21.695091+0000","last_change":"2026-02-23T13:13:30.117925+0000","last_active":"2026-02-23T13:14:21.695091+0000","last_peered":"2026-02-23T13:14:21.695091+0000","last_clean":"2026-02-23T13:14:21.695091+0000","last_became_active":"2026-02-23T13:11:54.595996+0000","last_became_peered":"2026-02-23T13:11:54.595996+0000","last_unstale":"2026-02-23T13:14:21.695091+0000","last_undegraded":"2026-02-23T13:14:21.695091+0000","last_fullsized":"2026-02-23T13:14:21.695091+0000","mapping_epoch":78,"log_start":"94'65833","ondisk_log_start":"94'65833","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'39783","last_scrub_stamp":"2026-02-23T13:13:30.117805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:30.117805+0000","objects_scrubbed":37328,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:56.078765+0000","scrub_duration":4535,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":681443328,"num_objects":10398,"num_object_clones":0,"num_object_copies":31194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10398,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65836,"num_write_kb":2439488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"94'65291","reported_seq":65687,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:21.672525+0000","last_change":"2026-02-23T13:13:18.223410+0000","last_active":"2026-02-23T13:14:21.672525+0000","last_peered":"2026-02-23T13:14:21.672525+0000","last_clean":"2026-02-23T13:14:21.672525+0000","last_became_active":"2026-02-23T13:11:54.598958+0000","last_became_peered":"2026-02-23T13:11:54.598958+0000","last_unstale":"2026-02-23T13:14:21.672525+0000","last_undegraded":"2026-02-23T13:14:21.672525+0000","last_fullsized":"2026-02-23T13:14:21.672525+0000","mapping_epoch":78,"log_start":"94'65288","ondisk_log_start":"94'65288","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34997","last_scrub_stamp":"2026-02-23T13:13:18.223228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:18.223228+0000","objects_scrubbed":34269,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:30.400168+0000","scrub_duration":3831,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":681115648,"num_objects":10393,"num_object_clones":0,"num_object_copies":31179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10393,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65291,"num_write_kb":2421888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"94'65184","reported_seq":65672,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:21.671703+0000","last_change":"2026-02-23T13:14:19.935545+0000","last_active":"2026-02-23T13:14:21.671703+0000","last_peered":"2026-02-23T13:14:21.671703+0000","last_clean":"2026-02-23T13:14:21.671703+0000","last_became_active":"2026-02-23T13:11:54.598751+0000","last_became_peered":"2026-02-23T13:11:54.598751+0000","last_unstale":"2026-02-23T13:14:21.671703+0000","last_undegraded":"2026-02-23T13:14:21.671703+0000","last_fullsized":"2026-02-23T13:14:21.671703+0000","mapping_epoch":78,"log_start":"94'65181","ondisk_log_start":"94'65181","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'64263","last_scrub_stamp":"2026-02-23T13:14:19.935472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:14:19.935472+0000","objects_scrubbed":11481,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:40.893851+0000","scrub_duration":1206,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":675545088,"num_objects":10308,"num_object_clones":0,"num_object_copies":30924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10308,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65184,"num_write_kb":2415744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"94'65071","reported_seq":65402,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:21.694714+0000","last_change":"2026-02-23T13:13:00.668240+0000","last_active":"2026-02-23T13:14:21.694714+0000","last_peered":"2026-02-23T13:14:21.694714+0000","last_clean":"2026-02-23T13:14:21.694714+0000","last_became_active":"2026-02-23T13:11:54.595840+0000","last_became_peered":"2026-02-23T13:11:54.595840+0000","last_unstale":"2026-02-23T13:14:21.694714+0000","last_undegraded":"2026-02-23T13:14:21.694714+0000","last_fullsized":"2026-02-23T13:14:21.694714+0000","mapping_epoch":78,"log_start":"94'65068","ondisk_log_start":"94'65068","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'28514","last_scrub_stamp":"2026-02-23T13:13:00.668153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:00.668153+0000","objects_scrubbed":27959,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"queued for scrub","scrub_duration":2841,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":686227456,"num_objects":10471,"num_object_clones":0,"num_object_copies":31413,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65071,"num_write_kb":2417344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"94'65158","reported_seq":65539,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:21.679474+0000","last_change":"2026-02-23T13:13:13.604684+0000","last_active":"2026-02-23T13:14:21.679474+0000","last_peered":"2026-02-23T13:14:21.679474+0000","last_clean":"2026-02-23T13:14:21.679474+0000","last_became_active":"2026-02-23T13:11:54.595287+0000","last_became_peered":"2026-02-23T13:11:54.595287+0000","last_unstale":"2026-02-23T13:14:21.679474+0000","last_undegraded":"2026-02-23T13:14:21.679474+0000","last_fullsized":"2026-02-23T13:14:21.679474+0000","mapping_epoch":78,"log_start":"94'65155","ondisk_log_start":"94'65155","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'33325","last_scrub_stamp":"2026-02-23T13:13:13.604647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:13.604647+0000","objects_scrubbed":32944,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:25.477441+0000","scrub_duration":2412,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":687079424,"num_objects":10484,"num_object_clones":0,"num_object_copies":31452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10484,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65158,"num_write_kb":2420544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":393,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:11.656044+0000","last_change":"2026-02-23T13:14:11.656044+0000","last_active":"2026-02-23T13:14:11.656044+0000","last_peered":"2026-02-23T13:14:11.656044+0000","last_clean":"2026-02-23T13:14:11.656044+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:14:11.656044+0000","last_undegraded":"2026-02-23T13:14:11.656044+0000","last_fullsized":"2026-02-23T13:14:11.656044+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:14:11.656003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:14:11.656003+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:24.978553+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":10896670744,"num_objects":166271,"num_object_clones":0,"num_object_copies":498813,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":166271,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1045189,"num_write_kb":38766657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32665645056,"data_stored":32665632840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":186,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1745,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247947,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":10938600,"kb_used_data":9755412,"kb_used_omap":16,"kb_used_meta":1183087,"kb_avail":723064600,"statfs":{"total":751619276800,"available":740418150400,"internally_reserved":0,"allocated":9989541888,"data_stored":9989066344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16905,"internal_metadata":1211481591},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444174,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":8076328,"kb_used_data":7444500,"kb_used_omap":18,"kb_used_meta":631725,"kb_avail":725926872,"statfs":{"total":751619276800,"available":743349116928,"internally_reserved":0,"allocated":7623168000,"data_stored":7622692456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18929,"internal_metadata":646886927},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574992,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":7898784,"kb_used_data":6790732,"kb_used_omap":18,"kb_used_meta":1108013,"kb_avail":726104416,"statfs":{"total":751619276800,"available":743530921984,"internally_reserved":0,"allocated":6953709568,"data_stored":6953241648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18636,"internal_metadata":1134606132},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705809,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":9732392,"kb_used_data":9057236,"kb_used_omap":13,"kb_used_meta":675122,"kb_avail":724270808,"statfs":{"total":751619276800,"available":741653307392,"internally_reserved":0,"allocated":9274609664,"data_stored":9274134120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14183,"internal_metadata":691325081},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1745,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8864993280,"data_stored":8864989208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6764298240,"data_stored":6764298240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7488606208,"data_stored":7488602136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9547747328,"data_stored":9547743256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93,"internal_metadata":0}]}} 2026-02-23T13:14:26.543 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:14:26.543 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_3 pg_num 96 2026-02-23T13:14:26.559 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:26.557+0000 7f126a5e6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:26.559 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:26.557+0000 7f126a5e6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:26.560 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:14:26 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:14:26.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:14:26.573 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:14:26.574 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:14:26.585 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:14:26.586 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:14:26.597 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:14:26.598 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:14:26.610 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:14:26.611 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:14:26.686 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:26.809 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:26.807+0000 7f073fa01640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:26.810 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:26 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1446063579' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:14:26.810 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:26.807+0000 7f073fa01640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:26.942 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:14:26.980 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:14:28.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:27 trial046 ceph-mon[38575]: 5.4 scrub starts 2026-02-23T13:14:28.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:27 trial046 ceph-mon[38575]: from='client.15395 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:14:28.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:27 trial046 ceph-mon[38575]: pgmap v413: 17 pgs: 17 active+clean; 9.4 GiB data, 33 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 7.55k op/s 2026-02-23T13:14:28.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:27 trial046 ceph-mon[38575]: 5.8 scrub starts 2026-02-23T13:14:28.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:27 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4152696451' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_3", "var": "pg_num", "val": "96"} : dispatch 2026-02-23T13:14:28.652 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:14:28.795 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:28.857 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:28 trial046 ceph-mon[38575]: 5.4 scrub ok 2026-02-23T13:14:28.857 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:28 trial046 ceph-mon[38575]: 5.8 scrub ok 2026-02-23T13:14:28.920 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:28.918+0000 7fbd682dd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:28.921 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:28.918+0000 7fbd682dd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:28.936 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:14:28.936 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:14:28.951 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:14:28.951 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:14:28.962 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:14:28.963 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:14:28.974 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:14:28.975 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:14:30.038 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:29 trial046 ceph-mon[38575]: pgmap v414: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 7.8 GiB data, 28 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 8.38k op/s 2026-02-23T13:14:30.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:29 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1648269699' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:14:31.016 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:14:31.038 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:30 trial046 ceph-mon[38575]: 5.5 scrub starts 2026-02-23T13:14:31.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:30 trial046 ceph-mon[38575]: 5.9 scrub starts 2026-02-23T13:14:31.155 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:31.541 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:14:31.541 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:14:31.541 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:31.501+0000 7fdb74a4e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:31.541 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:31.501+0000 7fdb74a4e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:31.541 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:14:31.542 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:14:31.553 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:14:31.553 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:14:31.565 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:14:31.566 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:14:31.635 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:31 trial046 ceph-mon[38575]: 5.5 scrub ok 2026-02-23T13:14:31.635 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:31 trial046 ceph-mon[38575]: 5.9 scrub ok 2026-02-23T13:14:31.635 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:31 trial046 ceph-mon[38575]: pgmap v415: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 7.8 GiB data, 28 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 6.55k op/s 2026-02-23T13:14:31.636 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:31 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:14:31.636 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:31 trial046 ceph-mon[38575]: 5.2 scrub starts 2026-02-23T13:14:31.636 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:31 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1530974218' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:14:31.981 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:14:31.981 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:14:31.981 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:14:31.981 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:14:32.134 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:32.418 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:32.416+0000 7ff54e1b9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:32.418 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:32.416+0000 7ff54e1b9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:32.562 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:14:32.562 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:14:32.605 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":415,"stamp":"2026-02-23T13:14:30.683542+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8333820472,"num_objects":127158,"num_object_clones":0,"num_object_copies":381474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127158,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":1084439,"num_write_kb":38768807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":29187416,"kb_used_data":25372680,"kb_used_omap":67,"kb_used_meta":3814524,"kb_avail":2906825384,"statfs":{"total":3006477107200,"available":2976589193216,"internally_reserved":0,"allocated":25981624320,"data_stored":25979729768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":68746,"internal_metadata":3906073462},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5153816576,"num_objects":-78641,"num_object_clones":0,"num_object_copies":-235923,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-78641,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78641,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001655"},"pg_stats":[{"pgid":"5.f","version":"94'68219","reported_seq":68635,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:26.673144+0000","last_change":"2026-02-23T13:13:23.096196+0000","last_active":"2026-02-23T13:14:26.673144+0000","last_peered":"2026-02-23T13:14:26.673144+0000","last_clean":"2026-02-23T13:14:26.673144+0000","last_became_active":"2026-02-23T13:11:54.595945+0000","last_became_peered":"2026-02-23T13:11:54.595945+0000","last_unstale":"2026-02-23T13:14:26.673144+0000","last_undegraded":"2026-02-23T13:14:26.673144+0000","last_fullsized":"2026-02-23T13:14:26.673144+0000","mapping_epoch":78,"log_start":"94'68216","ondisk_log_start":"94'68216","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'37044","last_scrub_stamp":"2026-02-23T13:13:23.096162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:23.096162+0000","objects_scrubbed":36289,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:30.719300+0000","scrub_duration":3945,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526843904,"num_objects":8039,"num_object_clones":0,"num_object_copies":24117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8039,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68219,"num_write_kb":2440256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"94'68315","reported_seq":68707,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:26.667821+0000","last_change":"2026-02-23T13:13:16.070635+0000","last_active":"2026-02-23T13:14:26.667821+0000","last_peered":"2026-02-23T13:14:26.667821+0000","last_clean":"2026-02-23T13:14:26.667821+0000","last_became_active":"2026-02-23T13:11:54.599064+0000","last_became_peered":"2026-02-23T13:11:54.599064+0000","last_unstale":"2026-02-23T13:14:26.667821+0000","last_undegraded":"2026-02-23T13:14:26.667821+0000","last_fullsized":"2026-02-23T13:14:26.667821+0000","mapping_epoch":78,"log_start":"94'68312","ondisk_log_start":"94'68312","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'34507","last_scrub_stamp":"2026-02-23T13:13:16.070555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:16.070555+0000","objects_scrubbed":33959,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:37.180440+0000","scrub_duration":3680,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":523698176,"num_objects":7991,"num_object_clones":0,"num_object_copies":23973,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7991,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68315,"num_write_kb":2441792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"94'68420","reported_seq":68820,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:26.698282+0000","last_change":"2026-02-23T13:13:35.762276+0000","last_active":"2026-02-23T13:14:26.698282+0000","last_peered":"2026-02-23T13:14:26.698282+0000","last_clean":"2026-02-23T13:14:26.698282+0000","last_became_active":"2026-02-23T13:11:54.595773+0000","last_became_peered":"2026-02-23T13:11:54.595773+0000","last_unstale":"2026-02-23T13:14:26.698282+0000","last_undegraded":"2026-02-23T13:14:26.698282+0000","last_fullsized":"2026-02-23T13:14:26.698282+0000","mapping_epoch":78,"log_start":"94'68417","ondisk_log_start":"94'68417","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'42527","last_scrub_stamp":"2026-02-23T13:13:35.762219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:35.762219+0000","objects_scrubbed":34717,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:36.846836+0000","scrub_duration":4038,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":519241752,"num_objects":7924,"num_object_clones":0,"num_object_copies":23772,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7924,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":68420,"num_write_kb":2442945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"94'67201","reported_seq":67591,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:26.811660+0000","last_change":"2026-02-23T13:13:17.030615+0000","last_active":"2026-02-23T13:14:26.811660+0000","last_peered":"2026-02-23T13:14:26.811660+0000","last_clean":"2026-02-23T13:14:26.811660+0000","last_became_active":"2026-02-23T13:11:54.595560+0000","last_became_peered":"2026-02-23T13:11:54.595560+0000","last_unstale":"2026-02-23T13:14:26.811660+0000","last_undegraded":"2026-02-23T13:14:26.811660+0000","last_fullsized":"2026-02-23T13:14:26.811660+0000","mapping_epoch":78,"log_start":"94'67198","ondisk_log_start":"94'67198","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34247","last_scrub_stamp":"2026-02-23T13:13:17.030566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:17.030566+0000","objects_scrubbed":33782,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:44.233824+0000","scrub_duration":2702,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":510328832,"num_objects":7787,"num_object_clones":0,"num_object_copies":23361,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7787,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67201,"num_write_kb":2399616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"94'67623","reported_seq":68126,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:26.696256+0000","last_change":"2026-02-23T13:14:17.419169+0000","last_active":"2026-02-23T13:14:26.696256+0000","last_peered":"2026-02-23T13:14:26.696256+0000","last_clean":"2026-02-23T13:14:26.696256+0000","last_became_active":"2026-02-23T13:11:54.596133+0000","last_became_peered":"2026-02-23T13:11:54.596133+0000","last_unstale":"2026-02-23T13:14:26.696256+0000","last_undegraded":"2026-02-23T13:14:26.696256+0000","last_fullsized":"2026-02-23T13:14:26.696256+0000","mapping_epoch":78,"log_start":"94'67620","ondisk_log_start":"94'67620","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'62966","last_scrub_stamp":"2026-02-23T13:14:17.419090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:14:17.419090+0000","objects_scrubbed":12857,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:28.592731+0000","scrub_duration":1703,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":514785280,"num_objects":7855,"num_object_clones":0,"num_object_copies":23565,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7855,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67623,"num_write_kb":2415296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"94'67476","reported_seq":67869,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:26.693194+0000","last_change":"2026-02-23T13:13:18.263885+0000","last_active":"2026-02-23T13:14:26.693194+0000","last_peered":"2026-02-23T13:14:26.693194+0000","last_clean":"2026-02-23T13:14:26.693194+0000","last_became_active":"2026-02-23T13:11:54.595080+0000","last_became_peered":"2026-02-23T13:11:54.595080+0000","last_unstale":"2026-02-23T13:14:26.693194+0000","last_undegraded":"2026-02-23T13:14:26.693194+0000","last_fullsized":"2026-02-23T13:14:26.693194+0000","mapping_epoch":78,"log_start":"94'67473","ondisk_log_start":"94'67473","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34829","last_scrub_stamp":"2026-02-23T13:13:18.263833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:18.263833+0000","objects_scrubbed":34171,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:35.520181+0000","scrub_duration":3597,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516816896,"num_objects":7886,"num_object_clones":0,"num_object_copies":23658,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7886,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67476,"num_write_kb":2411584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"94'67520","reported_seq":67870,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:26.673038+0000","last_change":"2026-02-23T13:13:04.939376+0000","last_active":"2026-02-23T13:14:26.673038+0000","last_peered":"2026-02-23T13:14:26.673038+0000","last_clean":"2026-02-23T13:14:26.673038+0000","last_became_active":"2026-02-23T13:11:54.598325+0000","last_became_peered":"2026-02-23T13:11:54.598325+0000","last_unstale":"2026-02-23T13:14:26.673038+0000","last_undegraded":"2026-02-23T13:14:26.673038+0000","last_fullsized":"2026-02-23T13:14:26.673038+0000","mapping_epoch":78,"log_start":"94'67517","ondisk_log_start":"94'67517","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'30360","last_scrub_stamp":"2026-02-23T13:13:04.939307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:04.939307+0000","objects_scrubbed":29843,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"queued for scrub","scrub_duration":2554,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":523370496,"num_objects":7986,"num_object_clones":0,"num_object_copies":23958,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7986,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67520,"num_write_kb":2416192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"94'67249","reported_seq":67607,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:26.699773+0000","last_change":"2026-02-23T13:13:08.083112+0000","last_active":"2026-02-23T13:14:26.699773+0000","last_peered":"2026-02-23T13:14:26.699773+0000","last_clean":"2026-02-23T13:14:26.699773+0000","last_became_active":"2026-02-23T13:11:54.595110+0000","last_became_peered":"2026-02-23T13:11:54.595110+0000","last_unstale":"2026-02-23T13:14:26.699773+0000","last_undegraded":"2026-02-23T13:14:26.699773+0000","last_fullsized":"2026-02-23T13:14:26.699773+0000","mapping_epoch":78,"log_start":"94'67246","ondisk_log_start":"94'67246","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'31220","last_scrub_stamp":"2026-02-23T13:13:08.083065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:08.083065+0000","objects_scrubbed":30674,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"queued for scrub","scrub_duration":3240,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530251776,"num_objects":8091,"num_object_clones":0,"num_object_copies":24273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8091,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67249,"num_write_kb":2410880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"94'68244","reported_seq":68654,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:26.669285+0000","last_change":"2026-02-23T13:13:21.209650+0000","last_active":"2026-02-23T13:14:26.669285+0000","last_peered":"2026-02-23T13:14:26.669285+0000","last_clean":"2026-02-23T13:14:26.669285+0000","last_became_active":"2026-02-23T13:11:54.599155+0000","last_became_peered":"2026-02-23T13:11:54.599155+0000","last_unstale":"2026-02-23T13:14:26.669285+0000","last_undegraded":"2026-02-23T13:14:26.669285+0000","last_fullsized":"2026-02-23T13:14:26.669285+0000","mapping_epoch":78,"log_start":"94'68241","ondisk_log_start":"94'68241","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'36425","last_scrub_stamp":"2026-02-23T13:13:21.209611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:21.209611+0000","objects_scrubbed":35661,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:41.420198+0000","scrub_duration":3833,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":523632640,"num_objects":7990,"num_object_clones":0,"num_object_copies":23970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7990,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68244,"num_write_kb":2439488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"94'67692","reported_seq":68118,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:26.811224+0000","last_change":"2026-02-23T13:13:26.394617+0000","last_active":"2026-02-23T13:14:26.811224+0000","last_peered":"2026-02-23T13:14:26.811224+0000","last_clean":"2026-02-23T13:14:26.811224+0000","last_became_active":"2026-02-23T13:11:54.595645+0000","last_became_peered":"2026-02-23T13:11:54.595645+0000","last_unstale":"2026-02-23T13:14:26.811224+0000","last_undegraded":"2026-02-23T13:14:26.811224+0000","last_fullsized":"2026-02-23T13:14:26.811224+0000","mapping_epoch":78,"log_start":"94'67689","ondisk_log_start":"94'67689","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'37974","last_scrub_stamp":"2026-02-23T13:13:26.394522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:26.394522+0000","objects_scrubbed":37376,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:55.787953+0000","scrub_duration":3046,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":506986496,"num_objects":7736,"num_object_clones":0,"num_object_copies":23208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7736,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67692,"num_write_kb":2413696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"94'67702","reported_seq":68127,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:26.699685+0000","last_change":"2026-02-23T13:13:28.610333+0000","last_active":"2026-02-23T13:14:26.699685+0000","last_peered":"2026-02-23T13:14:26.699685+0000","last_clean":"2026-02-23T13:14:26.699685+0000","last_became_active":"2026-02-23T13:11:54.595144+0000","last_became_peered":"2026-02-23T13:11:54.595144+0000","last_unstale":"2026-02-23T13:14:26.699685+0000","last_undegraded":"2026-02-23T13:14:26.699685+0000","last_fullsized":"2026-02-23T13:14:26.699685+0000","mapping_epoch":78,"log_start":"94'67699","ondisk_log_start":"94'67699","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'38921","last_scrub_stamp":"2026-02-23T13:13:28.610251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:28.610251+0000","objects_scrubbed":37355,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:29.459459+0000","scrub_duration":4072,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":519045120,"num_objects":7920,"num_object_clones":0,"num_object_copies":23760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7920,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67702,"num_write_kb":2419904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"94'68293","reported_seq":68719,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:26.696577+0000","last_change":"2026-02-23T13:13:30.117925+0000","last_active":"2026-02-23T13:14:26.696577+0000","last_peered":"2026-02-23T13:14:26.696577+0000","last_clean":"2026-02-23T13:14:26.696577+0000","last_became_active":"2026-02-23T13:11:54.595996+0000","last_became_peered":"2026-02-23T13:11:54.595996+0000","last_unstale":"2026-02-23T13:14:26.696577+0000","last_undegraded":"2026-02-23T13:14:26.696577+0000","last_fullsized":"2026-02-23T13:14:26.696577+0000","mapping_epoch":78,"log_start":"94'68290","ondisk_log_start":"94'68290","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'39783","last_scrub_stamp":"2026-02-23T13:13:30.117805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:30.117805+0000","objects_scrubbed":37328,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:56.078765+0000","scrub_duration":4535,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":520421376,"num_objects":7941,"num_object_clones":0,"num_object_copies":23823,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7941,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68293,"num_write_kb":2439488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"94'67718","reported_seq":68114,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:26.672730+0000","last_change":"2026-02-23T13:13:18.223410+0000","last_active":"2026-02-23T13:14:26.672730+0000","last_peered":"2026-02-23T13:14:26.672730+0000","last_clean":"2026-02-23T13:14:26.672730+0000","last_became_active":"2026-02-23T13:11:54.598958+0000","last_became_peered":"2026-02-23T13:11:54.598958+0000","last_unstale":"2026-02-23T13:14:26.672730+0000","last_undegraded":"2026-02-23T13:14:26.672730+0000","last_fullsized":"2026-02-23T13:14:26.672730+0000","mapping_epoch":78,"log_start":"94'67715","ondisk_log_start":"94'67715","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34997","last_scrub_stamp":"2026-02-23T13:13:18.223228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:18.223228+0000","objects_scrubbed":34269,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:30.400168+0000","scrub_duration":3831,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":522059776,"num_objects":7966,"num_object_clones":0,"num_object_copies":23898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7966,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67718,"num_write_kb":2421888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"94'67553","reported_seq":68041,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:26.664618+0000","last_change":"2026-02-23T13:14:19.935545+0000","last_active":"2026-02-23T13:14:26.664618+0000","last_peered":"2026-02-23T13:14:26.664618+0000","last_clean":"2026-02-23T13:14:26.664618+0000","last_became_active":"2026-02-23T13:11:54.598751+0000","last_became_peered":"2026-02-23T13:11:54.598751+0000","last_unstale":"2026-02-23T13:14:26.664618+0000","last_undegraded":"2026-02-23T13:14:26.664618+0000","last_fullsized":"2026-02-23T13:14:26.664618+0000","mapping_epoch":78,"log_start":"94'67550","ondisk_log_start":"94'67550","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'64263","last_scrub_stamp":"2026-02-23T13:14:19.935472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:14:19.935472+0000","objects_scrubbed":11481,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:40.893851+0000","scrub_duration":1206,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":520290304,"num_objects":7939,"num_object_clones":0,"num_object_copies":23817,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7939,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67553,"num_write_kb":2415744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"94'67521","reported_seq":67958,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:26.694947+0000","last_change":"2026-02-23T13:14:24.272234+0000","last_active":"2026-02-23T13:14:26.694947+0000","last_peered":"2026-02-23T13:14:26.694947+0000","last_clean":"2026-02-23T13:14:26.694947+0000","last_became_active":"2026-02-23T13:11:54.595840+0000","last_became_peered":"2026-02-23T13:11:54.595840+0000","last_unstale":"2026-02-23T13:14:26.694947+0000","last_undegraded":"2026-02-23T13:14:26.694947+0000","last_fullsized":"2026-02-23T13:14:26.694947+0000","mapping_epoch":78,"log_start":"94'67518","ondisk_log_start":"94'67518","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'66264","last_scrub_stamp":"2026-02-23T13:14:24.272175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:14:24.272175+0000","objects_scrubbed":9559,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:48.772118+0000","scrub_duration":1443,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525664256,"num_objects":8021,"num_object_clones":0,"num_object_copies":24063,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8021,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67521,"num_write_kb":2417344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"94'67558","reported_seq":67988,"reported_epoch":94,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:14:26.683519+0000","last_change":"2026-02-23T13:14:26.306692+0000","last_active":"2026-02-23T13:14:26.683519+0000","last_peered":"2026-02-23T13:14:26.683519+0000","last_clean":"2026-02-23T13:14:26.683519+0000","last_became_active":"2026-02-23T13:11:54.595287+0000","last_became_peered":"2026-02-23T13:11:54.595287+0000","last_unstale":"2026-02-23T13:14:26.683519+0000","last_undegraded":"2026-02-23T13:14:26.683519+0000","last_fullsized":"2026-02-23T13:14:26.683519+0000","mapping_epoch":78,"log_start":"94'67555","ondisk_log_start":"94'67555","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'33325","last_scrub_stamp":"2026-02-23T13:13:13.604647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:13.604647+0000","objects_scrubbed":4549,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"scrubbing for 1s","scrub_duration":2412,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":529793024,"num_objects":8084,"num_object_clones":0,"num_object_copies":24252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8084,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67558,"num_write_kb":2420544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":393,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:11.656044+0000","last_change":"2026-02-23T13:14:11.656044+0000","last_active":"2026-02-23T13:14:11.656044+0000","last_peered":"2026-02-23T13:14:11.656044+0000","last_clean":"2026-02-23T13:14:11.656044+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:14:11.656044+0000","last_undegraded":"2026-02-23T13:14:11.656044+0000","last_fullsized":"2026-02-23T13:14:11.656044+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:14:11.656003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:14:11.656003+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:24.978553+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":8333230104,"num_objects":127156,"num_object_clones":0,"num_object_copies":381468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127156,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1084304,"num_write_kb":38766657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24984760320,"data_stored":24984748104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":372,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1745,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247948,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":8734312,"kb_used_data":7478932,"kb_used_omap":16,"kb_used_meta":1255279,"kb_avail":725268888,"statfs":{"total":751619276800,"available":742675341312,"internally_reserved":0,"allocated":7658426368,"data_stored":7657950824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16905,"internal_metadata":1285406199},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444175,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6410792,"kb_used_data":5724884,"kb_used_omap":18,"kb_used_meta":685869,"kb_avail":727592408,"statfs":{"total":751619276800,"available":745054625792,"internally_reserved":0,"allocated":5862281216,"data_stored":5861805672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18929,"internal_metadata":702330383},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574993,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6354528,"kb_used_data":5210380,"kb_used_omap":18,"kb_used_meta":1144109,"kb_avail":727648672,"statfs":{"total":751619276800,"available":745112240128,"internally_reserved":0,"allocated":5335429120,"data_stored":5334961200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18636,"internal_metadata":1171568436},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705810,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":7687784,"kb_used_data":6958484,"kb_used_omap":13,"kb_used_meta":729266,"kb_avail":726315416,"statfs":{"total":751619276800,"available":743746985984,"internally_reserved":0,"allocated":7125487616,"data_stored":7125012072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14276,"internal_metadata":746768444},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1745,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6772690944,"data_stored":6772686872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":186,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5176885248,"data_stored":5176885248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5728702464,"data_stored":5728698392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7306481664,"data_stored":7306477592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93,"internal_metadata":0}]}} 2026-02-23T13:14:32.606 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:14:32.606 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 281 2026-02-23T13:14:32.743 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:32.815 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:32 trial046 ceph-mon[38575]: 5.2 scrub ok 2026-02-23T13:14:32.872 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:32.870+0000 7fe6dab33640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:32.873 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:32.871+0000 7fe6dab33640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:33.008 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:14:33.482 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:14:33.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:33 trial046 ceph-mon[38575]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:14:33.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:33 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:14:33.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:33 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:14:33.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:33 trial046 ceph-mon[38575]: pgmap v416: 17 pgs: 17 active+clean; 5.4 GiB data, 21 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 9.79k op/s 2026-02-23T13:14:33.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:33 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2507285218' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "281"} : dispatch 2026-02-23T13:14:33.991 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:14:34.127 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:34.252 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:34.250+0000 7f228025a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:34.252 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:34.250+0000 7f228025a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:34.268 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:14:34.268 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:14:34.280 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:14:34.281 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:14:34.293 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:14:34.294 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:14:34.310 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:14:34.310 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:14:35.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:34 trial046 ceph-mon[38575]: 5.f scrub starts 2026-02-23T13:14:35.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:34 trial046 ceph-mon[38575]: 5.f scrub ok 2026-02-23T13:14:35.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:34 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1074081787' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:14:36.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:35 trial046 ceph-mon[38575]: pgmap v417: 17 pgs: 17 active+clean; 5.4 GiB data, 21 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 6.50k op/s 2026-02-23T13:14:36.354 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:14:36.380 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:14:36 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:14:36] "GET /metrics HTTP/1.1" 200 4225 "" "Prometheus/3.6.0" 2026-02-23T13:14:36.503 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:36.560 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:14:36 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:14:36.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:14:36.632 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:36.631+0000 7f1eaefaf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:36.632 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:36.631+0000 7f1eaefaf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:36.646 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:14:36.647 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:14:36.659 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:14:36.660 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:14:36.675 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:14:36.675 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:14:36.687 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:14:36.687 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:14:37.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:36 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2682119378' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:14:38.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:37 trial046 ceph-mon[38575]: pgmap v418: 17 pgs: 17 active+clean; 4.6 GiB data, 19 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 7.53k op/s 2026-02-23T13:14:38.484 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:14:38.484 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:14:38.484 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:14:38.484 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:14:38.627 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:38.731 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:14:38.750 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:38.749+0000 7f50dc502640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:38.750 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:38.750+0000 7f50dc502640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:38.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:38 trial046 ceph-mon[38575]: 5.a scrub starts 2026-02-23T13:14:38.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:38 trial046 ceph-mon[38575]: 5.a scrub ok 2026-02-23T13:14:38.875 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:38.898 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:14:38.899 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:14:39.096 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":419,"stamp":"2026-02-23T13:14:38.684608+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3201237560,"num_objects":48841,"num_object_clones":0,"num_object_copies":146523,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48841,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":1162756,"num_write_kb":38768807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53,"ondisk_log_size":53,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":14701016,"kb_used_data":10471112,"kb_used_omap":68,"kb_used_meta":4229627,"kb_avail":2921311784,"statfs":{"total":3006477107200,"available":2991423266816,"internally_reserved":0,"allocated":10722418688,"data_stored":10720524136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":69956,"internal_metadata":4331138748},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,2,7],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6905593856,"num_objects":-105371,"num_object_clones":0,"num_object_copies":-316113,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-105371,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105371,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001639"},"pg_stats":[{"pgid":"5.f","version":"94'73134","reported_seq":73607,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:36.681208+0000","last_change":"2026-02-23T13:14:33.812008+0000","last_active":"2026-02-23T13:14:36.681208+0000","last_peered":"2026-02-23T13:14:36.681208+0000","last_clean":"2026-02-23T13:14:36.681208+0000","last_became_active":"2026-02-23T13:11:54.595945+0000","last_became_peered":"2026-02-23T13:11:54.595945+0000","last_unstale":"2026-02-23T13:14:36.681208+0000","last_undegraded":"2026-02-23T13:14:36.681208+0000","last_fullsized":"2026-02-23T13:14:36.681208+0000","mapping_epoch":78,"log_start":"94'73131","ondisk_log_start":"94'73131","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'71559","last_scrub_stamp":"2026-02-23T13:14:33.811977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:14:33.811977+0000","objects_scrubbed":4802,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:44.436798+0000","scrub_duration":450,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204734464,"num_objects":3124,"num_object_clones":0,"num_object_copies":9372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3124,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73134,"num_write_kb":2440256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"94'73254","reported_seq":73646,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:36.673083+0000","last_change":"2026-02-23T13:13:16.070635+0000","last_active":"2026-02-23T13:14:36.673083+0000","last_peered":"2026-02-23T13:14:36.673083+0000","last_clean":"2026-02-23T13:14:36.673083+0000","last_became_active":"2026-02-23T13:11:54.599064+0000","last_became_peered":"2026-02-23T13:11:54.599064+0000","last_unstale":"2026-02-23T13:14:36.673083+0000","last_undegraded":"2026-02-23T13:14:36.673083+0000","last_fullsized":"2026-02-23T13:14:36.673083+0000","mapping_epoch":78,"log_start":"94'73249","ondisk_log_start":"94'73249","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'34507","last_scrub_stamp":"2026-02-23T13:13:16.070555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:16.070555+0000","objects_scrubbed":33959,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:37.180440+0000","scrub_duration":3680,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200015872,"num_objects":3052,"num_object_clones":0,"num_object_copies":9156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3052,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73254,"num_write_kb":2441792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"94'73354","reported_seq":73753,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:36.701569+0000","last_change":"2026-02-23T13:13:35.762276+0000","last_active":"2026-02-23T13:14:36.701569+0000","last_peered":"2026-02-23T13:14:36.701569+0000","last_clean":"2026-02-23T13:14:36.701569+0000","last_became_active":"2026-02-23T13:11:54.595773+0000","last_became_peered":"2026-02-23T13:11:54.595773+0000","last_unstale":"2026-02-23T13:14:36.701569+0000","last_undegraded":"2026-02-23T13:14:36.701569+0000","last_fullsized":"2026-02-23T13:14:36.701569+0000","mapping_epoch":78,"log_start":"94'73351","ondisk_log_start":"94'73351","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'42527","last_scrub_stamp":"2026-02-23T13:13:35.762219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:35.762219+0000","objects_scrubbed":34717,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:36.846836+0000","scrub_duration":4038,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195887128,"num_objects":2990,"num_object_clones":0,"num_object_copies":8970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2990,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":73354,"num_write_kb":2442945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"94'72065","reported_seq":72455,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:36.810818+0000","last_change":"2026-02-23T13:13:17.030615+0000","last_active":"2026-02-23T13:14:36.810818+0000","last_peered":"2026-02-23T13:14:36.810818+0000","last_clean":"2026-02-23T13:14:36.810818+0000","last_became_active":"2026-02-23T13:11:54.595560+0000","last_became_peered":"2026-02-23T13:11:54.595560+0000","last_unstale":"2026-02-23T13:14:36.810818+0000","last_undegraded":"2026-02-23T13:14:36.810818+0000","last_fullsized":"2026-02-23T13:14:36.810818+0000","mapping_epoch":78,"log_start":"94'72062","ondisk_log_start":"94'72062","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34247","last_scrub_stamp":"2026-02-23T13:13:17.030566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:17.030566+0000","objects_scrubbed":33782,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:44.233824+0000","scrub_duration":2702,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191561728,"num_objects":2923,"num_object_clones":0,"num_object_copies":8769,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2923,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72065,"num_write_kb":2399616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"94'72469","reported_seq":72972,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:36.700118+0000","last_change":"2026-02-23T13:14:17.419169+0000","last_active":"2026-02-23T13:14:36.700118+0000","last_peered":"2026-02-23T13:14:36.700118+0000","last_clean":"2026-02-23T13:14:36.700118+0000","last_became_active":"2026-02-23T13:11:54.596133+0000","last_became_peered":"2026-02-23T13:11:54.596133+0000","last_unstale":"2026-02-23T13:14:36.700118+0000","last_undegraded":"2026-02-23T13:14:36.700118+0000","last_fullsized":"2026-02-23T13:14:36.700118+0000","mapping_epoch":78,"log_start":"94'72466","ondisk_log_start":"94'72466","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'62966","last_scrub_stamp":"2026-02-23T13:14:17.419090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:14:17.419090+0000","objects_scrubbed":12857,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:28.592731+0000","scrub_duration":1703,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197197824,"num_objects":3009,"num_object_clones":0,"num_object_copies":9027,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3009,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72469,"num_write_kb":2415296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"94'72298","reported_seq":72689,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:36.700139+0000","last_change":"2026-02-23T13:13:18.263885+0000","last_active":"2026-02-23T13:14:36.700139+0000","last_peered":"2026-02-23T13:14:36.700139+0000","last_clean":"2026-02-23T13:14:36.700139+0000","last_became_active":"2026-02-23T13:11:54.595080+0000","last_became_peered":"2026-02-23T13:11:54.595080+0000","last_unstale":"2026-02-23T13:14:36.700139+0000","last_undegraded":"2026-02-23T13:14:36.700139+0000","last_fullsized":"2026-02-23T13:14:36.700139+0000","mapping_epoch":78,"log_start":"94'72295","ondisk_log_start":"94'72295","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34829","last_scrub_stamp":"2026-02-23T13:13:18.263833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:18.263833+0000","objects_scrubbed":34171,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"queued for scrub","scrub_duration":3597,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200802304,"num_objects":3064,"num_object_clones":0,"num_object_copies":9192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3064,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72298,"num_write_kb":2411584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"94'72403","reported_seq":72825,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:36.674214+0000","last_change":"2026-02-23T13:14:30.481156+0000","last_active":"2026-02-23T13:14:36.674214+0000","last_peered":"2026-02-23T13:14:36.674214+0000","last_clean":"2026-02-23T13:14:36.674214+0000","last_became_active":"2026-02-23T13:11:54.598325+0000","last_became_peered":"2026-02-23T13:11:54.598325+0000","last_unstale":"2026-02-23T13:14:36.674214+0000","last_undegraded":"2026-02-23T13:14:36.674214+0000","last_fullsized":"2026-02-23T13:14:36.674214+0000","mapping_epoch":78,"log_start":"94'72400","ondisk_log_start":"94'72400","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'69420","last_scrub_stamp":"2026-02-23T13:14:30.481107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:14:30.481107+0000","objects_scrubbed":6225,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:53.934089+0000","scrub_duration":609,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203358208,"num_objects":3103,"num_object_clones":0,"num_object_copies":9309,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72403,"num_write_kb":2416192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"94'72221","reported_seq":72666,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:36.699727+0000","last_change":"2026-02-23T13:14:27.737284+0000","last_active":"2026-02-23T13:14:36.699727+0000","last_peered":"2026-02-23T13:14:36.699727+0000","last_clean":"2026-02-23T13:14:36.699727+0000","last_became_active":"2026-02-23T13:11:54.595110+0000","last_became_peered":"2026-02-23T13:11:54.595110+0000","last_unstale":"2026-02-23T13:14:36.699727+0000","last_undegraded":"2026-02-23T13:14:36.699727+0000","last_fullsized":"2026-02-23T13:14:36.699727+0000","mapping_epoch":78,"log_start":"94'72218","ondisk_log_start":"94'72218","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'67739","last_scrub_stamp":"2026-02-23T13:14:27.737213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:14:27.737213+0000","objects_scrubbed":7828,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:32.047568+0000","scrub_duration":897,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204406784,"num_objects":3119,"num_object_clones":0,"num_object_copies":9357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3119,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72221,"num_write_kb":2410880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"94'73164","reported_seq":73574,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:36.672922+0000","last_change":"2026-02-23T13:13:21.209650+0000","last_active":"2026-02-23T13:14:36.672922+0000","last_peered":"2026-02-23T13:14:36.672922+0000","last_clean":"2026-02-23T13:14:36.672922+0000","last_became_active":"2026-02-23T13:11:54.599155+0000","last_became_peered":"2026-02-23T13:11:54.599155+0000","last_unstale":"2026-02-23T13:14:36.672922+0000","last_undegraded":"2026-02-23T13:14:36.672922+0000","last_fullsized":"2026-02-23T13:14:36.672922+0000","mapping_epoch":78,"log_start":"94'73161","ondisk_log_start":"94'73161","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'36425","last_scrub_stamp":"2026-02-23T13:13:21.209611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:21.209611+0000","objects_scrubbed":35661,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:41.420198+0000","scrub_duration":3833,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201195520,"num_objects":3070,"num_object_clones":0,"num_object_copies":9210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3070,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73164,"num_write_kb":2439488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"94'72477","reported_seq":72903,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:36.811392+0000","last_change":"2026-02-23T13:13:26.394617+0000","last_active":"2026-02-23T13:14:36.811392+0000","last_peered":"2026-02-23T13:14:36.811392+0000","last_clean":"2026-02-23T13:14:36.811392+0000","last_became_active":"2026-02-23T13:11:54.595645+0000","last_became_peered":"2026-02-23T13:11:54.595645+0000","last_unstale":"2026-02-23T13:14:36.811392+0000","last_undegraded":"2026-02-23T13:14:36.811392+0000","last_fullsized":"2026-02-23T13:14:36.811392+0000","mapping_epoch":78,"log_start":"94'72474","ondisk_log_start":"94'72474","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'37974","last_scrub_stamp":"2026-02-23T13:13:26.394522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:26.394522+0000","objects_scrubbed":37376,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:55.787953+0000","scrub_duration":3046,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":193396736,"num_objects":2951,"num_object_clones":0,"num_object_copies":8853,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2951,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72477,"num_write_kb":2413696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"94'72492","reported_seq":72987,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:36.699652+0000","last_change":"2026-02-23T13:14:30.367551+0000","last_active":"2026-02-23T13:14:36.699652+0000","last_peered":"2026-02-23T13:14:36.699652+0000","last_clean":"2026-02-23T13:14:36.699652+0000","last_became_active":"2026-02-23T13:11:54.595144+0000","last_became_peered":"2026-02-23T13:11:54.595144+0000","last_unstale":"2026-02-23T13:14:36.699652+0000","last_undegraded":"2026-02-23T13:14:36.699652+0000","last_fullsized":"2026-02-23T13:14:36.699652+0000","mapping_epoch":78,"log_start":"94'72489","ondisk_log_start":"94'72489","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'69546","last_scrub_stamp":"2026-02-23T13:14:30.367520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:14:30.367520+0000","objects_scrubbed":6210,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:53.273403+0000","scrub_duration":584,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205127680,"num_objects":3130,"num_object_clones":0,"num_object_copies":9390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3130,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72492,"num_write_kb":2419904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"94'73203","reported_seq":73628,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:36.700127+0000","last_change":"2026-02-23T13:13:30.117925+0000","last_active":"2026-02-23T13:14:36.700127+0000","last_peered":"2026-02-23T13:14:36.700127+0000","last_clean":"2026-02-23T13:14:36.700127+0000","last_became_active":"2026-02-23T13:11:54.595996+0000","last_became_peered":"2026-02-23T13:11:54.595996+0000","last_unstale":"2026-02-23T13:14:36.700127+0000","last_undegraded":"2026-02-23T13:14:36.700127+0000","last_fullsized":"2026-02-23T13:14:36.700127+0000","mapping_epoch":78,"log_start":"94'73200","ondisk_log_start":"94'73200","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'39783","last_scrub_stamp":"2026-02-23T13:13:30.117805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:30.117805+0000","objects_scrubbed":37328,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:56.078765+0000","scrub_duration":4535,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198639616,"num_objects":3031,"num_object_clones":0,"num_object_copies":9093,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3031,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73203,"num_write_kb":2439488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"94'72634","reported_seq":73096,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:36.672785+0000","last_change":"2026-02-23T13:14:31.594637+0000","last_active":"2026-02-23T13:14:36.672785+0000","last_peered":"2026-02-23T13:14:36.672785+0000","last_clean":"2026-02-23T13:14:36.672785+0000","last_became_active":"2026-02-23T13:11:54.598958+0000","last_became_peered":"2026-02-23T13:11:54.598958+0000","last_unstale":"2026-02-23T13:14:36.672785+0000","last_undegraded":"2026-02-23T13:14:36.672785+0000","last_fullsized":"2026-02-23T13:14:36.672785+0000","mapping_epoch":78,"log_start":"94'72631","ondisk_log_start":"94'72631","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'70102","last_scrub_stamp":"2026-02-23T13:14:31.594593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:14:31.594593+0000","objects_scrubbed":5719,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:58.177104+0000","scrub_duration":760,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199884800,"num_objects":3050,"num_object_clones":0,"num_object_copies":9150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3050,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72634,"num_write_kb":2421888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"94'72471","reported_seq":72959,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:36.659907+0000","last_change":"2026-02-23T13:14:19.935545+0000","last_active":"2026-02-23T13:14:36.659907+0000","last_peered":"2026-02-23T13:14:36.659907+0000","last_clean":"2026-02-23T13:14:36.659907+0000","last_became_active":"2026-02-23T13:11:54.598751+0000","last_became_peered":"2026-02-23T13:11:54.598751+0000","last_unstale":"2026-02-23T13:14:36.659907+0000","last_undegraded":"2026-02-23T13:14:36.659907+0000","last_fullsized":"2026-02-23T13:14:36.659907+0000","mapping_epoch":78,"log_start":"94'72468","ondisk_log_start":"94'72468","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'64263","last_scrub_stamp":"2026-02-23T13:14:19.935472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:14:19.935472+0000","objects_scrubbed":11481,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:40.893851+0000","scrub_duration":1206,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197984256,"num_objects":3021,"num_object_clones":0,"num_object_copies":9063,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3021,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72471,"num_write_kb":2415744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"94'72469","reported_seq":72907,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:36.699441+0000","last_change":"2026-02-23T13:14:24.272234+0000","last_active":"2026-02-23T13:14:36.699441+0000","last_peered":"2026-02-23T13:14:36.699441+0000","last_clean":"2026-02-23T13:14:36.699441+0000","last_became_active":"2026-02-23T13:11:54.595840+0000","last_became_peered":"2026-02-23T13:11:54.595840+0000","last_unstale":"2026-02-23T13:14:36.699441+0000","last_undegraded":"2026-02-23T13:14:36.699441+0000","last_fullsized":"2026-02-23T13:14:36.699441+0000","mapping_epoch":78,"log_start":"94'72466","ondisk_log_start":"94'72466","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'66264","last_scrub_stamp":"2026-02-23T13:14:24.272175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:14:24.272175+0000","objects_scrubbed":9559,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:48.772118+0000","scrub_duration":1443,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201392128,"num_objects":3073,"num_object_clones":0,"num_object_copies":9219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3073,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72469,"num_write_kb":2417344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"94'72513","reported_seq":72985,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:36.681925+0000","last_change":"2026-02-23T13:14:26.988267+0000","last_active":"2026-02-23T13:14:36.681925+0000","last_peered":"2026-02-23T13:14:36.681925+0000","last_clean":"2026-02-23T13:14:36.681925+0000","last_became_active":"2026-02-23T13:11:54.595287+0000","last_became_peered":"2026-02-23T13:11:54.595287+0000","last_unstale":"2026-02-23T13:14:36.681925+0000","last_undegraded":"2026-02-23T13:14:36.681925+0000","last_fullsized":"2026-02-23T13:14:36.681925+0000","mapping_epoch":78,"log_start":"94'72510","ondisk_log_start":"94'72510","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'67714","last_scrub_stamp":"2026-02-23T13:14:26.988239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:14:26.988239+0000","objects_scrubbed":8103,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:37.300182+0000","scrub_duration":682,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205062144,"num_objects":3129,"num_object_clones":0,"num_object_copies":9387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3129,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72513,"num_write_kb":2420544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":393,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:11.656044+0000","last_change":"2026-02-23T13:14:11.656044+0000","last_active":"2026-02-23T13:14:11.656044+0000","last_peered":"2026-02-23T13:14:11.656044+0000","last_clean":"2026-02-23T13:14:11.656044+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:14:11.656044+0000","last_undegraded":"2026-02-23T13:14:11.656044+0000","last_fullsized":"2026-02-23T13:14:11.656044+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:14:11.656003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:14:11.656003+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:24.978553+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":3200647192,"num_objects":48839,"num_object_clones":0,"num_object_copies":146517,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48839,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1162621,"num_write_kb":38766657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9589370880,"data_stored":9589358664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":837,"internal_metadata":0},"log_size":50,"ondisk_log_size":50,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1745,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247950,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4559912,"kb_used_data":3196244,"kb_used_omap":16,"kb_used_meta":1363567,"kb_avail":729443288,"statfs":{"total":751619276800,"available":746949926912,"internally_reserved":0,"allocated":3272953856,"data_stored":3272478312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17091,"internal_metadata":1396292925},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,2,7],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444177,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3036264,"kb_used_data":2260116,"kb_used_omap":19,"kb_used_meta":776108,"kb_avail":730966936,"statfs":{"total":751619276800,"available":748510142464,"internally_reserved":0,"allocated":2314358784,"data_stored":2313883240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19767,"internal_metadata":794735305},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574995,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3317984,"kb_used_data":2083532,"kb_used_omap":18,"kb_used_meta":1234349,"kb_avail":730685216,"statfs":{"total":751619276800,"available":748221661184,"internally_reserved":0,"allocated":2133536768,"data_stored":2133068848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18636,"internal_metadata":1263974196},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705812,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3786856,"kb_used_data":2931220,"kb_used_omap":14,"kb_used_meta":855601,"kb_avail":730216344,"statfs":{"total":751619276800,"available":747741536256,"internally_reserved":0,"allocated":3001569280,"data_stored":3001093736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14462,"internal_metadata":876136322},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1745,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2597785600,"data_stored":2597781528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":372,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1972764672,"data_stored":1972764672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2199523328,"data_stored":2199519256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":186,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2819297280,"data_stored":2819293208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":279,"internal_metadata":0}]}} 2026-02-23T13:14:39.098 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:14:39.098 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 291 2026-02-23T13:14:39.141 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:39.139+0000 7eff105bb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:39.141 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:39.139+0000 7eff105bb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:39.154 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:14:39.155 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:14:39.166 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:14:39.167 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:14:39.182 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:14:39.182 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:14:39.194 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:14:39.194 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:14:39.301 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:39.493 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:39.492+0000 7f91ee5c9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:39.493 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:39.492+0000 7f91ee5c9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:39.648 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:14:39.994 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:39 trial046 ceph-mon[38575]: pgmap v419: 17 pgs: 17 active+clean; 3.0 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 8.78k op/s 2026-02-23T13:14:39.995 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:39 trial046 ceph-mon[38575]: 5.e scrub starts 2026-02-23T13:14:39.995 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:39 trial046 ceph-mon[38575]: 5.d scrub starts 2026-02-23T13:14:39.995 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:39 trial046 ceph-mon[38575]: 5.e scrub ok 2026-02-23T13:14:39.995 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:39 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/994561820' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:14:39.995 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:39 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2871852855' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "291"} : dispatch 2026-02-23T13:14:40.373 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:14:41.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:40 trial046 ceph-mon[38575]: from='client.15413 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:14:41.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:40 trial046 ceph-mon[38575]: 5.d scrub ok 2026-02-23T13:14:41.338 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:14:41.478 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:41.927 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:41.875+0000 7f2146739640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:41.927 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:41.876+0000 7f2146739640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:41.928 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:14:41.928 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:14:41.929 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:14:41.929 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:14:41.941 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:14:41.941 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:14:41.954 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:14:41.954 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:14:41.954 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:41 trial046 ceph-mon[38575]: pgmap v420: 17 pgs: 17 active+clean; 3.0 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 6.53k op/s 2026-02-23T13:14:42.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:42 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:14:42.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:42 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:14:42.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:42 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2190160140' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:14:43.208 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Removed 605729 objects 2026-02-23T13:14:43.208 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Clean up completed and total clean up time :77.5091 2026-02-23T13:14:44.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:43 trial046 ceph-mon[38575]: pgmap v421: 17 pgs: 17 active+clean; 628 MiB data, 7.0 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 9.76k op/s 2026-02-23T13:14:44.452 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:14:44.570 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:44.672 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:44.671+0000 7ff4db7d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:44.672 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:44.671+0000 7ff4db7d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:44.684 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:14:44.684 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:14:44.694 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:14:44.694 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:14:44.706 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:14:44.706 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:14:44.718 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:14:44.718 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:14:44.732 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:44 trial046 ceph-mon[38575]: 5.7 scrub starts 2026-02-23T13:14:44.732 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:44 trial046 ceph-mon[38575]: 5.7 scrub ok 2026-02-23T13:14:44.732 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:44 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2614377084' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:14:45.374 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:14:45.374 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:14:45.375 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_3 2026-02-23T13:14:45.375 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:14:45.494 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:45.599 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:45.598+0000 7f4ddb6fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:45.600 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:45.598+0000 7f4ddb6fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:45.710 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:14:45.710 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:14:45.746 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":422,"stamp":"2026-02-23T13:14:44.685458+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658768440,"num_objects":10046,"num_object_clones":0,"num_object_copies":30138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10046,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":1201551,"num_write_kb":38768807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53,"ondisk_log_size":53,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":7336280,"kb_used_data":2869256,"kb_used_omap":69,"kb_used_meta":4466874,"kb_avail":2928676520,"statfs":{"total":3006477107200,"available":2998964756480,"internally_reserved":0,"allocated":2938118144,"data_stored":2936223592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":70887,"internal_metadata":4574079769},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[15,2,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5126684672,"num_objects":-78227,"num_object_clones":0,"num_object_copies":-234681,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-78227,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78227,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001672"},"pg_stats":[{"pgid":"5.f","version":"94'75596","reported_seq":76069,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:41.680407+0000","last_change":"2026-02-23T13:14:33.812008+0000","last_active":"2026-02-23T13:14:41.680407+0000","last_peered":"2026-02-23T13:14:41.680407+0000","last_clean":"2026-02-23T13:14:41.680407+0000","last_became_active":"2026-02-23T13:11:54.595945+0000","last_became_peered":"2026-02-23T13:11:54.595945+0000","last_unstale":"2026-02-23T13:14:41.680407+0000","last_undegraded":"2026-02-23T13:14:41.680407+0000","last_fullsized":"2026-02-23T13:14:41.680407+0000","mapping_epoch":78,"log_start":"94'75593","ondisk_log_start":"94'75593","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'71559","last_scrub_stamp":"2026-02-23T13:14:33.811977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:14:33.811977+0000","objects_scrubbed":4802,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:44.436798+0000","scrub_duration":450,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43384832,"num_objects":662,"num_object_clones":0,"num_object_copies":1986,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":662,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75596,"num_write_kb":2440256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"94'75659","reported_seq":76078,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:41.672111+0000","last_change":"2026-02-23T13:14:39.031085+0000","last_active":"2026-02-23T13:14:41.672111+0000","last_peered":"2026-02-23T13:14:41.672111+0000","last_clean":"2026-02-23T13:14:41.672111+0000","last_became_active":"2026-02-23T13:11:54.599064+0000","last_became_peered":"2026-02-23T13:11:54.599064+0000","last_unstale":"2026-02-23T13:14:41.672111+0000","last_undegraded":"2026-02-23T13:14:41.672111+0000","last_fullsized":"2026-02-23T13:14:41.672111+0000","mapping_epoch":78,"log_start":"94'75656","ondisk_log_start":"94'75656","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'74469","last_scrub_stamp":"2026-02-23T13:14:39.031044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:14:39.031044+0000","objects_scrubbed":1874,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:58.967067+0000","scrub_duration":230,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42401792,"num_objects":647,"num_object_clones":0,"num_object_copies":1941,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":647,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75659,"num_write_kb":2441792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"94'75721","reported_seq":76152,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:41.700321+0000","last_change":"2026-02-23T13:14:39.243409+0000","last_active":"2026-02-23T13:14:41.700321+0000","last_peered":"2026-02-23T13:14:41.700321+0000","last_clean":"2026-02-23T13:14:41.700321+0000","last_became_active":"2026-02-23T13:11:54.595773+0000","last_became_peered":"2026-02-23T13:11:54.595773+0000","last_unstale":"2026-02-23T13:14:41.700321+0000","last_undegraded":"2026-02-23T13:14:41.700321+0000","last_fullsized":"2026-02-23T13:14:41.700321+0000","mapping_epoch":78,"log_start":"94'75718","ondisk_log_start":"94'75718","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'74597","last_scrub_stamp":"2026-02-23T13:14:39.243341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:14:39.243341+0000","objects_scrubbed":1837,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:54.994454+0000","scrub_duration":432,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40763416,"num_objects":623,"num_object_clones":0,"num_object_copies":1869,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":623,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":75721,"num_write_kb":2442945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"94'74399","reported_seq":74789,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:41.781945+0000","last_change":"2026-02-23T13:13:17.030615+0000","last_active":"2026-02-23T13:14:41.781945+0000","last_peered":"2026-02-23T13:14:41.781945+0000","last_clean":"2026-02-23T13:14:41.781945+0000","last_became_active":"2026-02-23T13:11:54.595560+0000","last_became_peered":"2026-02-23T13:11:54.595560+0000","last_unstale":"2026-02-23T13:14:41.781945+0000","last_undegraded":"2026-02-23T13:14:41.781945+0000","last_fullsized":"2026-02-23T13:14:41.781945+0000","mapping_epoch":78,"log_start":"94'74396","ondisk_log_start":"94'74396","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'34247","last_scrub_stamp":"2026-02-23T13:13:17.030566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:17.030566+0000","objects_scrubbed":33782,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:44.233824+0000","scrub_duration":2702,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38600704,"num_objects":589,"num_object_clones":0,"num_object_copies":1767,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":589,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74399,"num_write_kb":2399616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"94'74860","reported_seq":75363,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:41.697280+0000","last_change":"2026-02-23T13:14:17.419169+0000","last_active":"2026-02-23T13:14:41.697280+0000","last_peered":"2026-02-23T13:14:41.697280+0000","last_clean":"2026-02-23T13:14:41.697280+0000","last_became_active":"2026-02-23T13:11:54.596133+0000","last_became_peered":"2026-02-23T13:11:54.596133+0000","last_unstale":"2026-02-23T13:14:41.697280+0000","last_undegraded":"2026-02-23T13:14:41.697280+0000","last_fullsized":"2026-02-23T13:14:41.697280+0000","mapping_epoch":78,"log_start":"94'74857","ondisk_log_start":"94'74857","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'62966","last_scrub_stamp":"2026-02-23T13:14:17.419090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:14:17.419090+0000","objects_scrubbed":12857,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:28.592731+0000","scrub_duration":1703,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40501248,"num_objects":618,"num_object_clones":0,"num_object_copies":1854,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":618,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74860,"num_write_kb":2415296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"94'74742","reported_seq":75167,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:41.696669+0000","last_change":"2026-02-23T13:14:38.129026+0000","last_active":"2026-02-23T13:14:41.696669+0000","last_peered":"2026-02-23T13:14:41.696669+0000","last_clean":"2026-02-23T13:14:41.696669+0000","last_became_active":"2026-02-23T13:11:54.595080+0000","last_became_peered":"2026-02-23T13:11:54.595080+0000","last_unstale":"2026-02-23T13:14:41.696669+0000","last_undegraded":"2026-02-23T13:14:41.696669+0000","last_fullsized":"2026-02-23T13:14:41.696669+0000","mapping_epoch":78,"log_start":"94'74739","ondisk_log_start":"94'74739","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'73066","last_scrub_stamp":"2026-02-23T13:14:38.128966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:14:38.128966+0000","objects_scrubbed":2381,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:03.400946+0000","scrub_duration":348,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40632320,"num_objects":620,"num_object_clones":0,"num_object_copies":1860,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":620,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74742,"num_write_kb":2411584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"94'74838","reported_seq":75260,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:41.632512+0000","last_change":"2026-02-23T13:14:30.481156+0000","last_active":"2026-02-23T13:14:41.632512+0000","last_peered":"2026-02-23T13:14:41.632512+0000","last_clean":"2026-02-23T13:14:41.632512+0000","last_became_active":"2026-02-23T13:11:54.598325+0000","last_became_peered":"2026-02-23T13:11:54.598325+0000","last_unstale":"2026-02-23T13:14:41.632512+0000","last_undegraded":"2026-02-23T13:14:41.632512+0000","last_fullsized":"2026-02-23T13:14:41.632512+0000","mapping_epoch":78,"log_start":"94'74835","ondisk_log_start":"94'74835","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'69420","last_scrub_stamp":"2026-02-23T13:14:30.481107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:14:30.481107+0000","objects_scrubbed":6225,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:53.934089+0000","scrub_duration":609,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43778048,"num_objects":668,"num_object_clones":0,"num_object_copies":2004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":668,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74838,"num_write_kb":2416192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"94'74713","reported_seq":75158,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:41.699631+0000","last_change":"2026-02-23T13:14:27.737284+0000","last_active":"2026-02-23T13:14:41.699631+0000","last_peered":"2026-02-23T13:14:41.699631+0000","last_clean":"2026-02-23T13:14:41.699631+0000","last_became_active":"2026-02-23T13:11:54.595110+0000","last_became_peered":"2026-02-23T13:11:54.595110+0000","last_unstale":"2026-02-23T13:14:41.699631+0000","last_undegraded":"2026-02-23T13:14:41.699631+0000","last_fullsized":"2026-02-23T13:14:41.699631+0000","mapping_epoch":78,"log_start":"94'74710","ondisk_log_start":"94'74710","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'67739","last_scrub_stamp":"2026-02-23T13:14:27.737213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:14:27.737213+0000","objects_scrubbed":7828,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:32.047568+0000","scrub_duration":897,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41091072,"num_objects":627,"num_object_clones":0,"num_object_copies":1881,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":627,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74713,"num_write_kb":2410880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"94'75562","reported_seq":75972,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:41.670319+0000","last_change":"2026-02-23T13:13:21.209650+0000","last_active":"2026-02-23T13:14:41.670319+0000","last_peered":"2026-02-23T13:14:41.670319+0000","last_clean":"2026-02-23T13:14:41.670319+0000","last_became_active":"2026-02-23T13:11:54.599155+0000","last_became_peered":"2026-02-23T13:11:54.599155+0000","last_unstale":"2026-02-23T13:14:41.670319+0000","last_undegraded":"2026-02-23T13:14:41.670319+0000","last_fullsized":"2026-02-23T13:14:41.670319+0000","mapping_epoch":78,"log_start":"94'75559","ondisk_log_start":"94'75559","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'36425","last_scrub_stamp":"2026-02-23T13:13:21.209611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:21.209611+0000","objects_scrubbed":35661,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"queued for scrub","scrub_duration":3833,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44040192,"num_objects":672,"num_object_clones":0,"num_object_copies":2016,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":672,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75562,"num_write_kb":2439488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"94'74883","reported_seq":75309,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:41.783022+0000","last_change":"2026-02-23T13:13:26.394617+0000","last_active":"2026-02-23T13:14:41.783022+0000","last_peered":"2026-02-23T13:14:41.783022+0000","last_clean":"2026-02-23T13:14:41.783022+0000","last_became_active":"2026-02-23T13:11:54.595645+0000","last_became_peered":"2026-02-23T13:11:54.595645+0000","last_unstale":"2026-02-23T13:14:41.783022+0000","last_undegraded":"2026-02-23T13:14:41.783022+0000","last_fullsized":"2026-02-23T13:14:41.783022+0000","mapping_epoch":78,"log_start":"94'74880","ondisk_log_start":"94'74880","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'37974","last_scrub_stamp":"2026-02-23T13:13:26.394522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:26.394522+0000","objects_scrubbed":37376,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:55.787953+0000","scrub_duration":3046,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35717120,"num_objects":545,"num_object_clones":0,"num_object_copies":1635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":545,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74883,"num_write_kb":2413696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"94'75016","reported_seq":75511,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:41.700910+0000","last_change":"2026-02-23T13:14:30.367551+0000","last_active":"2026-02-23T13:14:41.700910+0000","last_peered":"2026-02-23T13:14:41.700910+0000","last_clean":"2026-02-23T13:14:41.700910+0000","last_became_active":"2026-02-23T13:11:54.595144+0000","last_became_peered":"2026-02-23T13:11:54.595144+0000","last_unstale":"2026-02-23T13:14:41.700910+0000","last_undegraded":"2026-02-23T13:14:41.700910+0000","last_fullsized":"2026-02-23T13:14:41.700910+0000","mapping_epoch":78,"log_start":"94'75013","ondisk_log_start":"94'75013","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'69546","last_scrub_stamp":"2026-02-23T13:14:30.367520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:14:30.367520+0000","objects_scrubbed":6210,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:53.273403+0000","scrub_duration":584,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39714816,"num_objects":606,"num_object_clones":0,"num_object_copies":1818,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":606,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75016,"num_write_kb":2419904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"94'75642","reported_seq":76067,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:41.703162+0000","last_change":"2026-02-23T13:13:30.117925+0000","last_active":"2026-02-23T13:14:41.703162+0000","last_peered":"2026-02-23T13:14:41.703162+0000","last_clean":"2026-02-23T13:14:41.703162+0000","last_became_active":"2026-02-23T13:11:54.595996+0000","last_became_peered":"2026-02-23T13:11:54.595996+0000","last_unstale":"2026-02-23T13:14:41.703162+0000","last_undegraded":"2026-02-23T13:14:41.703162+0000","last_fullsized":"2026-02-23T13:14:41.703162+0000","mapping_epoch":78,"log_start":"94'75637","ondisk_log_start":"94'75637","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'39783","last_scrub_stamp":"2026-02-23T13:13:30.117805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:13:30.117805+0000","objects_scrubbed":37328,"log_size":5,"log_dups_size":3000,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:14:56.078765+0000","scrub_duration":4535,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38797312,"num_objects":592,"num_object_clones":0,"num_object_copies":1776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":592,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75642,"num_write_kb":2439488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"94'75049","reported_seq":75509,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:41.674269+0000","last_change":"2026-02-23T13:14:31.594637+0000","last_active":"2026-02-23T13:14:41.674269+0000","last_peered":"2026-02-23T13:14:41.674269+0000","last_clean":"2026-02-23T13:14:41.674269+0000","last_became_active":"2026-02-23T13:11:54.598958+0000","last_became_peered":"2026-02-23T13:11:54.598958+0000","last_unstale":"2026-02-23T13:14:41.674269+0000","last_undegraded":"2026-02-23T13:14:41.674269+0000","last_fullsized":"2026-02-23T13:14:41.674269+0000","mapping_epoch":78,"log_start":"94'75046","ondisk_log_start":"94'75046","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'70102","last_scrub_stamp":"2026-02-23T13:14:31.594593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:14:31.594593+0000","objects_scrubbed":5719,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:58.177104+0000","scrub_duration":760,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41615360,"num_objects":635,"num_object_clones":0,"num_object_copies":1905,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":635,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75049,"num_write_kb":2421888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"94'74838","reported_seq":75326,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:41.671675+0000","last_change":"2026-02-23T13:14:19.935545+0000","last_active":"2026-02-23T13:14:41.671675+0000","last_peered":"2026-02-23T13:14:41.671675+0000","last_clean":"2026-02-23T13:14:41.671675+0000","last_became_active":"2026-02-23T13:11:54.598751+0000","last_became_peered":"2026-02-23T13:11:54.598751+0000","last_unstale":"2026-02-23T13:14:41.671675+0000","last_undegraded":"2026-02-23T13:14:41.671675+0000","last_fullsized":"2026-02-23T13:14:41.671675+0000","mapping_epoch":78,"log_start":"94'74835","ondisk_log_start":"94'74835","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'64263","last_scrub_stamp":"2026-02-23T13:14:19.935472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:14:19.935472+0000","objects_scrubbed":11481,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:40.893851+0000","scrub_duration":1206,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42860544,"num_objects":654,"num_object_clones":0,"num_object_copies":1962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":654,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74838,"num_write_kb":2415744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"94'74866","reported_seq":75304,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:41.699419+0000","last_change":"2026-02-23T13:14:24.272234+0000","last_active":"2026-02-23T13:14:41.699419+0000","last_peered":"2026-02-23T13:14:41.699419+0000","last_clean":"2026-02-23T13:14:41.699419+0000","last_became_active":"2026-02-23T13:11:54.595840+0000","last_became_peered":"2026-02-23T13:11:54.595840+0000","last_unstale":"2026-02-23T13:14:41.699419+0000","last_undegraded":"2026-02-23T13:14:41.699419+0000","last_fullsized":"2026-02-23T13:14:41.699419+0000","mapping_epoch":78,"log_start":"94'74863","ondisk_log_start":"94'74863","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'66264","last_scrub_stamp":"2026-02-23T13:14:24.272175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:14:24.272175+0000","objects_scrubbed":9559,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:48.772118+0000","scrub_duration":1443,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44302336,"num_objects":676,"num_object_clones":0,"num_object_copies":2028,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":676,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74866,"num_write_kb":2417344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"94'75032","reported_seq":75504,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:41.683909+0000","last_change":"2026-02-23T13:14:26.988267+0000","last_active":"2026-02-23T13:14:41.683909+0000","last_peered":"2026-02-23T13:14:41.683909+0000","last_clean":"2026-02-23T13:14:41.683909+0000","last_became_active":"2026-02-23T13:11:54.595287+0000","last_became_peered":"2026-02-23T13:11:54.595287+0000","last_unstale":"2026-02-23T13:14:41.683909+0000","last_undegraded":"2026-02-23T13:14:41.683909+0000","last_fullsized":"2026-02-23T13:14:41.683909+0000","mapping_epoch":78,"log_start":"94'75029","ondisk_log_start":"94'75029","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'67714","last_scrub_stamp":"2026-02-23T13:14:26.988239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:11:53.586576+0000","last_clean_scrub_stamp":"2026-02-23T13:14:26.988239+0000","objects_scrubbed":8103,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:37.300182+0000","scrub_duration":682,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39976960,"num_objects":610,"num_object_clones":0,"num_object_copies":1830,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":610,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75032,"num_write_kb":2420544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":393,"reported_epoch":94,"state":"active+clean","last_fresh":"2026-02-23T13:14:11.656044+0000","last_change":"2026-02-23T13:14:11.656044+0000","last_active":"2026-02-23T13:14:11.656044+0000","last_peered":"2026-02-23T13:14:11.656044+0000","last_clean":"2026-02-23T13:14:11.656044+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:14:11.656044+0000","last_undegraded":"2026-02-23T13:14:11.656044+0000","last_fullsized":"2026-02-23T13:14:11.656044+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:14:11.656003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:14:11.656003+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:24.978553+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":658178072,"num_objects":10044,"num_object_clones":0,"num_object_copies":30132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10044,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1201416,"num_write_kb":38766657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1966813184,"data_stored":1966800968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1116,"internal_metadata":0},"log_size":50,"ondisk_log_size":50,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1838,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247951,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2393128,"kb_used_data":954708,"kb_used_omap":16,"kb_used_meta":1438383,"kb_avail":731610072,"statfs":{"total":751619276800,"available":749168713728,"internally_reserved":0,"allocated":977620992,"data_stored":977145448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17184,"internal_metadata":1472904416},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444178,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1373928,"kb_used_data":543636,"kb_used_omap":19,"kb_used_meta":830252,"kb_avail":732629272,"statfs":{"total":751619276800,"available":750212374528,"internally_reserved":0,"allocated":556683264,"data_stored":556207720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19767,"internal_metadata":850178761},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574996,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1784928,"kb_used_data":496396,"kb_used_omap":18,"kb_used_meta":1288493,"kb_avail":732218272,"statfs":{"total":751619276800,"available":749791510528,"internally_reserved":0,"allocated":508309504,"data_stored":507841584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19288,"internal_metadata":1319417000},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705813,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1784296,"kb_used_data":874516,"kb_used_omap":14,"kb_used_meta":909745,"kb_avail":732218904,"statfs":{"total":751619276800,"available":749792157696,"internally_reserved":0,"allocated":895504384,"data_stored":895028840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14648,"internal_metadata":931579592},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,2,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1838,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":536809472,"data_stored":536805400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":558,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":382533632,"data_stored":382533632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":460656640,"data_stored":460652568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":186,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":586813440,"data_stored":586809368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":372,"internal_metadata":0}]}} 2026-02-23T13:14:45.748 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:14:45.748 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_3 pg_num 106 2026-02-23T13:14:45.866 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:45.966 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:45.966+0000 7f2537344640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:45.967 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:45 trial046 ceph-mon[38575]: pgmap v422: 17 pgs: 17 active+clean; 628 MiB data, 7.0 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 6.52k op/s 2026-02-23T13:14:45.967 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:45.966+0000 7f2537344640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:46.074 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:14:46.121 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:14:46.289 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:14:46 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:14:46] "GET /metrics HTTP/1.1" 200 4225 "" "Prometheus/3.6.0" 2026-02-23T13:14:46.470 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:14:46 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:14:46.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:14:46.472 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_3 2026-02-23T13:14:46.472 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool rm unique_pool_3 unique_pool_3 --yes-i-really-really-mean-it 2026-02-23T13:14:46.591 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:46.701 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:46.700+0000 7f95cc6c4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:46.701 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:46.701+0000 7f95cc6c4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:46.754 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:14:46.776 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:46 trial046 ceph-mon[38575]: from='client.15423 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:14:46.777 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:46 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:14:46.777 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:46 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4105417917' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_3", "var": "pg_num", "val": "106"} : dispatch 2026-02-23T13:14:46.871 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:46.973 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:46.972+0000 7fe88cd0a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:46.973 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:46.972+0000 7fe88cd0a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:46.985 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:14:46.985 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:14:46.996 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:14:46.996 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:14:47.007 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:14:47.007 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:14:47.018 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:14:47.018 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:14:47.700 INFO:teuthology.orchestra.run.trial046.stderr:pool 'unique_pool_3' removed 2026-02-23T13:14:47.750 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2026-02-23T13:14:47.751 INFO:tasks.radosbench:Beginning radosbench... 2026-02-23T13:14:47.751 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_4 2026-02-23T13:14:47.752 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool create unique_pool_4 16 2026-02-23T13:14:47.879 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:47.985 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:47.984+0000 7f8a310ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:47.985 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:47.984+0000 7f8a310ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:47.986 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:47 trial046 ceph-mon[38575]: 5.c scrub starts 2026-02-23T13:14:47.986 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:47 trial046 ceph-mon[38575]: 5.c scrub ok 2026-02-23T13:14:47.986 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:47 trial046 ceph-mon[38575]: pgmap v423: 17 pgs: 17 active+clean; 344 MiB data, 5.7 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 6.90k op/s 2026-02-23T13:14:47.986 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:47 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2997639940' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "unique_pool_3", "pool2": "unique_pool_3", "yes_i_really_really_mean_it": true} : dispatch 2026-02-23T13:14:47.986 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:47 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/538898035' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:14:48.704 INFO:teuthology.orchestra.run.trial046.stderr:pool 'unique_pool_4' created 2026-02-23T13:14:48.745 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool application enable unique_pool_4 rados --yes-i-really-mean-it || true 2026-02-23T13:14:48.861 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:48.962 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:48.961+0000 7f44a62f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:48.962 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:48 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2997639940' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_3", "pool2": "unique_pool_3", "yes_i_really_really_mean_it": true}]': finished 2026-02-23T13:14:48.963 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:48 trial046 ceph-mon[38575]: osdmap e95: 4 total, 4 up, 4 in 2026-02-23T13:14:48.963 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:48 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1807881261' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "unique_pool_4", "pg_num": 16} : dispatch 2026-02-23T13:14:48.963 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:48.961+0000 7f44a62f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:49.054 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:14:49.171 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:49.281 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:49.280+0000 7fee90591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:49.281 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:49.280+0000 7fee90591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:49.293 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:14:49.293 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:14:49.303 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:14:49.304 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:14:49.315 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:14:49.315 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:14:49.326 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:14:49.326 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:14:49.705 INFO:teuthology.orchestra.run.trial046.stderr:enabled application 'rados' on pool 'unique_pool_4' 2026-02-23T13:14:50.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:49 trial046 ceph-mon[38575]: pgmap v425: 1 pgs: 1 active+clean; 577 KiB data, 4.4 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-23T13:14:50.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:49 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1807881261' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_4", "pg_num": 16}]': finished 2026-02-23T13:14:50.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:49 trial046 ceph-mon[38575]: osdmap e96: 4 total, 4 up, 4 in 2026-02-23T13:14:50.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:49 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1404269796' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "unique_pool_4", "app": "rados", "yes_i_really_mean_it": true} : dispatch 2026-02-23T13:14:50.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:49 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1916057381' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:14:50.749 DEBUG:teuthology.orchestra.run.trial046:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -t 16 -b 65536 --object-size 65536 -p unique_pool_4 bench 90 write' 2026-02-23T13:14:50.751 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2026-02-23T13:14:50.751 INFO:teuthology.orchestra.run:waiting for 3000 2026-02-23T13:14:50.798 INFO:tasks.radosbench.radosbench.0.trial046.stdout:hints = 1 2026-02-23T13:14:50.798 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2026-02-23T13:14:50.798 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Object prefix: benchmark_data_trial046_139285 2026-02-23T13:14:50.798 INFO:tasks.radosbench.radosbench.0.trial046.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-23T13:14:50.798 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 0 0 0 0 0 0 - 0 2026-02-23T13:14:51.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:50 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1404269796' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_4", "app": "rados", "yes_i_really_mean_it": true}]': finished 2026-02-23T13:14:51.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:50 trial046 ceph-mon[38575]: osdmap e97: 4 total, 4 up, 4 in 2026-02-23T13:14:51.122 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:14:51.123 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-23T13:14:51.275 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:51.361 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:14:51.408 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:51.407+0000 7f9f38a22640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:51.408 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:51.407+0000 7f9f38a22640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:51.520 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:51.643 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:51.641+0000 7f0014075640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:51.644 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:51.642+0000 7f0014075640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:51.660 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:14:51.660 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:14:51.681 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:14:51.682 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:14:51.695 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:14:51.695 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:14:51.707 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:14:51.708 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:14:51.710 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.0 to 1 (10000) 2026-02-23T13:14:51.766 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-23T13:14:51.798 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 1 16 7750 7734 483.333 483.375 0.00174717 0.00206442 2026-02-23T13:14:51.946 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:51.975 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:51 trial046 ceph-mon[38575]: pgmap v428: 17 pgs: 16 unknown, 1 active+clean; 577 KiB data, 4.4 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-23T13:14:51.975 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:51 trial046 ceph-mon[38575]: osdmap e98: 4 total, 4 up, 4 in 2026-02-23T13:14:51.975 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:51 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4280108916' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-23T13:14:51.975 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:51 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3634488734' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:14:52.077 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:52.075+0000 7f0fd42f1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:52.077 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:52.076+0000 7f0fd42f1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:52.714 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.1 to 1 (10000) 2026-02-23T13:14:52.763 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-23T13:14:52.798 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 2 16 15375 15359 479.928 476.562 0.00259002 0.00208104 2026-02-23T13:14:52.915 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:52.967 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:52 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4280108916' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-23T13:14:52.968 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:52 trial046 ceph-mon[38575]: osdmap e99: 4 total, 4 up, 4 in 2026-02-23T13:14:52.968 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:52 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3779186383' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-23T13:14:53.036 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:53.035+0000 7f3eca1ba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:53.037 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:53.035+0000 7f3eca1ba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:53.719 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.2 to 1 (10000) 2026-02-23T13:14:53.768 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:14:53.770 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-23T13:14:53.798 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 3 16 22986 22970 478.503 475.688 0.0017498 0.00208736 2026-02-23T13:14:53.948 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:53.948 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:53.976 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:53 trial046 ceph-mon[38575]: pgmap v431: 17 pgs: 17 active+clean; 458 MiB data, 5.1 GiB used, 2.7 TiB / 2.7 TiB avail; 114 MiB/s wr, 1.83k op/s 2026-02-23T13:14:53.976 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:53 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3779186383' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-23T13:14:53.977 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:53 trial046 ceph-mon[38575]: osdmap e100: 4 total, 4 up, 4 in 2026-02-23T13:14:53.977 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:53 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4107245841' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-23T13:14:54.083 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:54.081+0000 7f84d47c5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:54.083 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:54.082+0000 7f84d47c5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:54.092 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:54.090+0000 7f7970127640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:54.092 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:54.090+0000 7f7970127640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:54.102 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:14:54.103 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:14:54.120 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:14:54.121 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:14:54.134 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:14:54.135 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:14:54.148 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:14:54.148 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:14:54.602 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.3 to 1 (10000) 2026-02-23T13:14:54.648 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-23T13:14:54.648 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:14:54.797 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:54.798 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 4 16 30521 30505 476.603 470.938 0.00171824 0.00209624 2026-02-23T13:14:54.855 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:54 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4107245841' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-23T13:14:54.855 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:54 trial046 ceph-mon[38575]: osdmap e101: 4 total, 4 up, 4 in 2026-02-23T13:14:54.855 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:54 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:14:54.855 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:54 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:14:54.856 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:54 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3766616279' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:14:54.856 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:54 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/231526797' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-23T13:14:54.856 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:54 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/231526797' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-23T13:14:54.856 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:54 trial046 ceph-mon[38575]: osdmap e102: 4 total, 4 up, 4 in 2026-02-23T13:14:54.935 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:54.933+0000 7f668b599640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:54.935 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:54.933+0000 7f668b599640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:55.083 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:14:55.083 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:14:55.134 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":435,"stamp":"2026-02-23T13:14:54.686848+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":479920672,"num_objects":7316,"num_object_clones":0,"num_object_copies":21948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7316,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":7449,"num_write_kb":470246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":5359872,"kb_used_data":751024,"kb_used_omap":79,"kb_used_meta":4608624,"kb_avail":2930652928,"statfs":{"total":3006477107200,"available":3000988598272,"internally_reserved":0,"allocated":769048576,"data_stored":767051944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":81280,"internal_metadata":4719231616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":479330304,"num_objects":7314,"num_object_clones":0,"num_object_copies":21942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7314,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7314,"num_write_kb":468096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.976744"},"pg_stats":[{"pgid":"6.f","version":"99'490","reported_seq":505,"reported_epoch":99,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.816718+0000","last_change":"2026-02-23T13:14:49.711212+0000","last_active":"2026-02-23T13:14:51.816718+0000","last_peered":"2026-02-23T13:14:51.816718+0000","last_clean":"2026-02-23T13:14:51.816718+0000","last_became_active":"2026-02-23T13:14:49.710909+0000","last_became_peered":"2026-02-23T13:14:49.710909+0000","last_unstale":"2026-02-23T13:14:51.816718+0000","last_undegraded":"2026-02-23T13:14:51.816718+0000","last_fullsized":"2026-02-23T13:14:51.816718+0000","mapping_epoch":96,"log_start":"99'487","ondisk_log_start":"99'487","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":487,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:18.401390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32112640,"num_objects":490,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":490,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":490,"num_write_kb":31360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"98'428","reported_seq":442,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.683923+0000","last_change":"2026-02-23T13:14:49.711013+0000","last_active":"2026-02-23T13:14:51.683923+0000","last_peered":"2026-02-23T13:14:51.683923+0000","last_clean":"2026-02-23T13:14:51.683923+0000","last_became_active":"2026-02-23T13:14:49.710608+0000","last_became_peered":"2026-02-23T13:14:49.710608+0000","last_unstale":"2026-02-23T13:14:51.683923+0000","last_undegraded":"2026-02-23T13:14:51.683923+0000","last_fullsized":"2026-02-23T13:14:51.683923+0000","mapping_epoch":96,"log_start":"98'425","ondisk_log_start":"98'425","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":425,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:57.080821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28049408,"num_objects":428,"num_object_clones":0,"num_object_copies":1284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":428,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":428,"num_write_kb":27392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"98'428","reported_seq":442,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.683870+0000","last_change":"2026-02-23T13:14:49.711150+0000","last_active":"2026-02-23T13:14:51.683870+0000","last_peered":"2026-02-23T13:14:51.683870+0000","last_clean":"2026-02-23T13:14:51.683870+0000","last_became_active":"2026-02-23T13:14:49.710759+0000","last_became_peered":"2026-02-23T13:14:49.710759+0000","last_unstale":"2026-02-23T13:14:51.683870+0000","last_undegraded":"2026-02-23T13:14:51.683870+0000","last_fullsized":"2026-02-23T13:14:51.683870+0000","mapping_epoch":96,"log_start":"98'425","ondisk_log_start":"98'425","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":425,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:09.130033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28049408,"num_objects":428,"num_object_clones":0,"num_object_copies":1284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":428,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":428,"num_write_kb":27392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"99'514","reported_seq":530,"reported_epoch":99,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.813683+0000","last_change":"2026-02-23T13:14:49.711353+0000","last_active":"2026-02-23T13:14:51.813683+0000","last_peered":"2026-02-23T13:14:51.813683+0000","last_clean":"2026-02-23T13:14:51.813683+0000","last_became_active":"2026-02-23T13:14:49.710648+0000","last_became_peered":"2026-02-23T13:14:49.710648+0000","last_unstale":"2026-02-23T13:14:51.813683+0000","last_undegraded":"2026-02-23T13:14:51.813683+0000","last_fullsized":"2026-02-23T13:14:51.813683+0000","mapping_epoch":96,"log_start":"99'511","ondisk_log_start":"99'511","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":511,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:00.632137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33685504,"num_objects":514,"num_object_clones":0,"num_object_copies":1542,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":514,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":514,"num_write_kb":32896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"99'498","reported_seq":513,"reported_epoch":99,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.815114+0000","last_change":"2026-02-23T13:14:49.710716+0000","last_active":"2026-02-23T13:14:51.815114+0000","last_peered":"2026-02-23T13:14:51.815114+0000","last_clean":"2026-02-23T13:14:51.815114+0000","last_became_active":"2026-02-23T13:14:49.709875+0000","last_became_peered":"2026-02-23T13:14:49.709875+0000","last_unstale":"2026-02-23T13:14:51.815114+0000","last_undegraded":"2026-02-23T13:14:51.815114+0000","last_fullsized":"2026-02-23T13:14:51.815114+0000","mapping_epoch":96,"log_start":"99'495","ondisk_log_start":"99'495","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":495,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:08.189503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32636928,"num_objects":498,"num_object_clones":0,"num_object_copies":1494,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":498,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":498,"num_write_kb":31872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"98'433","reported_seq":446,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.685136+0000","last_change":"2026-02-23T13:14:49.710292+0000","last_active":"2026-02-23T13:14:51.685136+0000","last_peered":"2026-02-23T13:14:51.685136+0000","last_clean":"2026-02-23T13:14:51.685136+0000","last_became_active":"2026-02-23T13:14:49.709618+0000","last_became_peered":"2026-02-23T13:14:49.709618+0000","last_unstale":"2026-02-23T13:14:51.685136+0000","last_undegraded":"2026-02-23T13:14:51.685136+0000","last_fullsized":"2026-02-23T13:14:51.685136+0000","mapping_epoch":96,"log_start":"98'430","ondisk_log_start":"98'430","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":430,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:12.895714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28377088,"num_objects":433,"num_object_clones":0,"num_object_copies":1299,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":433,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":27712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"98'439","reported_seq":453,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.702999+0000","last_change":"2026-02-23T13:14:49.711809+0000","last_active":"2026-02-23T13:14:51.702999+0000","last_peered":"2026-02-23T13:14:51.702999+0000","last_clean":"2026-02-23T13:14:51.702999+0000","last_became_active":"2026-02-23T13:14:49.711647+0000","last_became_peered":"2026-02-23T13:14:49.711647+0000","last_unstale":"2026-02-23T13:14:51.702999+0000","last_undegraded":"2026-02-23T13:14:51.702999+0000","last_fullsized":"2026-02-23T13:14:51.702999+0000","mapping_epoch":96,"log_start":"98'436","ondisk_log_start":"98'436","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":436,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:16.696834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28770304,"num_objects":439,"num_object_clones":0,"num_object_copies":1317,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":439,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":439,"num_write_kb":28096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"98'418","reported_seq":431,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.675512+0000","last_change":"2026-02-23T13:14:49.710392+0000","last_active":"2026-02-23T13:14:51.675512+0000","last_peered":"2026-02-23T13:14:51.675512+0000","last_clean":"2026-02-23T13:14:51.675512+0000","last_became_active":"2026-02-23T13:14:49.710064+0000","last_became_peered":"2026-02-23T13:14:49.710064+0000","last_unstale":"2026-02-23T13:14:51.675512+0000","last_undegraded":"2026-02-23T13:14:51.675512+0000","last_fullsized":"2026-02-23T13:14:51.675512+0000","mapping_epoch":96,"log_start":"98'415","ondisk_log_start":"98'415","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":415,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:07.281706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27394048,"num_objects":418,"num_object_clones":0,"num_object_copies":1254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":418,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":26752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"99'543","reported_seq":558,"reported_epoch":99,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.815691+0000","last_change":"2026-02-23T13:14:49.711523+0000","last_active":"2026-02-23T13:14:51.815691+0000","last_peered":"2026-02-23T13:14:51.815691+0000","last_clean":"2026-02-23T13:14:51.815691+0000","last_became_active":"2026-02-23T13:14:49.711227+0000","last_became_peered":"2026-02-23T13:14:49.711227+0000","last_unstale":"2026-02-23T13:14:51.815691+0000","last_undegraded":"2026-02-23T13:14:51.815691+0000","last_fullsized":"2026-02-23T13:14:51.815691+0000","mapping_epoch":96,"log_start":"99'540","ondisk_log_start":"99'540","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":540,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:09.568570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35586048,"num_objects":543,"num_object_clones":0,"num_object_copies":1629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":543,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":543,"num_write_kb":34752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"98'438","reported_seq":452,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.685123+0000","last_change":"2026-02-23T13:14:49.710830+0000","last_active":"2026-02-23T13:14:51.685123+0000","last_peered":"2026-02-23T13:14:51.685123+0000","last_clean":"2026-02-23T13:14:51.685123+0000","last_became_active":"2026-02-23T13:14:49.710282+0000","last_became_peered":"2026-02-23T13:14:49.710282+0000","last_unstale":"2026-02-23T13:14:51.685123+0000","last_undegraded":"2026-02-23T13:14:51.685123+0000","last_fullsized":"2026-02-23T13:14:51.685123+0000","mapping_epoch":96,"log_start":"98'435","ondisk_log_start":"98'435","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":435,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:05.474131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28704768,"num_objects":438,"num_object_clones":0,"num_object_copies":1314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":438,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":438,"num_write_kb":28032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"99'465","reported_seq":480,"reported_epoch":99,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.816532+0000","last_change":"2026-02-23T13:14:49.711384+0000","last_active":"2026-02-23T13:14:51.816532+0000","last_peered":"2026-02-23T13:14:51.816532+0000","last_clean":"2026-02-23T13:14:51.816532+0000","last_became_active":"2026-02-23T13:14:49.710940+0000","last_became_peered":"2026-02-23T13:14:49.710940+0000","last_unstale":"2026-02-23T13:14:51.816532+0000","last_undegraded":"2026-02-23T13:14:51.816532+0000","last_fullsized":"2026-02-23T13:14:51.816532+0000","mapping_epoch":96,"log_start":"99'462","ondisk_log_start":"99'462","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":462,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:01.989539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30474240,"num_objects":465,"num_object_clones":0,"num_object_copies":1395,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":465,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":465,"num_write_kb":29760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"98'442","reported_seq":455,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.676950+0000","last_change":"2026-02-23T13:14:49.709045+0000","last_active":"2026-02-23T13:14:51.676950+0000","last_peered":"2026-02-23T13:14:51.676950+0000","last_clean":"2026-02-23T13:14:51.676950+0000","last_became_active":"2026-02-23T13:14:49.708668+0000","last_became_peered":"2026-02-23T13:14:49.708668+0000","last_unstale":"2026-02-23T13:14:51.676950+0000","last_undegraded":"2026-02-23T13:14:51.676950+0000","last_fullsized":"2026-02-23T13:14:51.676950+0000","mapping_epoch":96,"log_start":"98'439","ondisk_log_start":"98'439","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":439,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:05.829857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28966912,"num_objects":442,"num_object_clones":0,"num_object_copies":1326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":442,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":442,"num_write_kb":28288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"98'436","reported_seq":450,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.675807+0000","last_change":"2026-02-23T13:14:49.709471+0000","last_active":"2026-02-23T13:14:51.675807+0000","last_peered":"2026-02-23T13:14:51.675807+0000","last_clean":"2026-02-23T13:14:51.675807+0000","last_became_active":"2026-02-23T13:14:49.709202+0000","last_became_peered":"2026-02-23T13:14:49.709202+0000","last_unstale":"2026-02-23T13:14:51.675807+0000","last_undegraded":"2026-02-23T13:14:51.675807+0000","last_fullsized":"2026-02-23T13:14:51.675807+0000","mapping_epoch":96,"log_start":"98'433","ondisk_log_start":"98'433","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":433,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:00.362060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28573696,"num_objects":436,"num_object_clones":0,"num_object_copies":1308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":436,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":436,"num_write_kb":27904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"99'475","reported_seq":491,"reported_epoch":99,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.815455+0000","last_change":"2026-02-23T13:14:49.711071+0000","last_active":"2026-02-23T13:14:51.815455+0000","last_peered":"2026-02-23T13:14:51.815455+0000","last_clean":"2026-02-23T13:14:51.815455+0000","last_became_active":"2026-02-23T13:14:49.710193+0000","last_became_peered":"2026-02-23T13:14:49.710193+0000","last_unstale":"2026-02-23T13:14:51.815455+0000","last_undegraded":"2026-02-23T13:14:51.815455+0000","last_fullsized":"2026-02-23T13:14:51.815455+0000","mapping_epoch":96,"log_start":"99'472","ondisk_log_start":"99'472","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":472,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:15.360867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31129600,"num_objects":475,"num_object_clones":0,"num_object_copies":1425,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":475,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":475,"num_write_kb":30400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"98'416","reported_seq":428,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.704038+0000","last_change":"2026-02-23T13:14:49.710077+0000","last_active":"2026-02-23T13:14:51.704038+0000","last_peered":"2026-02-23T13:14:51.704038+0000","last_clean":"2026-02-23T13:14:51.704038+0000","last_became_active":"2026-02-23T13:14:49.709781+0000","last_became_peered":"2026-02-23T13:14:49.709781+0000","last_unstale":"2026-02-23T13:14:51.704038+0000","last_undegraded":"2026-02-23T13:14:51.704038+0000","last_fullsized":"2026-02-23T13:14:51.704038+0000","mapping_epoch":96,"log_start":"98'413","ondisk_log_start":"98'413","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":413,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:16.674175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":416,"num_object_clones":0,"num_object_copies":1248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":416,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"98'451","reported_seq":465,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.675460+0000","last_change":"2026-02-23T13:14:49.709980+0000","last_active":"2026-02-23T13:14:51.675460+0000","last_peered":"2026-02-23T13:14:51.675460+0000","last_clean":"2026-02-23T13:14:51.675460+0000","last_became_active":"2026-02-23T13:14:49.709715+0000","last_became_peered":"2026-02-23T13:14:49.709715+0000","last_unstale":"2026-02-23T13:14:51.675460+0000","last_undegraded":"2026-02-23T13:14:51.675460+0000","last_fullsized":"2026-02-23T13:14:51.675460+0000","mapping_epoch":96,"log_start":"98'448","ondisk_log_start":"98'448","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":448,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:07.659456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29556736,"num_objects":451,"num_object_clones":0,"num_object_copies":1353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":451,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":401,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-23T13:14:50.710355+0000","last_change":"2026-02-23T13:14:11.656044+0000","last_active":"2026-02-23T13:14:50.710355+0000","last_peered":"2026-02-23T13:14:50.710355+0000","last_clean":"2026-02-23T13:14:50.710355+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:14:50.710355+0000","last_undegraded":"2026-02-23T13:14:50.710355+0000","last_fullsized":"2026-02-23T13:14:50.710355+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:14:11.656003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:14:11.656003+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:24.978553+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":479330304,"num_objects":7314,"num_object_clones":0,"num_object_copies":21942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7314,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7314,"num_write_kb":468096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1423310848,"data_stored":1423310848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3763,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247953,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1779156,"kb_used_data":253120,"kb_used_omap":19,"kb_used_meta":1525996,"kb_avail":732224044,"statfs":{"total":751619276800,"available":749797421056,"internally_reserved":0,"allocated":259194880,"data_stored":258692948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20034,"internal_metadata":1562620350},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444180,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1053332,"kb_used_data":204928,"kb_used_omap":21,"kb_used_meta":848298,"kb_avail":732949868,"statfs":{"total":751619276800,"available":750540664832,"internally_reserved":0,"allocated":209846272,"data_stored":209344340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22437,"internal_metadata":868657243},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574998,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1598224,"kb_used_data":291644,"kb_used_omap":21,"kb_used_meta":1306538,"kb_avail":732404976,"statfs":{"total":751619276800,"available":749982695424,"internally_reserved":0,"allocated":298643456,"data_stored":298145076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22020,"internal_metadata":1337895420},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705815,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":929160,"kb_used_data":1332,"kb_used_omap":16,"kb_used_meta":927791,"kb_avail":733074040,"statfs":{"total":751619276800,"available":750667816960,"internally_reserved":0,"allocated":1363968,"data_stored":869580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16789,"internal_metadata":950058603},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3763,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":345571328,"data_stored":345571328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":453378048,"data_stored":453378048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":339935232,"data_stored":339935232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":284426240,"data_stored":284426240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:14:55.136 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:14:55.287 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:55.413 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:55.410+0000 7faa5da8d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:55.413 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:55.411+0000 7faa5da8d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:55.564 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:14:55.564 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:14:55.616 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":435,"stamp":"2026-02-23T13:14:54.686848+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":479920672,"num_objects":7316,"num_object_clones":0,"num_object_copies":21948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7316,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":7449,"num_write_kb":470246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":5359872,"kb_used_data":751024,"kb_used_omap":79,"kb_used_meta":4608624,"kb_avail":2930652928,"statfs":{"total":3006477107200,"available":3000988598272,"internally_reserved":0,"allocated":769048576,"data_stored":767051944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":81280,"internal_metadata":4719231616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":479330304,"num_objects":7314,"num_object_clones":0,"num_object_copies":21942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7314,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7314,"num_write_kb":468096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.976744"},"pg_stats":[{"pgid":"6.f","version":"99'490","reported_seq":505,"reported_epoch":99,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.816718+0000","last_change":"2026-02-23T13:14:49.711212+0000","last_active":"2026-02-23T13:14:51.816718+0000","last_peered":"2026-02-23T13:14:51.816718+0000","last_clean":"2026-02-23T13:14:51.816718+0000","last_became_active":"2026-02-23T13:14:49.710909+0000","last_became_peered":"2026-02-23T13:14:49.710909+0000","last_unstale":"2026-02-23T13:14:51.816718+0000","last_undegraded":"2026-02-23T13:14:51.816718+0000","last_fullsized":"2026-02-23T13:14:51.816718+0000","mapping_epoch":96,"log_start":"99'487","ondisk_log_start":"99'487","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":487,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:18.401390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32112640,"num_objects":490,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":490,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":490,"num_write_kb":31360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"98'428","reported_seq":442,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.683923+0000","last_change":"2026-02-23T13:14:49.711013+0000","last_active":"2026-02-23T13:14:51.683923+0000","last_peered":"2026-02-23T13:14:51.683923+0000","last_clean":"2026-02-23T13:14:51.683923+0000","last_became_active":"2026-02-23T13:14:49.710608+0000","last_became_peered":"2026-02-23T13:14:49.710608+0000","last_unstale":"2026-02-23T13:14:51.683923+0000","last_undegraded":"2026-02-23T13:14:51.683923+0000","last_fullsized":"2026-02-23T13:14:51.683923+0000","mapping_epoch":96,"log_start":"98'425","ondisk_log_start":"98'425","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":425,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:57.080821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28049408,"num_objects":428,"num_object_clones":0,"num_object_copies":1284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":428,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":428,"num_write_kb":27392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"98'428","reported_seq":442,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.683870+0000","last_change":"2026-02-23T13:14:49.711150+0000","last_active":"2026-02-23T13:14:51.683870+0000","last_peered":"2026-02-23T13:14:51.683870+0000","last_clean":"2026-02-23T13:14:51.683870+0000","last_became_active":"2026-02-23T13:14:49.710759+0000","last_became_peered":"2026-02-23T13:14:49.710759+0000","last_unstale":"2026-02-23T13:14:51.683870+0000","last_undegraded":"2026-02-23T13:14:51.683870+0000","last_fullsized":"2026-02-23T13:14:51.683870+0000","mapping_epoch":96,"log_start":"98'425","ondisk_log_start":"98'425","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":425,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:09.130033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28049408,"num_objects":428,"num_object_clones":0,"num_object_copies":1284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":428,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":428,"num_write_kb":27392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"99'514","reported_seq":530,"reported_epoch":99,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.813683+0000","last_change":"2026-02-23T13:14:49.711353+0000","last_active":"2026-02-23T13:14:51.813683+0000","last_peered":"2026-02-23T13:14:51.813683+0000","last_clean":"2026-02-23T13:14:51.813683+0000","last_became_active":"2026-02-23T13:14:49.710648+0000","last_became_peered":"2026-02-23T13:14:49.710648+0000","last_unstale":"2026-02-23T13:14:51.813683+0000","last_undegraded":"2026-02-23T13:14:51.813683+0000","last_fullsized":"2026-02-23T13:14:51.813683+0000","mapping_epoch":96,"log_start":"99'511","ondisk_log_start":"99'511","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":511,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:00.632137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33685504,"num_objects":514,"num_object_clones":0,"num_object_copies":1542,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":514,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":514,"num_write_kb":32896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"99'498","reported_seq":513,"reported_epoch":99,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.815114+0000","last_change":"2026-02-23T13:14:49.710716+0000","last_active":"2026-02-23T13:14:51.815114+0000","last_peered":"2026-02-23T13:14:51.815114+0000","last_clean":"2026-02-23T13:14:51.815114+0000","last_became_active":"2026-02-23T13:14:49.709875+0000","last_became_peered":"2026-02-23T13:14:49.709875+0000","last_unstale":"2026-02-23T13:14:51.815114+0000","last_undegraded":"2026-02-23T13:14:51.815114+0000","last_fullsized":"2026-02-23T13:14:51.815114+0000","mapping_epoch":96,"log_start":"99'495","ondisk_log_start":"99'495","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":495,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:08.189503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32636928,"num_objects":498,"num_object_clones":0,"num_object_copies":1494,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":498,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":498,"num_write_kb":31872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"98'433","reported_seq":446,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.685136+0000","last_change":"2026-02-23T13:14:49.710292+0000","last_active":"2026-02-23T13:14:51.685136+0000","last_peered":"2026-02-23T13:14:51.685136+0000","last_clean":"2026-02-23T13:14:51.685136+0000","last_became_active":"2026-02-23T13:14:49.709618+0000","last_became_peered":"2026-02-23T13:14:49.709618+0000","last_unstale":"2026-02-23T13:14:51.685136+0000","last_undegraded":"2026-02-23T13:14:51.685136+0000","last_fullsized":"2026-02-23T13:14:51.685136+0000","mapping_epoch":96,"log_start":"98'430","ondisk_log_start":"98'430","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":430,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:12.895714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28377088,"num_objects":433,"num_object_clones":0,"num_object_copies":1299,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":433,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":27712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"98'439","reported_seq":453,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.702999+0000","last_change":"2026-02-23T13:14:49.711809+0000","last_active":"2026-02-23T13:14:51.702999+0000","last_peered":"2026-02-23T13:14:51.702999+0000","last_clean":"2026-02-23T13:14:51.702999+0000","last_became_active":"2026-02-23T13:14:49.711647+0000","last_became_peered":"2026-02-23T13:14:49.711647+0000","last_unstale":"2026-02-23T13:14:51.702999+0000","last_undegraded":"2026-02-23T13:14:51.702999+0000","last_fullsized":"2026-02-23T13:14:51.702999+0000","mapping_epoch":96,"log_start":"98'436","ondisk_log_start":"98'436","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":436,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:16.696834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28770304,"num_objects":439,"num_object_clones":0,"num_object_copies":1317,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":439,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":439,"num_write_kb":28096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"98'418","reported_seq":431,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.675512+0000","last_change":"2026-02-23T13:14:49.710392+0000","last_active":"2026-02-23T13:14:51.675512+0000","last_peered":"2026-02-23T13:14:51.675512+0000","last_clean":"2026-02-23T13:14:51.675512+0000","last_became_active":"2026-02-23T13:14:49.710064+0000","last_became_peered":"2026-02-23T13:14:49.710064+0000","last_unstale":"2026-02-23T13:14:51.675512+0000","last_undegraded":"2026-02-23T13:14:51.675512+0000","last_fullsized":"2026-02-23T13:14:51.675512+0000","mapping_epoch":96,"log_start":"98'415","ondisk_log_start":"98'415","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":415,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:07.281706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27394048,"num_objects":418,"num_object_clones":0,"num_object_copies":1254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":418,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":26752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"99'543","reported_seq":558,"reported_epoch":99,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.815691+0000","last_change":"2026-02-23T13:14:49.711523+0000","last_active":"2026-02-23T13:14:51.815691+0000","last_peered":"2026-02-23T13:14:51.815691+0000","last_clean":"2026-02-23T13:14:51.815691+0000","last_became_active":"2026-02-23T13:14:49.711227+0000","last_became_peered":"2026-02-23T13:14:49.711227+0000","last_unstale":"2026-02-23T13:14:51.815691+0000","last_undegraded":"2026-02-23T13:14:51.815691+0000","last_fullsized":"2026-02-23T13:14:51.815691+0000","mapping_epoch":96,"log_start":"99'540","ondisk_log_start":"99'540","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":540,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:09.568570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35586048,"num_objects":543,"num_object_clones":0,"num_object_copies":1629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":543,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":543,"num_write_kb":34752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"98'438","reported_seq":452,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.685123+0000","last_change":"2026-02-23T13:14:49.710830+0000","last_active":"2026-02-23T13:14:51.685123+0000","last_peered":"2026-02-23T13:14:51.685123+0000","last_clean":"2026-02-23T13:14:51.685123+0000","last_became_active":"2026-02-23T13:14:49.710282+0000","last_became_peered":"2026-02-23T13:14:49.710282+0000","last_unstale":"2026-02-23T13:14:51.685123+0000","last_undegraded":"2026-02-23T13:14:51.685123+0000","last_fullsized":"2026-02-23T13:14:51.685123+0000","mapping_epoch":96,"log_start":"98'435","ondisk_log_start":"98'435","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":435,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:05.474131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28704768,"num_objects":438,"num_object_clones":0,"num_object_copies":1314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":438,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":438,"num_write_kb":28032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"99'465","reported_seq":480,"reported_epoch":99,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.816532+0000","last_change":"2026-02-23T13:14:49.711384+0000","last_active":"2026-02-23T13:14:51.816532+0000","last_peered":"2026-02-23T13:14:51.816532+0000","last_clean":"2026-02-23T13:14:51.816532+0000","last_became_active":"2026-02-23T13:14:49.710940+0000","last_became_peered":"2026-02-23T13:14:49.710940+0000","last_unstale":"2026-02-23T13:14:51.816532+0000","last_undegraded":"2026-02-23T13:14:51.816532+0000","last_fullsized":"2026-02-23T13:14:51.816532+0000","mapping_epoch":96,"log_start":"99'462","ondisk_log_start":"99'462","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":462,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:01.989539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30474240,"num_objects":465,"num_object_clones":0,"num_object_copies":1395,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":465,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":465,"num_write_kb":29760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"98'442","reported_seq":455,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.676950+0000","last_change":"2026-02-23T13:14:49.709045+0000","last_active":"2026-02-23T13:14:51.676950+0000","last_peered":"2026-02-23T13:14:51.676950+0000","last_clean":"2026-02-23T13:14:51.676950+0000","last_became_active":"2026-02-23T13:14:49.708668+0000","last_became_peered":"2026-02-23T13:14:49.708668+0000","last_unstale":"2026-02-23T13:14:51.676950+0000","last_undegraded":"2026-02-23T13:14:51.676950+0000","last_fullsized":"2026-02-23T13:14:51.676950+0000","mapping_epoch":96,"log_start":"98'439","ondisk_log_start":"98'439","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":439,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:05.829857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28966912,"num_objects":442,"num_object_clones":0,"num_object_copies":1326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":442,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":442,"num_write_kb":28288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"98'436","reported_seq":450,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.675807+0000","last_change":"2026-02-23T13:14:49.709471+0000","last_active":"2026-02-23T13:14:51.675807+0000","last_peered":"2026-02-23T13:14:51.675807+0000","last_clean":"2026-02-23T13:14:51.675807+0000","last_became_active":"2026-02-23T13:14:49.709202+0000","last_became_peered":"2026-02-23T13:14:49.709202+0000","last_unstale":"2026-02-23T13:14:51.675807+0000","last_undegraded":"2026-02-23T13:14:51.675807+0000","last_fullsized":"2026-02-23T13:14:51.675807+0000","mapping_epoch":96,"log_start":"98'433","ondisk_log_start":"98'433","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":433,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:00.362060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28573696,"num_objects":436,"num_object_clones":0,"num_object_copies":1308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":436,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":436,"num_write_kb":27904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"99'475","reported_seq":491,"reported_epoch":99,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.815455+0000","last_change":"2026-02-23T13:14:49.711071+0000","last_active":"2026-02-23T13:14:51.815455+0000","last_peered":"2026-02-23T13:14:51.815455+0000","last_clean":"2026-02-23T13:14:51.815455+0000","last_became_active":"2026-02-23T13:14:49.710193+0000","last_became_peered":"2026-02-23T13:14:49.710193+0000","last_unstale":"2026-02-23T13:14:51.815455+0000","last_undegraded":"2026-02-23T13:14:51.815455+0000","last_fullsized":"2026-02-23T13:14:51.815455+0000","mapping_epoch":96,"log_start":"99'472","ondisk_log_start":"99'472","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":472,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:15.360867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31129600,"num_objects":475,"num_object_clones":0,"num_object_copies":1425,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":475,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":475,"num_write_kb":30400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"98'416","reported_seq":428,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.704038+0000","last_change":"2026-02-23T13:14:49.710077+0000","last_active":"2026-02-23T13:14:51.704038+0000","last_peered":"2026-02-23T13:14:51.704038+0000","last_clean":"2026-02-23T13:14:51.704038+0000","last_became_active":"2026-02-23T13:14:49.709781+0000","last_became_peered":"2026-02-23T13:14:49.709781+0000","last_unstale":"2026-02-23T13:14:51.704038+0000","last_undegraded":"2026-02-23T13:14:51.704038+0000","last_fullsized":"2026-02-23T13:14:51.704038+0000","mapping_epoch":96,"log_start":"98'413","ondisk_log_start":"98'413","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":413,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:16.674175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":416,"num_object_clones":0,"num_object_copies":1248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":416,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"98'451","reported_seq":465,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.675460+0000","last_change":"2026-02-23T13:14:49.709980+0000","last_active":"2026-02-23T13:14:51.675460+0000","last_peered":"2026-02-23T13:14:51.675460+0000","last_clean":"2026-02-23T13:14:51.675460+0000","last_became_active":"2026-02-23T13:14:49.709715+0000","last_became_peered":"2026-02-23T13:14:49.709715+0000","last_unstale":"2026-02-23T13:14:51.675460+0000","last_undegraded":"2026-02-23T13:14:51.675460+0000","last_fullsized":"2026-02-23T13:14:51.675460+0000","mapping_epoch":96,"log_start":"98'448","ondisk_log_start":"98'448","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":448,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:07.659456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29556736,"num_objects":451,"num_object_clones":0,"num_object_copies":1353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":451,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":401,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-23T13:14:50.710355+0000","last_change":"2026-02-23T13:14:11.656044+0000","last_active":"2026-02-23T13:14:50.710355+0000","last_peered":"2026-02-23T13:14:50.710355+0000","last_clean":"2026-02-23T13:14:50.710355+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:14:50.710355+0000","last_undegraded":"2026-02-23T13:14:50.710355+0000","last_fullsized":"2026-02-23T13:14:50.710355+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:14:11.656003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:14:11.656003+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:24.978553+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":479330304,"num_objects":7314,"num_object_clones":0,"num_object_copies":21942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7314,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7314,"num_write_kb":468096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1423310848,"data_stored":1423310848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3763,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247953,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1779156,"kb_used_data":253120,"kb_used_omap":19,"kb_used_meta":1525996,"kb_avail":732224044,"statfs":{"total":751619276800,"available":749797421056,"internally_reserved":0,"allocated":259194880,"data_stored":258692948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20034,"internal_metadata":1562620350},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444180,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1053332,"kb_used_data":204928,"kb_used_omap":21,"kb_used_meta":848298,"kb_avail":732949868,"statfs":{"total":751619276800,"available":750540664832,"internally_reserved":0,"allocated":209846272,"data_stored":209344340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22437,"internal_metadata":868657243},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574998,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1598224,"kb_used_data":291644,"kb_used_omap":21,"kb_used_meta":1306538,"kb_avail":732404976,"statfs":{"total":751619276800,"available":749982695424,"internally_reserved":0,"allocated":298643456,"data_stored":298145076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22020,"internal_metadata":1337895420},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705815,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":929160,"kb_used_data":1332,"kb_used_omap":16,"kb_used_meta":927791,"kb_avail":733074040,"statfs":{"total":751619276800,"available":750667816960,"internally_reserved":0,"allocated":1363968,"data_stored":869580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16789,"internal_metadata":950058603},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3763,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":345571328,"data_stored":345571328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":453378048,"data_stored":453378048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":339935232,"data_stored":339935232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":284426240,"data_stored":284426240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:14:55.618 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-23T13:14:55.618 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:14:55.618 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_4 2026-02-23T13:14:55.618 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:14:55.767 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:55.798 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 5 16 38414 38398 479.937 493.312 0.00218266 0.00208197 2026-02-23T13:14:55.886 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:55 trial046 ceph-mon[38575]: pgmap v435: 17 pgs: 17 active+clean; 458 MiB data, 5.1 GiB used, 2.7 TiB / 2.7 TiB avail; 115 MiB/s wr, 1.84k op/s 2026-02-23T13:14:55.903 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:55.901+0000 7f02df86d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:55.903 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:55.901+0000 7f02df86d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:56.044 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:14:56.044 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:14:56.094 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":435,"stamp":"2026-02-23T13:14:54.686848+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":479920672,"num_objects":7316,"num_object_clones":0,"num_object_copies":21948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7316,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":7449,"num_write_kb":470246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":5359872,"kb_used_data":751024,"kb_used_omap":79,"kb_used_meta":4608624,"kb_avail":2930652928,"statfs":{"total":3006477107200,"available":3000988598272,"internally_reserved":0,"allocated":769048576,"data_stored":767051944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":81280,"internal_metadata":4719231616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":479330304,"num_objects":7314,"num_object_clones":0,"num_object_copies":21942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7314,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7314,"num_write_kb":468096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.976744"},"pg_stats":[{"pgid":"6.f","version":"99'490","reported_seq":505,"reported_epoch":99,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.816718+0000","last_change":"2026-02-23T13:14:49.711212+0000","last_active":"2026-02-23T13:14:51.816718+0000","last_peered":"2026-02-23T13:14:51.816718+0000","last_clean":"2026-02-23T13:14:51.816718+0000","last_became_active":"2026-02-23T13:14:49.710909+0000","last_became_peered":"2026-02-23T13:14:49.710909+0000","last_unstale":"2026-02-23T13:14:51.816718+0000","last_undegraded":"2026-02-23T13:14:51.816718+0000","last_fullsized":"2026-02-23T13:14:51.816718+0000","mapping_epoch":96,"log_start":"99'487","ondisk_log_start":"99'487","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":487,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:18.401390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32112640,"num_objects":490,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":490,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":490,"num_write_kb":31360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"98'428","reported_seq":442,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.683923+0000","last_change":"2026-02-23T13:14:49.711013+0000","last_active":"2026-02-23T13:14:51.683923+0000","last_peered":"2026-02-23T13:14:51.683923+0000","last_clean":"2026-02-23T13:14:51.683923+0000","last_became_active":"2026-02-23T13:14:49.710608+0000","last_became_peered":"2026-02-23T13:14:49.710608+0000","last_unstale":"2026-02-23T13:14:51.683923+0000","last_undegraded":"2026-02-23T13:14:51.683923+0000","last_fullsized":"2026-02-23T13:14:51.683923+0000","mapping_epoch":96,"log_start":"98'425","ondisk_log_start":"98'425","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":425,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:57.080821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28049408,"num_objects":428,"num_object_clones":0,"num_object_copies":1284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":428,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":428,"num_write_kb":27392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"98'428","reported_seq":442,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.683870+0000","last_change":"2026-02-23T13:14:49.711150+0000","last_active":"2026-02-23T13:14:51.683870+0000","last_peered":"2026-02-23T13:14:51.683870+0000","last_clean":"2026-02-23T13:14:51.683870+0000","last_became_active":"2026-02-23T13:14:49.710759+0000","last_became_peered":"2026-02-23T13:14:49.710759+0000","last_unstale":"2026-02-23T13:14:51.683870+0000","last_undegraded":"2026-02-23T13:14:51.683870+0000","last_fullsized":"2026-02-23T13:14:51.683870+0000","mapping_epoch":96,"log_start":"98'425","ondisk_log_start":"98'425","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":425,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:09.130033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28049408,"num_objects":428,"num_object_clones":0,"num_object_copies":1284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":428,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":428,"num_write_kb":27392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"99'514","reported_seq":530,"reported_epoch":99,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.813683+0000","last_change":"2026-02-23T13:14:49.711353+0000","last_active":"2026-02-23T13:14:51.813683+0000","last_peered":"2026-02-23T13:14:51.813683+0000","last_clean":"2026-02-23T13:14:51.813683+0000","last_became_active":"2026-02-23T13:14:49.710648+0000","last_became_peered":"2026-02-23T13:14:49.710648+0000","last_unstale":"2026-02-23T13:14:51.813683+0000","last_undegraded":"2026-02-23T13:14:51.813683+0000","last_fullsized":"2026-02-23T13:14:51.813683+0000","mapping_epoch":96,"log_start":"99'511","ondisk_log_start":"99'511","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":511,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:00.632137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33685504,"num_objects":514,"num_object_clones":0,"num_object_copies":1542,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":514,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":514,"num_write_kb":32896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"99'498","reported_seq":513,"reported_epoch":99,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.815114+0000","last_change":"2026-02-23T13:14:49.710716+0000","last_active":"2026-02-23T13:14:51.815114+0000","last_peered":"2026-02-23T13:14:51.815114+0000","last_clean":"2026-02-23T13:14:51.815114+0000","last_became_active":"2026-02-23T13:14:49.709875+0000","last_became_peered":"2026-02-23T13:14:49.709875+0000","last_unstale":"2026-02-23T13:14:51.815114+0000","last_undegraded":"2026-02-23T13:14:51.815114+0000","last_fullsized":"2026-02-23T13:14:51.815114+0000","mapping_epoch":96,"log_start":"99'495","ondisk_log_start":"99'495","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":495,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:08.189503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32636928,"num_objects":498,"num_object_clones":0,"num_object_copies":1494,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":498,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":498,"num_write_kb":31872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"98'433","reported_seq":446,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.685136+0000","last_change":"2026-02-23T13:14:49.710292+0000","last_active":"2026-02-23T13:14:51.685136+0000","last_peered":"2026-02-23T13:14:51.685136+0000","last_clean":"2026-02-23T13:14:51.685136+0000","last_became_active":"2026-02-23T13:14:49.709618+0000","last_became_peered":"2026-02-23T13:14:49.709618+0000","last_unstale":"2026-02-23T13:14:51.685136+0000","last_undegraded":"2026-02-23T13:14:51.685136+0000","last_fullsized":"2026-02-23T13:14:51.685136+0000","mapping_epoch":96,"log_start":"98'430","ondisk_log_start":"98'430","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":430,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:12.895714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28377088,"num_objects":433,"num_object_clones":0,"num_object_copies":1299,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":433,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":27712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"98'439","reported_seq":453,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.702999+0000","last_change":"2026-02-23T13:14:49.711809+0000","last_active":"2026-02-23T13:14:51.702999+0000","last_peered":"2026-02-23T13:14:51.702999+0000","last_clean":"2026-02-23T13:14:51.702999+0000","last_became_active":"2026-02-23T13:14:49.711647+0000","last_became_peered":"2026-02-23T13:14:49.711647+0000","last_unstale":"2026-02-23T13:14:51.702999+0000","last_undegraded":"2026-02-23T13:14:51.702999+0000","last_fullsized":"2026-02-23T13:14:51.702999+0000","mapping_epoch":96,"log_start":"98'436","ondisk_log_start":"98'436","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":436,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:16.696834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28770304,"num_objects":439,"num_object_clones":0,"num_object_copies":1317,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":439,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":439,"num_write_kb":28096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"98'418","reported_seq":431,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.675512+0000","last_change":"2026-02-23T13:14:49.710392+0000","last_active":"2026-02-23T13:14:51.675512+0000","last_peered":"2026-02-23T13:14:51.675512+0000","last_clean":"2026-02-23T13:14:51.675512+0000","last_became_active":"2026-02-23T13:14:49.710064+0000","last_became_peered":"2026-02-23T13:14:49.710064+0000","last_unstale":"2026-02-23T13:14:51.675512+0000","last_undegraded":"2026-02-23T13:14:51.675512+0000","last_fullsized":"2026-02-23T13:14:51.675512+0000","mapping_epoch":96,"log_start":"98'415","ondisk_log_start":"98'415","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":415,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:07.281706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27394048,"num_objects":418,"num_object_clones":0,"num_object_copies":1254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":418,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":26752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"99'543","reported_seq":558,"reported_epoch":99,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.815691+0000","last_change":"2026-02-23T13:14:49.711523+0000","last_active":"2026-02-23T13:14:51.815691+0000","last_peered":"2026-02-23T13:14:51.815691+0000","last_clean":"2026-02-23T13:14:51.815691+0000","last_became_active":"2026-02-23T13:14:49.711227+0000","last_became_peered":"2026-02-23T13:14:49.711227+0000","last_unstale":"2026-02-23T13:14:51.815691+0000","last_undegraded":"2026-02-23T13:14:51.815691+0000","last_fullsized":"2026-02-23T13:14:51.815691+0000","mapping_epoch":96,"log_start":"99'540","ondisk_log_start":"99'540","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":540,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:09.568570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35586048,"num_objects":543,"num_object_clones":0,"num_object_copies":1629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":543,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":543,"num_write_kb":34752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"98'438","reported_seq":452,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.685123+0000","last_change":"2026-02-23T13:14:49.710830+0000","last_active":"2026-02-23T13:14:51.685123+0000","last_peered":"2026-02-23T13:14:51.685123+0000","last_clean":"2026-02-23T13:14:51.685123+0000","last_became_active":"2026-02-23T13:14:49.710282+0000","last_became_peered":"2026-02-23T13:14:49.710282+0000","last_unstale":"2026-02-23T13:14:51.685123+0000","last_undegraded":"2026-02-23T13:14:51.685123+0000","last_fullsized":"2026-02-23T13:14:51.685123+0000","mapping_epoch":96,"log_start":"98'435","ondisk_log_start":"98'435","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":435,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:05.474131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28704768,"num_objects":438,"num_object_clones":0,"num_object_copies":1314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":438,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":438,"num_write_kb":28032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"99'465","reported_seq":480,"reported_epoch":99,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.816532+0000","last_change":"2026-02-23T13:14:49.711384+0000","last_active":"2026-02-23T13:14:51.816532+0000","last_peered":"2026-02-23T13:14:51.816532+0000","last_clean":"2026-02-23T13:14:51.816532+0000","last_became_active":"2026-02-23T13:14:49.710940+0000","last_became_peered":"2026-02-23T13:14:49.710940+0000","last_unstale":"2026-02-23T13:14:51.816532+0000","last_undegraded":"2026-02-23T13:14:51.816532+0000","last_fullsized":"2026-02-23T13:14:51.816532+0000","mapping_epoch":96,"log_start":"99'462","ondisk_log_start":"99'462","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":462,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:01.989539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30474240,"num_objects":465,"num_object_clones":0,"num_object_copies":1395,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":465,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":465,"num_write_kb":29760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"98'442","reported_seq":455,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.676950+0000","last_change":"2026-02-23T13:14:49.709045+0000","last_active":"2026-02-23T13:14:51.676950+0000","last_peered":"2026-02-23T13:14:51.676950+0000","last_clean":"2026-02-23T13:14:51.676950+0000","last_became_active":"2026-02-23T13:14:49.708668+0000","last_became_peered":"2026-02-23T13:14:49.708668+0000","last_unstale":"2026-02-23T13:14:51.676950+0000","last_undegraded":"2026-02-23T13:14:51.676950+0000","last_fullsized":"2026-02-23T13:14:51.676950+0000","mapping_epoch":96,"log_start":"98'439","ondisk_log_start":"98'439","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":439,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:05.829857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28966912,"num_objects":442,"num_object_clones":0,"num_object_copies":1326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":442,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":442,"num_write_kb":28288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"98'436","reported_seq":450,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.675807+0000","last_change":"2026-02-23T13:14:49.709471+0000","last_active":"2026-02-23T13:14:51.675807+0000","last_peered":"2026-02-23T13:14:51.675807+0000","last_clean":"2026-02-23T13:14:51.675807+0000","last_became_active":"2026-02-23T13:14:49.709202+0000","last_became_peered":"2026-02-23T13:14:49.709202+0000","last_unstale":"2026-02-23T13:14:51.675807+0000","last_undegraded":"2026-02-23T13:14:51.675807+0000","last_fullsized":"2026-02-23T13:14:51.675807+0000","mapping_epoch":96,"log_start":"98'433","ondisk_log_start":"98'433","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":433,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:00.362060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28573696,"num_objects":436,"num_object_clones":0,"num_object_copies":1308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":436,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":436,"num_write_kb":27904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"99'475","reported_seq":491,"reported_epoch":99,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.815455+0000","last_change":"2026-02-23T13:14:49.711071+0000","last_active":"2026-02-23T13:14:51.815455+0000","last_peered":"2026-02-23T13:14:51.815455+0000","last_clean":"2026-02-23T13:14:51.815455+0000","last_became_active":"2026-02-23T13:14:49.710193+0000","last_became_peered":"2026-02-23T13:14:49.710193+0000","last_unstale":"2026-02-23T13:14:51.815455+0000","last_undegraded":"2026-02-23T13:14:51.815455+0000","last_fullsized":"2026-02-23T13:14:51.815455+0000","mapping_epoch":96,"log_start":"99'472","ondisk_log_start":"99'472","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":472,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:15.360867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31129600,"num_objects":475,"num_object_clones":0,"num_object_copies":1425,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":475,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":475,"num_write_kb":30400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"98'416","reported_seq":428,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.704038+0000","last_change":"2026-02-23T13:14:49.710077+0000","last_active":"2026-02-23T13:14:51.704038+0000","last_peered":"2026-02-23T13:14:51.704038+0000","last_clean":"2026-02-23T13:14:51.704038+0000","last_became_active":"2026-02-23T13:14:49.709781+0000","last_became_peered":"2026-02-23T13:14:49.709781+0000","last_unstale":"2026-02-23T13:14:51.704038+0000","last_undegraded":"2026-02-23T13:14:51.704038+0000","last_fullsized":"2026-02-23T13:14:51.704038+0000","mapping_epoch":96,"log_start":"98'413","ondisk_log_start":"98'413","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":413,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:16.674175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":416,"num_object_clones":0,"num_object_copies":1248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":416,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"98'451","reported_seq":465,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-23T13:14:51.675460+0000","last_change":"2026-02-23T13:14:49.709980+0000","last_active":"2026-02-23T13:14:51.675460+0000","last_peered":"2026-02-23T13:14:51.675460+0000","last_clean":"2026-02-23T13:14:51.675460+0000","last_became_active":"2026-02-23T13:14:49.709715+0000","last_became_peered":"2026-02-23T13:14:49.709715+0000","last_unstale":"2026-02-23T13:14:51.675460+0000","last_undegraded":"2026-02-23T13:14:51.675460+0000","last_fullsized":"2026-02-23T13:14:51.675460+0000","mapping_epoch":96,"log_start":"98'448","ondisk_log_start":"98'448","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":448,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:07.659456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29556736,"num_objects":451,"num_object_clones":0,"num_object_copies":1353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":451,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":401,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-23T13:14:50.710355+0000","last_change":"2026-02-23T13:14:11.656044+0000","last_active":"2026-02-23T13:14:50.710355+0000","last_peered":"2026-02-23T13:14:50.710355+0000","last_clean":"2026-02-23T13:14:50.710355+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:14:50.710355+0000","last_undegraded":"2026-02-23T13:14:50.710355+0000","last_fullsized":"2026-02-23T13:14:50.710355+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:14:11.656003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:14:11.656003+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:24.978553+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":479330304,"num_objects":7314,"num_object_clones":0,"num_object_copies":21942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7314,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7314,"num_write_kb":468096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1423310848,"data_stored":1423310848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3763,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247953,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1779156,"kb_used_data":253120,"kb_used_omap":19,"kb_used_meta":1525996,"kb_avail":732224044,"statfs":{"total":751619276800,"available":749797421056,"internally_reserved":0,"allocated":259194880,"data_stored":258692948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20034,"internal_metadata":1562620350},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444180,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1053332,"kb_used_data":204928,"kb_used_omap":21,"kb_used_meta":848298,"kb_avail":732949868,"statfs":{"total":751619276800,"available":750540664832,"internally_reserved":0,"allocated":209846272,"data_stored":209344340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22437,"internal_metadata":868657243},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574998,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1598224,"kb_used_data":291644,"kb_used_omap":21,"kb_used_meta":1306538,"kb_avail":732404976,"statfs":{"total":751619276800,"available":749982695424,"internally_reserved":0,"allocated":298643456,"data_stored":298145076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22020,"internal_metadata":1337895420},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705815,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":929160,"kb_used_data":1332,"kb_used_omap":16,"kb_used_meta":927791,"kb_avail":733074040,"statfs":{"total":751619276800,"available":750667816960,"internally_reserved":0,"allocated":1363968,"data_stored":869580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16789,"internal_metadata":950058603},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3763,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":345571328,"data_stored":345571328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":453378048,"data_stored":453378048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":339935232,"data_stored":339935232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":284426240,"data_stored":284426240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:14:56.096 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:14:56.097 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_4 pg_num 26 2026-02-23T13:14:56.196 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:14:56.223 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:14:56 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:14:56] "GET /metrics HTTP/1.1" 200 4225 "" "Prometheus/3.6.0" 2026-02-23T13:14:56.254 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:56.345 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:56.395 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:56.393+0000 7f8ead32d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:56.395 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:56.394+0000 7f8ead32d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:56.491 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:56.489+0000 7faef0133640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:56.491 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:56.490+0000 7faef0133640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:56.507 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:14:56.507 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:14:56.524 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:14:56.525 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:14:56.537 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:14:56.538 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:14:56.551 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:14:56.551 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:14:56.556 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:14:56.560 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:14:56 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:14:56.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:14:56.606 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:14:56.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:56 trial046 ceph-mon[38575]: from='client.15452 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:14:56.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:56 trial046 ceph-mon[38575]: from='client.15454 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:14:56.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:56 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3227898089' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:14:56.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:56 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1892746750' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pg_num", "val": "26"} : dispatch 2026-02-23T13:14:56.798 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 6 16 46612 46596 485.337 512.375 0.00183153 0.00205873 2026-02-23T13:14:57.799 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 7 15 55177 55162 492.479 535.375 0.00190497 0.00202897 2026-02-23T13:14:58.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:57 trial046 ceph-mon[38575]: from='client.15456 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:14:58.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:57 trial046 ceph-mon[38575]: pgmap v436: 17 pgs: 17 active+clean; 1.6 GiB data, 7.7 GiB used, 2.7 TiB / 2.7 TiB avail; 280 MiB/s wr, 4.49k op/s 2026-02-23T13:14:58.606 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:14:58.762 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:14:58.799 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 8 15 62947 62932 491.617 485.625 0.00196255 0.00203243 2026-02-23T13:14:59.205 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:59.160+0000 7f3859f2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:59.205 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:14:59.160+0000 7f3859f2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:14:59.205 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:14:59.205 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:14:59.205 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:14:59.206 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:14:59.211 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:14:59.211 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:14:59.225 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:14:59.225 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:14:59.799 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 9 16 68473 68457 475.358 345.312 0.00189171 0.00210208 2026-02-23T13:15:00.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:59 trial046 ceph-mon[38575]: pgmap v437: 17 pgs: 17 active+clean; 2.8 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 404 MiB/s wr, 6.47k op/s 2026-02-23T13:15:00.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:59 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1789751325' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:15:00.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:14:59 trial046 ceph-mon[38575]: osdmap e103: 4 total, 4 up, 4 in 2026-02-23T13:15:00.799 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 10 16 76296 76280 476.713 488.938 0.001763 0.00209617 2026-02-23T13:15:01.607 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:15:01.607 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:15:01.608 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:15:01.608 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:15:01.747 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:15:01.762 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:01.799 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 11 15 84351 84336 479.144 503.5 0.00243947 0.00208557 2026-02-23T13:15:01.899 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:01.907 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:01.905+0000 7ff9c4e8c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:01.907 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:01.905+0000 7ff9c4e8c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:01.908 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:01 trial046 ceph-mon[38575]: pgmap v439: 17 pgs: 17 active+clean; 2.8 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 348 MiB/s wr, 5.57k op/s 2026-02-23T13:15:01.908 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:01 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:15:02.027 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:02.025+0000 7fed74025640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:02.027 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:02.025+0000 7fed74025640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:02.045 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:15:02.045 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:15:02.060 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:15:02.061 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:15:02.073 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:15:02.074 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:15:02.074 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:15:02.074 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:15:02.087 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:15:02.088 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:15:02.139 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":439,"stamp":"2026-02-23T13:15:00.687696+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3023045152,"num_objects":46121,"num_object_clones":0,"num_object_copies":138363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46121,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":46254,"num_write_kb":2953766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":12280460,"kb_used_data":8109308,"kb_used_omap":90,"kb_used_meta":4170917,"kb_avail":2923732340,"statfs":{"total":3006477107200,"available":2993901916160,"internally_reserved":0,"allocated":8303931392,"data_stored":8301801152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93008,"internal_metadata":4271019184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2543124480,"num_objects":38805,"num_object_clones":0,"num_object_copies":116415,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38805,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38805,"num_write_kb":2483520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.966933"},"pg_stats":[{"pgid":"6.f","version":"102'2939","reported_seq":2961,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-23T13:14:56.816255+0000","last_change":"2026-02-23T13:14:49.711212+0000","last_active":"2026-02-23T13:14:56.816255+0000","last_peered":"2026-02-23T13:14:56.816255+0000","last_clean":"2026-02-23T13:14:56.816255+0000","last_became_active":"2026-02-23T13:14:49.710909+0000","last_became_peered":"2026-02-23T13:14:49.710909+0000","last_unstale":"2026-02-23T13:14:56.816255+0000","last_undegraded":"2026-02-23T13:14:56.816255+0000","last_fullsized":"2026-02-23T13:14:56.816255+0000","mapping_epoch":96,"log_start":"102'2936","ondisk_log_start":"102'2936","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2936,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:18.401390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192610304,"num_objects":2939,"num_object_clones":0,"num_object_copies":8817,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2939,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2939,"num_write_kb":188096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"102'2891","reported_seq":2913,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-23T13:14:56.681752+0000","last_change":"2026-02-23T13:14:49.711013+0000","last_active":"2026-02-23T13:14:56.681752+0000","last_peered":"2026-02-23T13:14:56.681752+0000","last_clean":"2026-02-23T13:14:56.681752+0000","last_became_active":"2026-02-23T13:14:49.710608+0000","last_became_peered":"2026-02-23T13:14:49.710608+0000","last_unstale":"2026-02-23T13:14:56.681752+0000","last_undegraded":"2026-02-23T13:14:56.681752+0000","last_fullsized":"2026-02-23T13:14:56.681752+0000","mapping_epoch":96,"log_start":"102'2888","ondisk_log_start":"102'2888","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2888,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:57.080821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":189464576,"num_objects":2891,"num_object_clones":0,"num_object_copies":8673,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2891,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2891,"num_write_kb":185024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"102'2856","reported_seq":2878,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-23T13:14:56.683614+0000","last_change":"2026-02-23T13:14:49.711150+0000","last_active":"2026-02-23T13:14:56.683614+0000","last_peered":"2026-02-23T13:14:56.683614+0000","last_clean":"2026-02-23T13:14:56.683614+0000","last_became_active":"2026-02-23T13:14:49.710759+0000","last_became_peered":"2026-02-23T13:14:49.710759+0000","last_unstale":"2026-02-23T13:14:56.683614+0000","last_undegraded":"2026-02-23T13:14:56.683614+0000","last_fullsized":"2026-02-23T13:14:56.683614+0000","mapping_epoch":96,"log_start":"102'2853","ondisk_log_start":"102'2853","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2853,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:09.130033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187170816,"num_objects":2856,"num_object_clones":0,"num_object_copies":8568,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2856,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2856,"num_write_kb":182784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"102'2979","reported_seq":3001,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-23T13:14:56.814601+0000","last_change":"2026-02-23T13:14:49.711353+0000","last_active":"2026-02-23T13:14:56.814601+0000","last_peered":"2026-02-23T13:14:56.814601+0000","last_clean":"2026-02-23T13:14:56.814601+0000","last_became_active":"2026-02-23T13:14:49.710648+0000","last_became_peered":"2026-02-23T13:14:49.710648+0000","last_unstale":"2026-02-23T13:14:56.814601+0000","last_undegraded":"2026-02-23T13:14:56.814601+0000","last_fullsized":"2026-02-23T13:14:56.814601+0000","mapping_epoch":96,"log_start":"102'2976","ondisk_log_start":"102'2976","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2976,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:00.632137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195231744,"num_objects":2979,"num_object_clones":0,"num_object_copies":8937,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2979,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2979,"num_write_kb":190656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"102'2927","reported_seq":2949,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-23T13:14:56.815934+0000","last_change":"2026-02-23T13:14:49.710716+0000","last_active":"2026-02-23T13:14:56.815934+0000","last_peered":"2026-02-23T13:14:56.815934+0000","last_clean":"2026-02-23T13:14:56.815934+0000","last_became_active":"2026-02-23T13:14:49.709875+0000","last_became_peered":"2026-02-23T13:14:49.709875+0000","last_unstale":"2026-02-23T13:14:56.815934+0000","last_undegraded":"2026-02-23T13:14:56.815934+0000","last_fullsized":"2026-02-23T13:14:56.815934+0000","mapping_epoch":96,"log_start":"102'2924","ondisk_log_start":"102'2924","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2924,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:08.189503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191823872,"num_objects":2927,"num_object_clones":0,"num_object_copies":8781,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2927,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2927,"num_write_kb":187328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"102'2896","reported_seq":2918,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-23T13:14:56.684186+0000","last_change":"2026-02-23T13:14:49.710292+0000","last_active":"2026-02-23T13:14:56.684186+0000","last_peered":"2026-02-23T13:14:56.684186+0000","last_clean":"2026-02-23T13:14:56.684186+0000","last_became_active":"2026-02-23T13:14:49.709618+0000","last_became_peered":"2026-02-23T13:14:49.709618+0000","last_unstale":"2026-02-23T13:14:56.684186+0000","last_undegraded":"2026-02-23T13:14:56.684186+0000","last_fullsized":"2026-02-23T13:14:56.684186+0000","mapping_epoch":96,"log_start":"102'2893","ondisk_log_start":"102'2893","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2893,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:12.895714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":189792256,"num_objects":2896,"num_object_clones":0,"num_object_copies":8688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2896,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2896,"num_write_kb":185344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"102'2832","reported_seq":2854,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-23T13:14:56.697516+0000","last_change":"2026-02-23T13:14:49.711809+0000","last_active":"2026-02-23T13:14:56.697516+0000","last_peered":"2026-02-23T13:14:56.697516+0000","last_clean":"2026-02-23T13:14:56.697516+0000","last_became_active":"2026-02-23T13:14:49.711647+0000","last_became_peered":"2026-02-23T13:14:49.711647+0000","last_unstale":"2026-02-23T13:14:56.697516+0000","last_undegraded":"2026-02-23T13:14:56.697516+0000","last_fullsized":"2026-02-23T13:14:56.697516+0000","mapping_epoch":96,"log_start":"102'2829","ondisk_log_start":"102'2829","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2829,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:16.696834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185597952,"num_objects":2832,"num_object_clones":0,"num_object_copies":8496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2832,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2832,"num_write_kb":181248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"102'2769","reported_seq":2791,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-23T13:14:56.670323+0000","last_change":"2026-02-23T13:14:49.710392+0000","last_active":"2026-02-23T13:14:56.670323+0000","last_peered":"2026-02-23T13:14:56.670323+0000","last_clean":"2026-02-23T13:14:56.670323+0000","last_became_active":"2026-02-23T13:14:49.710064+0000","last_became_peered":"2026-02-23T13:14:49.710064+0000","last_unstale":"2026-02-23T13:14:56.670323+0000","last_undegraded":"2026-02-23T13:14:56.670323+0000","last_fullsized":"2026-02-23T13:14:56.670323+0000","mapping_epoch":96,"log_start":"102'2766","ondisk_log_start":"102'2766","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2766,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:07.281706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181469184,"num_objects":2769,"num_object_clones":0,"num_object_copies":8307,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2769,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2769,"num_write_kb":177216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"102'2944","reported_seq":2966,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-23T13:14:56.815180+0000","last_change":"2026-02-23T13:14:49.711523+0000","last_active":"2026-02-23T13:14:56.815180+0000","last_peered":"2026-02-23T13:14:56.815180+0000","last_clean":"2026-02-23T13:14:56.815180+0000","last_became_active":"2026-02-23T13:14:49.711227+0000","last_became_peered":"2026-02-23T13:14:49.711227+0000","last_unstale":"2026-02-23T13:14:56.815180+0000","last_undegraded":"2026-02-23T13:14:56.815180+0000","last_fullsized":"2026-02-23T13:14:56.815180+0000","mapping_epoch":96,"log_start":"102'2941","ondisk_log_start":"102'2941","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2941,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:09.568570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192937984,"num_objects":2944,"num_object_clones":0,"num_object_copies":8832,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2944,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2944,"num_write_kb":188416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"102'2944","reported_seq":2966,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-23T13:14:56.683749+0000","last_change":"2026-02-23T13:14:49.710830+0000","last_active":"2026-02-23T13:14:56.683749+0000","last_peered":"2026-02-23T13:14:56.683749+0000","last_clean":"2026-02-23T13:14:56.683749+0000","last_became_active":"2026-02-23T13:14:49.710282+0000","last_became_peered":"2026-02-23T13:14:49.710282+0000","last_unstale":"2026-02-23T13:14:56.683749+0000","last_undegraded":"2026-02-23T13:14:56.683749+0000","last_fullsized":"2026-02-23T13:14:56.683749+0000","mapping_epoch":96,"log_start":"102'2941","ondisk_log_start":"102'2941","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2941,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:05.474131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192937984,"num_objects":2944,"num_object_clones":0,"num_object_copies":8832,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2944,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2944,"num_write_kb":188416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"102'2828","reported_seq":2850,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-23T13:14:56.814269+0000","last_change":"2026-02-23T13:14:49.711384+0000","last_active":"2026-02-23T13:14:56.814269+0000","last_peered":"2026-02-23T13:14:56.814269+0000","last_clean":"2026-02-23T13:14:56.814269+0000","last_became_active":"2026-02-23T13:14:49.710940+0000","last_became_peered":"2026-02-23T13:14:49.710940+0000","last_unstale":"2026-02-23T13:14:56.814269+0000","last_undegraded":"2026-02-23T13:14:56.814269+0000","last_fullsized":"2026-02-23T13:14:56.814269+0000","mapping_epoch":96,"log_start":"102'2825","ondisk_log_start":"102'2825","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2825,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:01.989539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185335808,"num_objects":2828,"num_object_clones":0,"num_object_copies":8484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2828,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2828,"num_write_kb":180992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"102'2792","reported_seq":2814,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-23T13:14:56.681708+0000","last_change":"2026-02-23T13:14:49.709045+0000","last_active":"2026-02-23T13:14:56.681708+0000","last_peered":"2026-02-23T13:14:56.681708+0000","last_clean":"2026-02-23T13:14:56.681708+0000","last_became_active":"2026-02-23T13:14:49.708668+0000","last_became_peered":"2026-02-23T13:14:49.708668+0000","last_unstale":"2026-02-23T13:14:56.681708+0000","last_undegraded":"2026-02-23T13:14:56.681708+0000","last_fullsized":"2026-02-23T13:14:56.681708+0000","mapping_epoch":96,"log_start":"102'2789","ondisk_log_start":"102'2789","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2789,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:05.829857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182976512,"num_objects":2792,"num_object_clones":0,"num_object_copies":8376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2792,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2792,"num_write_kb":178688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"102'2764","reported_seq":2786,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-23T13:14:56.670682+0000","last_change":"2026-02-23T13:14:49.709471+0000","last_active":"2026-02-23T13:14:56.670682+0000","last_peered":"2026-02-23T13:14:56.670682+0000","last_clean":"2026-02-23T13:14:56.670682+0000","last_became_active":"2026-02-23T13:14:49.709202+0000","last_became_peered":"2026-02-23T13:14:49.709202+0000","last_unstale":"2026-02-23T13:14:56.670682+0000","last_undegraded":"2026-02-23T13:14:56.670682+0000","last_fullsized":"2026-02-23T13:14:56.670682+0000","mapping_epoch":96,"log_start":"102'2761","ondisk_log_start":"102'2761","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2761,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:00.362060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181141504,"num_objects":2764,"num_object_clones":0,"num_object_copies":8292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2764,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2764,"num_write_kb":176896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"102'2942","reported_seq":2964,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-23T13:14:56.811069+0000","last_change":"2026-02-23T13:14:49.711071+0000","last_active":"2026-02-23T13:14:56.811069+0000","last_peered":"2026-02-23T13:14:56.811069+0000","last_clean":"2026-02-23T13:14:56.811069+0000","last_became_active":"2026-02-23T13:14:49.710193+0000","last_became_peered":"2026-02-23T13:14:49.710193+0000","last_unstale":"2026-02-23T13:14:56.811069+0000","last_undegraded":"2026-02-23T13:14:56.811069+0000","last_fullsized":"2026-02-23T13:14:56.811069+0000","mapping_epoch":96,"log_start":"102'2939","ondisk_log_start":"102'2939","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2939,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:15.360867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192806912,"num_objects":2942,"num_object_clones":0,"num_object_copies":8826,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2942,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2942,"num_write_kb":188288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"102'2906","reported_seq":2928,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-23T13:14:56.701462+0000","last_change":"2026-02-23T13:14:49.710077+0000","last_active":"2026-02-23T13:14:56.701462+0000","last_peered":"2026-02-23T13:14:56.701462+0000","last_clean":"2026-02-23T13:14:56.701462+0000","last_became_active":"2026-02-23T13:14:49.709781+0000","last_became_peered":"2026-02-23T13:14:49.709781+0000","last_unstale":"2026-02-23T13:14:56.701462+0000","last_undegraded":"2026-02-23T13:14:56.701462+0000","last_fullsized":"2026-02-23T13:14:56.701462+0000","mapping_epoch":96,"log_start":"102'2903","ondisk_log_start":"102'2903","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2903,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:16.674175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190447616,"num_objects":2906,"num_object_clones":0,"num_object_copies":8718,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2906,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2906,"num_write_kb":185984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"102'2910","reported_seq":2932,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-23T13:14:56.676709+0000","last_change":"2026-02-23T13:14:49.709980+0000","last_active":"2026-02-23T13:14:56.676709+0000","last_peered":"2026-02-23T13:14:56.676709+0000","last_clean":"2026-02-23T13:14:56.676709+0000","last_became_active":"2026-02-23T13:14:49.709715+0000","last_became_peered":"2026-02-23T13:14:49.709715+0000","last_unstale":"2026-02-23T13:14:56.676709+0000","last_undegraded":"2026-02-23T13:14:56.676709+0000","last_fullsized":"2026-02-23T13:14:56.676709+0000","mapping_epoch":96,"log_start":"102'2907","ondisk_log_start":"102'2907","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":2907,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:07.659456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190709760,"num_objects":2910,"num_object_clones":0,"num_object_copies":8730,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2910,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2910,"num_write_kb":186240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":409,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-23T13:14:54.606544+0000","last_change":"2026-02-23T13:14:11.656044+0000","last_active":"2026-02-23T13:14:54.606544+0000","last_peered":"2026-02-23T13:14:54.606544+0000","last_clean":"2026-02-23T13:14:54.606544+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:14:54.606544+0000","last_undegraded":"2026-02-23T13:14:54.606544+0000","last_fullsized":"2026-02-23T13:14:54.606544+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:14:11.656003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:14:11.656003+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:24.978553+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":3022454784,"num_objects":46119,"num_object_clones":0,"num_object_copies":138357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46119,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46119,"num_write_kb":2951616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9055043584,"data_stored":9055043584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3633,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247954,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2436868,"kb_used_data":1763120,"kb_used_omap":22,"kb_used_meta":673641,"kb_avail":731566332,"statfs":{"total":751619276800,"available":749123923968,"internally_reserved":0,"allocated":1805434880,"data_stored":1804901432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23297,"internal_metadata":689808639},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444181,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3058372,"kb_used_data":2065648,"kb_used_omap":24,"kb_used_meta":992679,"kb_avail":730944828,"statfs":{"total":751619276800,"available":748487503872,"internally_reserved":0,"allocated":2115223552,"data_stored":2114690104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25045,"internal_metadata":1016503851},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574999,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3887680,"kb_used_data":2436716,"kb_used_omap":24,"kb_used_meta":1450919,"kb_avail":730115520,"statfs":{"total":751619276800,"available":747638292480,"internally_reserved":0,"allocated":2495197184,"data_stored":2494667288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24616,"internal_metadata":1485742040},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705816,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2897540,"kb_used_data":1843824,"kb_used_omap":19,"kb_used_meta":1053676,"kb_avail":731105660,"statfs":{"total":751619276800,"available":748652195840,"internally_reserved":0,"allocated":1888075776,"data_stored":1887542328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20050,"internal_metadata":1078964654},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3633,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2253586432,"data_stored":2253586432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2682519552,"data_stored":2682519552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2253127680,"data_stored":2253127680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1865809920,"data_stored":1865809920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:15:02.141 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:15:02.141 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 301 2026-02-23T13:15:02.349 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:02.486 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:02.484+0000 7f631153c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:02.487 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:02.485+0000 7f631153c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:02.655 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:15:02.702 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:15:02.799 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 12 15 92591 92576 482.129 515 0.00180115 0.00207267 2026-02-23T13:15:03.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:02 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/527097494' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:15:03.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:02 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2117353143' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "301"} : dispatch 2026-02-23T13:15:03.799 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 13 16 100862 100846 484.799 516.875 0.00125425 0.00206123 2026-02-23T13:15:04.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:03 trial046 ceph-mon[38575]: from='client.15464 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:15:04.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:03 trial046 ceph-mon[38575]: pgmap v440: 17 pgs: 17 active+clean; 5.1 GiB data, 19 GiB used, 2.7 TiB / 2.7 TiB avail; 592 MiB/s wr, 9.46k op/s 2026-02-23T13:15:04.151 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:15:04.303 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:04.682 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:15:04.682 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:15:04.682 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:04.640+0000 7fda85c30640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:04.682 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:04.640+0000 7fda85c30640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:04.682 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:15:04.682 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:15:04.688 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:15:04.688 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:15:04.701 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:15:04.702 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:15:04.799 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 14 16 107481 107465 479.718 413.688 0.00137786 0.00208308 2026-02-23T13:15:05.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:05 trial046 ceph-mon[38575]: osdmap e104: 4 total, 4 up, 4 in 2026-02-23T13:15:05.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:05 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2033153175' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:15:05.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:05 trial046 ceph-mon[38575]: pgmap v442: 17 pgs: 17 active+clean; 5.1 GiB data, 19 GiB used, 2.7 TiB / 2.7 TiB avail; 447 MiB/s wr, 7.14k op/s 2026-02-23T13:15:05.799 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 15 16 113883 113867 474.409 400.125 0.00347183 0.00210634 2026-02-23T13:15:06.539 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:15:06 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:15:06] "GET /metrics HTTP/1.1" 200 4214 "" "Prometheus/3.6.0" 2026-02-23T13:15:06.560 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:15:06 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:15:06.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:15:06.799 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 16 15 121658 121643 475.131 486 0.00133414 0.00210322 2026-02-23T13:15:07.443 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:15:07.604 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:07.704 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:15:07.704 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:15:07.704 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:15:07.705 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:15:07.800 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 17 16 129405 129389 475.658 484.125 0.00240902 0.00210089 2026-02-23T13:15:07.882 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:07.935 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:07.933+0000 7f29246c0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:07.935 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:07.933+0000 7f29246c0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:07.952 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:15:07.953 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:15:07.970 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:15:07.971 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:15:07.985 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:15:07.985 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:15:07.986 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:07 trial046 ceph-mon[38575]: pgmap v443: 17 pgs: 17 active+clean; 6.3 GiB data, 22 GiB used, 2.7 TiB / 2.7 TiB avail; 441 MiB/s wr, 7.05k op/s 2026-02-23T13:15:08.000 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:15:08.001 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:15:08.009 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:08.007+0000 7f12b71d8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:08.009 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:08.007+0000 7f12b71d8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:08.156 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:15:08.156 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:15:08.212 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":443,"stamp":"2026-02-23T13:15:06.688590+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6722290208,"num_objects":102567,"num_object_clones":0,"num_object_copies":307701,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102567,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":102700,"num_write_kb":6566310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":23322260,"kb_used_data":18609732,"kb_used_omap":94,"kb_used_meta":4712353,"kb_avail":2912690540,"statfs":{"total":3006477107200,"available":2982595112960,"internally_reserved":0,"allocated":19056365568,"data_stored":19054188006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":96909,"internal_metadata":4825449843},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3699245056,"num_objects":56446,"num_object_clones":0,"num_object_copies":169338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56446,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56446,"num_write_kb":3612544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001226"},"pg_stats":[{"pgid":"6.f","version":"103'5343","reported_seq":5365,"reported_epoch":103,"state":"active+clean","last_fresh":"2026-02-23T13:15:01.817867+0000","last_change":"2026-02-23T13:14:49.711212+0000","last_active":"2026-02-23T13:15:01.817867+0000","last_peered":"2026-02-23T13:15:01.817867+0000","last_clean":"2026-02-23T13:15:01.817867+0000","last_became_active":"2026-02-23T13:14:49.710909+0000","last_became_peered":"2026-02-23T13:14:49.710909+0000","last_unstale":"2026-02-23T13:15:01.817867+0000","last_undegraded":"2026-02-23T13:15:01.817867+0000","last_fullsized":"2026-02-23T13:15:01.817867+0000","mapping_epoch":96,"log_start":"103'5340","ondisk_log_start":"103'5340","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:18.401390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":350158848,"num_objects":5343,"num_object_clones":0,"num_object_copies":16029,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5343,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5343,"num_write_kb":341952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"104'7572","reported_seq":7598,"reported_epoch":104,"state":"active+clean","last_fresh":"2026-02-23T13:15:06.686273+0000","last_change":"2026-02-23T13:14:49.711013+0000","last_active":"2026-02-23T13:15:06.686273+0000","last_peered":"2026-02-23T13:15:06.686273+0000","last_clean":"2026-02-23T13:15:06.686273+0000","last_became_active":"2026-02-23T13:14:49.710608+0000","last_became_peered":"2026-02-23T13:14:49.710608+0000","last_unstale":"2026-02-23T13:15:06.686273+0000","last_undegraded":"2026-02-23T13:15:06.686273+0000","last_fullsized":"2026-02-23T13:15:06.686273+0000","mapping_epoch":96,"log_start":"104'7569","ondisk_log_start":"104'7569","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:57.080821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":496238592,"num_objects":7572,"num_object_clones":0,"num_object_copies":22716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7572,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7572,"num_write_kb":484608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"104'7599","reported_seq":7625,"reported_epoch":104,"state":"active+clean","last_fresh":"2026-02-23T13:15:06.686627+0000","last_change":"2026-02-23T13:14:49.711150+0000","last_active":"2026-02-23T13:15:06.686627+0000","last_peered":"2026-02-23T13:15:06.686627+0000","last_clean":"2026-02-23T13:15:06.686627+0000","last_became_active":"2026-02-23T13:14:49.710759+0000","last_became_peered":"2026-02-23T13:14:49.710759+0000","last_unstale":"2026-02-23T13:15:06.686627+0000","last_undegraded":"2026-02-23T13:15:06.686627+0000","last_fullsized":"2026-02-23T13:15:06.686627+0000","mapping_epoch":96,"log_start":"104'7596","ondisk_log_start":"104'7596","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:09.130033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":498008064,"num_objects":7599,"num_object_clones":0,"num_object_copies":22797,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7599,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7599,"num_write_kb":486336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"103'5273","reported_seq":5297,"reported_epoch":103,"state":"active+clean","last_fresh":"2026-02-23T13:15:01.805467+0000","last_change":"2026-02-23T13:14:49.711353+0000","last_active":"2026-02-23T13:15:01.805467+0000","last_peered":"2026-02-23T13:15:01.805467+0000","last_clean":"2026-02-23T13:15:01.805467+0000","last_became_active":"2026-02-23T13:14:49.710648+0000","last_became_peered":"2026-02-23T13:14:49.710648+0000","last_unstale":"2026-02-23T13:15:01.805467+0000","last_undegraded":"2026-02-23T13:15:01.805467+0000","last_fullsized":"2026-02-23T13:15:01.805467+0000","mapping_epoch":96,"log_start":"103'5270","ondisk_log_start":"103'5270","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:00.632137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":345571328,"num_objects":5273,"num_object_clones":0,"num_object_copies":15819,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5273,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5273,"num_write_kb":337472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"103'5315","reported_seq":5339,"reported_epoch":103,"state":"active+clean","last_fresh":"2026-02-23T13:15:01.815094+0000","last_change":"2026-02-23T13:14:49.710716+0000","last_active":"2026-02-23T13:15:01.815094+0000","last_peered":"2026-02-23T13:15:01.815094+0000","last_clean":"2026-02-23T13:15:01.815094+0000","last_became_active":"2026-02-23T13:14:49.709875+0000","last_became_peered":"2026-02-23T13:14:49.709875+0000","last_unstale":"2026-02-23T13:15:01.815094+0000","last_undegraded":"2026-02-23T13:15:01.815094+0000","last_fullsized":"2026-02-23T13:15:01.815094+0000","mapping_epoch":96,"log_start":"103'5312","ondisk_log_start":"103'5312","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:08.189503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":348323840,"num_objects":5315,"num_object_clones":0,"num_object_copies":15945,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5315,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5315,"num_write_kb":340160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"104'7624","reported_seq":7650,"reported_epoch":104,"state":"active+clean","last_fresh":"2026-02-23T13:15:06.686147+0000","last_change":"2026-02-23T13:14:49.710292+0000","last_active":"2026-02-23T13:15:06.686147+0000","last_peered":"2026-02-23T13:15:06.686147+0000","last_clean":"2026-02-23T13:15:06.686147+0000","last_became_active":"2026-02-23T13:14:49.709618+0000","last_became_peered":"2026-02-23T13:14:49.709618+0000","last_unstale":"2026-02-23T13:15:06.686147+0000","last_undegraded":"2026-02-23T13:15:06.686147+0000","last_fullsized":"2026-02-23T13:15:06.686147+0000","mapping_epoch":96,"log_start":"104'7621","ondisk_log_start":"104'7621","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:12.895714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":499646464,"num_objects":7624,"num_object_clones":0,"num_object_copies":22872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7624,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7624,"num_write_kb":487936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"103'5132","reported_seq":5155,"reported_epoch":103,"state":"active+clean","last_fresh":"2026-02-23T13:15:01.702178+0000","last_change":"2026-02-23T13:14:49.711809+0000","last_active":"2026-02-23T13:15:01.702178+0000","last_peered":"2026-02-23T13:15:01.702178+0000","last_clean":"2026-02-23T13:15:01.702178+0000","last_became_active":"2026-02-23T13:14:49.711647+0000","last_became_peered":"2026-02-23T13:14:49.711647+0000","last_unstale":"2026-02-23T13:15:01.702178+0000","last_undegraded":"2026-02-23T13:15:01.702178+0000","last_fullsized":"2026-02-23T13:15:01.702178+0000","mapping_epoch":96,"log_start":"103'5129","ondisk_log_start":"103'5129","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:16.696834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":336330752,"num_objects":5132,"num_object_clones":0,"num_object_copies":15396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5132,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5132,"num_write_kb":328448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"104'7419","reported_seq":7445,"reported_epoch":104,"state":"active+clean","last_fresh":"2026-02-23T13:15:06.675264+0000","last_change":"2026-02-23T13:14:49.710392+0000","last_active":"2026-02-23T13:15:06.675264+0000","last_peered":"2026-02-23T13:15:06.675264+0000","last_clean":"2026-02-23T13:15:06.675264+0000","last_became_active":"2026-02-23T13:14:49.710064+0000","last_became_peered":"2026-02-23T13:14:49.710064+0000","last_unstale":"2026-02-23T13:15:06.675264+0000","last_undegraded":"2026-02-23T13:15:06.675264+0000","last_fullsized":"2026-02-23T13:15:06.675264+0000","mapping_epoch":96,"log_start":"104'7416","ondisk_log_start":"104'7416","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:07.281706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":486211584,"num_objects":7419,"num_object_clones":0,"num_object_copies":22257,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7419,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7419,"num_write_kb":474816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"103'5348","reported_seq":5371,"reported_epoch":103,"state":"active+clean","last_fresh":"2026-02-23T13:15:01.811755+0000","last_change":"2026-02-23T13:14:49.711523+0000","last_active":"2026-02-23T13:15:01.811755+0000","last_peered":"2026-02-23T13:15:01.811755+0000","last_clean":"2026-02-23T13:15:01.811755+0000","last_became_active":"2026-02-23T13:14:49.711227+0000","last_became_peered":"2026-02-23T13:14:49.711227+0000","last_unstale":"2026-02-23T13:15:01.811755+0000","last_undegraded":"2026-02-23T13:15:01.811755+0000","last_fullsized":"2026-02-23T13:15:01.811755+0000","mapping_epoch":96,"log_start":"103'5345","ondisk_log_start":"103'5345","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:09.568570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":350486528,"num_objects":5348,"num_object_clones":0,"num_object_copies":16044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5348,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5348,"num_write_kb":342272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"104'7668","reported_seq":7694,"reported_epoch":104,"state":"active+clean","last_fresh":"2026-02-23T13:15:06.686375+0000","last_change":"2026-02-23T13:14:49.710830+0000","last_active":"2026-02-23T13:15:06.686375+0000","last_peered":"2026-02-23T13:15:06.686375+0000","last_clean":"2026-02-23T13:15:06.686375+0000","last_became_active":"2026-02-23T13:14:49.710282+0000","last_became_peered":"2026-02-23T13:14:49.710282+0000","last_unstale":"2026-02-23T13:15:06.686375+0000","last_undegraded":"2026-02-23T13:15:06.686375+0000","last_fullsized":"2026-02-23T13:15:06.686375+0000","mapping_epoch":96,"log_start":"104'7664","ondisk_log_start":"104'7664","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:05.474131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502530048,"num_objects":7668,"num_object_clones":0,"num_object_copies":23004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7668,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7668,"num_write_kb":490752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"103'5218","reported_seq":5241,"reported_epoch":103,"state":"active+clean","last_fresh":"2026-02-23T13:15:01.816632+0000","last_change":"2026-02-23T13:14:49.711384+0000","last_active":"2026-02-23T13:15:01.816632+0000","last_peered":"2026-02-23T13:15:01.816632+0000","last_clean":"2026-02-23T13:15:01.816632+0000","last_became_active":"2026-02-23T13:14:49.710940+0000","last_became_peered":"2026-02-23T13:14:49.710940+0000","last_unstale":"2026-02-23T13:15:01.816632+0000","last_undegraded":"2026-02-23T13:15:01.816632+0000","last_fullsized":"2026-02-23T13:15:01.816632+0000","mapping_epoch":96,"log_start":"103'5215","ondisk_log_start":"103'5215","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:01.989539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":341966848,"num_objects":5218,"num_object_clones":0,"num_object_copies":15654,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5218,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5218,"num_write_kb":333952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"104'7531","reported_seq":7557,"reported_epoch":104,"state":"active+clean","last_fresh":"2026-02-23T13:15:06.682247+0000","last_change":"2026-02-23T13:14:49.709045+0000","last_active":"2026-02-23T13:15:06.682247+0000","last_peered":"2026-02-23T13:15:06.682247+0000","last_clean":"2026-02-23T13:15:06.682247+0000","last_became_active":"2026-02-23T13:14:49.708668+0000","last_became_peered":"2026-02-23T13:14:49.708668+0000","last_unstale":"2026-02-23T13:15:06.682247+0000","last_undegraded":"2026-02-23T13:15:06.682247+0000","last_fullsized":"2026-02-23T13:15:06.682247+0000","mapping_epoch":96,"log_start":"104'7528","ondisk_log_start":"104'7528","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:05.829857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493551616,"num_objects":7531,"num_object_clones":0,"num_object_copies":22593,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7531,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7531,"num_write_kb":481984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"104'7552","reported_seq":7578,"reported_epoch":104,"state":"active+clean","last_fresh":"2026-02-23T13:15:06.676419+0000","last_change":"2026-02-23T13:14:49.709471+0000","last_active":"2026-02-23T13:15:06.676419+0000","last_peered":"2026-02-23T13:15:06.676419+0000","last_clean":"2026-02-23T13:15:06.676419+0000","last_became_active":"2026-02-23T13:14:49.709202+0000","last_became_peered":"2026-02-23T13:14:49.709202+0000","last_unstale":"2026-02-23T13:15:06.676419+0000","last_undegraded":"2026-02-23T13:15:06.676419+0000","last_fullsized":"2026-02-23T13:15:06.676419+0000","mapping_epoch":96,"log_start":"104'7549","ondisk_log_start":"104'7549","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:00.362060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":494927872,"num_objects":7552,"num_object_clones":0,"num_object_copies":22656,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7552,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7552,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"103'5295","reported_seq":5319,"reported_epoch":103,"state":"active+clean","last_fresh":"2026-02-23T13:15:01.817127+0000","last_change":"2026-02-23T13:14:49.711071+0000","last_active":"2026-02-23T13:15:01.817127+0000","last_peered":"2026-02-23T13:15:01.817127+0000","last_clean":"2026-02-23T13:15:01.817127+0000","last_became_active":"2026-02-23T13:14:49.710193+0000","last_became_peered":"2026-02-23T13:14:49.710193+0000","last_unstale":"2026-02-23T13:15:01.817127+0000","last_undegraded":"2026-02-23T13:15:01.817127+0000","last_fullsized":"2026-02-23T13:15:01.817127+0000","mapping_epoch":96,"log_start":"103'5292","ondisk_log_start":"103'5292","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:15.360867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":347013120,"num_objects":5295,"num_object_clones":0,"num_object_copies":15885,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5295,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5295,"num_write_kb":338880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"103'5266","reported_seq":5290,"reported_epoch":103,"state":"active+clean","last_fresh":"2026-02-23T13:15:01.699161+0000","last_change":"2026-02-23T13:14:49.710077+0000","last_active":"2026-02-23T13:15:01.699161+0000","last_peered":"2026-02-23T13:15:01.699161+0000","last_clean":"2026-02-23T13:15:01.699161+0000","last_became_active":"2026-02-23T13:14:49.709781+0000","last_became_peered":"2026-02-23T13:14:49.709781+0000","last_unstale":"2026-02-23T13:15:01.699161+0000","last_undegraded":"2026-02-23T13:15:01.699161+0000","last_fullsized":"2026-02-23T13:15:01.699161+0000","mapping_epoch":96,"log_start":"103'5263","ondisk_log_start":"103'5263","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:16.674175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":345112576,"num_objects":5266,"num_object_clones":0,"num_object_copies":15798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5266,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5266,"num_write_kb":337024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"104'7410","reported_seq":7436,"reported_epoch":104,"state":"active+clean","last_fresh":"2026-02-23T13:15:06.675290+0000","last_change":"2026-02-23T13:14:49.709980+0000","last_active":"2026-02-23T13:15:06.675290+0000","last_peered":"2026-02-23T13:15:06.675290+0000","last_clean":"2026-02-23T13:15:06.675290+0000","last_became_active":"2026-02-23T13:14:49.709715+0000","last_became_peered":"2026-02-23T13:14:49.709715+0000","last_unstale":"2026-02-23T13:15:06.675290+0000","last_undegraded":"2026-02-23T13:15:06.675290+0000","last_fullsized":"2026-02-23T13:15:06.675290+0000","mapping_epoch":96,"log_start":"104'7407","ondisk_log_start":"104'7407","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:07.659456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":485621760,"num_objects":7410,"num_object_clones":0,"num_object_copies":22230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7410,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7410,"num_write_kb":474240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":414,"reported_epoch":104,"state":"active+clean","last_fresh":"2026-02-23T13:15:04.604315+0000","last_change":"2026-02-23T13:14:11.656044+0000","last_active":"2026-02-23T13:15:04.604315+0000","last_peered":"2026-02-23T13:15:04.604315+0000","last_clean":"2026-02-23T13:15:04.604315+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:15:04.604315+0000","last_undegraded":"2026-02-23T13:15:04.604315+0000","last_fullsized":"2026-02-23T13:15:04.604315+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:14:11.656003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:14:11.656003+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:24.978553+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":6721699840,"num_objects":102565,"num_object_clones":0,"num_object_copies":307695,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102565,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102565,"num_write_kb":6564160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19835322368,"data_stored":19835322368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3819,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247956,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5561628,"kb_used_data":4743560,"kb_used_omap":24,"kb_used_meta":818023,"kb_avail":728441572,"statfs":{"total":751619276800,"available":745924169728,"internally_reserved":0,"allocated":4857405440,"data_stored":4856856218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24598,"internal_metadata":837656554},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444183,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6828124,"kb_used_data":5654920,"kb_used_omap":25,"kb_used_meta":1173158,"kb_avail":727175076,"statfs":{"total":751619276800,"available":744627277824,"internally_reserved":0,"allocated":5790638080,"data_stored":5790088858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26349,"internal_metadata":1201314067},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575000,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":6106572,"kb_used_data":4547320,"kb_used_omap":24,"kb_used_meta":1559207,"kb_avail":727896628,"statfs":{"total":751619276800,"available":745366147072,"internally_reserved":0,"allocated":4656455680,"data_stored":4655917897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25272,"internal_metadata":1596628296},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705817,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4825936,"kb_used_data":3663932,"kb_used_omap":20,"kb_used_meta":1161963,"kb_avail":729177264,"statfs":{"total":751619276800,"available":746677518336,"internally_reserved":0,"allocated":3751866368,"data_stored":3751325033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20690,"internal_metadata":1189850926},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3819,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4109107200,"data_stored":4109107200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4845535232,"data_stored":4845535232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5953028096,"data_stored":5953028096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4927651840,"data_stored":4927651840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:15:08.215 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:15:08.216 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 311 2026-02-23T13:15:08.369 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:08.492 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:08.489+0000 7fbdf7169640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:08.492 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:08.490+0000 7fbdf7169640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:08.658 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:15:08.702 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:15:08.799 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 18 15 137323 137308 476.727 494.938 0.00158631 0.00209625 2026-02-23T13:15:09.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:08 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1599630294' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:15:09.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:08 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1333456777' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "311"} : dispatch 2026-02-23T13:15:09.799 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 19 16 145649 145633 479.019 520.312 0.00146177 0.00208619 2026-02-23T13:15:10.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:09 trial046 ceph-mon[38575]: from='client.15474 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:15:10.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:09 trial046 ceph-mon[38575]: pgmap v444: 17 pgs: 17 active+clean; 7.4 GiB data, 26 GiB used, 2.7 TiB / 2.7 TiB avail; 516 MiB/s wr, 8.26k op/s 2026-02-23T13:15:10.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:09 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:15:10.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:09 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:15:10.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:09 trial046 ceph-mon[38575]: osdmap e105: 4 total, 4 up, 4 in 2026-02-23T13:15:10.056 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:15:10.208 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:10.337 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:10.335+0000 7f9aea184640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:10.337 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:10.335+0000 7f9aea184640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:10.353 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:15:10.353 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:15:10.368 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:15:10.369 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:15:10.383 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:15:10.383 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:15:10.397 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:15:10.397 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:15:10.800 INFO:tasks.radosbench.radosbench.0.trial046.stdout:2026-02-23T13:15:10.799784+0000 min lat: 0.000715357 max lat: 0.0380912 avg lat: 0.0020828 2026-02-23T13:15:10.800 INFO:tasks.radosbench.radosbench.0.trial046.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-23T13:15:10.800 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 20 16 153563 153547 479.797 494.625 0.00272749 0.0020828 2026-02-23T13:15:11.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:10 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3234181386' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:15:11.800 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 21 16 161830 161814 481.552 516.688 0.00106652 0.00207523 2026-02-23T13:15:12.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:11 trial046 ceph-mon[38575]: pgmap v446: 17 pgs: 17 active+clean; 7.4 GiB data, 26 GiB used, 2.7 TiB / 2.7 TiB avail; 292 MiB/s wr, 4.67k op/s 2026-02-23T13:15:12.457 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:15:12.615 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:12.752 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:12.749+0000 7f77e3e34640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:12.752 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:12.750+0000 7f77e3e34640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:12.768 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:15:12.768 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:15:12.783 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:15:12.783 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:15:12.796 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:15:12.797 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:15:12.800 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 22 16 170057 170041 483.033 514.188 0.00150034 0.00206888 2026-02-23T13:15:12.811 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:15:12.811 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:15:13.703 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:15:13.703 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:15:13.703 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_4 2026-02-23T13:15:13.704 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:15:13.800 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 23 16 178144 178128 484.006 505.438 0.00144372 0.00206472 2026-02-23T13:15:13.853 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:14.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:13 trial046 ceph-mon[38575]: pgmap v447: 17 pgs: 17 active+clean; 9.8 GiB data, 33 GiB used, 2.7 TiB / 2.7 TiB avail; 599 MiB/s wr, 9.58k op/s 2026-02-23T13:15:14.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:13 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1385199189' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:15:14.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:13 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-23T13:15:14.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:13 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:15:14.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:13 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-23T13:15:14.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:13 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:15:14.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:13 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-23T13:15:14.228 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:14.213+0000 7feaf6e8b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:14.228 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:14.213+0000 7feaf6e8b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:14.356 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:15:14.357 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:15:14.671 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":447,"stamp":"2026-02-23T13:15:12.689395+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":10570498592,"num_objects":161286,"num_object_clones":0,"num_object_copies":483858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":161286,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":161419,"num_write_kb":10324326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":34782876,"kb_used_data":30210764,"kb_used_omap":99,"kb_used_meta":4571932,"kb_avail":2901229924,"statfs":{"total":3006477107200,"available":2970859442176,"internally_reserved":0,"allocated":30935822336,"data_stored":30933597452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":101459,"internal_metadata":4681659309},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5076353024,"num_objects":77459,"num_object_clones":0,"num_object_copies":232377,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77459,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77459,"num_write_kb":4957376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.085387"},"pg_stats":[{"pgid":"6.f","version":"105'10254","reported_seq":10282,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-23T13:15:11.819515+0000","last_change":"2026-02-23T13:14:49.711212+0000","last_active":"2026-02-23T13:15:11.819515+0000","last_peered":"2026-02-23T13:15:11.819515+0000","last_clean":"2026-02-23T13:15:11.819515+0000","last_became_active":"2026-02-23T13:14:49.710909+0000","last_became_peered":"2026-02-23T13:14:49.710909+0000","last_unstale":"2026-02-23T13:15:11.819515+0000","last_undegraded":"2026-02-23T13:15:11.819515+0000","last_fullsized":"2026-02-23T13:15:11.819515+0000","mapping_epoch":96,"log_start":"105'10251","ondisk_log_start":"105'10251","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:18.401390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672006144,"num_objects":10254,"num_object_clones":0,"num_object_copies":30762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10254,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10254,"num_write_kb":656256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"105'10119","reported_seq":10146,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-23T13:15:11.688382+0000","last_change":"2026-02-23T13:14:49.711013+0000","last_active":"2026-02-23T13:15:11.688382+0000","last_peered":"2026-02-23T13:15:11.688382+0000","last_clean":"2026-02-23T13:15:11.688382+0000","last_became_active":"2026-02-23T13:14:49.710608+0000","last_became_peered":"2026-02-23T13:14:49.710608+0000","last_unstale":"2026-02-23T13:15:11.688382+0000","last_undegraded":"2026-02-23T13:15:11.688382+0000","last_fullsized":"2026-02-23T13:15:11.688382+0000","mapping_epoch":96,"log_start":"105'10116","ondisk_log_start":"105'10116","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:57.080821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":663158784,"num_objects":10119,"num_object_clones":0,"num_object_copies":30357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10119,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10119,"num_write_kb":647616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"105'10106","reported_seq":10134,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-23T13:15:11.687525+0000","last_change":"2026-02-23T13:14:49.711150+0000","last_active":"2026-02-23T13:15:11.687525+0000","last_peered":"2026-02-23T13:15:11.687525+0000","last_clean":"2026-02-23T13:15:11.687525+0000","last_became_active":"2026-02-23T13:14:49.710759+0000","last_became_peered":"2026-02-23T13:14:49.710759+0000","last_unstale":"2026-02-23T13:15:11.687525+0000","last_undegraded":"2026-02-23T13:15:11.687525+0000","last_fullsized":"2026-02-23T13:15:11.687525+0000","mapping_epoch":96,"log_start":"105'10103","ondisk_log_start":"105'10103","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:09.130033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":662306816,"num_objects":10106,"num_object_clones":0,"num_object_copies":30318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10106,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10106,"num_write_kb":646784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"105'10193","reported_seq":10220,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-23T13:15:11.817029+0000","last_change":"2026-02-23T13:14:49.711353+0000","last_active":"2026-02-23T13:15:11.817029+0000","last_peered":"2026-02-23T13:15:11.817029+0000","last_clean":"2026-02-23T13:15:11.817029+0000","last_became_active":"2026-02-23T13:14:49.710648+0000","last_became_peered":"2026-02-23T13:14:49.710648+0000","last_unstale":"2026-02-23T13:15:11.817029+0000","last_undegraded":"2026-02-23T13:15:11.817029+0000","last_fullsized":"2026-02-23T13:15:11.817029+0000","mapping_epoch":96,"log_start":"105'10190","ondisk_log_start":"105'10190","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:00.632137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668008448,"num_objects":10193,"num_object_clones":0,"num_object_copies":30579,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10193,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10193,"num_write_kb":652352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"105'10051","reported_seq":10079,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-23T13:15:11.803805+0000","last_change":"2026-02-23T13:14:49.710716+0000","last_active":"2026-02-23T13:15:11.803805+0000","last_peered":"2026-02-23T13:15:11.803805+0000","last_clean":"2026-02-23T13:15:11.803805+0000","last_became_active":"2026-02-23T13:14:49.709875+0000","last_became_peered":"2026-02-23T13:14:49.709875+0000","last_unstale":"2026-02-23T13:15:11.803805+0000","last_undegraded":"2026-02-23T13:15:11.803805+0000","last_fullsized":"2026-02-23T13:15:11.803805+0000","mapping_epoch":96,"log_start":"105'10048","ondisk_log_start":"105'10048","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:08.189503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":658702336,"num_objects":10051,"num_object_clones":0,"num_object_copies":30153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10051,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10051,"num_write_kb":643264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"105'10144","reported_seq":10172,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-23T13:15:11.682201+0000","last_change":"2026-02-23T13:14:49.710292+0000","last_active":"2026-02-23T13:15:11.682201+0000","last_peered":"2026-02-23T13:15:11.682201+0000","last_clean":"2026-02-23T13:15:11.682201+0000","last_became_active":"2026-02-23T13:14:49.709618+0000","last_became_peered":"2026-02-23T13:14:49.709618+0000","last_unstale":"2026-02-23T13:15:11.682201+0000","last_undegraded":"2026-02-23T13:15:11.682201+0000","last_fullsized":"2026-02-23T13:15:11.682201+0000","mapping_epoch":96,"log_start":"105'10141","ondisk_log_start":"105'10141","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:12.895714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":664797184,"num_objects":10144,"num_object_clones":0,"num_object_copies":30432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10144,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10144,"num_write_kb":649216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"105'9947","reported_seq":9975,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-23T13:15:11.697751+0000","last_change":"2026-02-23T13:14:49.711809+0000","last_active":"2026-02-23T13:15:11.697751+0000","last_peered":"2026-02-23T13:15:11.697751+0000","last_clean":"2026-02-23T13:15:11.697751+0000","last_became_active":"2026-02-23T13:14:49.711647+0000","last_became_peered":"2026-02-23T13:14:49.711647+0000","last_unstale":"2026-02-23T13:15:11.697751+0000","last_undegraded":"2026-02-23T13:15:11.697751+0000","last_fullsized":"2026-02-23T13:15:11.697751+0000","mapping_epoch":96,"log_start":"105'9944","ondisk_log_start":"105'9944","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:16.696834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":651886592,"num_objects":9947,"num_object_clones":0,"num_object_copies":29841,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9947,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9947,"num_write_kb":636608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"105'9890","reported_seq":9918,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-23T13:15:11.674103+0000","last_change":"2026-02-23T13:14:49.710392+0000","last_active":"2026-02-23T13:15:11.674103+0000","last_peered":"2026-02-23T13:15:11.674103+0000","last_clean":"2026-02-23T13:15:11.674103+0000","last_became_active":"2026-02-23T13:14:49.710064+0000","last_became_peered":"2026-02-23T13:14:49.710064+0000","last_unstale":"2026-02-23T13:15:11.674103+0000","last_undegraded":"2026-02-23T13:15:11.674103+0000","last_fullsized":"2026-02-23T13:15:11.674103+0000","mapping_epoch":96,"log_start":"105'9887","ondisk_log_start":"105'9887","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:07.281706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":648151040,"num_objects":9890,"num_object_clones":0,"num_object_copies":29670,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9890,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9890,"num_write_kb":632960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"105'10169","reported_seq":10197,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-23T13:15:11.812735+0000","last_change":"2026-02-23T13:14:49.711523+0000","last_active":"2026-02-23T13:15:11.812735+0000","last_peered":"2026-02-23T13:15:11.812735+0000","last_clean":"2026-02-23T13:15:11.812735+0000","last_became_active":"2026-02-23T13:14:49.711227+0000","last_became_peered":"2026-02-23T13:14:49.711227+0000","last_unstale":"2026-02-23T13:15:11.812735+0000","last_undegraded":"2026-02-23T13:15:11.812735+0000","last_fullsized":"2026-02-23T13:15:11.812735+0000","mapping_epoch":96,"log_start":"105'10166","ondisk_log_start":"105'10166","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:09.568570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":666435584,"num_objects":10169,"num_object_clones":0,"num_object_copies":30507,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10169,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10169,"num_write_kb":650816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"105'10194","reported_seq":10222,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-23T13:15:11.687572+0000","last_change":"2026-02-23T13:14:49.710830+0000","last_active":"2026-02-23T13:15:11.687572+0000","last_peered":"2026-02-23T13:15:11.687572+0000","last_clean":"2026-02-23T13:15:11.687572+0000","last_became_active":"2026-02-23T13:14:49.710282+0000","last_became_peered":"2026-02-23T13:14:49.710282+0000","last_unstale":"2026-02-23T13:15:11.687572+0000","last_undegraded":"2026-02-23T13:15:11.687572+0000","last_fullsized":"2026-02-23T13:15:11.687572+0000","mapping_epoch":96,"log_start":"105'10191","ondisk_log_start":"105'10191","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:05.474131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668073984,"num_objects":10194,"num_object_clones":0,"num_object_copies":30582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10194,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10194,"num_write_kb":652416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"105'10056","reported_seq":10084,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-23T13:15:11.813940+0000","last_change":"2026-02-23T13:14:49.711384+0000","last_active":"2026-02-23T13:15:11.813940+0000","last_peered":"2026-02-23T13:15:11.813940+0000","last_clean":"2026-02-23T13:15:11.813940+0000","last_became_active":"2026-02-23T13:14:49.710940+0000","last_became_peered":"2026-02-23T13:14:49.710940+0000","last_unstale":"2026-02-23T13:15:11.813940+0000","last_undegraded":"2026-02-23T13:15:11.813940+0000","last_fullsized":"2026-02-23T13:15:11.813940+0000","mapping_epoch":96,"log_start":"105'10053","ondisk_log_start":"105'10053","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:01.989539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":659030016,"num_objects":10056,"num_object_clones":0,"num_object_copies":30168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10056,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10056,"num_write_kb":643584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"105'9984","reported_seq":10012,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-23T13:15:11.682100+0000","last_change":"2026-02-23T13:14:49.709045+0000","last_active":"2026-02-23T13:15:11.682100+0000","last_peered":"2026-02-23T13:15:11.682100+0000","last_clean":"2026-02-23T13:15:11.682100+0000","last_became_active":"2026-02-23T13:14:49.708668+0000","last_became_peered":"2026-02-23T13:14:49.708668+0000","last_unstale":"2026-02-23T13:15:11.682100+0000","last_undegraded":"2026-02-23T13:15:11.682100+0000","last_fullsized":"2026-02-23T13:15:11.682100+0000","mapping_epoch":96,"log_start":"105'9981","ondisk_log_start":"105'9981","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:05.829857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":654311424,"num_objects":9984,"num_object_clones":0,"num_object_copies":29952,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9984,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9984,"num_write_kb":638976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"105'10077","reported_seq":10103,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-23T13:15:11.676454+0000","last_change":"2026-02-23T13:14:49.709471+0000","last_active":"2026-02-23T13:15:11.676454+0000","last_peered":"2026-02-23T13:15:11.676454+0000","last_clean":"2026-02-23T13:15:11.676454+0000","last_became_active":"2026-02-23T13:14:49.709202+0000","last_became_peered":"2026-02-23T13:14:49.709202+0000","last_unstale":"2026-02-23T13:15:11.676454+0000","last_undegraded":"2026-02-23T13:15:11.676454+0000","last_fullsized":"2026-02-23T13:15:11.676454+0000","mapping_epoch":96,"log_start":"105'10074","ondisk_log_start":"105'10074","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:00.362060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":660406272,"num_objects":10077,"num_object_clones":0,"num_object_copies":30231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10077,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10077,"num_write_kb":644928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"105'10085","reported_seq":10113,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-23T13:15:11.816570+0000","last_change":"2026-02-23T13:14:49.711071+0000","last_active":"2026-02-23T13:15:11.816570+0000","last_peered":"2026-02-23T13:15:11.816570+0000","last_clean":"2026-02-23T13:15:11.816570+0000","last_became_active":"2026-02-23T13:14:49.710193+0000","last_became_peered":"2026-02-23T13:14:49.710193+0000","last_unstale":"2026-02-23T13:15:11.816570+0000","last_undegraded":"2026-02-23T13:15:11.816570+0000","last_fullsized":"2026-02-23T13:15:11.816570+0000","mapping_epoch":96,"log_start":"105'10082","ondisk_log_start":"105'10082","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:15.360867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":660930560,"num_objects":10085,"num_object_clones":0,"num_object_copies":30255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10085,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10085,"num_write_kb":645440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"105'10036","reported_seq":10064,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-23T13:15:11.697821+0000","last_change":"2026-02-23T13:14:49.710077+0000","last_active":"2026-02-23T13:15:11.697821+0000","last_peered":"2026-02-23T13:15:11.697821+0000","last_clean":"2026-02-23T13:15:11.697821+0000","last_became_active":"2026-02-23T13:14:49.709781+0000","last_became_peered":"2026-02-23T13:14:49.709781+0000","last_unstale":"2026-02-23T13:15:11.697821+0000","last_undegraded":"2026-02-23T13:15:11.697821+0000","last_fullsized":"2026-02-23T13:15:11.697821+0000","mapping_epoch":96,"log_start":"105'10033","ondisk_log_start":"105'10033","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:16.674175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":657719296,"num_objects":10036,"num_object_clones":0,"num_object_copies":30108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10036,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10036,"num_write_kb":642304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"105'9979","reported_seq":10007,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-23T13:15:11.677113+0000","last_change":"2026-02-23T13:14:49.709980+0000","last_active":"2026-02-23T13:15:11.677113+0000","last_peered":"2026-02-23T13:15:11.677113+0000","last_clean":"2026-02-23T13:15:11.677113+0000","last_became_active":"2026-02-23T13:14:49.709715+0000","last_became_peered":"2026-02-23T13:14:49.709715+0000","last_unstale":"2026-02-23T13:15:11.677113+0000","last_undegraded":"2026-02-23T13:15:11.677113+0000","last_fullsized":"2026-02-23T13:15:11.677113+0000","mapping_epoch":96,"log_start":"105'9976","ondisk_log_start":"105'9976","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:07.659456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":653983744,"num_objects":9979,"num_object_clones":0,"num_object_copies":29937,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9979,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9979,"num_write_kb":638656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":416,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-23T13:15:09.605816+0000","last_change":"2026-02-23T13:14:11.656044+0000","last_active":"2026-02-23T13:15:09.605816+0000","last_peered":"2026-02-23T13:15:09.605816+0000","last_clean":"2026-02-23T13:15:09.605816+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:15:09.605816+0000","last_undegraded":"2026-02-23T13:15:09.605816+0000","last_fullsized":"2026-02-23T13:15:09.605816+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:14:11.656003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:14:11.656003+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:24.978553+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":10569908224,"num_objects":161284,"num_object_clones":0,"num_object_copies":483852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":161284,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161284,"num_write_kb":10322176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":31696748544,"data_stored":31696748544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3897,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247957,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":7296936,"kb_used_data":6370580,"kb_used_omap":24,"kb_used_meta":926311,"kb_avail":726706264,"statfs":{"total":751619276800,"available":744147214336,"internally_reserved":0,"allocated":6523473920,"data_stored":6522916811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25240,"internal_metadata":948542824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444184,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":8904104,"kb_used_data":7568468,"kb_used_omap":26,"kb_used_meta":1335589,"kb_avail":725099096,"statfs":{"total":751619276800,"available":742501474304,"internally_reserved":0,"allocated":7750111232,"data_stored":7749554123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27001,"internal_metadata":1367643783},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575002,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":9811620,"kb_used_data":8898128,"kb_used_omap":25,"kb_used_meta":913446,"kb_avail":724191580,"statfs":{"total":751619276800,"available":741572177920,"internally_reserved":0,"allocated":9111683072,"data_stored":9111129515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26572,"internal_metadata":935368756},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705819,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":8770216,"kb_used_data":7373588,"kb_used_omap":22,"kb_used_meta":1396585,"kb_avail":725232984,"statfs":{"total":751619276800,"available":742638575616,"internally_reserved":0,"allocated":7550554112,"data_stored":7549997003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22646,"internal_metadata":1430103946},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3897,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7919960064,"data_stored":7919960064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9277079552,"data_stored":9277079552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7925202944,"data_stored":7925202944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6574505984,"data_stored":6574505984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:15:14.673 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_4 pgp_num 26 2026-02-23T13:15:14.800 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 24 16 184669 184653 480.83 407.812 0.0022328 0.00207835 2026-02-23T13:15:14.832 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:14.866 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:15:14.966 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:14.964+0000 7f28aafed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:14.967 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:14.965+0000 7f28aafed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:15.025 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:15.128 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-23T13:15:15.153 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:15.151+0000 7f5131f46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:15.154 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:15.152+0000 7f5131f46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:15.171 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:15:15.172 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:15:15.176 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:15:15.186 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:15:15.186 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:15:15.198 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:15:15.199 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:15:15.212 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:15:15.213 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:15:15.800 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 25 16 192782 192766 481.877 507.062 0.00244203 0.00207382 2026-02-23T13:15:16.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:15 trial046 ceph-mon[38575]: from='client.15482 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:15:16.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:15 trial046 ceph-mon[38575]: osdmap e106: 4 total, 4 up, 4 in 2026-02-23T13:15:16.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:15 trial046 ceph-mon[38575]: pgmap v449: 17 pgs: 17 active+clean; 9.8 GiB data, 33 GiB used, 2.7 TiB / 2.7 TiB avail; 459 MiB/s wr, 7.34k op/s 2026-02-23T13:15:16.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:15 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1756502984' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pgp_num", "val": "26"} : dispatch 2026-02-23T13:15:16.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:15 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2700170529' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:15:16.469 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:15:16 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:15:16.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:15:16.539 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:15:16 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:15:16] "GET /metrics HTTP/1.1" 200 4214 "" "Prometheus/3.6.0" 2026-02-23T13:15:16.800 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 26 16 201234 201218 483.659 528.25 0.00141994 0.00206617 2026-02-23T13:15:17.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:16 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:15:17.261 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:15:17.413 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:17.549 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:17.547+0000 7f8c68c62640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:17.549 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:17.547+0000 7f8c68c62640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:17.568 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:15:17.568 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:15:17.581 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:15:17.582 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:15:17.597 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:15:17.597 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:15:17.613 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:15:17.613 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:15:17.800 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 27 16 209331 209315 484.488 506.062 0.00115671 0.00206266 2026-02-23T13:15:18.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:17 trial046 ceph-mon[38575]: pgmap v450: 17 pgs: 17 active+clean; 11 GiB data, 37 GiB used, 2.7 TiB / 2.7 TiB avail; 468 MiB/s wr, 7.48k op/s 2026-02-23T13:15:18.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:17 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3441801438' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:15:18.800 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 28 16 217025 217009 484.357 480.875 0.00184641 0.00206322 2026-02-23T13:15:19.663 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:15:19.800 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 29 15 225362 225347 485.624 521.125 0.00225448 0.00205786 2026-02-23T13:15:19.816 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:19.939 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:19 trial046 ceph-mon[38575]: pgmap v451: 17 pgs: 17 active+clean; 12 GiB data, 41 GiB used, 2.7 TiB / 2.7 TiB avail; 547 MiB/s wr, 8.75k op/s 2026-02-23T13:15:19.939 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:19 trial046 ceph-mon[38575]: osdmap e107: 4 total, 4 up, 4 in 2026-02-23T13:15:20.079 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:20.069+0000 7f1a6d62f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:20.080 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:20.069+0000 7f1a6d62f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:20.084 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:15:20.084 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:15:20.099 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:15:20.100 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:15:20.114 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:15:20.115 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:15:20.128 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:15:20.128 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:15:20.177 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:15:20.177 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:15:20.178 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_4 2026-02-23T13:15:20.178 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:15:20.319 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:20.800 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 30 16 230952 230936 481.079 349.312 0.00148113 0.00207732 2026-02-23T13:15:20.918 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:20 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3911064308' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:15:21.057 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:21.055+0000 7f1cc667e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:21.057 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:21.055+0000 7f1cc667e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:21.207 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:15:21.208 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:15:21.259 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":453,"stamp":"2026-02-23T13:15:20.690551+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":13150323232,"num_objects":200651,"num_object_clones":0,"num_object_copies":601953,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200651,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":200784,"num_write_kb":12843686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":43091980,"kb_used_data":38068604,"kb_used_omap":101,"kb_used_meta":5023130,"kb_avail":2892920820,"statfs":{"total":3006477107200,"available":2962350919680,"internally_reserved":0,"allocated":38982250496,"data_stored":38979994064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":104077,"internal_metadata":5143685491},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2579824640,"num_objects":39365,"num_object_clones":0,"num_object_copies":118095,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39365,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39365,"num_write_kb":2519360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001156"},"pg_stats":[{"pgid":"6.f","version":"106'12735","reported_seq":12765,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-23T13:15:16.816277+0000","last_change":"2026-02-23T13:14:49.711212+0000","last_active":"2026-02-23T13:15:16.816277+0000","last_peered":"2026-02-23T13:15:16.816277+0000","last_clean":"2026-02-23T13:15:16.816277+0000","last_became_active":"2026-02-23T13:14:49.710909+0000","last_became_peered":"2026-02-23T13:14:49.710909+0000","last_unstale":"2026-02-23T13:15:16.816277+0000","last_undegraded":"2026-02-23T13:15:16.816277+0000","last_fullsized":"2026-02-23T13:15:16.816277+0000","mapping_epoch":96,"log_start":"106'12732","ondisk_log_start":"106'12732","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:18.401390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":834600960,"num_objects":12735,"num_object_clones":0,"num_object_copies":38205,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12735,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12735,"num_write_kb":815040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"106'12590","reported_seq":12620,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-23T13:15:16.687659+0000","last_change":"2026-02-23T13:14:49.711013+0000","last_active":"2026-02-23T13:15:16.687659+0000","last_peered":"2026-02-23T13:15:16.687659+0000","last_clean":"2026-02-23T13:15:16.687659+0000","last_became_active":"2026-02-23T13:14:49.710608+0000","last_became_peered":"2026-02-23T13:14:49.710608+0000","last_unstale":"2026-02-23T13:15:16.687659+0000","last_undegraded":"2026-02-23T13:15:16.687659+0000","last_fullsized":"2026-02-23T13:15:16.687659+0000","mapping_epoch":96,"log_start":"106'12587","ondisk_log_start":"106'12587","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:57.080821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":825098240,"num_objects":12590,"num_object_clones":0,"num_object_copies":37770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12590,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12590,"num_write_kb":805760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"106'12572","reported_seq":12602,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-23T13:15:16.678343+0000","last_change":"2026-02-23T13:14:49.711150+0000","last_active":"2026-02-23T13:15:16.678343+0000","last_peered":"2026-02-23T13:15:16.678343+0000","last_clean":"2026-02-23T13:15:16.678343+0000","last_became_active":"2026-02-23T13:14:49.710759+0000","last_became_peered":"2026-02-23T13:14:49.710759+0000","last_unstale":"2026-02-23T13:15:16.678343+0000","last_undegraded":"2026-02-23T13:15:16.678343+0000","last_fullsized":"2026-02-23T13:15:16.678343+0000","mapping_epoch":96,"log_start":"106'12569","ondisk_log_start":"106'12569","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:09.130033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":823918592,"num_objects":12572,"num_object_clones":0,"num_object_copies":37716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12572,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12572,"num_write_kb":804608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"106'12607","reported_seq":12637,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-23T13:15:16.809546+0000","last_change":"2026-02-23T13:14:49.711353+0000","last_active":"2026-02-23T13:15:16.809546+0000","last_peered":"2026-02-23T13:15:16.809546+0000","last_clean":"2026-02-23T13:15:16.809546+0000","last_became_active":"2026-02-23T13:14:49.710648+0000","last_became_peered":"2026-02-23T13:14:49.710648+0000","last_unstale":"2026-02-23T13:15:16.809546+0000","last_undegraded":"2026-02-23T13:15:16.809546+0000","last_fullsized":"2026-02-23T13:15:16.809546+0000","mapping_epoch":96,"log_start":"106'12604","ondisk_log_start":"106'12604","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:00.632137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826212352,"num_objects":12607,"num_object_clones":0,"num_object_copies":37821,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12607,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12607,"num_write_kb":806848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"106'12533","reported_seq":12563,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-23T13:15:16.816802+0000","last_change":"2026-02-23T13:14:49.710716+0000","last_active":"2026-02-23T13:15:16.816802+0000","last_peered":"2026-02-23T13:15:16.816802+0000","last_clean":"2026-02-23T13:15:16.816802+0000","last_became_active":"2026-02-23T13:14:49.709875+0000","last_became_peered":"2026-02-23T13:14:49.709875+0000","last_unstale":"2026-02-23T13:15:16.816802+0000","last_undegraded":"2026-02-23T13:15:16.816802+0000","last_fullsized":"2026-02-23T13:15:16.816802+0000","mapping_epoch":96,"log_start":"106'12530","ondisk_log_start":"106'12530","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:08.189503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":821362688,"num_objects":12533,"num_object_clones":0,"num_object_copies":37599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12533,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12533,"num_write_kb":802112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"106'12606","reported_seq":12636,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-23T13:15:16.688132+0000","last_change":"2026-02-23T13:14:49.710292+0000","last_active":"2026-02-23T13:15:16.688132+0000","last_peered":"2026-02-23T13:15:16.688132+0000","last_clean":"2026-02-23T13:15:16.688132+0000","last_became_active":"2026-02-23T13:14:49.709618+0000","last_became_peered":"2026-02-23T13:14:49.709618+0000","last_unstale":"2026-02-23T13:15:16.688132+0000","last_undegraded":"2026-02-23T13:15:16.688132+0000","last_fullsized":"2026-02-23T13:15:16.688132+0000","mapping_epoch":96,"log_start":"106'12603","ondisk_log_start":"106'12603","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:12.895714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826146816,"num_objects":12606,"num_object_clones":0,"num_object_copies":37818,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12606,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12606,"num_write_kb":806784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"106'12363","reported_seq":12393,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-23T13:15:16.704457+0000","last_change":"2026-02-23T13:14:49.711809+0000","last_active":"2026-02-23T13:15:16.704457+0000","last_peered":"2026-02-23T13:15:16.704457+0000","last_clean":"2026-02-23T13:15:16.704457+0000","last_became_active":"2026-02-23T13:14:49.711647+0000","last_became_peered":"2026-02-23T13:14:49.711647+0000","last_unstale":"2026-02-23T13:15:16.704457+0000","last_undegraded":"2026-02-23T13:15:16.704457+0000","last_fullsized":"2026-02-23T13:15:16.704457+0000","mapping_epoch":96,"log_start":"106'12360","ondisk_log_start":"106'12360","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:16.696834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":810221568,"num_objects":12363,"num_object_clones":0,"num_object_copies":37089,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12363,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12363,"num_write_kb":791232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"106'12369","reported_seq":12399,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-23T13:15:16.671323+0000","last_change":"2026-02-23T13:14:49.710392+0000","last_active":"2026-02-23T13:15:16.671323+0000","last_peered":"2026-02-23T13:15:16.671323+0000","last_clean":"2026-02-23T13:15:16.671323+0000","last_became_active":"2026-02-23T13:14:49.710064+0000","last_became_peered":"2026-02-23T13:14:49.710064+0000","last_unstale":"2026-02-23T13:15:16.671323+0000","last_undegraded":"2026-02-23T13:15:16.671323+0000","last_fullsized":"2026-02-23T13:15:16.671323+0000","mapping_epoch":96,"log_start":"106'12366","ondisk_log_start":"106'12366","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:07.281706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":810614784,"num_objects":12369,"num_object_clones":0,"num_object_copies":37107,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12369,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12369,"num_write_kb":791616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"106'12609","reported_seq":12639,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-23T13:15:16.818026+0000","last_change":"2026-02-23T13:14:49.711523+0000","last_active":"2026-02-23T13:15:16.818026+0000","last_peered":"2026-02-23T13:15:16.818026+0000","last_clean":"2026-02-23T13:15:16.818026+0000","last_became_active":"2026-02-23T13:14:49.711227+0000","last_became_peered":"2026-02-23T13:14:49.711227+0000","last_unstale":"2026-02-23T13:15:16.818026+0000","last_undegraded":"2026-02-23T13:15:16.818026+0000","last_fullsized":"2026-02-23T13:15:16.818026+0000","mapping_epoch":96,"log_start":"106'12606","ondisk_log_start":"106'12606","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:09.568570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826343424,"num_objects":12609,"num_object_clones":0,"num_object_copies":37827,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12609,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12609,"num_write_kb":806976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"106'12717","reported_seq":12747,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-23T13:15:16.677176+0000","last_change":"2026-02-23T13:14:49.710830+0000","last_active":"2026-02-23T13:15:16.677176+0000","last_peered":"2026-02-23T13:15:16.677176+0000","last_clean":"2026-02-23T13:15:16.677176+0000","last_became_active":"2026-02-23T13:14:49.710282+0000","last_became_peered":"2026-02-23T13:14:49.710282+0000","last_unstale":"2026-02-23T13:15:16.677176+0000","last_undegraded":"2026-02-23T13:15:16.677176+0000","last_fullsized":"2026-02-23T13:15:16.677176+0000","mapping_epoch":96,"log_start":"106'12714","ondisk_log_start":"106'12714","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:05.474131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":833421312,"num_objects":12717,"num_object_clones":0,"num_object_copies":38151,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12717,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12717,"num_write_kb":813888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"106'12475","reported_seq":12503,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-23T13:15:16.819402+0000","last_change":"2026-02-23T13:14:49.711384+0000","last_active":"2026-02-23T13:15:16.819402+0000","last_peered":"2026-02-23T13:15:16.819402+0000","last_clean":"2026-02-23T13:15:16.819402+0000","last_became_active":"2026-02-23T13:14:49.710940+0000","last_became_peered":"2026-02-23T13:14:49.710940+0000","last_unstale":"2026-02-23T13:15:16.819402+0000","last_undegraded":"2026-02-23T13:15:16.819402+0000","last_fullsized":"2026-02-23T13:15:16.819402+0000","mapping_epoch":96,"log_start":"106'12472","ondisk_log_start":"106'12472","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:01.989539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":817561600,"num_objects":12475,"num_object_clones":0,"num_object_copies":37425,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12475,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12475,"num_write_kb":798400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"106'12330","reported_seq":12360,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-23T13:15:16.683522+0000","last_change":"2026-02-23T13:14:49.709045+0000","last_active":"2026-02-23T13:15:16.683522+0000","last_peered":"2026-02-23T13:15:16.683522+0000","last_clean":"2026-02-23T13:15:16.683522+0000","last_became_active":"2026-02-23T13:14:49.708668+0000","last_became_peered":"2026-02-23T13:14:49.708668+0000","last_unstale":"2026-02-23T13:15:16.683522+0000","last_undegraded":"2026-02-23T13:15:16.683522+0000","last_fullsized":"2026-02-23T13:15:16.683522+0000","mapping_epoch":96,"log_start":"106'12327","ondisk_log_start":"106'12327","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:05.829857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":808058880,"num_objects":12330,"num_object_clones":0,"num_object_copies":36990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12330,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12330,"num_write_kb":789120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"106'12639","reported_seq":12669,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-23T13:15:16.674815+0000","last_change":"2026-02-23T13:14:49.709471+0000","last_active":"2026-02-23T13:15:16.674815+0000","last_peered":"2026-02-23T13:15:16.674815+0000","last_clean":"2026-02-23T13:15:16.674815+0000","last_became_active":"2026-02-23T13:14:49.709202+0000","last_became_peered":"2026-02-23T13:14:49.709202+0000","last_unstale":"2026-02-23T13:15:16.674815+0000","last_undegraded":"2026-02-23T13:15:16.674815+0000","last_fullsized":"2026-02-23T13:15:16.674815+0000","mapping_epoch":96,"log_start":"106'12636","ondisk_log_start":"106'12636","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:00.362060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":828309504,"num_objects":12639,"num_object_clones":0,"num_object_copies":37917,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12639,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12639,"num_write_kb":808896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"106'12609","reported_seq":12639,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-23T13:15:16.814418+0000","last_change":"2026-02-23T13:14:49.711071+0000","last_active":"2026-02-23T13:15:16.814418+0000","last_peered":"2026-02-23T13:15:16.814418+0000","last_clean":"2026-02-23T13:15:16.814418+0000","last_became_active":"2026-02-23T13:14:49.710193+0000","last_became_peered":"2026-02-23T13:14:49.710193+0000","last_unstale":"2026-02-23T13:15:16.814418+0000","last_undegraded":"2026-02-23T13:15:16.814418+0000","last_fullsized":"2026-02-23T13:15:16.814418+0000","mapping_epoch":96,"log_start":"106'12606","ondisk_log_start":"106'12606","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:15.360867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826343424,"num_objects":12609,"num_object_clones":0,"num_object_copies":37827,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12609,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12609,"num_write_kb":806976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"106'12486","reported_seq":12516,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-23T13:15:16.701208+0000","last_change":"2026-02-23T13:14:49.710077+0000","last_active":"2026-02-23T13:15:16.701208+0000","last_peered":"2026-02-23T13:15:16.701208+0000","last_clean":"2026-02-23T13:15:16.701208+0000","last_became_active":"2026-02-23T13:14:49.709781+0000","last_became_peered":"2026-02-23T13:14:49.709781+0000","last_unstale":"2026-02-23T13:15:16.701208+0000","last_undegraded":"2026-02-23T13:15:16.701208+0000","last_fullsized":"2026-02-23T13:15:16.701208+0000","mapping_epoch":96,"log_start":"106'12483","ondisk_log_start":"106'12483","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:16.674175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":818282496,"num_objects":12486,"num_object_clones":0,"num_object_copies":37458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12486,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12486,"num_write_kb":799104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"106'12409","reported_seq":12438,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-23T13:15:16.673668+0000","last_change":"2026-02-23T13:14:49.709980+0000","last_active":"2026-02-23T13:15:16.673668+0000","last_peered":"2026-02-23T13:15:16.673668+0000","last_clean":"2026-02-23T13:15:16.673668+0000","last_became_active":"2026-02-23T13:14:49.709715+0000","last_became_peered":"2026-02-23T13:14:49.709715+0000","last_unstale":"2026-02-23T13:15:16.673668+0000","last_undegraded":"2026-02-23T13:15:16.673668+0000","last_fullsized":"2026-02-23T13:15:16.673668+0000","mapping_epoch":96,"log_start":"106'12406","ondisk_log_start":"106'12406","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:07.659456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":813236224,"num_objects":12409,"num_object_clones":0,"num_object_copies":37227,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12409,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12409,"num_write_kb":794176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":418,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-23T13:15:14.606644+0000","last_change":"2026-02-23T13:14:11.656044+0000","last_active":"2026-02-23T13:15:14.606644+0000","last_peered":"2026-02-23T13:15:14.606644+0000","last_clean":"2026-02-23T13:15:14.606644+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:15:14.606644+0000","last_undegraded":"2026-02-23T13:15:14.606644+0000","last_fullsized":"2026-02-23T13:15:14.606644+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:14:11.656003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:14:11.656003+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:24.978553+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":13149732864,"num_objects":200649,"num_object_clones":0,"num_object_copies":601947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200649,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200649,"num_write_kb":12841536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":39441727488,"data_stored":39441727488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3975,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247958,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":8954804,"kb_used_data":7902048,"kb_used_omap":25,"kb_used_meta":1052646,"kb_avail":725048396,"statfs":{"total":751619276800,"available":742449557504,"internally_reserved":0,"allocated":8091697152,"data_stored":8091132156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25908,"internal_metadata":1077910220},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444185,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":10878772,"kb_used_data":9452896,"kb_used_omap":27,"kb_used_meta":1425828,"kb_avail":723124428,"statfs":{"total":751619276800,"available":740479414272,"internally_reserved":0,"allocated":9679765504,"data_stored":9679200508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27653,"internal_metadata":1460048891},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575003,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":12109552,"kb_used_data":11087772,"kb_used_omap":26,"kb_used_meta":1021733,"kb_avail":721893648,"statfs":{"total":751619276800,"available":739219095552,"internally_reserved":0,"allocated":11353878528,"data_stored":11353317084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27221,"internal_metadata":1046255019},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705820,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":11148852,"kb_used_data":9625888,"kb_used_omap":22,"kb_used_meta":1522921,"kb_avail":722854348,"statfs":{"total":751619276800,"available":740202852352,"internally_reserved":0,"allocated":9856909312,"data_stored":9856344316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23295,"internal_metadata":1559471361},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3975,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9861988352,"data_stored":9861988352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11527520256,"data_stored":11527520256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9859825664,"data_stored":9859825664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192393216,"data_stored":8192393216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:15:21.261 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:15:21.261 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_4 pg_num 36 2026-02-23T13:15:21.413 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:21.547 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:21.545+0000 7f5688b4c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:21.547 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:21.545+0000 7f5688b4c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:21.703 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:15:21.746 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:15:21.800 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 31 16 238105 238089 479.98 447.062 0.00168284 0.00208205 2026-02-23T13:15:22.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:21 trial046 ceph-mon[38575]: pgmap v453: 17 pgs: 17 active+clean; 12 GiB data, 41 GiB used, 2.7 TiB / 2.7 TiB avail; 307 MiB/s wr, 4.92k op/s 2026-02-23T13:15:22.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:21 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/770801850' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pg_num", "val": "36"} : dispatch 2026-02-23T13:15:22.682 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:15:22.801 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 32 16 246337 246321 481.058 514.5 0.00161167 0.00207742 2026-02-23T13:15:22.832 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:22.969 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:22.966+0000 7fd66d608640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:22.969 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:22 trial046 ceph-mon[38575]: from='client.15492 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:15:22.970 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:22.967+0000 7fd66d608640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:22.984 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:15:22.984 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:15:22.998 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:15:22.999 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:15:23.015 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:15:23.016 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:15:23.030 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:15:23.030 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:15:23.800 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 33 16 254594 254578 482.117 516.062 0.00143332 0.00207285 2026-02-23T13:15:24.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:23 trial046 ceph-mon[38575]: pgmap v454: 17 pgs: 17 active+clean; 15 GiB data, 48 GiB used, 2.7 TiB / 2.7 TiB avail; 590 MiB/s wr, 9.44k op/s 2026-02-23T13:15:24.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:23 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1626916061' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:15:24.801 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 34 15 262646 262631 482.74 503.312 0.00267376 0.00207011 2026-02-23T13:15:25.076 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:15:25.232 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:25.535 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:25.528+0000 7f54fe7ab640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:25.535 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:25.529+0000 7f54fe7ab640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:25.547 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:15:25.547 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:15:25.566 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:15:25.566 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:15:25.581 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:15:25.582 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:15:25.595 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:15:25.595 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:15:25.801 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 35 15 268611 268596 479.598 372.812 0.00233221 0.00208374 2026-02-23T13:15:26.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:25 trial046 ceph-mon[38575]: pgmap v455: 17 pgs: 17 active+clean; 15 GiB data, 48 GiB used, 2.7 TiB / 2.7 TiB avail; 477 MiB/s wr, 7.63k op/s 2026-02-23T13:15:26.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:25 trial046 ceph-mon[38575]: 1.0 scrub starts 2026-02-23T13:15:26.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:25 trial046 ceph-mon[38575]: 1.0 scrub ok 2026-02-23T13:15:26.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:25 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4266094060' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:15:26.539 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:15:26 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:15:26] "GET /metrics HTTP/1.1" 200 4214 "" "Prometheus/3.6.0" 2026-02-23T13:15:26.561 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:15:26 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:15:26.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:15:26.747 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:15:26.747 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:15:26.748 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_4 2026-02-23T13:15:26.748 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:15:26.801 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 36 16 276152 276136 479.365 471.25 0.00171532 0.00208473 2026-02-23T13:15:26.895 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:27.242 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:27.235+0000 7f5dcb3f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:27.242 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:27.235+0000 7f5dcb3f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:27.380 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:15:27.380 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:15:27.801 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 37 16 281758 281742 475.878 350.375 0.00147211 0.00210002 2026-02-23T13:15:27.812 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":456,"stamp":"2026-02-23T13:15:26.691360+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16810050080,"num_objects":256494,"num_object_clones":0,"num_object_copies":769482,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":256494,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":256627,"num_write_kb":16417638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":53869244,"kb_used_data":48484524,"kb_used_omap":103,"kb_used_meta":5384536,"kb_avail":2882143556,"statfs":{"total":3006477107200,"available":2951315001344,"internally_reserved":0,"allocated":49648152576,"data_stored":49645864596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":106402,"internal_metadata":5513764958},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4945936384,"num_objects":75469,"num_object_clones":0,"num_object_copies":226407,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75469,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75469,"num_write_kb":4830016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001405"},"pg_stats":[{"pgid":"6.f","version":"107'15022","reported_seq":15054,"reported_epoch":107,"state":"active+clean","last_fresh":"2026-02-23T13:15:21.818568+0000","last_change":"2026-02-23T13:14:49.711212+0000","last_active":"2026-02-23T13:15:21.818568+0000","last_peered":"2026-02-23T13:15:21.818568+0000","last_clean":"2026-02-23T13:15:21.818568+0000","last_became_active":"2026-02-23T13:14:49.710909+0000","last_became_peered":"2026-02-23T13:14:49.710909+0000","last_unstale":"2026-02-23T13:15:21.818568+0000","last_undegraded":"2026-02-23T13:15:21.818568+0000","last_fullsized":"2026-02-23T13:15:21.818568+0000","mapping_epoch":96,"log_start":"107'15019","ondisk_log_start":"107'15019","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:18.401390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":984481792,"num_objects":15022,"num_object_clones":0,"num_object_copies":45066,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15022,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15022,"num_write_kb":961408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"107'17346","reported_seq":17378,"reported_epoch":107,"state":"active+clean","last_fresh":"2026-02-23T13:15:26.688865+0000","last_change":"2026-02-23T13:14:49.711013+0000","last_active":"2026-02-23T13:15:26.688865+0000","last_peered":"2026-02-23T13:15:26.688865+0000","last_clean":"2026-02-23T13:15:26.688865+0000","last_became_active":"2026-02-23T13:14:49.710608+0000","last_became_peered":"2026-02-23T13:14:49.710608+0000","last_unstale":"2026-02-23T13:15:26.688865+0000","last_undegraded":"2026-02-23T13:15:26.688865+0000","last_fullsized":"2026-02-23T13:15:26.688865+0000","mapping_epoch":96,"log_start":"107'17343","ondisk_log_start":"107'17343","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:57.080821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136787456,"num_objects":17346,"num_object_clones":0,"num_object_copies":52038,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17346,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17346,"num_write_kb":1110144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"107'17158","reported_seq":17190,"reported_epoch":107,"state":"active+clean","last_fresh":"2026-02-23T13:15:26.683577+0000","last_change":"2026-02-23T13:14:49.711150+0000","last_active":"2026-02-23T13:15:26.683577+0000","last_peered":"2026-02-23T13:15:26.683577+0000","last_clean":"2026-02-23T13:15:26.683577+0000","last_became_active":"2026-02-23T13:14:49.710759+0000","last_became_peered":"2026-02-23T13:14:49.710759+0000","last_unstale":"2026-02-23T13:15:26.683577+0000","last_undegraded":"2026-02-23T13:15:26.683577+0000","last_fullsized":"2026-02-23T13:15:26.683577+0000","mapping_epoch":96,"log_start":"107'17155","ondisk_log_start":"107'17155","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:09.130033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1124466688,"num_objects":17158,"num_object_clones":0,"num_object_copies":51474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17158,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17158,"num_write_kb":1098112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"107'14937","reported_seq":14969,"reported_epoch":107,"state":"active+clean","last_fresh":"2026-02-23T13:15:21.816336+0000","last_change":"2026-02-23T13:14:49.711353+0000","last_active":"2026-02-23T13:15:21.816336+0000","last_peered":"2026-02-23T13:15:21.816336+0000","last_clean":"2026-02-23T13:15:21.816336+0000","last_became_active":"2026-02-23T13:14:49.710648+0000","last_became_peered":"2026-02-23T13:14:49.710648+0000","last_unstale":"2026-02-23T13:15:21.816336+0000","last_undegraded":"2026-02-23T13:15:21.816336+0000","last_fullsized":"2026-02-23T13:15:21.816336+0000","mapping_epoch":96,"log_start":"107'14934","ondisk_log_start":"107'14934","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:00.632137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978911232,"num_objects":14937,"num_object_clones":0,"num_object_copies":44811,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14937,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14937,"num_write_kb":955968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"107'14808","reported_seq":14840,"reported_epoch":107,"state":"active+clean","last_fresh":"2026-02-23T13:15:21.815251+0000","last_change":"2026-02-23T13:14:49.710716+0000","last_active":"2026-02-23T13:15:21.815251+0000","last_peered":"2026-02-23T13:15:21.815251+0000","last_clean":"2026-02-23T13:15:21.815251+0000","last_became_active":"2026-02-23T13:14:49.709875+0000","last_became_peered":"2026-02-23T13:14:49.709875+0000","last_unstale":"2026-02-23T13:15:21.815251+0000","last_undegraded":"2026-02-23T13:15:21.815251+0000","last_fullsized":"2026-02-23T13:15:21.815251+0000","mapping_epoch":96,"log_start":"107'14805","ondisk_log_start":"107'14805","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:08.189503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":970457088,"num_objects":14808,"num_object_clones":0,"num_object_copies":44424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14808,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14808,"num_write_kb":947712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"107'17384","reported_seq":17416,"reported_epoch":107,"state":"active+clean","last_fresh":"2026-02-23T13:15:26.684313+0000","last_change":"2026-02-23T13:14:49.710292+0000","last_active":"2026-02-23T13:15:26.684313+0000","last_peered":"2026-02-23T13:15:26.684313+0000","last_clean":"2026-02-23T13:15:26.684313+0000","last_became_active":"2026-02-23T13:14:49.709618+0000","last_became_peered":"2026-02-23T13:14:49.709618+0000","last_unstale":"2026-02-23T13:15:26.684313+0000","last_undegraded":"2026-02-23T13:15:26.684313+0000","last_fullsized":"2026-02-23T13:15:26.684313+0000","mapping_epoch":96,"log_start":"107'17381","ondisk_log_start":"107'17381","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:12.895714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139277824,"num_objects":17384,"num_object_clones":0,"num_object_copies":52152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17384,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17384,"num_write_kb":1112576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"107'14604","reported_seq":14636,"reported_epoch":107,"state":"active+clean","last_fresh":"2026-02-23T13:15:21.704448+0000","last_change":"2026-02-23T13:14:49.711809+0000","last_active":"2026-02-23T13:15:21.704448+0000","last_peered":"2026-02-23T13:15:21.704448+0000","last_clean":"2026-02-23T13:15:21.704448+0000","last_became_active":"2026-02-23T13:14:49.711647+0000","last_became_peered":"2026-02-23T13:14:49.711647+0000","last_unstale":"2026-02-23T13:15:21.704448+0000","last_undegraded":"2026-02-23T13:15:21.704448+0000","last_fullsized":"2026-02-23T13:15:21.704448+0000","mapping_epoch":96,"log_start":"107'14601","ondisk_log_start":"107'14601","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:16.696834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":957087744,"num_objects":14604,"num_object_clones":0,"num_object_copies":43812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14604,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14604,"num_write_kb":934656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"107'17012","reported_seq":17044,"reported_epoch":107,"state":"active+clean","last_fresh":"2026-02-23T13:15:26.675035+0000","last_change":"2026-02-23T13:14:49.710392+0000","last_active":"2026-02-23T13:15:26.675035+0000","last_peered":"2026-02-23T13:15:26.675035+0000","last_clean":"2026-02-23T13:15:26.675035+0000","last_became_active":"2026-02-23T13:14:49.710064+0000","last_became_peered":"2026-02-23T13:14:49.710064+0000","last_unstale":"2026-02-23T13:15:26.675035+0000","last_undegraded":"2026-02-23T13:15:26.675035+0000","last_fullsized":"2026-02-23T13:15:26.675035+0000","mapping_epoch":96,"log_start":"107'17009","ondisk_log_start":"107'17009","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:07.281706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114898432,"num_objects":17012,"num_object_clones":0,"num_object_copies":51036,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17012,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17012,"num_write_kb":1088768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"107'14854","reported_seq":14886,"reported_epoch":107,"state":"active+clean","last_fresh":"2026-02-23T13:15:21.819698+0000","last_change":"2026-02-23T13:14:49.711523+0000","last_active":"2026-02-23T13:15:21.819698+0000","last_peered":"2026-02-23T13:15:21.819698+0000","last_clean":"2026-02-23T13:15:21.819698+0000","last_became_active":"2026-02-23T13:14:49.711227+0000","last_became_peered":"2026-02-23T13:14:49.711227+0000","last_unstale":"2026-02-23T13:15:21.819698+0000","last_undegraded":"2026-02-23T13:15:21.819698+0000","last_fullsized":"2026-02-23T13:15:21.819698+0000","mapping_epoch":96,"log_start":"107'14851","ondisk_log_start":"107'14851","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:09.568570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":973471744,"num_objects":14854,"num_object_clones":0,"num_object_copies":44562,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14854,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14854,"num_write_kb":950656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"107'17312","reported_seq":17344,"reported_epoch":107,"state":"active+clean","last_fresh":"2026-02-23T13:15:26.687744+0000","last_change":"2026-02-23T13:14:49.710830+0000","last_active":"2026-02-23T13:15:26.687744+0000","last_peered":"2026-02-23T13:15:26.687744+0000","last_clean":"2026-02-23T13:15:26.687744+0000","last_became_active":"2026-02-23T13:14:49.710282+0000","last_became_peered":"2026-02-23T13:14:49.710282+0000","last_unstale":"2026-02-23T13:15:26.687744+0000","last_undegraded":"2026-02-23T13:15:26.687744+0000","last_fullsized":"2026-02-23T13:15:26.687744+0000","mapping_epoch":96,"log_start":"107'17309","ondisk_log_start":"107'17309","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:05.474131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134559232,"num_objects":17312,"num_object_clones":0,"num_object_copies":51936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17312,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17312,"num_write_kb":1107968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"107'14905","reported_seq":14936,"reported_epoch":107,"state":"active+clean","last_fresh":"2026-02-23T13:15:21.818220+0000","last_change":"2026-02-23T13:14:49.711384+0000","last_active":"2026-02-23T13:15:21.818220+0000","last_peered":"2026-02-23T13:15:21.818220+0000","last_clean":"2026-02-23T13:15:21.818220+0000","last_became_active":"2026-02-23T13:14:49.710940+0000","last_became_peered":"2026-02-23T13:14:49.710940+0000","last_unstale":"2026-02-23T13:15:21.818220+0000","last_undegraded":"2026-02-23T13:15:21.818220+0000","last_fullsized":"2026-02-23T13:15:21.818220+0000","mapping_epoch":96,"log_start":"107'14902","ondisk_log_start":"107'14902","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:01.989539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":976814080,"num_objects":14905,"num_object_clones":0,"num_object_copies":44715,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14905,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14905,"num_write_kb":953920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"107'16993","reported_seq":17023,"reported_epoch":107,"state":"active+clean","last_fresh":"2026-02-23T13:15:26.688853+0000","last_change":"2026-02-23T13:14:49.709045+0000","last_active":"2026-02-23T13:15:26.688853+0000","last_peered":"2026-02-23T13:15:26.688853+0000","last_clean":"2026-02-23T13:15:26.688853+0000","last_became_active":"2026-02-23T13:14:49.708668+0000","last_became_peered":"2026-02-23T13:14:49.708668+0000","last_unstale":"2026-02-23T13:15:26.688853+0000","last_undegraded":"2026-02-23T13:15:26.688853+0000","last_fullsized":"2026-02-23T13:15:26.688853+0000","mapping_epoch":96,"log_start":"107'16990","ondisk_log_start":"107'16990","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:05.829857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1113653248,"num_objects":16993,"num_object_clones":0,"num_object_copies":50979,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16993,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16993,"num_write_kb":1087552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"107'17293","reported_seq":17325,"reported_epoch":107,"state":"active+clean","last_fresh":"2026-02-23T13:15:26.677007+0000","last_change":"2026-02-23T13:14:49.709471+0000","last_active":"2026-02-23T13:15:26.677007+0000","last_peered":"2026-02-23T13:15:26.677007+0000","last_clean":"2026-02-23T13:15:26.677007+0000","last_became_active":"2026-02-23T13:14:49.709202+0000","last_became_peered":"2026-02-23T13:14:49.709202+0000","last_unstale":"2026-02-23T13:15:26.677007+0000","last_undegraded":"2026-02-23T13:15:26.677007+0000","last_fullsized":"2026-02-23T13:15:26.677007+0000","mapping_epoch":96,"log_start":"107'17290","ondisk_log_start":"107'17290","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:00.362060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133314048,"num_objects":17293,"num_object_clones":0,"num_object_copies":51879,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17293,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17293,"num_write_kb":1106752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"107'14900","reported_seq":14932,"reported_epoch":107,"state":"active+clean","last_fresh":"2026-02-23T13:15:21.820413+0000","last_change":"2026-02-23T13:14:49.711071+0000","last_active":"2026-02-23T13:15:21.820413+0000","last_peered":"2026-02-23T13:15:21.820413+0000","last_clean":"2026-02-23T13:15:21.820413+0000","last_became_active":"2026-02-23T13:14:49.710193+0000","last_became_peered":"2026-02-23T13:14:49.710193+0000","last_unstale":"2026-02-23T13:15:21.820413+0000","last_undegraded":"2026-02-23T13:15:21.820413+0000","last_fullsized":"2026-02-23T13:15:21.820413+0000","mapping_epoch":96,"log_start":"107'14897","ondisk_log_start":"107'14897","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:15.360867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":976486400,"num_objects":14900,"num_object_clones":0,"num_object_copies":44700,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14900,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14900,"num_write_kb":953600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"107'14820","reported_seq":14852,"reported_epoch":107,"state":"active+clean","last_fresh":"2026-02-23T13:15:21.705757+0000","last_change":"2026-02-23T13:14:49.710077+0000","last_active":"2026-02-23T13:15:21.705757+0000","last_peered":"2026-02-23T13:15:21.705757+0000","last_clean":"2026-02-23T13:15:21.705757+0000","last_became_active":"2026-02-23T13:14:49.709781+0000","last_became_peered":"2026-02-23T13:14:49.709781+0000","last_unstale":"2026-02-23T13:15:21.705757+0000","last_undegraded":"2026-02-23T13:15:21.705757+0000","last_fullsized":"2026-02-23T13:15:21.705757+0000","mapping_epoch":96,"log_start":"107'14817","ondisk_log_start":"107'14817","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:16.674175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":971243520,"num_objects":14820,"num_object_clones":0,"num_object_copies":44460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14820,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14820,"num_write_kb":948480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"107'17144","reported_seq":17176,"reported_epoch":107,"state":"active+clean","last_fresh":"2026-02-23T13:15:26.678537+0000","last_change":"2026-02-23T13:14:49.709980+0000","last_active":"2026-02-23T13:15:26.678537+0000","last_peered":"2026-02-23T13:15:26.678537+0000","last_clean":"2026-02-23T13:15:26.678537+0000","last_became_active":"2026-02-23T13:14:49.709715+0000","last_became_peered":"2026-02-23T13:14:49.709715+0000","last_unstale":"2026-02-23T13:15:26.678537+0000","last_undegraded":"2026-02-23T13:15:26.678537+0000","last_fullsized":"2026-02-23T13:15:26.678537+0000","mapping_epoch":96,"log_start":"107'17141","ondisk_log_start":"107'17141","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:07.659456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1123549184,"num_objects":17144,"num_object_clones":0,"num_object_copies":51432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17144,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17144,"num_write_kb":1097216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":428,"reported_epoch":107,"state":"active+clean","last_fresh":"2026-02-23T13:15:25.299766+0000","last_change":"2026-02-23T13:15:25.299766+0000","last_active":"2026-02-23T13:15:25.299766+0000","last_peered":"2026-02-23T13:15:25.299766+0000","last_clean":"2026-02-23T13:15:25.299766+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:15:25.299766+0000","last_undegraded":"2026-02-23T13:15:25.299766+0000","last_fullsized":"2026-02-23T13:15:25.299766+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:15:25.299737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:15:25.299737+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:42.738354+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":16809459712,"num_objects":256492,"num_object_clones":0,"num_object_copies":769476,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":256492,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":256492,"num_write_kb":16415488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":50125471744,"data_stored":50125471744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3873,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247960,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":12080576,"kb_used_data":10865452,"kb_used_omap":25,"kb_used_meta":1215078,"kb_avail":721922624,"statfs":{"total":751619276800,"available":739248766976,"internally_reserved":0,"allocated":11126222848,"data_stored":11125649965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26247,"internal_metadata":1244240249},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444187,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":14689408,"kb_used_data":13046892,"kb_used_omap":27,"kb_used_meta":1642468,"kb_avail":719313792,"statfs":{"total":751619276800,"available":736577323008,"internally_reserved":0,"allocated":13360017408,"data_stored":13359444525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28305,"internal_metadata":1681887599},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575004,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":14123900,"kb_used_data":13192040,"kb_used_omap":27,"kb_used_meta":931812,"kb_avail":719879300,"statfs":{"total":751619276800,"available":737156403200,"internally_reserved":0,"allocated":13508648960,"data_stored":13508079629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27888,"internal_metadata":954176272},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705821,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":12975360,"kb_used_data":11380140,"kb_used_omap":23,"kb_used_meta":1595176,"kb_avail":721027840,"statfs":{"total":751619276800,"available":738332508160,"internally_reserved":0,"allocated":11653263360,"data_stored":11652690477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23962,"internal_metadata":1633460838},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3873,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11683561472,"data_stored":11683561472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13642825728,"data_stored":13642825728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13557366784,"data_stored":13557366784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11241717760,"data_stored":11241717760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:15:27.814 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:15:27.814 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_4 pg_num 46 2026-02-23T13:15:27.850 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:15:27.974 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:28.005 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:27 trial046 ceph-mon[38575]: pgmap v456: 17 pgs: 17 active+clean; 16 GiB data, 51 GiB used, 2.7 TiB / 2.7 TiB avail; 472 MiB/s wr, 7.54k op/s 2026-02-23T13:15:28.008 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:28.113 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:28.112+0000 7f6319fb0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:28.114 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:28.112+0000 7f6319fb0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:28.127 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:28.126+0000 7fc31f24d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:28.127 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:28.127+0000 7fc31f24d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:28.147 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:15:28.147 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:15:28.162 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:15:28.162 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:15:28.176 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:15:28.176 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:15:28.190 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:15:28.190 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:15:28.260 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:15:28.301 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:15:28.801 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 38 16 289490 289474 476.071 483.25 0.00242748 0.00209915 2026-02-23T13:15:29.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:28 trial046 ceph-mon[38575]: from='client.15500 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:15:29.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:28 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4059382011' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:15:29.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:28 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3542188439' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pg_num", "val": "46"} : dispatch 2026-02-23T13:15:29.801 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 39 16 297449 297433 476.618 497.438 0.00183218 0.00209676 2026-02-23T13:15:30.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:29 trial046 ceph-mon[38575]: pgmap v457: 17 pgs: 17 active+clean; 17 GiB data, 55 GiB used, 2.7 TiB / 2.7 TiB avail; 469 MiB/s wr, 7.50k op/s 2026-02-23T13:15:30.240 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:15:30.394 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:30.521 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:30.520+0000 7f4f2a3b0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:30.522 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:30.520+0000 7f4f2a3b0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:30.535 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:15:30.535 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:15:30.553 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:15:30.553 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:15:30.568 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:15:30.568 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:15:30.582 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:15:30.582 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:15:30.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:30 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2691857672' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:15:30.801 INFO:tasks.radosbench.radosbench.0.trial046.stdout:2026-02-23T13:15:30.801380+0000 min lat: 0.000705438 max lat: 0.0425785 avg lat: 0.00209277 2026-02-23T13:15:30.801 INFO:tasks.radosbench.radosbench.0.trial046.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-23T13:15:30.801 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 40 16 305656 305640 477.525 512.938 0.00223369 0.00209277 2026-02-23T13:15:31.801 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 41 16 313754 313738 478.221 506.125 0.00170192 0.00208973 2026-02-23T13:15:32.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:31 trial046 ceph-mon[38575]: pgmap v458: 17 pgs: 17 active+clean; 17 GiB data, 55 GiB used, 2.7 TiB / 2.7 TiB avail; 423 MiB/s wr, 6.76k op/s 2026-02-23T13:15:32.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:31 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:15:32.636 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:15:32.781 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:32.801 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 42 16 322251 322235 479.479 531.062 0.00182857 0.00208425 2026-02-23T13:15:32.910 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:32.909+0000 7fd3c2dd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:32.911 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:32.909+0000 7fd3c2dd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:32.927 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:15:32.928 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:15:32.940 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:15:32.940 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:15:32.952 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:15:32.953 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:15:32.966 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:15:32.966 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:15:33.302 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:15:33.303 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-23T13:15:33.460 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:33.600 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:33.599+0000 7f4ea6061640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:33.601 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:33.599+0000 7f4ea6061640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:33.801 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 43 15 330208 330193 479.894 497.375 0.00130293 0.00208247 2026-02-23T13:15:34.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:33 trial046 ceph-mon[38575]: pgmap v459: 17 pgs: 17 active+clean; 19 GiB data, 62 GiB used, 2.7 TiB / 2.7 TiB avail; 586 MiB/s wr, 9.38k op/s 2026-02-23T13:15:34.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:33 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/978866392' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:15:34.752 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.0 to 1 (10000) 2026-02-23T13:15:34.802 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 44 16 338060 338044 480.138 490.688 0.00192491 0.00208135 2026-02-23T13:15:34.804 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-23T13:15:34.951 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:35.013 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:34 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/333217456' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-23T13:15:35.018 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:15:35.094 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:35.092+0000 7f5e249ee640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:35.094 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:35.093+0000 7f5e249ee640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:35.174 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:35.314 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:35.313+0000 7f3373f0c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:35.314 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:35.313+0000 7f3373f0c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:35.331 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:15:35.331 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:15:35.346 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:15:35.346 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:15:35.361 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:15:35.361 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:15:35.376 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:15:35.376 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:15:35.753 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.1 to 1 (10000) 2026-02-23T13:15:35.802 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 45 16 346122 346106 480.662 503.875 0.00116187 0.00207912 2026-02-23T13:15:35.805 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-23T13:15:35.962 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:36.019 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:35 trial046 ceph-mon[38575]: pgmap v460: 17 pgs: 17 active+clean; 19 GiB data, 62 GiB used, 2.7 TiB / 2.7 TiB avail; 394 MiB/s wr, 6.30k op/s 2026-02-23T13:15:36.019 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:35 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/333217456' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-23T13:15:36.019 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:35 trial046 ceph-mon[38575]: osdmap e108: 4 total, 4 up, 4 in 2026-02-23T13:15:36.019 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:35 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/943170238' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-23T13:15:36.019 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:35 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3322818106' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:15:36.097 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:36.096+0000 7fef52f6f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:36.097 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:36.096+0000 7fef52f6f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:36.289 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:15:36 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:15:36] "GET /metrics HTTP/1.1" 200 4211 "" "Prometheus/3.6.0" 2026-02-23T13:15:36.560 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:15:36 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:15:36.087Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:15:36.758 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.2 to 1 (10000) 2026-02-23T13:15:36.802 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 46 16 354446 354430 481.522 520.25 0.00155743 0.0020754 2026-02-23T13:15:36.815 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-23T13:15:36.969 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:37.028 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:36 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/943170238' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-23T13:15:37.029 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:36 trial046 ceph-mon[38575]: osdmap e109: 4 total, 4 up, 4 in 2026-02-23T13:15:37.029 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:36 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1632685951' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-23T13:15:37.109 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:37.108+0000 7f51e905d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:37.109 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:37.108+0000 7f51e905d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:37.428 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:15:37.583 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:37.716 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:37.714+0000 7f16a105c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:37.717 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:37.715+0000 7f16a105c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:37.733 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:15:37.734 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:15:37.749 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:15:37.749 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:15:37.759 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.3 to 1 (10000) 2026-02-23T13:15:37.762 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:15:37.762 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:15:37.774 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:15:37.775 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:15:37.802 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 47 16 362712 362696 482.268 516.625 0.00210426 0.00207219 2026-02-23T13:15:37.811 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-23T13:15:37.811 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:15:37.954 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:37.984 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:37 trial046 ceph-mon[38575]: pgmap v463: 17 pgs: 17 active+clean; 20 GiB data, 65 GiB used, 2.7 TiB / 2.7 TiB avail; 452 MiB/s wr, 7.23k op/s 2026-02-23T13:15:37.984 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:37 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1632685951' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-23T13:15:37.984 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:37 trial046 ceph-mon[38575]: osdmap e110: 4 total, 4 up, 4 in 2026-02-23T13:15:37.984 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:37 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1145298032' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-23T13:15:37.984 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:37 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1299861438' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:15:38.086 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:38.084+0000 7f655f6fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:38.086 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:38.085+0000 7f655f6fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:38.244 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:15:38.245 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:15:38.381 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":465,"stamp":"2026-02-23T13:15:37.759022+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23198171680,"num_objects":353969,"num_object_clones":0,"num_object_copies":1061907,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":353969,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":354102,"num_write_kb":22656038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":72809820,"kb_used_data":67298444,"kb_used_omap":110,"kb_used_meta":5511185,"kb_avail":2863202980,"statfs":{"total":3006477107200,"available":2931919851520,"internally_reserved":0,"allocated":68913606656,"data_stored":68911255644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":113026,"internal_metadata":5643454078},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2668036096,"num_objects":40711,"num_object_clones":0,"num_object_copies":122133,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40711,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40711,"num_write_kb":2605504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.066834"},"pg_stats":[{"pgid":"6.f","version":"110'22258","reported_seq":22296,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.819049+0000","last_change":"2026-02-23T13:14:49.711212+0000","last_active":"2026-02-23T13:15:36.819049+0000","last_peered":"2026-02-23T13:15:36.819049+0000","last_clean":"2026-02-23T13:15:36.819049+0000","last_became_active":"2026-02-23T13:14:49.710909+0000","last_became_peered":"2026-02-23T13:14:49.710909+0000","last_unstale":"2026-02-23T13:15:36.819049+0000","last_undegraded":"2026-02-23T13:15:36.819049+0000","last_fullsized":"2026-02-23T13:15:36.819049+0000","mapping_epoch":96,"log_start":"110'22254","ondisk_log_start":"110'22254","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:18.401390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1458700288,"num_objects":22258,"num_object_clones":0,"num_object_copies":66774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22258,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22258,"num_write_kb":1424512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"109'22173","reported_seq":22209,"reported_epoch":109,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.688934+0000","last_change":"2026-02-23T13:14:49.711013+0000","last_active":"2026-02-23T13:15:36.688934+0000","last_peered":"2026-02-23T13:15:36.688934+0000","last_clean":"2026-02-23T13:15:36.688934+0000","last_became_active":"2026-02-23T13:14:49.710608+0000","last_became_peered":"2026-02-23T13:14:49.710608+0000","last_unstale":"2026-02-23T13:15:36.688934+0000","last_undegraded":"2026-02-23T13:15:36.688934+0000","last_fullsized":"2026-02-23T13:15:36.688934+0000","mapping_epoch":96,"log_start":"109'22170","ondisk_log_start":"109'22170","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:57.080821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1453129728,"num_objects":22173,"num_object_clones":0,"num_object_copies":66519,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22173,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22173,"num_write_kb":1419072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"109'22010","reported_seq":22046,"reported_epoch":109,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.688557+0000","last_change":"2026-02-23T13:14:49.711150+0000","last_active":"2026-02-23T13:15:36.688557+0000","last_peered":"2026-02-23T13:15:36.688557+0000","last_clean":"2026-02-23T13:15:36.688557+0000","last_became_active":"2026-02-23T13:14:49.710759+0000","last_became_peered":"2026-02-23T13:14:49.710759+0000","last_unstale":"2026-02-23T13:15:36.688557+0000","last_undegraded":"2026-02-23T13:15:36.688557+0000","last_fullsized":"2026-02-23T13:15:36.688557+0000","mapping_epoch":96,"log_start":"109'22007","ondisk_log_start":"109'22007","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:09.130033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1442447360,"num_objects":22010,"num_object_clones":0,"num_object_copies":66030,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22010,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22010,"num_write_kb":1408640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"110'22252","reported_seq":22290,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.820666+0000","last_change":"2026-02-23T13:14:49.711353+0000","last_active":"2026-02-23T13:15:36.820666+0000","last_peered":"2026-02-23T13:15:36.820666+0000","last_clean":"2026-02-23T13:15:36.820666+0000","last_became_active":"2026-02-23T13:14:49.710648+0000","last_became_peered":"2026-02-23T13:14:49.710648+0000","last_unstale":"2026-02-23T13:15:36.820666+0000","last_undegraded":"2026-02-23T13:15:36.820666+0000","last_fullsized":"2026-02-23T13:15:36.820666+0000","mapping_epoch":96,"log_start":"110'22249","ondisk_log_start":"110'22249","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:00.632137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1458307072,"num_objects":22252,"num_object_clones":0,"num_object_copies":66756,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22252,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22252,"num_write_kb":1424128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"110'22047","reported_seq":22085,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.821387+0000","last_change":"2026-02-23T13:14:49.710716+0000","last_active":"2026-02-23T13:15:36.821387+0000","last_peered":"2026-02-23T13:15:36.821387+0000","last_clean":"2026-02-23T13:15:36.821387+0000","last_became_active":"2026-02-23T13:14:49.709875+0000","last_became_peered":"2026-02-23T13:14:49.709875+0000","last_unstale":"2026-02-23T13:15:36.821387+0000","last_undegraded":"2026-02-23T13:15:36.821387+0000","last_fullsized":"2026-02-23T13:15:36.821387+0000","mapping_epoch":96,"log_start":"110'22044","ondisk_log_start":"110'22044","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:08.189503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1444872192,"num_objects":22047,"num_object_clones":0,"num_object_copies":66141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22047,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22047,"num_write_kb":1411008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"109'22323","reported_seq":22359,"reported_epoch":109,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.691124+0000","last_change":"2026-02-23T13:14:49.710292+0000","last_active":"2026-02-23T13:15:36.691124+0000","last_peered":"2026-02-23T13:15:36.691124+0000","last_clean":"2026-02-23T13:15:36.691124+0000","last_became_active":"2026-02-23T13:14:49.709618+0000","last_became_peered":"2026-02-23T13:14:49.709618+0000","last_unstale":"2026-02-23T13:15:36.691124+0000","last_undegraded":"2026-02-23T13:15:36.691124+0000","last_fullsized":"2026-02-23T13:15:36.691124+0000","mapping_epoch":96,"log_start":"109'22320","ondisk_log_start":"109'22320","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:12.895714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1462960128,"num_objects":22323,"num_object_clones":0,"num_object_copies":66969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22323,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22323,"num_write_kb":1428672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"109'21925","reported_seq":21961,"reported_epoch":109,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.696691+0000","last_change":"2026-02-23T13:14:49.711809+0000","last_active":"2026-02-23T13:15:36.696691+0000","last_peered":"2026-02-23T13:15:36.696691+0000","last_clean":"2026-02-23T13:15:36.696691+0000","last_became_active":"2026-02-23T13:14:49.711647+0000","last_became_peered":"2026-02-23T13:14:49.711647+0000","last_unstale":"2026-02-23T13:15:36.696691+0000","last_undegraded":"2026-02-23T13:15:36.696691+0000","last_fullsized":"2026-02-23T13:15:36.696691+0000","mapping_epoch":96,"log_start":"109'21922","ondisk_log_start":"109'21922","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:16.696834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1436876800,"num_objects":21925,"num_object_clones":0,"num_object_copies":65775,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21925,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21925,"num_write_kb":1403200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"109'21878","reported_seq":21914,"reported_epoch":109,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.678629+0000","last_change":"2026-02-23T13:14:49.710392+0000","last_active":"2026-02-23T13:15:36.678629+0000","last_peered":"2026-02-23T13:15:36.678629+0000","last_clean":"2026-02-23T13:15:36.678629+0000","last_became_active":"2026-02-23T13:14:49.710064+0000","last_became_peered":"2026-02-23T13:14:49.710064+0000","last_unstale":"2026-02-23T13:15:36.678629+0000","last_undegraded":"2026-02-23T13:15:36.678629+0000","last_fullsized":"2026-02-23T13:15:36.678629+0000","mapping_epoch":96,"log_start":"109'21875","ondisk_log_start":"109'21875","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:07.281706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1433796608,"num_objects":21878,"num_object_clones":0,"num_object_copies":65634,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21878,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21878,"num_write_kb":1400192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"110'22180","reported_seq":22218,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.824972+0000","last_change":"2026-02-23T13:14:49.711523+0000","last_active":"2026-02-23T13:15:36.824972+0000","last_peered":"2026-02-23T13:15:36.824972+0000","last_clean":"2026-02-23T13:15:36.824972+0000","last_became_active":"2026-02-23T13:14:49.711227+0000","last_became_peered":"2026-02-23T13:14:49.711227+0000","last_unstale":"2026-02-23T13:15:36.824972+0000","last_undegraded":"2026-02-23T13:15:36.824972+0000","last_fullsized":"2026-02-23T13:15:36.824972+0000","mapping_epoch":96,"log_start":"110'22177","ondisk_log_start":"110'22177","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:09.568570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1453588480,"num_objects":22180,"num_object_clones":0,"num_object_copies":66540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22180,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22180,"num_write_kb":1419520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"109'22213","reported_seq":22249,"reported_epoch":109,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.688619+0000","last_change":"2026-02-23T13:14:49.710830+0000","last_active":"2026-02-23T13:15:36.688619+0000","last_peered":"2026-02-23T13:15:36.688619+0000","last_clean":"2026-02-23T13:15:36.688619+0000","last_became_active":"2026-02-23T13:14:49.710282+0000","last_became_peered":"2026-02-23T13:14:49.710282+0000","last_unstale":"2026-02-23T13:15:36.688619+0000","last_undegraded":"2026-02-23T13:15:36.688619+0000","last_fullsized":"2026-02-23T13:15:36.688619+0000","mapping_epoch":96,"log_start":"109'22210","ondisk_log_start":"109'22210","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:05.474131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1455751168,"num_objects":22213,"num_object_clones":0,"num_object_copies":66639,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22213,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22213,"num_write_kb":1421632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"110'22166","reported_seq":22204,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.823417+0000","last_change":"2026-02-23T13:14:49.711384+0000","last_active":"2026-02-23T13:15:36.823417+0000","last_peered":"2026-02-23T13:15:36.823417+0000","last_clean":"2026-02-23T13:15:36.823417+0000","last_became_active":"2026-02-23T13:14:49.710940+0000","last_became_peered":"2026-02-23T13:14:49.710940+0000","last_unstale":"2026-02-23T13:15:36.823417+0000","last_undegraded":"2026-02-23T13:15:36.823417+0000","last_fullsized":"2026-02-23T13:15:36.823417+0000","mapping_epoch":96,"log_start":"110'22163","ondisk_log_start":"110'22163","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:01.989539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1452670976,"num_objects":22166,"num_object_clones":0,"num_object_copies":66498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22166,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22166,"num_write_kb":1418624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"109'21821","reported_seq":21857,"reported_epoch":109,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.691069+0000","last_change":"2026-02-23T13:14:49.709045+0000","last_active":"2026-02-23T13:15:36.691069+0000","last_peered":"2026-02-23T13:15:36.691069+0000","last_clean":"2026-02-23T13:15:36.691069+0000","last_became_active":"2026-02-23T13:14:49.708668+0000","last_became_peered":"2026-02-23T13:14:49.708668+0000","last_unstale":"2026-02-23T13:15:36.691069+0000","last_undegraded":"2026-02-23T13:15:36.691069+0000","last_fullsized":"2026-02-23T13:15:36.691069+0000","mapping_epoch":96,"log_start":"109'21818","ondisk_log_start":"109'21818","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:05.829857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1430061056,"num_objects":21821,"num_object_clones":0,"num_object_copies":65463,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21821,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21821,"num_write_kb":1396544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"109'22188","reported_seq":22224,"reported_epoch":109,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.678935+0000","last_change":"2026-02-23T13:14:49.709471+0000","last_active":"2026-02-23T13:15:36.678935+0000","last_peered":"2026-02-23T13:15:36.678935+0000","last_clean":"2026-02-23T13:15:36.678935+0000","last_became_active":"2026-02-23T13:14:49.709202+0000","last_became_peered":"2026-02-23T13:14:49.709202+0000","last_unstale":"2026-02-23T13:15:36.678935+0000","last_undegraded":"2026-02-23T13:15:36.678935+0000","last_fullsized":"2026-02-23T13:15:36.678935+0000","mapping_epoch":96,"log_start":"109'22185","ondisk_log_start":"109'22185","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:00.362060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1454112768,"num_objects":22188,"num_object_clones":0,"num_object_copies":66564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22188,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22188,"num_write_kb":1420032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"110'22310","reported_seq":22348,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.824395+0000","last_change":"2026-02-23T13:14:49.711071+0000","last_active":"2026-02-23T13:15:36.824395+0000","last_peered":"2026-02-23T13:15:36.824395+0000","last_clean":"2026-02-23T13:15:36.824395+0000","last_became_active":"2026-02-23T13:14:49.710193+0000","last_became_peered":"2026-02-23T13:14:49.710193+0000","last_unstale":"2026-02-23T13:15:36.824395+0000","last_undegraded":"2026-02-23T13:15:36.824395+0000","last_fullsized":"2026-02-23T13:15:36.824395+0000","mapping_epoch":96,"log_start":"110'22307","ondisk_log_start":"110'22307","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:15.360867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1462108160,"num_objects":22310,"num_object_clones":0,"num_object_copies":66930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22310,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22310,"num_write_kb":1427840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"109'22173","reported_seq":22209,"reported_epoch":109,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.704829+0000","last_change":"2026-02-23T13:14:49.710077+0000","last_active":"2026-02-23T13:15:36.704829+0000","last_peered":"2026-02-23T13:15:36.704829+0000","last_clean":"2026-02-23T13:15:36.704829+0000","last_became_active":"2026-02-23T13:14:49.709781+0000","last_became_peered":"2026-02-23T13:14:49.709781+0000","last_unstale":"2026-02-23T13:15:36.704829+0000","last_undegraded":"2026-02-23T13:15:36.704829+0000","last_fullsized":"2026-02-23T13:15:36.704829+0000","mapping_epoch":96,"log_start":"109'22170","ondisk_log_start":"109'22170","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:16.674175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1453129728,"num_objects":22173,"num_object_clones":0,"num_object_copies":66519,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22173,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22173,"num_write_kb":1419072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"109'22050","reported_seq":22086,"reported_epoch":109,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.677133+0000","last_change":"2026-02-23T13:14:49.709980+0000","last_active":"2026-02-23T13:15:36.677133+0000","last_peered":"2026-02-23T13:15:36.677133+0000","last_clean":"2026-02-23T13:15:36.677133+0000","last_became_active":"2026-02-23T13:14:49.709715+0000","last_became_peered":"2026-02-23T13:14:49.709715+0000","last_unstale":"2026-02-23T13:15:36.677133+0000","last_undegraded":"2026-02-23T13:15:36.677133+0000","last_fullsized":"2026-02-23T13:15:36.677133+0000","mapping_epoch":96,"log_start":"109'22047","ondisk_log_start":"109'22047","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:07.659456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1445068800,"num_objects":22050,"num_object_clones":0,"num_object_copies":66150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22050,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22050,"num_write_kb":1411200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":432,"reported_epoch":109,"state":"active+clean","last_fresh":"2026-02-23T13:15:35.753584+0000","last_change":"2026-02-23T13:15:25.299766+0000","last_active":"2026-02-23T13:15:35.753584+0000","last_peered":"2026-02-23T13:15:35.753584+0000","last_clean":"2026-02-23T13:15:35.753584+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:15:35.753584+0000","last_undegraded":"2026-02-23T13:15:35.753584+0000","last_fullsized":"2026-02-23T13:15:35.753584+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:15:25.299737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:15:25.299737+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:42.738354+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":23197581312,"num_objects":353967,"num_object_clones":0,"num_object_copies":1061901,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":353967,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":353967,"num_write_kb":22653888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":69576228864,"data_stored":69576228864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3993,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247962,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":15372120,"kb_used_data":13958468,"kb_used_omap":27,"kb_used_meta":1413604,"kb_avail":718631080,"statfs":{"total":751619276800,"available":735878225920,"internally_reserved":0,"allocated":14293471232,"data_stored":14292882591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27902,"internal_metadata":1447531266},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444189,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":18019608,"kb_used_data":16730884,"kb_used_omap":29,"kb_used_meta":1288674,"kb_avail":715983592,"statfs":{"total":751619276800,"available":733167198208,"internally_reserved":0,"allocated":17132425216,"data_stored":17131836575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30698,"internal_metadata":1319602198},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575007,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":21009492,"kb_used_data":19698624,"kb_used_omap":28,"kb_used_meta":1310819,"kb_avail":712993708,"statfs":{"total":751619276800,"available":730105556992,"internally_reserved":0,"allocated":20171390976,"data_stored":20170805887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29176,"internal_metadata":1342279176},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705824,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":18408600,"kb_used_data":16910468,"kb_used_omap":24,"kb_used_meta":1498087,"kb_avail":715594600,"statfs":{"total":751619276800,"available":732768870400,"internally_reserved":0,"allocated":17316319232,"data_stored":17315730591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25250,"internal_metadata":1534041438},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3993,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17407279104,"data_stored":17407279104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20323041280,"data_stored":20323041280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17392467968,"data_stored":17392467968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14453440512,"data_stored":14453440512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:15:38.383 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:15:38.529 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:38.651 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:38.649+0000 7fcf3d7e4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:38.651 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:38.650+0000 7fcf3d7e4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:38.802 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 48 16 370317 370301 482.122 475.312 0.00173024 0.00207282 2026-02-23T13:15:38.805 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:15:38.805 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:15:38.819 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:38 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1145298032' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-23T13:15:38.819 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:38 trial046 ceph-mon[38575]: osdmap e111: 4 total, 4 up, 4 in 2026-02-23T13:15:38.858 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":466,"stamp":"2026-02-23T13:15:38.693124+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23198171680,"num_objects":353969,"num_object_clones":0,"num_object_copies":1061907,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":353969,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":354102,"num_write_kb":22656038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":72809820,"kb_used_data":67298444,"kb_used_omap":110,"kb_used_meta":5511185,"kb_avail":2863202980,"statfs":{"total":3006477107200,"available":2931919851520,"internally_reserved":0,"allocated":68913606656,"data_stored":68911255644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":113026,"internal_metadata":5643454078},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2668036096,"num_objects":40711,"num_object_clones":0,"num_object_copies":122133,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40711,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40711,"num_write_kb":2605504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000588"},"pg_stats":[{"pgid":"6.f","version":"110'22258","reported_seq":22296,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.819049+0000","last_change":"2026-02-23T13:14:49.711212+0000","last_active":"2026-02-23T13:15:36.819049+0000","last_peered":"2026-02-23T13:15:36.819049+0000","last_clean":"2026-02-23T13:15:36.819049+0000","last_became_active":"2026-02-23T13:14:49.710909+0000","last_became_peered":"2026-02-23T13:14:49.710909+0000","last_unstale":"2026-02-23T13:15:36.819049+0000","last_undegraded":"2026-02-23T13:15:36.819049+0000","last_fullsized":"2026-02-23T13:15:36.819049+0000","mapping_epoch":96,"log_start":"110'22254","ondisk_log_start":"110'22254","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:18.401390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1458700288,"num_objects":22258,"num_object_clones":0,"num_object_copies":66774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22258,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22258,"num_write_kb":1424512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"109'22173","reported_seq":22209,"reported_epoch":109,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.688934+0000","last_change":"2026-02-23T13:14:49.711013+0000","last_active":"2026-02-23T13:15:36.688934+0000","last_peered":"2026-02-23T13:15:36.688934+0000","last_clean":"2026-02-23T13:15:36.688934+0000","last_became_active":"2026-02-23T13:14:49.710608+0000","last_became_peered":"2026-02-23T13:14:49.710608+0000","last_unstale":"2026-02-23T13:15:36.688934+0000","last_undegraded":"2026-02-23T13:15:36.688934+0000","last_fullsized":"2026-02-23T13:15:36.688934+0000","mapping_epoch":96,"log_start":"109'22170","ondisk_log_start":"109'22170","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:57.080821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1453129728,"num_objects":22173,"num_object_clones":0,"num_object_copies":66519,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22173,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22173,"num_write_kb":1419072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"109'22010","reported_seq":22046,"reported_epoch":109,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.688557+0000","last_change":"2026-02-23T13:14:49.711150+0000","last_active":"2026-02-23T13:15:36.688557+0000","last_peered":"2026-02-23T13:15:36.688557+0000","last_clean":"2026-02-23T13:15:36.688557+0000","last_became_active":"2026-02-23T13:14:49.710759+0000","last_became_peered":"2026-02-23T13:14:49.710759+0000","last_unstale":"2026-02-23T13:15:36.688557+0000","last_undegraded":"2026-02-23T13:15:36.688557+0000","last_fullsized":"2026-02-23T13:15:36.688557+0000","mapping_epoch":96,"log_start":"109'22007","ondisk_log_start":"109'22007","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:09.130033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1442447360,"num_objects":22010,"num_object_clones":0,"num_object_copies":66030,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22010,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22010,"num_write_kb":1408640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"110'22252","reported_seq":22290,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.820666+0000","last_change":"2026-02-23T13:14:49.711353+0000","last_active":"2026-02-23T13:15:36.820666+0000","last_peered":"2026-02-23T13:15:36.820666+0000","last_clean":"2026-02-23T13:15:36.820666+0000","last_became_active":"2026-02-23T13:14:49.710648+0000","last_became_peered":"2026-02-23T13:14:49.710648+0000","last_unstale":"2026-02-23T13:15:36.820666+0000","last_undegraded":"2026-02-23T13:15:36.820666+0000","last_fullsized":"2026-02-23T13:15:36.820666+0000","mapping_epoch":96,"log_start":"110'22249","ondisk_log_start":"110'22249","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:00.632137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1458307072,"num_objects":22252,"num_object_clones":0,"num_object_copies":66756,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22252,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22252,"num_write_kb":1424128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"110'22047","reported_seq":22085,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.821387+0000","last_change":"2026-02-23T13:14:49.710716+0000","last_active":"2026-02-23T13:15:36.821387+0000","last_peered":"2026-02-23T13:15:36.821387+0000","last_clean":"2026-02-23T13:15:36.821387+0000","last_became_active":"2026-02-23T13:14:49.709875+0000","last_became_peered":"2026-02-23T13:14:49.709875+0000","last_unstale":"2026-02-23T13:15:36.821387+0000","last_undegraded":"2026-02-23T13:15:36.821387+0000","last_fullsized":"2026-02-23T13:15:36.821387+0000","mapping_epoch":96,"log_start":"110'22044","ondisk_log_start":"110'22044","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:08.189503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1444872192,"num_objects":22047,"num_object_clones":0,"num_object_copies":66141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22047,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22047,"num_write_kb":1411008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"109'22323","reported_seq":22359,"reported_epoch":109,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.691124+0000","last_change":"2026-02-23T13:14:49.710292+0000","last_active":"2026-02-23T13:15:36.691124+0000","last_peered":"2026-02-23T13:15:36.691124+0000","last_clean":"2026-02-23T13:15:36.691124+0000","last_became_active":"2026-02-23T13:14:49.709618+0000","last_became_peered":"2026-02-23T13:14:49.709618+0000","last_unstale":"2026-02-23T13:15:36.691124+0000","last_undegraded":"2026-02-23T13:15:36.691124+0000","last_fullsized":"2026-02-23T13:15:36.691124+0000","mapping_epoch":96,"log_start":"109'22320","ondisk_log_start":"109'22320","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:12.895714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1462960128,"num_objects":22323,"num_object_clones":0,"num_object_copies":66969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22323,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22323,"num_write_kb":1428672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"109'21925","reported_seq":21961,"reported_epoch":109,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.696691+0000","last_change":"2026-02-23T13:14:49.711809+0000","last_active":"2026-02-23T13:15:36.696691+0000","last_peered":"2026-02-23T13:15:36.696691+0000","last_clean":"2026-02-23T13:15:36.696691+0000","last_became_active":"2026-02-23T13:14:49.711647+0000","last_became_peered":"2026-02-23T13:14:49.711647+0000","last_unstale":"2026-02-23T13:15:36.696691+0000","last_undegraded":"2026-02-23T13:15:36.696691+0000","last_fullsized":"2026-02-23T13:15:36.696691+0000","mapping_epoch":96,"log_start":"109'21922","ondisk_log_start":"109'21922","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:16.696834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1436876800,"num_objects":21925,"num_object_clones":0,"num_object_copies":65775,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21925,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21925,"num_write_kb":1403200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"109'21878","reported_seq":21914,"reported_epoch":109,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.678629+0000","last_change":"2026-02-23T13:14:49.710392+0000","last_active":"2026-02-23T13:15:36.678629+0000","last_peered":"2026-02-23T13:15:36.678629+0000","last_clean":"2026-02-23T13:15:36.678629+0000","last_became_active":"2026-02-23T13:14:49.710064+0000","last_became_peered":"2026-02-23T13:14:49.710064+0000","last_unstale":"2026-02-23T13:15:36.678629+0000","last_undegraded":"2026-02-23T13:15:36.678629+0000","last_fullsized":"2026-02-23T13:15:36.678629+0000","mapping_epoch":96,"log_start":"109'21875","ondisk_log_start":"109'21875","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:07.281706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1433796608,"num_objects":21878,"num_object_clones":0,"num_object_copies":65634,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21878,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21878,"num_write_kb":1400192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"110'22180","reported_seq":22218,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.824972+0000","last_change":"2026-02-23T13:14:49.711523+0000","last_active":"2026-02-23T13:15:36.824972+0000","last_peered":"2026-02-23T13:15:36.824972+0000","last_clean":"2026-02-23T13:15:36.824972+0000","last_became_active":"2026-02-23T13:14:49.711227+0000","last_became_peered":"2026-02-23T13:14:49.711227+0000","last_unstale":"2026-02-23T13:15:36.824972+0000","last_undegraded":"2026-02-23T13:15:36.824972+0000","last_fullsized":"2026-02-23T13:15:36.824972+0000","mapping_epoch":96,"log_start":"110'22177","ondisk_log_start":"110'22177","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:09.568570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1453588480,"num_objects":22180,"num_object_clones":0,"num_object_copies":66540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22180,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22180,"num_write_kb":1419520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"109'22213","reported_seq":22249,"reported_epoch":109,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.688619+0000","last_change":"2026-02-23T13:14:49.710830+0000","last_active":"2026-02-23T13:15:36.688619+0000","last_peered":"2026-02-23T13:15:36.688619+0000","last_clean":"2026-02-23T13:15:36.688619+0000","last_became_active":"2026-02-23T13:14:49.710282+0000","last_became_peered":"2026-02-23T13:14:49.710282+0000","last_unstale":"2026-02-23T13:15:36.688619+0000","last_undegraded":"2026-02-23T13:15:36.688619+0000","last_fullsized":"2026-02-23T13:15:36.688619+0000","mapping_epoch":96,"log_start":"109'22210","ondisk_log_start":"109'22210","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:05.474131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1455751168,"num_objects":22213,"num_object_clones":0,"num_object_copies":66639,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22213,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22213,"num_write_kb":1421632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"110'22166","reported_seq":22204,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.823417+0000","last_change":"2026-02-23T13:14:49.711384+0000","last_active":"2026-02-23T13:15:36.823417+0000","last_peered":"2026-02-23T13:15:36.823417+0000","last_clean":"2026-02-23T13:15:36.823417+0000","last_became_active":"2026-02-23T13:14:49.710940+0000","last_became_peered":"2026-02-23T13:14:49.710940+0000","last_unstale":"2026-02-23T13:15:36.823417+0000","last_undegraded":"2026-02-23T13:15:36.823417+0000","last_fullsized":"2026-02-23T13:15:36.823417+0000","mapping_epoch":96,"log_start":"110'22163","ondisk_log_start":"110'22163","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:01.989539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1452670976,"num_objects":22166,"num_object_clones":0,"num_object_copies":66498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22166,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22166,"num_write_kb":1418624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"109'21821","reported_seq":21857,"reported_epoch":109,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.691069+0000","last_change":"2026-02-23T13:14:49.709045+0000","last_active":"2026-02-23T13:15:36.691069+0000","last_peered":"2026-02-23T13:15:36.691069+0000","last_clean":"2026-02-23T13:15:36.691069+0000","last_became_active":"2026-02-23T13:14:49.708668+0000","last_became_peered":"2026-02-23T13:14:49.708668+0000","last_unstale":"2026-02-23T13:15:36.691069+0000","last_undegraded":"2026-02-23T13:15:36.691069+0000","last_fullsized":"2026-02-23T13:15:36.691069+0000","mapping_epoch":96,"log_start":"109'21818","ondisk_log_start":"109'21818","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:05.829857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1430061056,"num_objects":21821,"num_object_clones":0,"num_object_copies":65463,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21821,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21821,"num_write_kb":1396544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"109'22188","reported_seq":22224,"reported_epoch":109,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.678935+0000","last_change":"2026-02-23T13:14:49.709471+0000","last_active":"2026-02-23T13:15:36.678935+0000","last_peered":"2026-02-23T13:15:36.678935+0000","last_clean":"2026-02-23T13:15:36.678935+0000","last_became_active":"2026-02-23T13:14:49.709202+0000","last_became_peered":"2026-02-23T13:14:49.709202+0000","last_unstale":"2026-02-23T13:15:36.678935+0000","last_undegraded":"2026-02-23T13:15:36.678935+0000","last_fullsized":"2026-02-23T13:15:36.678935+0000","mapping_epoch":96,"log_start":"109'22185","ondisk_log_start":"109'22185","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:00.362060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1454112768,"num_objects":22188,"num_object_clones":0,"num_object_copies":66564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22188,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22188,"num_write_kb":1420032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"110'22310","reported_seq":22348,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.824395+0000","last_change":"2026-02-23T13:14:49.711071+0000","last_active":"2026-02-23T13:15:36.824395+0000","last_peered":"2026-02-23T13:15:36.824395+0000","last_clean":"2026-02-23T13:15:36.824395+0000","last_became_active":"2026-02-23T13:14:49.710193+0000","last_became_peered":"2026-02-23T13:14:49.710193+0000","last_unstale":"2026-02-23T13:15:36.824395+0000","last_undegraded":"2026-02-23T13:15:36.824395+0000","last_fullsized":"2026-02-23T13:15:36.824395+0000","mapping_epoch":96,"log_start":"110'22307","ondisk_log_start":"110'22307","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:15.360867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1462108160,"num_objects":22310,"num_object_clones":0,"num_object_copies":66930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22310,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22310,"num_write_kb":1427840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"109'22173","reported_seq":22209,"reported_epoch":109,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.704829+0000","last_change":"2026-02-23T13:14:49.710077+0000","last_active":"2026-02-23T13:15:36.704829+0000","last_peered":"2026-02-23T13:15:36.704829+0000","last_clean":"2026-02-23T13:15:36.704829+0000","last_became_active":"2026-02-23T13:14:49.709781+0000","last_became_peered":"2026-02-23T13:14:49.709781+0000","last_unstale":"2026-02-23T13:15:36.704829+0000","last_undegraded":"2026-02-23T13:15:36.704829+0000","last_fullsized":"2026-02-23T13:15:36.704829+0000","mapping_epoch":96,"log_start":"109'22170","ondisk_log_start":"109'22170","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:16.674175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1453129728,"num_objects":22173,"num_object_clones":0,"num_object_copies":66519,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22173,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22173,"num_write_kb":1419072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"109'22050","reported_seq":22086,"reported_epoch":109,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.677133+0000","last_change":"2026-02-23T13:14:49.709980+0000","last_active":"2026-02-23T13:15:36.677133+0000","last_peered":"2026-02-23T13:15:36.677133+0000","last_clean":"2026-02-23T13:15:36.677133+0000","last_became_active":"2026-02-23T13:14:49.709715+0000","last_became_peered":"2026-02-23T13:14:49.709715+0000","last_unstale":"2026-02-23T13:15:36.677133+0000","last_undegraded":"2026-02-23T13:15:36.677133+0000","last_fullsized":"2026-02-23T13:15:36.677133+0000","mapping_epoch":96,"log_start":"109'22047","ondisk_log_start":"109'22047","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:07.659456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1445068800,"num_objects":22050,"num_object_clones":0,"num_object_copies":66150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22050,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22050,"num_write_kb":1411200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":432,"reported_epoch":109,"state":"active+clean","last_fresh":"2026-02-23T13:15:35.753584+0000","last_change":"2026-02-23T13:15:25.299766+0000","last_active":"2026-02-23T13:15:35.753584+0000","last_peered":"2026-02-23T13:15:35.753584+0000","last_clean":"2026-02-23T13:15:35.753584+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:15:35.753584+0000","last_undegraded":"2026-02-23T13:15:35.753584+0000","last_fullsized":"2026-02-23T13:15:35.753584+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:15:25.299737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:15:25.299737+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:42.738354+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":23197581312,"num_objects":353967,"num_object_clones":0,"num_object_copies":1061901,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":353967,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":353967,"num_write_kb":22653888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":69576228864,"data_stored":69576228864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3993,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247962,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":15372120,"kb_used_data":13958468,"kb_used_omap":27,"kb_used_meta":1413604,"kb_avail":718631080,"statfs":{"total":751619276800,"available":735878225920,"internally_reserved":0,"allocated":14293471232,"data_stored":14292882591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27902,"internal_metadata":1447531266},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444189,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":18019608,"kb_used_data":16730884,"kb_used_omap":29,"kb_used_meta":1288674,"kb_avail":715983592,"statfs":{"total":751619276800,"available":733167198208,"internally_reserved":0,"allocated":17132425216,"data_stored":17131836575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30698,"internal_metadata":1319602198},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575007,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":21009492,"kb_used_data":19698624,"kb_used_omap":28,"kb_used_meta":1310819,"kb_avail":712993708,"statfs":{"total":751619276800,"available":730105556992,"internally_reserved":0,"allocated":20171390976,"data_stored":20170805887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29176,"internal_metadata":1342279176},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705824,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":18408600,"kb_used_data":16910468,"kb_used_omap":24,"kb_used_meta":1498087,"kb_avail":715594600,"statfs":{"total":751619276800,"available":732768870400,"internally_reserved":0,"allocated":17316319232,"data_stored":17315730591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25250,"internal_metadata":1534041438},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3993,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17407279104,"data_stored":17407279104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20323041280,"data_stored":20323041280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17392467968,"data_stored":17392467968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14453440512,"data_stored":14453440512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:15:38.859 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-23T13:15:38.860 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:15:38.860 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_4 2026-02-23T13:15:38.860 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:15:39.024 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:39.146 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:39.144+0000 7f9169bca640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:39.146 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:39.145+0000 7f9169bca640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:39.289 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:15:39.289 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:15:39.340 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":466,"stamp":"2026-02-23T13:15:38.693124+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23198171680,"num_objects":353969,"num_object_clones":0,"num_object_copies":1061907,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":353969,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":354102,"num_write_kb":22656038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":72809820,"kb_used_data":67298444,"kb_used_omap":110,"kb_used_meta":5511185,"kb_avail":2863202980,"statfs":{"total":3006477107200,"available":2931919851520,"internally_reserved":0,"allocated":68913606656,"data_stored":68911255644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":113026,"internal_metadata":5643454078},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2668036096,"num_objects":40711,"num_object_clones":0,"num_object_copies":122133,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40711,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40711,"num_write_kb":2605504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000588"},"pg_stats":[{"pgid":"6.f","version":"110'22258","reported_seq":22296,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.819049+0000","last_change":"2026-02-23T13:14:49.711212+0000","last_active":"2026-02-23T13:15:36.819049+0000","last_peered":"2026-02-23T13:15:36.819049+0000","last_clean":"2026-02-23T13:15:36.819049+0000","last_became_active":"2026-02-23T13:14:49.710909+0000","last_became_peered":"2026-02-23T13:14:49.710909+0000","last_unstale":"2026-02-23T13:15:36.819049+0000","last_undegraded":"2026-02-23T13:15:36.819049+0000","last_fullsized":"2026-02-23T13:15:36.819049+0000","mapping_epoch":96,"log_start":"110'22254","ondisk_log_start":"110'22254","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:18.401390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1458700288,"num_objects":22258,"num_object_clones":0,"num_object_copies":66774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22258,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22258,"num_write_kb":1424512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"109'22173","reported_seq":22209,"reported_epoch":109,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.688934+0000","last_change":"2026-02-23T13:14:49.711013+0000","last_active":"2026-02-23T13:15:36.688934+0000","last_peered":"2026-02-23T13:15:36.688934+0000","last_clean":"2026-02-23T13:15:36.688934+0000","last_became_active":"2026-02-23T13:14:49.710608+0000","last_became_peered":"2026-02-23T13:14:49.710608+0000","last_unstale":"2026-02-23T13:15:36.688934+0000","last_undegraded":"2026-02-23T13:15:36.688934+0000","last_fullsized":"2026-02-23T13:15:36.688934+0000","mapping_epoch":96,"log_start":"109'22170","ondisk_log_start":"109'22170","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:57.080821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1453129728,"num_objects":22173,"num_object_clones":0,"num_object_copies":66519,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22173,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22173,"num_write_kb":1419072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"109'22010","reported_seq":22046,"reported_epoch":109,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.688557+0000","last_change":"2026-02-23T13:14:49.711150+0000","last_active":"2026-02-23T13:15:36.688557+0000","last_peered":"2026-02-23T13:15:36.688557+0000","last_clean":"2026-02-23T13:15:36.688557+0000","last_became_active":"2026-02-23T13:14:49.710759+0000","last_became_peered":"2026-02-23T13:14:49.710759+0000","last_unstale":"2026-02-23T13:15:36.688557+0000","last_undegraded":"2026-02-23T13:15:36.688557+0000","last_fullsized":"2026-02-23T13:15:36.688557+0000","mapping_epoch":96,"log_start":"109'22007","ondisk_log_start":"109'22007","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:09.130033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1442447360,"num_objects":22010,"num_object_clones":0,"num_object_copies":66030,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22010,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22010,"num_write_kb":1408640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"110'22252","reported_seq":22290,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.820666+0000","last_change":"2026-02-23T13:14:49.711353+0000","last_active":"2026-02-23T13:15:36.820666+0000","last_peered":"2026-02-23T13:15:36.820666+0000","last_clean":"2026-02-23T13:15:36.820666+0000","last_became_active":"2026-02-23T13:14:49.710648+0000","last_became_peered":"2026-02-23T13:14:49.710648+0000","last_unstale":"2026-02-23T13:15:36.820666+0000","last_undegraded":"2026-02-23T13:15:36.820666+0000","last_fullsized":"2026-02-23T13:15:36.820666+0000","mapping_epoch":96,"log_start":"110'22249","ondisk_log_start":"110'22249","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:00.632137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1458307072,"num_objects":22252,"num_object_clones":0,"num_object_copies":66756,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22252,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22252,"num_write_kb":1424128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"110'22047","reported_seq":22085,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.821387+0000","last_change":"2026-02-23T13:14:49.710716+0000","last_active":"2026-02-23T13:15:36.821387+0000","last_peered":"2026-02-23T13:15:36.821387+0000","last_clean":"2026-02-23T13:15:36.821387+0000","last_became_active":"2026-02-23T13:14:49.709875+0000","last_became_peered":"2026-02-23T13:14:49.709875+0000","last_unstale":"2026-02-23T13:15:36.821387+0000","last_undegraded":"2026-02-23T13:15:36.821387+0000","last_fullsized":"2026-02-23T13:15:36.821387+0000","mapping_epoch":96,"log_start":"110'22044","ondisk_log_start":"110'22044","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:08.189503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1444872192,"num_objects":22047,"num_object_clones":0,"num_object_copies":66141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22047,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22047,"num_write_kb":1411008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"109'22323","reported_seq":22359,"reported_epoch":109,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.691124+0000","last_change":"2026-02-23T13:14:49.710292+0000","last_active":"2026-02-23T13:15:36.691124+0000","last_peered":"2026-02-23T13:15:36.691124+0000","last_clean":"2026-02-23T13:15:36.691124+0000","last_became_active":"2026-02-23T13:14:49.709618+0000","last_became_peered":"2026-02-23T13:14:49.709618+0000","last_unstale":"2026-02-23T13:15:36.691124+0000","last_undegraded":"2026-02-23T13:15:36.691124+0000","last_fullsized":"2026-02-23T13:15:36.691124+0000","mapping_epoch":96,"log_start":"109'22320","ondisk_log_start":"109'22320","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:12.895714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1462960128,"num_objects":22323,"num_object_clones":0,"num_object_copies":66969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22323,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22323,"num_write_kb":1428672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"109'21925","reported_seq":21961,"reported_epoch":109,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.696691+0000","last_change":"2026-02-23T13:14:49.711809+0000","last_active":"2026-02-23T13:15:36.696691+0000","last_peered":"2026-02-23T13:15:36.696691+0000","last_clean":"2026-02-23T13:15:36.696691+0000","last_became_active":"2026-02-23T13:14:49.711647+0000","last_became_peered":"2026-02-23T13:14:49.711647+0000","last_unstale":"2026-02-23T13:15:36.696691+0000","last_undegraded":"2026-02-23T13:15:36.696691+0000","last_fullsized":"2026-02-23T13:15:36.696691+0000","mapping_epoch":96,"log_start":"109'21922","ondisk_log_start":"109'21922","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:16.696834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1436876800,"num_objects":21925,"num_object_clones":0,"num_object_copies":65775,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21925,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21925,"num_write_kb":1403200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"109'21878","reported_seq":21914,"reported_epoch":109,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.678629+0000","last_change":"2026-02-23T13:14:49.710392+0000","last_active":"2026-02-23T13:15:36.678629+0000","last_peered":"2026-02-23T13:15:36.678629+0000","last_clean":"2026-02-23T13:15:36.678629+0000","last_became_active":"2026-02-23T13:14:49.710064+0000","last_became_peered":"2026-02-23T13:14:49.710064+0000","last_unstale":"2026-02-23T13:15:36.678629+0000","last_undegraded":"2026-02-23T13:15:36.678629+0000","last_fullsized":"2026-02-23T13:15:36.678629+0000","mapping_epoch":96,"log_start":"109'21875","ondisk_log_start":"109'21875","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:07.281706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1433796608,"num_objects":21878,"num_object_clones":0,"num_object_copies":65634,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21878,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21878,"num_write_kb":1400192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"110'22180","reported_seq":22218,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.824972+0000","last_change":"2026-02-23T13:14:49.711523+0000","last_active":"2026-02-23T13:15:36.824972+0000","last_peered":"2026-02-23T13:15:36.824972+0000","last_clean":"2026-02-23T13:15:36.824972+0000","last_became_active":"2026-02-23T13:14:49.711227+0000","last_became_peered":"2026-02-23T13:14:49.711227+0000","last_unstale":"2026-02-23T13:15:36.824972+0000","last_undegraded":"2026-02-23T13:15:36.824972+0000","last_fullsized":"2026-02-23T13:15:36.824972+0000","mapping_epoch":96,"log_start":"110'22177","ondisk_log_start":"110'22177","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:09.568570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1453588480,"num_objects":22180,"num_object_clones":0,"num_object_copies":66540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22180,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22180,"num_write_kb":1419520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"109'22213","reported_seq":22249,"reported_epoch":109,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.688619+0000","last_change":"2026-02-23T13:14:49.710830+0000","last_active":"2026-02-23T13:15:36.688619+0000","last_peered":"2026-02-23T13:15:36.688619+0000","last_clean":"2026-02-23T13:15:36.688619+0000","last_became_active":"2026-02-23T13:14:49.710282+0000","last_became_peered":"2026-02-23T13:14:49.710282+0000","last_unstale":"2026-02-23T13:15:36.688619+0000","last_undegraded":"2026-02-23T13:15:36.688619+0000","last_fullsized":"2026-02-23T13:15:36.688619+0000","mapping_epoch":96,"log_start":"109'22210","ondisk_log_start":"109'22210","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:05.474131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1455751168,"num_objects":22213,"num_object_clones":0,"num_object_copies":66639,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22213,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22213,"num_write_kb":1421632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"110'22166","reported_seq":22204,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.823417+0000","last_change":"2026-02-23T13:14:49.711384+0000","last_active":"2026-02-23T13:15:36.823417+0000","last_peered":"2026-02-23T13:15:36.823417+0000","last_clean":"2026-02-23T13:15:36.823417+0000","last_became_active":"2026-02-23T13:14:49.710940+0000","last_became_peered":"2026-02-23T13:14:49.710940+0000","last_unstale":"2026-02-23T13:15:36.823417+0000","last_undegraded":"2026-02-23T13:15:36.823417+0000","last_fullsized":"2026-02-23T13:15:36.823417+0000","mapping_epoch":96,"log_start":"110'22163","ondisk_log_start":"110'22163","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:01.989539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1452670976,"num_objects":22166,"num_object_clones":0,"num_object_copies":66498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22166,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22166,"num_write_kb":1418624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"109'21821","reported_seq":21857,"reported_epoch":109,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.691069+0000","last_change":"2026-02-23T13:14:49.709045+0000","last_active":"2026-02-23T13:15:36.691069+0000","last_peered":"2026-02-23T13:15:36.691069+0000","last_clean":"2026-02-23T13:15:36.691069+0000","last_became_active":"2026-02-23T13:14:49.708668+0000","last_became_peered":"2026-02-23T13:14:49.708668+0000","last_unstale":"2026-02-23T13:15:36.691069+0000","last_undegraded":"2026-02-23T13:15:36.691069+0000","last_fullsized":"2026-02-23T13:15:36.691069+0000","mapping_epoch":96,"log_start":"109'21818","ondisk_log_start":"109'21818","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:05.829857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1430061056,"num_objects":21821,"num_object_clones":0,"num_object_copies":65463,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21821,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21821,"num_write_kb":1396544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"109'22188","reported_seq":22224,"reported_epoch":109,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.678935+0000","last_change":"2026-02-23T13:14:49.709471+0000","last_active":"2026-02-23T13:15:36.678935+0000","last_peered":"2026-02-23T13:15:36.678935+0000","last_clean":"2026-02-23T13:15:36.678935+0000","last_became_active":"2026-02-23T13:14:49.709202+0000","last_became_peered":"2026-02-23T13:14:49.709202+0000","last_unstale":"2026-02-23T13:15:36.678935+0000","last_undegraded":"2026-02-23T13:15:36.678935+0000","last_fullsized":"2026-02-23T13:15:36.678935+0000","mapping_epoch":96,"log_start":"109'22185","ondisk_log_start":"109'22185","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:00.362060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1454112768,"num_objects":22188,"num_object_clones":0,"num_object_copies":66564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22188,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22188,"num_write_kb":1420032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"110'22310","reported_seq":22348,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.824395+0000","last_change":"2026-02-23T13:14:49.711071+0000","last_active":"2026-02-23T13:15:36.824395+0000","last_peered":"2026-02-23T13:15:36.824395+0000","last_clean":"2026-02-23T13:15:36.824395+0000","last_became_active":"2026-02-23T13:14:49.710193+0000","last_became_peered":"2026-02-23T13:14:49.710193+0000","last_unstale":"2026-02-23T13:15:36.824395+0000","last_undegraded":"2026-02-23T13:15:36.824395+0000","last_fullsized":"2026-02-23T13:15:36.824395+0000","mapping_epoch":96,"log_start":"110'22307","ondisk_log_start":"110'22307","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:15.360867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1462108160,"num_objects":22310,"num_object_clones":0,"num_object_copies":66930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22310,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22310,"num_write_kb":1427840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"109'22173","reported_seq":22209,"reported_epoch":109,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.704829+0000","last_change":"2026-02-23T13:14:49.710077+0000","last_active":"2026-02-23T13:15:36.704829+0000","last_peered":"2026-02-23T13:15:36.704829+0000","last_clean":"2026-02-23T13:15:36.704829+0000","last_became_active":"2026-02-23T13:14:49.709781+0000","last_became_peered":"2026-02-23T13:14:49.709781+0000","last_unstale":"2026-02-23T13:15:36.704829+0000","last_undegraded":"2026-02-23T13:15:36.704829+0000","last_fullsized":"2026-02-23T13:15:36.704829+0000","mapping_epoch":96,"log_start":"109'22170","ondisk_log_start":"109'22170","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:16.674175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1453129728,"num_objects":22173,"num_object_clones":0,"num_object_copies":66519,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22173,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22173,"num_write_kb":1419072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"109'22050","reported_seq":22086,"reported_epoch":109,"state":"active+clean","last_fresh":"2026-02-23T13:15:36.677133+0000","last_change":"2026-02-23T13:14:49.709980+0000","last_active":"2026-02-23T13:15:36.677133+0000","last_peered":"2026-02-23T13:15:36.677133+0000","last_clean":"2026-02-23T13:15:36.677133+0000","last_became_active":"2026-02-23T13:14:49.709715+0000","last_became_peered":"2026-02-23T13:14:49.709715+0000","last_unstale":"2026-02-23T13:15:36.677133+0000","last_undegraded":"2026-02-23T13:15:36.677133+0000","last_fullsized":"2026-02-23T13:15:36.677133+0000","mapping_epoch":96,"log_start":"109'22047","ondisk_log_start":"109'22047","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:07.659456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1445068800,"num_objects":22050,"num_object_clones":0,"num_object_copies":66150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22050,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22050,"num_write_kb":1411200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":432,"reported_epoch":109,"state":"active+clean","last_fresh":"2026-02-23T13:15:35.753584+0000","last_change":"2026-02-23T13:15:25.299766+0000","last_active":"2026-02-23T13:15:35.753584+0000","last_peered":"2026-02-23T13:15:35.753584+0000","last_clean":"2026-02-23T13:15:35.753584+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:15:35.753584+0000","last_undegraded":"2026-02-23T13:15:35.753584+0000","last_fullsized":"2026-02-23T13:15:35.753584+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:15:25.299737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:15:25.299737+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:42.738354+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":23197581312,"num_objects":353967,"num_object_clones":0,"num_object_copies":1061901,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":353967,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":353967,"num_write_kb":22653888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":69576228864,"data_stored":69576228864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3993,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247962,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":15372120,"kb_used_data":13958468,"kb_used_omap":27,"kb_used_meta":1413604,"kb_avail":718631080,"statfs":{"total":751619276800,"available":735878225920,"internally_reserved":0,"allocated":14293471232,"data_stored":14292882591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27902,"internal_metadata":1447531266},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444189,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":18019608,"kb_used_data":16730884,"kb_used_omap":29,"kb_used_meta":1288674,"kb_avail":715983592,"statfs":{"total":751619276800,"available":733167198208,"internally_reserved":0,"allocated":17132425216,"data_stored":17131836575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30698,"internal_metadata":1319602198},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575007,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":21009492,"kb_used_data":19698624,"kb_used_omap":28,"kb_used_meta":1310819,"kb_avail":712993708,"statfs":{"total":751619276800,"available":730105556992,"internally_reserved":0,"allocated":20171390976,"data_stored":20170805887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29176,"internal_metadata":1342279176},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705824,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":18408600,"kb_used_data":16910468,"kb_used_omap":24,"kb_used_meta":1498087,"kb_avail":715594600,"statfs":{"total":751619276800,"available":732768870400,"internally_reserved":0,"allocated":17316319232,"data_stored":17315730591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25250,"internal_metadata":1534041438},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3993,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17407279104,"data_stored":17407279104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20323041280,"data_stored":20323041280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17392467968,"data_stored":17392467968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14453440512,"data_stored":14453440512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:15:39.342 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:15:39.343 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_4 pg_num 56 2026-02-23T13:15:39.486 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:39.632 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:39.630+0000 7fca7a397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:39.633 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:39.631+0000 7fca7a397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:39.783 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:15:39.802 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 49 16 378175 378159 482.306 491.125 0.00149532 0.00207201 2026-02-23T13:15:39.824 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:15:39.825 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:15:39.962 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:39.990 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:39 trial046 ceph-mon[38575]: from='client.15522 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:15:39.990 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:39 trial046 ceph-mon[38575]: pgmap v466: 17 pgs: 17 active+clean; 22 GiB data, 69 GiB used, 2.7 TiB / 2.7 TiB avail; 636 MiB/s wr, 10.18k op/s 2026-02-23T13:15:39.990 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:39 trial046 ceph-mon[38575]: from='client.15524 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:15:40.095 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:40.093+0000 7fd1c853d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:40.095 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:40.093+0000 7fd1c853d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:40.111 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:15:40.111 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:15:40.127 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:15:40.127 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:15:40.140 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:15:40.140 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:15:40.154 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:15:40.155 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:15:40.802 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 50 15 386005 385990 482.447 489.438 0.00214205 0.00207141 2026-02-23T13:15:41.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:40 trial046 ceph-mon[38575]: from='client.15526 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:15:41.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:40 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3383424569' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pg_num", "val": "56"} : dispatch 2026-02-23T13:15:41.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:40 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/425838455' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:15:41.802 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 51 15 393829 393814 482.575 489 0.00263048 0.00207088 2026-02-23T13:15:42.038 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:41 trial046 ceph-mon[38575]: pgmap v467: 17 pgs: 17 active+clean; 22 GiB data, 69 GiB used, 2.7 TiB / 2.7 TiB avail; 428 MiB/s wr, 6.85k op/s 2026-02-23T13:15:42.203 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:15:42.354 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:42.484 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:42.482+0000 7fe394b10640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:42.484 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:42.482+0000 7fe394b10640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:42.501 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:15:42.501 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:15:42.514 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:15:42.515 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:15:42.528 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:15:42.528 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:15:42.542 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:15:42.542 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:15:42.802 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 52 16 401709 401693 482.764 492.438 0.002669 0.00207006 2026-02-23T13:15:43.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:42 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4042382895' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:15:43.802 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 53 16 409847 409831 483.251 508.625 0.0015037 0.00206797 2026-02-23T13:15:44.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:43 trial046 ceph-mon[38575]: pgmap v468: 17 pgs: 17 active+clean; 24 GiB data, 77 GiB used, 2.7 TiB / 2.7 TiB avail; 722 MiB/s wr, 11.54k op/s 2026-02-23T13:15:44.594 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:15:44.749 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:44.803 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 54 16 417727 417711 483.422 492.5 0.00277086 0.00206725 2026-02-23T13:15:44.826 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:15:44.826 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:15:44.827 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:15:44.827 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:15:45.083 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:45.046+0000 7f3cd0d5e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:45.083 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:45.047+0000 7f3cd0d5e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:45.083 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:15:45.084 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:15:45.084 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:15:45.084 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:15:45.097 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:45.098 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:15:45.098 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:15:45.111 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:15:45.111 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:15:45.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:45 trial046 ceph-mon[38575]: pgmap v469: 17 pgs: 17 active+clean; 24 GiB data, 77 GiB used, 2.7 TiB / 2.7 TiB avail; 468 MiB/s wr, 7.48k op/s 2026-02-23T13:15:45.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:45 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/375945314' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:15:45.803 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 55 15 422899 422884 480.508 323.312 0.00162568 0.0020798 2026-02-23T13:15:46.038 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:46.016+0000 7fb1468a7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:46.038 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:46.016+0000 7fb1468a7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:46.178 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:15:46.178 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:15:46.179 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:15:46 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:15:46] "GET /metrics HTTP/1.1" 200 4219 "" "Prometheus/3.6.0" 2026-02-23T13:15:46.469 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:15:46 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:15:46.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:15:46.774 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:46 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:15:46.803 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 56 16 428570 428554 478.255 354.375 0.00294959 0.0020896 2026-02-23T13:15:46.804 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":469,"stamp":"2026-02-23T13:15:44.693996+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":25780879904,"num_objects":393378,"num_object_clones":0,"num_object_copies":1180134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393378,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":393511,"num_write_kb":25178214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":80924156,"kb_used_data":74925484,"kb_used_omap":115,"kb_used_meta":5998476,"kb_avail":2855088644,"statfs":{"total":3006477107200,"available":2923610771456,"internally_reserved":0,"allocated":76723695616,"data_stored":76721281572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":118276,"internal_metadata":6142439932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3924230144,"num_objects":59879,"num_object_clones":0,"num_object_copies":179637,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59879,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59879,"num_write_kb":3832256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001164"},"pg_stats":[{"pgid":"6.f","version":"111'24672","reported_seq":24712,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:41.822721+0000","last_change":"2026-02-23T13:14:49.711212+0000","last_active":"2026-02-23T13:15:41.822721+0000","last_peered":"2026-02-23T13:15:41.822721+0000","last_clean":"2026-02-23T13:15:41.822721+0000","last_became_active":"2026-02-23T13:14:49.710909+0000","last_became_peered":"2026-02-23T13:14:49.710909+0000","last_unstale":"2026-02-23T13:15:41.822721+0000","last_undegraded":"2026-02-23T13:15:41.822721+0000","last_fullsized":"2026-02-23T13:15:41.822721+0000","mapping_epoch":96,"log_start":"111'24669","ondisk_log_start":"111'24669","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:18.401390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1616904192,"num_objects":24672,"num_object_clones":0,"num_object_copies":74016,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24672,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24672,"num_write_kb":1579008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"111'24622","reported_seq":24662,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:41.689447+0000","last_change":"2026-02-23T13:14:49.711013+0000","last_active":"2026-02-23T13:15:41.689447+0000","last_peered":"2026-02-23T13:15:41.689447+0000","last_clean":"2026-02-23T13:15:41.689447+0000","last_became_active":"2026-02-23T13:14:49.710608+0000","last_became_peered":"2026-02-23T13:14:49.710608+0000","last_unstale":"2026-02-23T13:15:41.689447+0000","last_undegraded":"2026-02-23T13:15:41.689447+0000","last_fullsized":"2026-02-23T13:15:41.689447+0000","mapping_epoch":96,"log_start":"111'24619","ondisk_log_start":"111'24619","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:57.080821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613627392,"num_objects":24622,"num_object_clones":0,"num_object_copies":73866,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24622,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24622,"num_write_kb":1575808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"111'24474","reported_seq":24514,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:41.687085+0000","last_change":"2026-02-23T13:14:49.711150+0000","last_active":"2026-02-23T13:15:41.687085+0000","last_peered":"2026-02-23T13:15:41.687085+0000","last_clean":"2026-02-23T13:15:41.687085+0000","last_became_active":"2026-02-23T13:14:49.710759+0000","last_became_peered":"2026-02-23T13:14:49.710759+0000","last_unstale":"2026-02-23T13:15:41.687085+0000","last_undegraded":"2026-02-23T13:15:41.687085+0000","last_fullsized":"2026-02-23T13:15:41.687085+0000","mapping_epoch":96,"log_start":"111'24471","ondisk_log_start":"111'24471","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:09.130033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1603928064,"num_objects":24474,"num_object_clones":0,"num_object_copies":73422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24474,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24474,"num_write_kb":1566336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"111'24757","reported_seq":24797,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:41.822981+0000","last_change":"2026-02-23T13:14:49.711353+0000","last_active":"2026-02-23T13:15:41.822981+0000","last_peered":"2026-02-23T13:15:41.822981+0000","last_clean":"2026-02-23T13:15:41.822981+0000","last_became_active":"2026-02-23T13:14:49.710648+0000","last_became_peered":"2026-02-23T13:14:49.710648+0000","last_unstale":"2026-02-23T13:15:41.822981+0000","last_undegraded":"2026-02-23T13:15:41.822981+0000","last_fullsized":"2026-02-23T13:15:41.822981+0000","mapping_epoch":96,"log_start":"111'24754","ondisk_log_start":"111'24754","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:00.632137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1622474752,"num_objects":24757,"num_object_clones":0,"num_object_copies":74271,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24757,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24757,"num_write_kb":1584448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"111'24550","reported_seq":24590,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:41.819892+0000","last_change":"2026-02-23T13:14:49.710716+0000","last_active":"2026-02-23T13:15:41.819892+0000","last_peered":"2026-02-23T13:15:41.819892+0000","last_clean":"2026-02-23T13:15:41.819892+0000","last_became_active":"2026-02-23T13:14:49.709875+0000","last_became_peered":"2026-02-23T13:14:49.709875+0000","last_unstale":"2026-02-23T13:15:41.819892+0000","last_undegraded":"2026-02-23T13:15:41.819892+0000","last_fullsized":"2026-02-23T13:15:41.819892+0000","mapping_epoch":96,"log_start":"111'24547","ondisk_log_start":"111'24547","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:08.189503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1608908800,"num_objects":24550,"num_object_clones":0,"num_object_copies":73650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24550,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24550,"num_write_kb":1571200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"111'24752","reported_seq":24792,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:41.687338+0000","last_change":"2026-02-23T13:14:49.710292+0000","last_active":"2026-02-23T13:15:41.687338+0000","last_peered":"2026-02-23T13:15:41.687338+0000","last_clean":"2026-02-23T13:15:41.687338+0000","last_became_active":"2026-02-23T13:14:49.709618+0000","last_became_peered":"2026-02-23T13:14:49.709618+0000","last_unstale":"2026-02-23T13:15:41.687338+0000","last_undegraded":"2026-02-23T13:15:41.687338+0000","last_fullsized":"2026-02-23T13:15:41.687338+0000","mapping_epoch":96,"log_start":"111'24749","ondisk_log_start":"111'24749","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:12.895714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1622147072,"num_objects":24752,"num_object_clones":0,"num_object_copies":74256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24752,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24752,"num_write_kb":1584128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"111'24343","reported_seq":24381,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:41.704774+0000","last_change":"2026-02-23T13:14:49.711809+0000","last_active":"2026-02-23T13:15:41.704774+0000","last_peered":"2026-02-23T13:15:41.704774+0000","last_clean":"2026-02-23T13:15:41.704774+0000","last_became_active":"2026-02-23T13:14:49.711647+0000","last_became_peered":"2026-02-23T13:14:49.711647+0000","last_unstale":"2026-02-23T13:15:41.704774+0000","last_undegraded":"2026-02-23T13:15:41.704774+0000","last_fullsized":"2026-02-23T13:15:41.704774+0000","mapping_epoch":96,"log_start":"111'24340","ondisk_log_start":"111'24340","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:16.696834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1595342848,"num_objects":24343,"num_object_clones":0,"num_object_copies":73029,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24343,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24343,"num_write_kb":1557952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"111'24331","reported_seq":24371,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:41.678310+0000","last_change":"2026-02-23T13:14:49.710392+0000","last_active":"2026-02-23T13:15:41.678310+0000","last_peered":"2026-02-23T13:15:41.678310+0000","last_clean":"2026-02-23T13:15:41.678310+0000","last_became_active":"2026-02-23T13:14:49.710064+0000","last_became_peered":"2026-02-23T13:14:49.710064+0000","last_unstale":"2026-02-23T13:15:41.678310+0000","last_undegraded":"2026-02-23T13:15:41.678310+0000","last_fullsized":"2026-02-23T13:15:41.678310+0000","mapping_epoch":96,"log_start":"111'24328","ondisk_log_start":"111'24328","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:07.281706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1594556416,"num_objects":24331,"num_object_clones":0,"num_object_copies":72993,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24331,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24331,"num_write_kb":1557184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"111'24582","reported_seq":24622,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:41.824875+0000","last_change":"2026-02-23T13:14:49.711523+0000","last_active":"2026-02-23T13:15:41.824875+0000","last_peered":"2026-02-23T13:15:41.824875+0000","last_clean":"2026-02-23T13:15:41.824875+0000","last_became_active":"2026-02-23T13:14:49.711227+0000","last_became_peered":"2026-02-23T13:14:49.711227+0000","last_unstale":"2026-02-23T13:15:41.824875+0000","last_undegraded":"2026-02-23T13:15:41.824875+0000","last_fullsized":"2026-02-23T13:15:41.824875+0000","mapping_epoch":96,"log_start":"111'24579","ondisk_log_start":"111'24579","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:09.568570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1611005952,"num_objects":24582,"num_object_clones":0,"num_object_copies":73746,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24582,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24582,"num_write_kb":1573248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"111'24668","reported_seq":24708,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:41.678695+0000","last_change":"2026-02-23T13:14:49.710830+0000","last_active":"2026-02-23T13:15:41.678695+0000","last_peered":"2026-02-23T13:15:41.678695+0000","last_clean":"2026-02-23T13:15:41.678695+0000","last_became_active":"2026-02-23T13:14:49.710282+0000","last_became_peered":"2026-02-23T13:14:49.710282+0000","last_unstale":"2026-02-23T13:15:41.678695+0000","last_undegraded":"2026-02-23T13:15:41.678695+0000","last_fullsized":"2026-02-23T13:15:41.678695+0000","mapping_epoch":96,"log_start":"111'24665","ondisk_log_start":"111'24665","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:05.474131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1616642048,"num_objects":24668,"num_object_clones":0,"num_object_copies":74004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24668,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24668,"num_write_kb":1578752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"111'24718","reported_seq":24758,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:41.823128+0000","last_change":"2026-02-23T13:14:49.711384+0000","last_active":"2026-02-23T13:15:41.823128+0000","last_peered":"2026-02-23T13:15:41.823128+0000","last_clean":"2026-02-23T13:15:41.823128+0000","last_became_active":"2026-02-23T13:14:49.710940+0000","last_became_peered":"2026-02-23T13:14:49.710940+0000","last_unstale":"2026-02-23T13:15:41.823128+0000","last_undegraded":"2026-02-23T13:15:41.823128+0000","last_fullsized":"2026-02-23T13:15:41.823128+0000","mapping_epoch":96,"log_start":"111'24715","ondisk_log_start":"111'24715","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:01.989539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1619918848,"num_objects":24718,"num_object_clones":0,"num_object_copies":74154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24718,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24718,"num_write_kb":1581952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"111'24345","reported_seq":24385,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:41.687244+0000","last_change":"2026-02-23T13:14:49.709045+0000","last_active":"2026-02-23T13:15:41.687244+0000","last_peered":"2026-02-23T13:15:41.687244+0000","last_clean":"2026-02-23T13:15:41.687244+0000","last_became_active":"2026-02-23T13:14:49.708668+0000","last_became_peered":"2026-02-23T13:14:49.708668+0000","last_unstale":"2026-02-23T13:15:41.687244+0000","last_undegraded":"2026-02-23T13:15:41.687244+0000","last_fullsized":"2026-02-23T13:15:41.687244+0000","mapping_epoch":96,"log_start":"111'24342","ondisk_log_start":"111'24342","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:05.829857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1595473920,"num_objects":24345,"num_object_clones":0,"num_object_copies":73035,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24345,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24345,"num_write_kb":1558080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"111'24637","reported_seq":24677,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:41.670688+0000","last_change":"2026-02-23T13:14:49.709471+0000","last_active":"2026-02-23T13:15:41.670688+0000","last_peered":"2026-02-23T13:15:41.670688+0000","last_clean":"2026-02-23T13:15:41.670688+0000","last_became_active":"2026-02-23T13:14:49.709202+0000","last_became_peered":"2026-02-23T13:14:49.709202+0000","last_unstale":"2026-02-23T13:15:41.670688+0000","last_undegraded":"2026-02-23T13:15:41.670688+0000","last_fullsized":"2026-02-23T13:15:41.670688+0000","mapping_epoch":96,"log_start":"111'24634","ondisk_log_start":"111'24634","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:00.362060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1614610432,"num_objects":24637,"num_object_clones":0,"num_object_copies":73911,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24637,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24637,"num_write_kb":1576768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"111'24793","reported_seq":24832,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:41.826411+0000","last_change":"2026-02-23T13:14:49.711071+0000","last_active":"2026-02-23T13:15:41.826411+0000","last_peered":"2026-02-23T13:15:41.826411+0000","last_clean":"2026-02-23T13:15:41.826411+0000","last_became_active":"2026-02-23T13:14:49.710193+0000","last_became_peered":"2026-02-23T13:14:49.710193+0000","last_unstale":"2026-02-23T13:15:41.826411+0000","last_undegraded":"2026-02-23T13:15:41.826411+0000","last_fullsized":"2026-02-23T13:15:41.826411+0000","mapping_epoch":96,"log_start":"111'24790","ondisk_log_start":"111'24790","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:15.360867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1624834048,"num_objects":24793,"num_object_clones":0,"num_object_copies":74379,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24793,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24793,"num_write_kb":1586752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"111'24666","reported_seq":24706,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:41.707987+0000","last_change":"2026-02-23T13:14:49.710077+0000","last_active":"2026-02-23T13:15:41.707987+0000","last_peered":"2026-02-23T13:15:41.707987+0000","last_clean":"2026-02-23T13:15:41.707987+0000","last_became_active":"2026-02-23T13:14:49.709781+0000","last_became_peered":"2026-02-23T13:14:49.709781+0000","last_unstale":"2026-02-23T13:15:41.707987+0000","last_undegraded":"2026-02-23T13:15:41.707987+0000","last_fullsized":"2026-02-23T13:15:41.707987+0000","mapping_epoch":96,"log_start":"111'24663","ondisk_log_start":"111'24663","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:16.674175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1616510976,"num_objects":24666,"num_object_clones":0,"num_object_copies":73998,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24666,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24666,"num_write_kb":1578624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"111'24466","reported_seq":24506,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:41.674345+0000","last_change":"2026-02-23T13:14:49.709980+0000","last_active":"2026-02-23T13:15:41.674345+0000","last_peered":"2026-02-23T13:15:41.674345+0000","last_clean":"2026-02-23T13:15:41.674345+0000","last_became_active":"2026-02-23T13:14:49.709715+0000","last_became_peered":"2026-02-23T13:14:49.709715+0000","last_unstale":"2026-02-23T13:15:41.674345+0000","last_undegraded":"2026-02-23T13:15:41.674345+0000","last_fullsized":"2026-02-23T13:15:41.674345+0000","mapping_epoch":96,"log_start":"111'24463","ondisk_log_start":"111'24463","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:07.659456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1603403776,"num_objects":24466,"num_object_clones":0,"num_object_copies":73398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24466,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24466,"num_write_kb":1565824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":436,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:37.760599+0000","last_change":"2026-02-23T13:15:25.299766+0000","last_active":"2026-02-23T13:15:37.760599+0000","last_peered":"2026-02-23T13:15:37.760599+0000","last_clean":"2026-02-23T13:15:37.760599+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:15:37.760599+0000","last_undegraded":"2026-02-23T13:15:37.760599+0000","last_fullsized":"2026-02-23T13:15:37.760599+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:15:25.299737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:15:25.299737+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:42.738354+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":25780289536,"num_objects":393376,"num_object_clones":0,"num_object_copies":1180128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393376,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":393376,"num_write_kb":25176064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":77323304960,"data_stored":77323304960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4101,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247963,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":17053104,"kb_used_data":15549212,"kb_used_omap":28,"kb_used_meta":1503843,"kb_avail":716950096,"statfs":{"total":751619276800,"available":734156898304,"internally_reserved":0,"allocated":15922393088,"data_stored":15921788689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29212,"internal_metadata":1539935716},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444190,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":20058800,"kb_used_data":18661788,"kb_used_omap":31,"kb_used_meta":1396960,"kb_avail":713944400,"statfs":{"total":751619276800,"available":731079065600,"internally_reserved":0,"allocated":19109670912,"data_stored":19109066513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32002,"internal_metadata":1430487806},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575008,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":23371244,"kb_used_data":21879896,"kb_used_omap":29,"kb_used_meta":1491298,"kb_avail":710631956,"statfs":{"total":751619276800,"available":727687122944,"internally_reserved":0,"allocated":22405013504,"data_stored":22404412657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30494,"internal_metadata":1527089378},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705825,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":20441008,"kb_used_data":18834588,"kb_used_omap":25,"kb_used_meta":1606374,"kb_avail":713562192,"statfs":{"total":751619276800,"available":730687684608,"internally_reserved":0,"allocated":19286618112,"data_stored":19286013713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26568,"internal_metadata":1644927032},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4101,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":19342098432,"data_stored":19342098432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22583181312,"data_stored":22583181312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19336593408,"data_stored":19336593408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16061431808,"data_stored":16061431808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:15:46.806 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:15:46.806 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 321 2026-02-23T13:15:46.957 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:47.407 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:47.401+0000 7f05d13c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:47.407 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:47.401+0000 7f05d13c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:47.553 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:15:47.803 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 57 16 434805 434789 476.7 389.688 0.00165145 0.00209563 2026-02-23T13:15:47.874 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:15:47.898 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:47 trial046 ceph-mon[38575]: from='client.15536 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:15:47.898 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:47 trial046 ceph-mon[38575]: pgmap v470: 17 pgs: 17 active+clean; 25 GiB data, 80 GiB used, 2.7 TiB / 2.7 TiB avail; 454 MiB/s wr, 7.26k op/s 2026-02-23T13:15:47.898 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:47 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2556767937' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "321"} : dispatch 2026-02-23T13:15:48.055 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:48.073 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:15:48.522 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:48.521+0000 7f6690778640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:48.523 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:48.521+0000 7f6690778640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:48.537 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:15:48.537 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:15:48.551 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:15:48.551 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:15:48.565 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:15:48.565 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:15:48.582 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:15:48.582 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:15:48.789 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:48 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2131473374' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:15:48.803 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 58 16 441308 441292 475.489 406.438 0.00213435 0.00210176 2026-02-23T13:15:49.803 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 59 16 449148 449132 475.734 490 0.0031805 0.00210067 2026-02-23T13:15:50.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:49 trial046 ceph-mon[38575]: pgmap v471: 17 pgs: 17 active+clean; 26 GiB data, 84 GiB used, 2.7 TiB / 2.7 TiB avail; 425 MiB/s wr, 6.80k op/s 2026-02-23T13:15:50.632 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:15:50.782 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:50.803 INFO:tasks.radosbench.radosbench.0.trial046.stdout:2026-02-23T13:15:50.803432+0000 min lat: 0.000705438 max lat: 0.0510585 avg lat: 0.00209957 2026-02-23T13:15:50.803 INFO:tasks.radosbench.radosbench.0.trial046.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-23T13:15:50.803 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 60 16 457002 456986 475.986 490.875 0.00229814 0.00209957 2026-02-23T13:15:50.913 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:50.912+0000 7f7912e8c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:50.914 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:50.912+0000 7f7912e8c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:50.930 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:15:50.930 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:15:50.946 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:15:50.946 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:15:50.960 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:15:50.960 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:15:50.974 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:15:50.974 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:15:51.803 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 61 16 464321 464305 475.681 457.438 0.00275268 0.00210092 2026-02-23T13:15:52.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:51 trial046 ceph-mon[38575]: pgmap v472: 17 pgs: 17 active+clean; 26 GiB data, 84 GiB used, 2.7 TiB / 2.7 TiB avail; 387 MiB/s wr, 6.19k op/s 2026-02-23T13:15:52.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:51 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2455428439' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:15:52.803 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 62 16 472134 472118 475.884 488.312 0.00241716 0.00210002 2026-02-23T13:15:53.025 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:15:53.075 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:15:53.075 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:15:53.075 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:15:53.075 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:15:53.172 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:53.232 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:53.312 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:53.310+0000 7fd0b3b67640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:53.312 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:53.310+0000 7fd0b3b67640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:53.328 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:15:53.328 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:15:53.342 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:15:53.342 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:15:53.356 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:15:53.356 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:15:53.370 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:15:53.370 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:15:53.370 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:53.369+0000 7fec59afe640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:53.371 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:53.369+0000 7fec59afe640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:53.525 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:15:53.525 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:15:53.572 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":473,"stamp":"2026-02-23T13:15:52.695146+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30402871840,"num_objects":463904,"num_object_clones":0,"num_object_copies":1391712,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":463904,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":464037,"num_write_kb":29691878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":95285116,"kb_used_data":88492780,"kb_used_omap":115,"kb_used_meta":6792076,"kb_avail":2840727684,"statfs":{"total":3006477107200,"available":2908905148416,"internally_reserved":0,"allocated":90616606720,"data_stored":90614192676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":118276,"internal_metadata":6955086332},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[13,10],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7204700160,"num_objects":109935,"num_object_clones":0,"num_object_copies":329805,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109935,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109935,"num_write_kb":7035840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001762"},"pg_stats":[{"pgid":"6.f","version":"111'29072","reported_seq":29112,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:51.816486+0000","last_change":"2026-02-23T13:14:49.711212+0000","last_active":"2026-02-23T13:15:51.816486+0000","last_peered":"2026-02-23T13:15:51.816486+0000","last_clean":"2026-02-23T13:15:51.816486+0000","last_became_active":"2026-02-23T13:14:49.710909+0000","last_became_peered":"2026-02-23T13:14:49.710909+0000","last_unstale":"2026-02-23T13:15:51.816486+0000","last_undegraded":"2026-02-23T13:15:51.816486+0000","last_fullsized":"2026-02-23T13:15:51.816486+0000","mapping_epoch":96,"log_start":"111'29069","ondisk_log_start":"111'29069","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:18.401390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1905262592,"num_objects":29072,"num_object_clones":0,"num_object_copies":87216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29072,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29072,"num_write_kb":1860608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"111'29004","reported_seq":29044,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:51.691347+0000","last_change":"2026-02-23T13:14:49.711013+0000","last_active":"2026-02-23T13:15:51.691347+0000","last_peered":"2026-02-23T13:15:51.691347+0000","last_clean":"2026-02-23T13:15:51.691347+0000","last_became_active":"2026-02-23T13:14:49.710608+0000","last_became_peered":"2026-02-23T13:14:49.710608+0000","last_unstale":"2026-02-23T13:15:51.691347+0000","last_undegraded":"2026-02-23T13:15:51.691347+0000","last_fullsized":"2026-02-23T13:15:51.691347+0000","mapping_epoch":96,"log_start":"111'29001","ondisk_log_start":"111'29001","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:57.080821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900806144,"num_objects":29004,"num_object_clones":0,"num_object_copies":87012,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29004,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29004,"num_write_kb":1856256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"111'28788","reported_seq":28827,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:51.687848+0000","last_change":"2026-02-23T13:14:49.711150+0000","last_active":"2026-02-23T13:15:51.687848+0000","last_peered":"2026-02-23T13:15:51.687848+0000","last_clean":"2026-02-23T13:15:51.687848+0000","last_became_active":"2026-02-23T13:14:49.710759+0000","last_became_peered":"2026-02-23T13:14:49.710759+0000","last_unstale":"2026-02-23T13:15:51.687848+0000","last_undegraded":"2026-02-23T13:15:51.687848+0000","last_fullsized":"2026-02-23T13:15:51.687848+0000","mapping_epoch":96,"log_start":"111'28785","ondisk_log_start":"111'28785","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:09.130033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1886650368,"num_objects":28788,"num_object_clones":0,"num_object_copies":86364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28788,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28788,"num_write_kb":1842432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"111'29239","reported_seq":29278,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:51.827822+0000","last_change":"2026-02-23T13:14:49.711353+0000","last_active":"2026-02-23T13:15:51.827822+0000","last_peered":"2026-02-23T13:15:51.827822+0000","last_clean":"2026-02-23T13:15:51.827822+0000","last_became_active":"2026-02-23T13:14:49.710648+0000","last_became_peered":"2026-02-23T13:14:49.710648+0000","last_unstale":"2026-02-23T13:15:51.827822+0000","last_undegraded":"2026-02-23T13:15:51.827822+0000","last_fullsized":"2026-02-23T13:15:51.827822+0000","mapping_epoch":96,"log_start":"111'29236","ondisk_log_start":"111'29236","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:00.632137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1916207104,"num_objects":29239,"num_object_clones":0,"num_object_copies":87717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29239,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29239,"num_write_kb":1871296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"111'28995","reported_seq":29035,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:51.823698+0000","last_change":"2026-02-23T13:14:49.710716+0000","last_active":"2026-02-23T13:15:51.823698+0000","last_peered":"2026-02-23T13:15:51.823698+0000","last_clean":"2026-02-23T13:15:51.823698+0000","last_became_active":"2026-02-23T13:14:49.709875+0000","last_became_peered":"2026-02-23T13:14:49.709875+0000","last_unstale":"2026-02-23T13:15:51.823698+0000","last_undegraded":"2026-02-23T13:15:51.823698+0000","last_fullsized":"2026-02-23T13:15:51.823698+0000","mapping_epoch":96,"log_start":"111'28992","ondisk_log_start":"111'28992","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:08.189503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900216320,"num_objects":28995,"num_object_clones":0,"num_object_copies":86985,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28995,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28995,"num_write_kb":1855680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"111'29103","reported_seq":29143,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:51.687684+0000","last_change":"2026-02-23T13:14:49.710292+0000","last_active":"2026-02-23T13:15:51.687684+0000","last_peered":"2026-02-23T13:15:51.687684+0000","last_clean":"2026-02-23T13:15:51.687684+0000","last_became_active":"2026-02-23T13:14:49.709618+0000","last_became_peered":"2026-02-23T13:14:49.709618+0000","last_unstale":"2026-02-23T13:15:51.687684+0000","last_undegraded":"2026-02-23T13:15:51.687684+0000","last_fullsized":"2026-02-23T13:15:51.687684+0000","mapping_epoch":96,"log_start":"111'29100","ondisk_log_start":"111'29100","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:12.895714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1907294208,"num_objects":29103,"num_object_clones":0,"num_object_copies":87309,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29103,"num_write_kb":1862592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"111'28781","reported_seq":28821,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:51.705972+0000","last_change":"2026-02-23T13:14:49.711809+0000","last_active":"2026-02-23T13:15:51.705972+0000","last_peered":"2026-02-23T13:15:51.705972+0000","last_clean":"2026-02-23T13:15:51.705972+0000","last_became_active":"2026-02-23T13:14:49.711647+0000","last_became_peered":"2026-02-23T13:14:49.711647+0000","last_unstale":"2026-02-23T13:15:51.705972+0000","last_undegraded":"2026-02-23T13:15:51.705972+0000","last_fullsized":"2026-02-23T13:15:51.705972+0000","mapping_epoch":96,"log_start":"111'28778","ondisk_log_start":"111'28778","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:16.696834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1886191616,"num_objects":28781,"num_object_clones":0,"num_object_copies":86343,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28781,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28781,"num_write_kb":1841984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"111'28704","reported_seq":28744,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:51.680907+0000","last_change":"2026-02-23T13:14:49.710392+0000","last_active":"2026-02-23T13:15:51.680907+0000","last_peered":"2026-02-23T13:15:51.680907+0000","last_clean":"2026-02-23T13:15:51.680907+0000","last_became_active":"2026-02-23T13:14:49.710064+0000","last_became_peered":"2026-02-23T13:14:49.710064+0000","last_unstale":"2026-02-23T13:15:51.680907+0000","last_undegraded":"2026-02-23T13:15:51.680907+0000","last_fullsized":"2026-02-23T13:15:51.680907+0000","mapping_epoch":96,"log_start":"111'28701","ondisk_log_start":"111'28701","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:07.281706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1881145344,"num_objects":28704,"num_object_clones":0,"num_object_copies":86112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28704,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28704,"num_write_kb":1837056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"111'28924","reported_seq":28964,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:51.828194+0000","last_change":"2026-02-23T13:14:49.711523+0000","last_active":"2026-02-23T13:15:51.828194+0000","last_peered":"2026-02-23T13:15:51.828194+0000","last_clean":"2026-02-23T13:15:51.828194+0000","last_became_active":"2026-02-23T13:14:49.711227+0000","last_became_peered":"2026-02-23T13:14:49.711227+0000","last_unstale":"2026-02-23T13:15:51.828194+0000","last_undegraded":"2026-02-23T13:15:51.828194+0000","last_fullsized":"2026-02-23T13:15:51.828194+0000","mapping_epoch":96,"log_start":"111'28921","ondisk_log_start":"111'28921","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:09.568570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1895563264,"num_objects":28924,"num_object_clones":0,"num_object_copies":86772,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28924,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28924,"num_write_kb":1851136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"111'29065","reported_seq":29105,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:51.690633+0000","last_change":"2026-02-23T13:14:49.710830+0000","last_active":"2026-02-23T13:15:51.690633+0000","last_peered":"2026-02-23T13:15:51.690633+0000","last_clean":"2026-02-23T13:15:51.690633+0000","last_became_active":"2026-02-23T13:14:49.710282+0000","last_became_peered":"2026-02-23T13:14:49.710282+0000","last_unstale":"2026-02-23T13:15:51.690633+0000","last_undegraded":"2026-02-23T13:15:51.690633+0000","last_fullsized":"2026-02-23T13:15:51.690633+0000","mapping_epoch":96,"log_start":"111'29062","ondisk_log_start":"111'29062","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:05.474131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1904803840,"num_objects":29065,"num_object_clones":0,"num_object_copies":87195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29065,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29065,"num_write_kb":1860160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"111'29163","reported_seq":29203,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:51.827073+0000","last_change":"2026-02-23T13:14:49.711384+0000","last_active":"2026-02-23T13:15:51.827073+0000","last_peered":"2026-02-23T13:15:51.827073+0000","last_clean":"2026-02-23T13:15:51.827073+0000","last_became_active":"2026-02-23T13:14:49.710940+0000","last_became_peered":"2026-02-23T13:14:49.710940+0000","last_unstale":"2026-02-23T13:15:51.827073+0000","last_undegraded":"2026-02-23T13:15:51.827073+0000","last_fullsized":"2026-02-23T13:15:51.827073+0000","mapping_epoch":96,"log_start":"111'29160","ondisk_log_start":"111'29160","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:01.989539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1911226368,"num_objects":29163,"num_object_clones":0,"num_object_copies":87489,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29163,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29163,"num_write_kb":1866432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"111'28735","reported_seq":28775,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:51.691280+0000","last_change":"2026-02-23T13:14:49.709045+0000","last_active":"2026-02-23T13:15:51.691280+0000","last_peered":"2026-02-23T13:15:51.691280+0000","last_clean":"2026-02-23T13:15:51.691280+0000","last_became_active":"2026-02-23T13:14:49.708668+0000","last_became_peered":"2026-02-23T13:14:49.708668+0000","last_unstale":"2026-02-23T13:15:51.691280+0000","last_undegraded":"2026-02-23T13:15:51.691280+0000","last_fullsized":"2026-02-23T13:15:51.691280+0000","mapping_epoch":96,"log_start":"111'28732","ondisk_log_start":"111'28732","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:05.829857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1883176960,"num_objects":28735,"num_object_clones":0,"num_object_copies":86205,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28735,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28735,"num_write_kb":1839040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"111'29065","reported_seq":29105,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:51.672750+0000","last_change":"2026-02-23T13:14:49.709471+0000","last_active":"2026-02-23T13:15:51.672750+0000","last_peered":"2026-02-23T13:15:51.672750+0000","last_clean":"2026-02-23T13:15:51.672750+0000","last_became_active":"2026-02-23T13:14:49.709202+0000","last_became_peered":"2026-02-23T13:14:49.709202+0000","last_unstale":"2026-02-23T13:15:51.672750+0000","last_undegraded":"2026-02-23T13:15:51.672750+0000","last_fullsized":"2026-02-23T13:15:51.672750+0000","mapping_epoch":96,"log_start":"111'29062","ondisk_log_start":"111'29062","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:00.362060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1904803840,"num_objects":29065,"num_object_clones":0,"num_object_copies":87195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29065,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29065,"num_write_kb":1860160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"111'29352","reported_seq":29392,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:51.825805+0000","last_change":"2026-02-23T13:14:49.711071+0000","last_active":"2026-02-23T13:15:51.825805+0000","last_peered":"2026-02-23T13:15:51.825805+0000","last_clean":"2026-02-23T13:15:51.825805+0000","last_became_active":"2026-02-23T13:14:49.710193+0000","last_became_peered":"2026-02-23T13:14:49.710193+0000","last_unstale":"2026-02-23T13:15:51.825805+0000","last_undegraded":"2026-02-23T13:15:51.825805+0000","last_fullsized":"2026-02-23T13:15:51.825805+0000","mapping_epoch":96,"log_start":"111'29349","ondisk_log_start":"111'29349","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:15.360867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1923612672,"num_objects":29352,"num_object_clones":0,"num_object_copies":88056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29352,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29352,"num_write_kb":1878528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"111'29087","reported_seq":29125,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:51.707665+0000","last_change":"2026-02-23T13:14:49.710077+0000","last_active":"2026-02-23T13:15:51.707665+0000","last_peered":"2026-02-23T13:15:51.707665+0000","last_clean":"2026-02-23T13:15:51.707665+0000","last_became_active":"2026-02-23T13:14:49.709781+0000","last_became_peered":"2026-02-23T13:14:49.709781+0000","last_unstale":"2026-02-23T13:15:51.707665+0000","last_undegraded":"2026-02-23T13:15:51.707665+0000","last_fullsized":"2026-02-23T13:15:51.707665+0000","mapping_epoch":96,"log_start":"111'29084","ondisk_log_start":"111'29084","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:16.674175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1906245632,"num_objects":29087,"num_object_clones":0,"num_object_copies":87261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29087,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29087,"num_write_kb":1861568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"111'28825","reported_seq":28865,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:51.678285+0000","last_change":"2026-02-23T13:14:49.709980+0000","last_active":"2026-02-23T13:15:51.678285+0000","last_peered":"2026-02-23T13:15:51.678285+0000","last_clean":"2026-02-23T13:15:51.678285+0000","last_became_active":"2026-02-23T13:14:49.709715+0000","last_became_peered":"2026-02-23T13:14:49.709715+0000","last_unstale":"2026-02-23T13:15:51.678285+0000","last_undegraded":"2026-02-23T13:15:51.678285+0000","last_fullsized":"2026-02-23T13:15:51.678285+0000","mapping_epoch":96,"log_start":"111'28822","ondisk_log_start":"111'28822","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:07.659456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1889075200,"num_objects":28825,"num_object_clones":0,"num_object_copies":86475,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28825,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28825,"num_write_kb":1844800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":436,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:37.760599+0000","last_change":"2026-02-23T13:15:25.299766+0000","last_active":"2026-02-23T13:15:37.760599+0000","last_peered":"2026-02-23T13:15:37.760599+0000","last_clean":"2026-02-23T13:15:37.760599+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:15:37.760599+0000","last_undegraded":"2026-02-23T13:15:37.760599+0000","last_fullsized":"2026-02-23T13:15:37.760599+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:15:25.299737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:15:25.299737+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:42.738354+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":30402281472,"num_objects":463902,"num_object_clones":0,"num_object_copies":1391706,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":463902,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":463902,"num_write_kb":29689728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":91187183616,"data_stored":91187183616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4101,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247965,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":20035568,"kb_used_data":18387292,"kb_used_omap":28,"kb_used_meta":1648227,"kb_avail":713967632,"statfs":{"total":751619276800,"available":731102855168,"internally_reserved":0,"allocated":18828587008,"data_stored":18827982609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29212,"internal_metadata":1687784932},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,4],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444192,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":23657008,"kb_used_data":22043356,"kb_used_omap":31,"kb_used_meta":1613536,"kb_avail":710346192,"statfs":{"total":751619276800,"available":727394500608,"internally_reserved":0,"allocated":22572396544,"data_stored":22571792145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32002,"internal_metadata":1652261630},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575010,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27526380,"kb_used_data":25818456,"kb_used_omap":29,"kb_used_meta":1707874,"kb_avail":706476820,"statfs":{"total":751619276800,"available":723432263680,"internally_reserved":0,"allocated":26438098944,"data_stored":26437498097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30494,"internal_metadata":1748863202},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,5],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705827,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":24066160,"kb_used_data":22243676,"kb_used_omap":25,"kb_used_meta":1822438,"kb_avail":709937040,"statfs":{"total":751619276800,"available":726975528960,"internally_reserved":0,"allocated":22777524224,"data_stored":22776919825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26568,"internal_metadata":1866176568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4101,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":22810984448,"data_stored":22810984448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26624131072,"data_stored":26624131072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22797549568,"data_stored":22797549568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18954518528,"data_stored":18954518528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:15:53.574 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:15:53.574 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 331 2026-02-23T13:15:53.725 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:53.803 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 63 16 479748 479732 475.884 475.875 0.00207256 0.00210002 2026-02-23T13:15:53.844 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:53 trial046 ceph-mon[38575]: pgmap v473: 17 pgs: 17 active+clean; 28 GiB data, 91 GiB used, 2.6 TiB / 2.7 TiB avail; 572 MiB/s wr, 9.16k op/s 2026-02-23T13:15:53.844 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:53 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4205763533' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:15:53.859 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:53.857+0000 7fbb66160640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:53.859 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:53.857+0000 7fbb66160640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:53.999 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:15:54.040 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:15:54.804 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 64 16 487374 487358 475.895 476.625 0.00182116 0.00209996 2026-02-23T13:15:55.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:54 trial046 ceph-mon[38575]: from='client.15546 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:15:55.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:54 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2334218775' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "331"} : dispatch 2026-02-23T13:15:55.423 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:15:55.578 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:55.804 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 65 16 494813 494797 475.726 464.938 0.0011668 0.00210009 2026-02-23T13:15:56.007 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:55 trial046 ceph-mon[38575]: pgmap v474: 17 pgs: 17 active+clean; 28 GiB data, 91 GiB used, 2.6 TiB / 2.7 TiB avail; 367 MiB/s wr, 5.88k op/s 2026-02-23T13:15:56.031 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:15:56.031 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:15:56.031 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:55.988+0000 7fa9711dd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:56.031 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:55.989+0000 7fa9711dd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:56.031 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:15:56.032 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:15:56.034 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:15:56.034 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:15:56.047 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:15:56.048 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:15:56.289 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:15:56 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:15:56] "GET /metrics HTTP/1.1" 200 4219 "" "Prometheus/3.6.0" 2026-02-23T13:15:56.560 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:15:56 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:15:56.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:15:56.804 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 66 16 500923 500907 474.303 381.875 0.00140014 0.00210702 2026-02-23T13:15:57.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:56 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3480749434' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:15:57.804 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 67 15 508242 508227 474.052 457.5 0.0013803 0.00210814 2026-02-23T13:15:58.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:57 trial046 ceph-mon[38575]: pgmap v475: 17 pgs: 17 active+clean; 29 GiB data, 94 GiB used, 2.6 TiB / 2.7 TiB avail; 463 MiB/s wr, 7.40k op/s 2026-02-23T13:15:58.588 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:15:58.732 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:58.804 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 68 15 515589 515574 473.833 459.188 0.00246219 0.00210911 2026-02-23T13:15:58.866 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:58.864+0000 7f71130c9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:58.866 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:58 trial046 ceph-mon[38575]: 6.e scrub starts 2026-02-23T13:15:58.866 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:58.865+0000 7f71130c9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:58.883 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:15:58.883 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:15:58.899 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:15:58.899 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:15:58.916 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:15:58.916 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:15:58.930 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:15:58.930 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:15:59.041 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:15:59.041 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:15:59.041 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:15:59.041 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:15:59.198 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:59.317 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:59.315+0000 7ff3e6015640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:59.318 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:59.315+0000 7ff3e6015640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:59.459 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:15:59.459 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:15:59.511 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":476,"stamp":"2026-02-23T13:15:58.696047+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":32799326752,"num_objects":500471,"num_object_clones":0,"num_object_copies":1501413,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":500471,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":500604,"num_write_kb":32032166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53,"ondisk_log_size":53,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":102879804,"kb_used_data":95600236,"kb_used_omap":115,"kb_used_meta":7279372,"kb_avail":2833132996,"statfs":{"total":3006477107200,"available":2901128187904,"internally_reserved":0,"allocated":97894641664,"data_stored":97892227620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":118276,"internal_metadata":7454077436},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[20,2,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5877137408,"num_objects":89678,"num_object_clones":0,"num_object_copies":269034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89678,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89678,"num_write_kb":5739392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001786"},"pg_stats":[{"pgid":"6.f","version":"111'31382","reported_seq":31422,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:56.827844+0000","last_change":"2026-02-23T13:14:49.711212+0000","last_active":"2026-02-23T13:15:56.827844+0000","last_peered":"2026-02-23T13:15:56.827844+0000","last_clean":"2026-02-23T13:15:56.827844+0000","last_became_active":"2026-02-23T13:14:49.710909+0000","last_became_peered":"2026-02-23T13:14:49.710909+0000","last_unstale":"2026-02-23T13:15:56.827844+0000","last_undegraded":"2026-02-23T13:15:56.827844+0000","last_fullsized":"2026-02-23T13:15:56.827844+0000","mapping_epoch":96,"log_start":"111'31379","ondisk_log_start":"111'31379","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:18.401390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2056650752,"num_objects":31382,"num_object_clones":0,"num_object_copies":94146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31382,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31382,"num_write_kb":2008448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"111'31266","reported_seq":31306,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:56.689670+0000","last_change":"2026-02-23T13:14:49.711013+0000","last_active":"2026-02-23T13:15:56.689670+0000","last_peered":"2026-02-23T13:15:56.689670+0000","last_clean":"2026-02-23T13:15:56.689670+0000","last_became_active":"2026-02-23T13:14:49.710608+0000","last_became_peered":"2026-02-23T13:14:49.710608+0000","last_unstale":"2026-02-23T13:15:56.689670+0000","last_undegraded":"2026-02-23T13:15:56.689670+0000","last_fullsized":"2026-02-23T13:15:56.689670+0000","mapping_epoch":96,"log_start":"111'31263","ondisk_log_start":"111'31263","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:15:57.080821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2049048576,"num_objects":31266,"num_object_clones":0,"num_object_copies":93798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31266,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31266,"num_write_kb":2001024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"111'31078","reported_seq":31118,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:56.692112+0000","last_change":"2026-02-23T13:14:49.711150+0000","last_active":"2026-02-23T13:15:56.692112+0000","last_peered":"2026-02-23T13:15:56.692112+0000","last_clean":"2026-02-23T13:15:56.692112+0000","last_became_active":"2026-02-23T13:14:49.710759+0000","last_became_peered":"2026-02-23T13:14:49.710759+0000","last_unstale":"2026-02-23T13:15:56.692112+0000","last_undegraded":"2026-02-23T13:15:56.692112+0000","last_fullsized":"2026-02-23T13:15:56.692112+0000","mapping_epoch":96,"log_start":"111'31075","ondisk_log_start":"111'31075","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:09.130033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2036727808,"num_objects":31078,"num_object_clones":0,"num_object_copies":93234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31078,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31078,"num_write_kb":1988992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"111'31532","reported_seq":31572,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:56.822802+0000","last_change":"2026-02-23T13:14:49.711353+0000","last_active":"2026-02-23T13:15:56.822802+0000","last_peered":"2026-02-23T13:15:56.822802+0000","last_clean":"2026-02-23T13:15:56.822802+0000","last_became_active":"2026-02-23T13:14:49.710648+0000","last_became_peered":"2026-02-23T13:14:49.710648+0000","last_unstale":"2026-02-23T13:15:56.822802+0000","last_undegraded":"2026-02-23T13:15:56.822802+0000","last_fullsized":"2026-02-23T13:15:56.822802+0000","mapping_epoch":96,"log_start":"111'31529","ondisk_log_start":"111'31529","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:00.632137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2066481152,"num_objects":31532,"num_object_clones":0,"num_object_copies":94596,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31532,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31532,"num_write_kb":2018048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"111'31215","reported_seq":31255,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:56.822551+0000","last_change":"2026-02-23T13:14:49.710716+0000","last_active":"2026-02-23T13:15:56.822551+0000","last_peered":"2026-02-23T13:15:56.822551+0000","last_clean":"2026-02-23T13:15:56.822551+0000","last_became_active":"2026-02-23T13:14:49.709875+0000","last_became_peered":"2026-02-23T13:14:49.709875+0000","last_unstale":"2026-02-23T13:15:56.822551+0000","last_undegraded":"2026-02-23T13:15:56.822551+0000","last_fullsized":"2026-02-23T13:15:56.822551+0000","mapping_epoch":96,"log_start":"111'31212","ondisk_log_start":"111'31212","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:08.189503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2045706240,"num_objects":31215,"num_object_clones":0,"num_object_copies":93645,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31215,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31215,"num_write_kb":1997760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"111'31433","reported_seq":31473,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:56.686049+0000","last_change":"2026-02-23T13:14:49.710292+0000","last_active":"2026-02-23T13:15:56.686049+0000","last_peered":"2026-02-23T13:15:56.686049+0000","last_clean":"2026-02-23T13:15:56.686049+0000","last_became_active":"2026-02-23T13:14:49.709618+0000","last_became_peered":"2026-02-23T13:14:49.709618+0000","last_unstale":"2026-02-23T13:15:56.686049+0000","last_undegraded":"2026-02-23T13:15:56.686049+0000","last_fullsized":"2026-02-23T13:15:56.686049+0000","mapping_epoch":96,"log_start":"111'31430","ondisk_log_start":"111'31430","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:12.895714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2059993088,"num_objects":31433,"num_object_clones":0,"num_object_copies":94299,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31433,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31433,"num_write_kb":2011712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"111'31061","reported_seq":31101,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:56.709050+0000","last_change":"2026-02-23T13:14:49.711809+0000","last_active":"2026-02-23T13:15:56.709050+0000","last_peered":"2026-02-23T13:15:56.709050+0000","last_clean":"2026-02-23T13:15:56.709050+0000","last_became_active":"2026-02-23T13:14:49.711647+0000","last_became_peered":"2026-02-23T13:14:49.711647+0000","last_unstale":"2026-02-23T13:15:56.709050+0000","last_undegraded":"2026-02-23T13:15:56.709050+0000","last_fullsized":"2026-02-23T13:15:56.709050+0000","mapping_epoch":96,"log_start":"111'31058","ondisk_log_start":"111'31058","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:16.696834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2035613696,"num_objects":31061,"num_object_clones":0,"num_object_copies":93183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31061,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31061,"num_write_kb":1987904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"111'30980","reported_seq":31018,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:56.683327+0000","last_change":"2026-02-23T13:14:49.710392+0000","last_active":"2026-02-23T13:15:56.683327+0000","last_peered":"2026-02-23T13:15:56.683327+0000","last_clean":"2026-02-23T13:15:56.683327+0000","last_became_active":"2026-02-23T13:14:49.710064+0000","last_became_peered":"2026-02-23T13:14:49.710064+0000","last_unstale":"2026-02-23T13:15:56.683327+0000","last_undegraded":"2026-02-23T13:15:56.683327+0000","last_fullsized":"2026-02-23T13:15:56.683327+0000","mapping_epoch":96,"log_start":"111'30976","ondisk_log_start":"111'30976","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:07.281706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2030305280,"num_objects":30980,"num_object_clones":0,"num_object_copies":92940,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30980,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30980,"num_write_kb":1982720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"111'31189","reported_seq":31229,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:56.822614+0000","last_change":"2026-02-23T13:14:49.711523+0000","last_active":"2026-02-23T13:15:56.822614+0000","last_peered":"2026-02-23T13:15:56.822614+0000","last_clean":"2026-02-23T13:15:56.822614+0000","last_became_active":"2026-02-23T13:14:49.711227+0000","last_became_peered":"2026-02-23T13:14:49.711227+0000","last_unstale":"2026-02-23T13:15:56.822614+0000","last_undegraded":"2026-02-23T13:15:56.822614+0000","last_fullsized":"2026-02-23T13:15:56.822614+0000","mapping_epoch":96,"log_start":"111'31186","ondisk_log_start":"111'31186","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:09.568570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2044002304,"num_objects":31189,"num_object_clones":0,"num_object_copies":93567,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31189,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31189,"num_write_kb":1996096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"111'31385","reported_seq":31425,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:56.691961+0000","last_change":"2026-02-23T13:14:49.710830+0000","last_active":"2026-02-23T13:15:56.691961+0000","last_peered":"2026-02-23T13:15:56.691961+0000","last_clean":"2026-02-23T13:15:56.691961+0000","last_became_active":"2026-02-23T13:14:49.710282+0000","last_became_peered":"2026-02-23T13:14:49.710282+0000","last_unstale":"2026-02-23T13:15:56.691961+0000","last_undegraded":"2026-02-23T13:15:56.691961+0000","last_fullsized":"2026-02-23T13:15:56.691961+0000","mapping_epoch":96,"log_start":"111'31382","ondisk_log_start":"111'31382","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:05.474131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2056847360,"num_objects":31385,"num_object_clones":0,"num_object_copies":94155,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31385,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31385,"num_write_kb":2008640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"111'31453","reported_seq":31492,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:56.830125+0000","last_change":"2026-02-23T13:14:49.711384+0000","last_active":"2026-02-23T13:15:56.830125+0000","last_peered":"2026-02-23T13:15:56.830125+0000","last_clean":"2026-02-23T13:15:56.830125+0000","last_became_active":"2026-02-23T13:14:49.710940+0000","last_became_peered":"2026-02-23T13:14:49.710940+0000","last_unstale":"2026-02-23T13:15:56.830125+0000","last_undegraded":"2026-02-23T13:15:56.830125+0000","last_fullsized":"2026-02-23T13:15:56.830125+0000","mapping_epoch":96,"log_start":"111'31450","ondisk_log_start":"111'31450","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:01.989539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2061303808,"num_objects":31453,"num_object_clones":0,"num_object_copies":94359,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31453,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31453,"num_write_kb":2012992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"111'31029","reported_seq":31066,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:56.689574+0000","last_change":"2026-02-23T13:14:49.709045+0000","last_active":"2026-02-23T13:15:56.689574+0000","last_peered":"2026-02-23T13:15:56.689574+0000","last_clean":"2026-02-23T13:15:56.689574+0000","last_became_active":"2026-02-23T13:14:49.708668+0000","last_became_peered":"2026-02-23T13:14:49.708668+0000","last_unstale":"2026-02-23T13:15:56.689574+0000","last_undegraded":"2026-02-23T13:15:56.689574+0000","last_fullsized":"2026-02-23T13:15:56.689574+0000","mapping_epoch":96,"log_start":"111'31025","ondisk_log_start":"111'31025","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:05.829857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2033516544,"num_objects":31029,"num_object_clones":0,"num_object_copies":93087,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31029,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31029,"num_write_kb":1985856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"111'31348","reported_seq":31388,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:56.680825+0000","last_change":"2026-02-23T13:14:49.709471+0000","last_active":"2026-02-23T13:15:56.680825+0000","last_peered":"2026-02-23T13:15:56.680825+0000","last_clean":"2026-02-23T13:15:56.680825+0000","last_became_active":"2026-02-23T13:14:49.709202+0000","last_became_peered":"2026-02-23T13:14:49.709202+0000","last_unstale":"2026-02-23T13:15:56.680825+0000","last_undegraded":"2026-02-23T13:15:56.680825+0000","last_fullsized":"2026-02-23T13:15:56.680825+0000","mapping_epoch":96,"log_start":"111'31345","ondisk_log_start":"111'31345","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:00.362060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2054422528,"num_objects":31348,"num_object_clones":0,"num_object_copies":94044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31348,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31348,"num_write_kb":2006272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"111'31669","reported_seq":31709,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:56.826781+0000","last_change":"2026-02-23T13:14:49.711071+0000","last_active":"2026-02-23T13:15:56.826781+0000","last_peered":"2026-02-23T13:15:56.826781+0000","last_clean":"2026-02-23T13:15:56.826781+0000","last_became_active":"2026-02-23T13:14:49.710193+0000","last_became_peered":"2026-02-23T13:14:49.710193+0000","last_unstale":"2026-02-23T13:15:56.826781+0000","last_undegraded":"2026-02-23T13:15:56.826781+0000","last_fullsized":"2026-02-23T13:15:56.826781+0000","mapping_epoch":96,"log_start":"111'31666","ondisk_log_start":"111'31666","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:15.360867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2075459584,"num_objects":31669,"num_object_clones":0,"num_object_copies":95007,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31669,"num_write_kb":2026816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"111'31350","reported_seq":31390,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:56.704613+0000","last_change":"2026-02-23T13:14:49.710077+0000","last_active":"2026-02-23T13:15:56.704613+0000","last_peered":"2026-02-23T13:15:56.704613+0000","last_clean":"2026-02-23T13:15:56.704613+0000","last_became_active":"2026-02-23T13:14:49.709781+0000","last_became_peered":"2026-02-23T13:14:49.709781+0000","last_unstale":"2026-02-23T13:15:56.704613+0000","last_undegraded":"2026-02-23T13:15:56.704613+0000","last_fullsized":"2026-02-23T13:15:56.704613+0000","mapping_epoch":96,"log_start":"111'31347","ondisk_log_start":"111'31347","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:16.674175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2054553600,"num_objects":31350,"num_object_clones":0,"num_object_copies":94050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31350,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31350,"num_write_kb":2006400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"111'31099","reported_seq":31139,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:56.683237+0000","last_change":"2026-02-23T13:14:49.709980+0000","last_active":"2026-02-23T13:15:56.683237+0000","last_peered":"2026-02-23T13:15:56.683237+0000","last_clean":"2026-02-23T13:15:56.683237+0000","last_became_active":"2026-02-23T13:14:49.709715+0000","last_became_peered":"2026-02-23T13:14:49.709715+0000","last_unstale":"2026-02-23T13:15:56.683237+0000","last_undegraded":"2026-02-23T13:15:56.683237+0000","last_fullsized":"2026-02-23T13:15:56.683237+0000","mapping_epoch":96,"log_start":"111'31096","ondisk_log_start":"111'31096","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:07.659456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2038104064,"num_objects":31099,"num_object_clones":0,"num_object_copies":93297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31099,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31099,"num_write_kb":1990336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":436,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:37.760599+0000","last_change":"2026-02-23T13:15:25.299766+0000","last_active":"2026-02-23T13:15:37.760599+0000","last_peered":"2026-02-23T13:15:37.760599+0000","last_clean":"2026-02-23T13:15:37.760599+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:15:37.760599+0000","last_undegraded":"2026-02-23T13:15:37.760599+0000","last_fullsized":"2026-02-23T13:15:37.760599+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:15:25.299737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:15:25.299737+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:42.738354+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":32798736384,"num_objects":500469,"num_object_clones":0,"num_object_copies":1501407,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":500469,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":500469,"num_write_kb":32030016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98380218368,"data_stored":98380218368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":50,"ondisk_log_size":50,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4101,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247966,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":21643888,"kb_used_data":19869276,"kb_used_omap":28,"kb_used_meta":1774563,"kb_avail":712359312,"statfs":{"total":751619276800,"available":729455935488,"internally_reserved":0,"allocated":20346138624,"data_stored":20345534225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29212,"internal_metadata":1817152996},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444193,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":25562352,"kb_used_data":23840476,"kb_used_omap":31,"kb_used_meta":1721824,"kb_avail":708440848,"statfs":{"total":751619276800,"available":725443428352,"internally_reserved":0,"allocated":24412647424,"data_stored":24412043025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32002,"internal_metadata":1763148542},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575011,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":29709484,"kb_used_data":27857176,"kb_used_omap":29,"kb_used_meta":1852258,"kb_avail":704293716,"statfs":{"total":751619276800,"available":721196765184,"internally_reserved":0,"allocated":28525748224,"data_stored":28525147377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30494,"internal_metadata":1896712418},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,2,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705828,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":25964080,"kb_used_data":24033308,"kb_used_omap":25,"kb_used_meta":1930726,"kb_avail":708039120,"statfs":{"total":751619276800,"available":725032058880,"internally_reserved":0,"allocated":24610107392,"data_stored":24609502993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26568,"internal_metadata":1977063480},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4101,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24613158912,"data_stored":24613158912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28722855936,"data_stored":28722855936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24594415616,"data_stored":24594415616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20449787904,"data_stored":20449787904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:15:59.513 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:15:59.513 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 341 2026-02-23T13:15:59.661 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:15:59.804 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 69 16 522751 522735 473.45 447.562 0.00287709 0.00211079 2026-02-23T13:15:59.805 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:59.803+0000 7fae65361640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:59.805 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:15:59.803+0000 7fae65361640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:15:59.954 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:16:00.002 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:59 trial046 ceph-mon[38575]: pgmap v476: 17 pgs: 17 active+clean; 31 GiB data, 98 GiB used, 2.6 TiB / 2.7 TiB avail; 467 MiB/s wr, 7.47k op/s 2026-02-23T13:16:00.002 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:15:59 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/108794040' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:16:00.003 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:16:00.804 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 70 16 530323 530307 473.447 473.25 0.00113025 0.00211083 2026-02-23T13:16:00.979 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:16:01.038 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:00 trial046 ceph-mon[38575]: from='client.15554 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:16:01.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:00 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/362457724' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "341"} : dispatch 2026-02-23T13:16:01.133 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:01.256 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:01.254+0000 7f32d2bb3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:01.257 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:01.255+0000 7f32d2bb3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:01.273 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:16:01.273 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:16:01.287 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:16:01.287 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:16:01.301 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:16:01.301 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:16:01.314 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:16:01.315 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:16:01.804 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 71 16 538044 538028 473.575 482.562 0.00135945 0.00211027 2026-02-23T13:16:02.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:01 trial046 ceph-mon[38575]: pgmap v477: 17 pgs: 17 active+clean; 31 GiB data, 98 GiB used, 2.6 TiB / 2.7 TiB avail; 376 MiB/s wr, 6.01k op/s 2026-02-23T13:16:02.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:01 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:16:02.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:01 trial046 ceph-mon[38575]: 6.e scrub ok 2026-02-23T13:16:02.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:01 trial046 ceph-mon[38575]: 6.2 scrub starts 2026-02-23T13:16:02.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:01 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1290852977' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:16:02.804 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 72 16 545574 545558 473.533 470.625 0.00162089 0.00211046 2026-02-23T13:16:03.038 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:02 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:16:03.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:02 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:16:03.362 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:16:03.510 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:03.635 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:03.633+0000 7fb709212640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:03.635 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:03.633+0000 7fb709212640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:03.652 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:16:03.652 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:16:03.668 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:16:03.669 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:16:03.683 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:16:03.683 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:16:03.697 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:16:03.697 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:16:03.804 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 73 16 553525 553509 473.853 496.938 0.00175768 0.00210901 2026-02-23T13:16:04.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:03 trial046 ceph-mon[38575]: pgmap v478: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 33 GiB data, 105 GiB used, 2.6 TiB / 2.7 TiB avail; 569 MiB/s wr, 9.11k op/s 2026-02-23T13:16:04.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:03 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4157987012' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:16:04.805 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 74 16 561331 561315 474.042 487.875 0.00250869 0.00210818 2026-02-23T13:16:05.005 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:16:05.005 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:16:05.005 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_4 2026-02-23T13:16:05.006 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:16:05.035 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:04 trial046 ceph-mon[38575]: 6.2 scrub ok 2026-02-23T13:16:05.159 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:05.295 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:05.293+0000 7f59d0ae8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:05.295 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:05.293+0000 7f59d0ae8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:05.451 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:16:05.451 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:16:05.499 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":479,"stamp":"2026-02-23T13:16:04.696920+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":35230188064,"num_objects":537563,"num_object_clones":0,"num_object_copies":1612689,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":537563,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":537696,"num_write_kb":34406054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":110033468,"kb_used_data":102591724,"kb_used_omap":116,"kb_used_meta":7441547,"kb_avail":2825979332,"statfs":{"total":3006477107200,"available":2893802835968,"internally_reserved":0,"allocated":105053925376,"data_stored":105051511332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":119060,"internal_metadata":7620144876},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9,5,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4827316224,"num_objects":73659,"num_object_clones":0,"num_object_copies":220977,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73659,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73659,"num_write_kb":4714176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001773"},"pg_stats":[{"pgid":"6.f","version":"111'33660","reported_seq":33700,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:01.824998+0000","last_change":"2026-02-23T13:14:49.711212+0000","last_active":"2026-02-23T13:16:01.824998+0000","last_peered":"2026-02-23T13:16:01.824998+0000","last_clean":"2026-02-23T13:16:01.824998+0000","last_became_active":"2026-02-23T13:14:49.710909+0000","last_became_peered":"2026-02-23T13:14:49.710909+0000","last_unstale":"2026-02-23T13:16:01.824998+0000","last_undegraded":"2026-02-23T13:16:01.824998+0000","last_fullsized":"2026-02-23T13:16:01.824998+0000","mapping_epoch":96,"log_start":"111'33657","ondisk_log_start":"111'33657","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:18.401390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2205941760,"num_objects":33660,"num_object_clones":0,"num_object_copies":100980,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33660,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33660,"num_write_kb":2154240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"111'33621","reported_seq":33993,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:01.693099+0000","last_change":"2026-02-23T13:16:00.821994+0000","last_active":"2026-02-23T13:16:01.693099+0000","last_peered":"2026-02-23T13:16:01.693099+0000","last_clean":"2026-02-23T13:16:01.693099+0000","last_became_active":"2026-02-23T13:14:49.710608+0000","last_became_peered":"2026-02-23T13:14:49.710608+0000","last_unstale":"2026-02-23T13:16:01.693099+0000","last_undegraded":"2026-02-23T13:16:01.693099+0000","last_fullsized":"2026-02-23T13:16:01.693099+0000","mapping_epoch":96,"log_start":"111'33618","ondisk_log_start":"111'33618","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'33186","last_scrub_stamp":"2026-02-23T13:16:00.821941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:00.821941+0000","objects_scrubbed":32277,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:02.918773+0000","scrub_duration":3732,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2203385856,"num_objects":33621,"num_object_clones":0,"num_object_copies":100863,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33621,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33621,"num_write_kb":2151744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"111'33452","reported_seq":33491,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:01.689697+0000","last_change":"2026-02-23T13:14:49.711150+0000","last_active":"2026-02-23T13:16:01.689697+0000","last_peered":"2026-02-23T13:16:01.689697+0000","last_clean":"2026-02-23T13:16:01.689697+0000","last_became_active":"2026-02-23T13:14:49.710759+0000","last_became_peered":"2026-02-23T13:14:49.710759+0000","last_unstale":"2026-02-23T13:16:01.689697+0000","last_undegraded":"2026-02-23T13:16:01.689697+0000","last_fullsized":"2026-02-23T13:16:01.689697+0000","mapping_epoch":96,"log_start":"111'33449","ondisk_log_start":"111'33449","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:09.130033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2192310272,"num_objects":33452,"num_object_clones":0,"num_object_copies":100356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33452,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33452,"num_write_kb":2140928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"111'33856","reported_seq":33896,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:01.830669+0000","last_change":"2026-02-23T13:14:49.711353+0000","last_active":"2026-02-23T13:16:01.830669+0000","last_peered":"2026-02-23T13:16:01.830669+0000","last_clean":"2026-02-23T13:16:01.830669+0000","last_became_active":"2026-02-23T13:14:49.710648+0000","last_became_peered":"2026-02-23T13:14:49.710648+0000","last_unstale":"2026-02-23T13:16:01.830669+0000","last_undegraded":"2026-02-23T13:16:01.830669+0000","last_fullsized":"2026-02-23T13:16:01.830669+0000","mapping_epoch":96,"log_start":"111'33853","ondisk_log_start":"111'33853","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2218786816,"num_objects":33856,"num_object_clones":0,"num_object_copies":101568,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33856,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33856,"num_write_kb":2166784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"111'33562","reported_seq":33600,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:01.830483+0000","last_change":"2026-02-23T13:14:49.710716+0000","last_active":"2026-02-23T13:16:01.830483+0000","last_peered":"2026-02-23T13:16:01.830483+0000","last_clean":"2026-02-23T13:16:01.830483+0000","last_became_active":"2026-02-23T13:14:49.709875+0000","last_became_peered":"2026-02-23T13:14:49.709875+0000","last_unstale":"2026-02-23T13:16:01.830483+0000","last_undegraded":"2026-02-23T13:16:01.830483+0000","last_fullsized":"2026-02-23T13:16:01.830483+0000","mapping_epoch":96,"log_start":"111'33558","ondisk_log_start":"111'33558","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:08.189503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2199519232,"num_objects":33562,"num_object_clones":0,"num_object_copies":100686,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33562,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33562,"num_write_kb":2147968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"111'33733","reported_seq":33773,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:01.693070+0000","last_change":"2026-02-23T13:14:49.710292+0000","last_active":"2026-02-23T13:16:01.693070+0000","last_peered":"2026-02-23T13:16:01.693070+0000","last_clean":"2026-02-23T13:16:01.693070+0000","last_became_active":"2026-02-23T13:14:49.709618+0000","last_became_peered":"2026-02-23T13:14:49.709618+0000","last_unstale":"2026-02-23T13:16:01.693070+0000","last_undegraded":"2026-02-23T13:16:01.693070+0000","last_fullsized":"2026-02-23T13:16:01.693070+0000","mapping_epoch":96,"log_start":"111'33730","ondisk_log_start":"111'33730","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:12.895714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2210725888,"num_objects":33733,"num_object_clones":0,"num_object_copies":101199,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33733,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33733,"num_write_kb":2158912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"111'33344","reported_seq":33384,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:01.708649+0000","last_change":"2026-02-23T13:14:49.711809+0000","last_active":"2026-02-23T13:16:01.708649+0000","last_peered":"2026-02-23T13:16:01.708649+0000","last_clean":"2026-02-23T13:16:01.708649+0000","last_became_active":"2026-02-23T13:14:49.711647+0000","last_became_peered":"2026-02-23T13:14:49.711647+0000","last_unstale":"2026-02-23T13:16:01.708649+0000","last_undegraded":"2026-02-23T13:16:01.708649+0000","last_fullsized":"2026-02-23T13:16:01.708649+0000","mapping_epoch":96,"log_start":"111'33341","ondisk_log_start":"111'33341","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:16.696834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2185232384,"num_objects":33344,"num_object_clones":0,"num_object_copies":100032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33344,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33344,"num_write_kb":2134016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"111'33330","reported_seq":33370,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:01.683981+0000","last_change":"2026-02-23T13:14:49.710392+0000","last_active":"2026-02-23T13:16:01.683981+0000","last_peered":"2026-02-23T13:16:01.683981+0000","last_clean":"2026-02-23T13:16:01.683981+0000","last_became_active":"2026-02-23T13:14:49.710064+0000","last_became_peered":"2026-02-23T13:14:49.710064+0000","last_unstale":"2026-02-23T13:16:01.683981+0000","last_undegraded":"2026-02-23T13:16:01.683981+0000","last_fullsized":"2026-02-23T13:16:01.683981+0000","mapping_epoch":96,"log_start":"111'33327","ondisk_log_start":"111'33327","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:07.281706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2184314880,"num_objects":33330,"num_object_clones":0,"num_object_copies":99990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33330,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33330,"num_write_kb":2133120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"111'33531","reported_seq":33571,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:01.826626+0000","last_change":"2026-02-23T13:14:49.711523+0000","last_active":"2026-02-23T13:16:01.826626+0000","last_peered":"2026-02-23T13:16:01.826626+0000","last_clean":"2026-02-23T13:16:01.826626+0000","last_became_active":"2026-02-23T13:14:49.711227+0000","last_became_peered":"2026-02-23T13:14:49.711227+0000","last_unstale":"2026-02-23T13:16:01.826626+0000","last_undegraded":"2026-02-23T13:16:01.826626+0000","last_fullsized":"2026-02-23T13:16:01.826626+0000","mapping_epoch":96,"log_start":"111'33528","ondisk_log_start":"111'33528","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:09.568570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2197487616,"num_objects":33531,"num_object_clones":0,"num_object_copies":100593,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33531,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33531,"num_write_kb":2145984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"111'33719","reported_seq":33759,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:01.691822+0000","last_change":"2026-02-23T13:14:49.710830+0000","last_active":"2026-02-23T13:16:01.691822+0000","last_peered":"2026-02-23T13:16:01.691822+0000","last_clean":"2026-02-23T13:16:01.691822+0000","last_became_active":"2026-02-23T13:14:49.710282+0000","last_became_peered":"2026-02-23T13:14:49.710282+0000","last_unstale":"2026-02-23T13:16:01.691822+0000","last_undegraded":"2026-02-23T13:16:01.691822+0000","last_fullsized":"2026-02-23T13:16:01.691822+0000","mapping_epoch":96,"log_start":"111'33716","ondisk_log_start":"111'33716","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:05.474131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2209808384,"num_objects":33719,"num_object_clones":0,"num_object_copies":101157,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33719,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33719,"num_write_kb":2158016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"111'33701","reported_seq":33741,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:01.829012+0000","last_change":"2026-02-23T13:14:49.711384+0000","last_active":"2026-02-23T13:16:01.829012+0000","last_peered":"2026-02-23T13:16:01.829012+0000","last_clean":"2026-02-23T13:16:01.829012+0000","last_became_active":"2026-02-23T13:14:49.710940+0000","last_became_peered":"2026-02-23T13:14:49.710940+0000","last_unstale":"2026-02-23T13:16:01.829012+0000","last_undegraded":"2026-02-23T13:16:01.829012+0000","last_fullsized":"2026-02-23T13:16:01.829012+0000","mapping_epoch":96,"log_start":"111'33698","ondisk_log_start":"111'33698","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:01.989539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2208628736,"num_objects":33701,"num_object_clones":0,"num_object_copies":101103,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33701,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33701,"num_write_kb":2156864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"111'33410","reported_seq":33450,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:01.691114+0000","last_change":"2026-02-23T13:14:49.709045+0000","last_active":"2026-02-23T13:16:01.691114+0000","last_peered":"2026-02-23T13:16:01.691114+0000","last_clean":"2026-02-23T13:16:01.691114+0000","last_became_active":"2026-02-23T13:14:49.708668+0000","last_became_peered":"2026-02-23T13:14:49.708668+0000","last_unstale":"2026-02-23T13:16:01.691114+0000","last_undegraded":"2026-02-23T13:16:01.691114+0000","last_fullsized":"2026-02-23T13:16:01.691114+0000","mapping_epoch":96,"log_start":"111'33407","ondisk_log_start":"111'33407","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:05.829857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2189557760,"num_objects":33410,"num_object_clones":0,"num_object_copies":100230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33410,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33410,"num_write_kb":2138240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"111'33644","reported_seq":33756,"reported_epoch":111,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:16:01.688821+0000","last_change":"2026-02-23T13:16:01.147872+0000","last_active":"2026-02-23T13:16:01.688821+0000","last_peered":"2026-02-23T13:16:01.688821+0000","last_clean":"2026-02-23T13:16:01.688821+0000","last_became_active":"2026-02-23T13:14:49.709202+0000","last_became_peered":"2026-02-23T13:14:49.709202+0000","last_unstale":"2026-02-23T13:16:01.688821+0000","last_undegraded":"2026-02-23T13:16:01.688821+0000","last_fullsized":"2026-02-23T13:16:01.688821+0000","mapping_epoch":96,"log_start":"111'33641","ondisk_log_start":"111'33641","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":6949,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2204893184,"num_objects":33644,"num_object_clones":0,"num_object_copies":100932,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33644,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33644,"num_write_kb":2153216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"111'34007","reported_seq":34047,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:01.827893+0000","last_change":"2026-02-23T13:14:49.711071+0000","last_active":"2026-02-23T13:16:01.827893+0000","last_peered":"2026-02-23T13:16:01.827893+0000","last_clean":"2026-02-23T13:16:01.827893+0000","last_became_active":"2026-02-23T13:14:49.710193+0000","last_became_peered":"2026-02-23T13:14:49.710193+0000","last_unstale":"2026-02-23T13:16:01.827893+0000","last_undegraded":"2026-02-23T13:16:01.827893+0000","last_fullsized":"2026-02-23T13:16:01.827893+0000","mapping_epoch":96,"log_start":"111'34004","ondisk_log_start":"111'34004","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:15.360867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2228682752,"num_objects":34007,"num_object_clones":0,"num_object_copies":102021,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34007,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34007,"num_write_kb":2176448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"111'33628","reported_seq":33668,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:01.703795+0000","last_change":"2026-02-23T13:14:49.710077+0000","last_active":"2026-02-23T13:16:01.703795+0000","last_peered":"2026-02-23T13:16:01.703795+0000","last_clean":"2026-02-23T13:16:01.703795+0000","last_became_active":"2026-02-23T13:14:49.709781+0000","last_became_peered":"2026-02-23T13:14:49.709781+0000","last_unstale":"2026-02-23T13:16:01.703795+0000","last_undegraded":"2026-02-23T13:16:01.703795+0000","last_fullsized":"2026-02-23T13:16:01.703795+0000","mapping_epoch":96,"log_start":"111'33625","ondisk_log_start":"111'33625","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:16.674175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2203844608,"num_objects":33628,"num_object_clones":0,"num_object_copies":100884,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33628,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33628,"num_write_kb":2152192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"111'33363","reported_seq":33403,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:01.684649+0000","last_change":"2026-02-23T13:14:49.709980+0000","last_active":"2026-02-23T13:16:01.684649+0000","last_peered":"2026-02-23T13:16:01.684649+0000","last_clean":"2026-02-23T13:16:01.684649+0000","last_became_active":"2026-02-23T13:14:49.709715+0000","last_became_peered":"2026-02-23T13:14:49.709715+0000","last_unstale":"2026-02-23T13:16:01.684649+0000","last_undegraded":"2026-02-23T13:16:01.684649+0000","last_fullsized":"2026-02-23T13:16:01.684649+0000","mapping_epoch":96,"log_start":"111'33360","ondisk_log_start":"111'33360","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:07.659456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2186477568,"num_objects":33363,"num_object_clones":0,"num_object_copies":100089,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33363,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33363,"num_write_kb":2135232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":436,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:37.760599+0000","last_change":"2026-02-23T13:15:25.299766+0000","last_active":"2026-02-23T13:15:37.760599+0000","last_peered":"2026-02-23T13:15:37.760599+0000","last_clean":"2026-02-23T13:15:37.760599+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:15:37.760599+0000","last_undegraded":"2026-02-23T13:15:37.760599+0000","last_fullsized":"2026-02-23T13:15:37.760599+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:15:25.299737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:15:25.299737+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:42.738354+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":35229597696,"num_objects":537561,"num_object_clones":0,"num_object_copies":1612683,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":537561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":537561,"num_write_kb":34403904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":105673981952,"data_stored":105673981952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4101,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247967,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":23154288,"kb_used_data":21289756,"kb_used_omap":28,"kb_used_meta":1864483,"kb_avail":710848912,"statfs":{"total":751619276800,"available":727909285888,"internally_reserved":0,"allocated":21800710144,"data_stored":21800105745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29212,"internal_metadata":1909231076},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444194,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27423920,"kb_used_data":25593756,"kb_used_omap":31,"kb_used_meta":1830112,"kb_avail":706579280,"statfs":{"total":751619276800,"available":723537182720,"internally_reserved":0,"allocated":26208006144,"data_stored":26207401745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32002,"internal_metadata":1874035454},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,5,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575012,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":31864684,"kb_used_data":29904088,"kb_used_omap":29,"kb_used_meta":1960546,"kb_avail":702138516,"statfs":{"total":751619276800,"available":718989840384,"internally_reserved":0,"allocated":30621786112,"data_stored":30621185265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30494,"internal_metadata":2007599330},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705829,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27590576,"kb_used_data":25804124,"kb_used_omap":26,"kb_used_meta":1786405,"kb_avail":706412624,"statfs":{"total":751619276800,"available":723366526976,"internally_reserved":0,"allocated":26423422976,"data_stored":26422818577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27352,"internal_metadata":1829279016},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4101,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26435518464,"data_stored":26435518464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30849695744,"data_stored":30849695744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":26416054272,"data_stored":26416054272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21972713472,"data_stored":21972713472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:16:05.501 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_4 pgp_num 56 2026-02-23T13:16:05.702 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:05.743 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:16:05.805 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 75 16 568872 568856 474.005 471.312 0.00275895 0.00210835 2026-02-23T13:16:05.821 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:05 trial046 ceph-mon[38575]: pgmap v479: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 33 GiB data, 105 GiB used, 2.6 TiB / 2.7 TiB avail; 384 MiB/s wr, 6.14k op/s 2026-02-23T13:16:05.831 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:05.829+0000 7f37f1813640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:05.831 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:05.830+0000 7f37f1813640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:05.908 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:05.987 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-23T13:16:06.423 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:16:06 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:16:06] "GET /metrics HTTP/1.1" 200 4210 "" "Prometheus/3.6.0" 2026-02-23T13:16:06.560 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:16:06 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:16:06.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:16:06.715 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:16:06.805 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 76 16 574789 574773 472.634 369.812 0.00108147 0.00211438 2026-02-23T13:16:06.940 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:16:06.940 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:16:06.941 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:16:06.941 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:06.890+0000 7f1aae685640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:06.941 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:06.891+0000 7f1aae685640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:06.941 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:16:06.941 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:16:06.941 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:16:06.942 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:06 trial046 ceph-mon[38575]: from='client.15562 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:16:06.942 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:06 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/242332931' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pgp_num", "val": "56"} : dispatch 2026-02-23T13:16:06.949 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:16:06.949 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:16:07.805 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 77 16 579997 579981 470.723 325.5 0.00427494 0.00212305 2026-02-23T13:16:08.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:07 trial046 ceph-mon[38575]: pgmap v480: 17 pgs: 17 active+clean; 34 GiB data, 108 GiB used, 2.6 TiB / 2.7 TiB avail; 479 MiB/s wr, 7.66k op/s 2026-02-23T13:16:08.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:07 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2355460201' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:16:08.805 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 78 16 586221 586205 469.675 389 0.00691285 0.00212777 2026-02-23T13:16:09.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:08 trial046 ceph-mon[38575]: 6.5 scrub starts 2026-02-23T13:16:09.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:08 trial046 ceph-mon[38575]: 6.c scrub starts 2026-02-23T13:16:09.437 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:16:09.585 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:09.805 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 79 16 591767 591751 468.117 346.625 0.00181441 0.00213487 2026-02-23T13:16:10.011 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:09 trial046 ceph-mon[38575]: pgmap v481: 17 pgs: 17 active+clean; 35 GiB data, 112 GiB used, 2.6 TiB / 2.7 TiB avail; 479 MiB/s wr, 7.67k op/s 2026-02-23T13:16:10.012 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:09 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:16:10.012 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:09 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:16:10.030 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:10.009+0000 7f9bffd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:10.030 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:10.009+0000 7f9bffd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:10.030 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:16:10.031 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:16:10.047 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:16:10.047 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:16:10.064 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:16:10.064 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:16:10.079 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:16:10.079 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:16:10.805 INFO:tasks.radosbench.radosbench.0.trial046.stdout:2026-02-23T13:16:10.805197+0000 min lat: 0.000705438 max lat: 0.0610893 avg lat: 0.00214721 2026-02-23T13:16:10.805 INFO:tasks.radosbench.radosbench.0.trial046.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-23T13:16:10.805 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 80 16 595812 595796 465.425 252.812 0.00188517 0.00214721 2026-02-23T13:16:11.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:10 trial046 ceph-mon[38575]: 6.4 scrub starts 2026-02-23T13:16:11.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:10 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2228464993' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:16:11.717 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:16:11.717 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:16:11.717 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:16:11.805 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 81 16 600917 600901 463.618 319.062 0.00361217 0.0021556 2026-02-23T13:16:11.870 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:12.000 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:11.999+0000 7f5ba38ee640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:12.000 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:11 trial046 ceph-mon[38575]: 6.3 scrub starts 2026-02-23T13:16:12.000 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:11 trial046 ceph-mon[38575]: 6.5 scrub ok 2026-02-23T13:16:12.001 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:11 trial046 ceph-mon[38575]: 6.b scrub starts 2026-02-23T13:16:12.001 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:11 trial046 ceph-mon[38575]: pgmap v482: 17 pgs: 17 active+clean; 35 GiB data, 112 GiB used, 2.6 TiB / 2.7 TiB avail; 384 MiB/s wr, 6.15k op/s 2026-02-23T13:16:12.001 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:11 trial046 ceph-mon[38575]: 6.8 scrub starts 2026-02-23T13:16:12.001 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:11.999+0000 7f5ba38ee640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:12.147 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:16:12.148 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:16:12.206 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":482,"stamp":"2026-02-23T13:16:10.697780+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":37635424800,"num_objects":574264,"num_object_clones":0,"num_object_copies":1722792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":574264,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":574397,"num_write_kb":36754918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":117640188,"kb_used_data":109765292,"kb_used_omap":116,"kb_used_meta":7874699,"kb_avail":2818372612,"statfs":{"total":3006477107200,"available":2886013554688,"internally_reserved":0,"allocated":112399659008,"data_stored":112397244964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":119712,"internal_metadata":8063691872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,2,1,0,6,2,3],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4836098048,"num_objects":73793,"num_object_clones":0,"num_object_copies":221379,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73793,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73793,"num_write_kb":4722752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001733"},"pg_stats":[{"pgid":"6.f","version":"111'35927","reported_seq":35967,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:06.798342+0000","last_change":"2026-02-23T13:14:49.711212+0000","last_active":"2026-02-23T13:16:06.798342+0000","last_peered":"2026-02-23T13:16:06.798342+0000","last_clean":"2026-02-23T13:16:06.798342+0000","last_became_active":"2026-02-23T13:14:49.710909+0000","last_became_peered":"2026-02-23T13:14:49.710909+0000","last_unstale":"2026-02-23T13:16:06.798342+0000","last_undegraded":"2026-02-23T13:16:06.798342+0000","last_fullsized":"2026-02-23T13:16:06.798342+0000","mapping_epoch":96,"log_start":"111'35924","ondisk_log_start":"111'35924","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:18.401390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2354511872,"num_objects":35927,"num_object_clones":0,"num_object_copies":107781,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35927,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35927,"num_write_kb":2299328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"111'35976","reported_seq":36347,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:06.693426+0000","last_change":"2026-02-23T13:16:00.821994+0000","last_active":"2026-02-23T13:16:06.693426+0000","last_peered":"2026-02-23T13:16:06.693426+0000","last_clean":"2026-02-23T13:16:06.693426+0000","last_became_active":"2026-02-23T13:14:49.710608+0000","last_became_peered":"2026-02-23T13:14:49.710608+0000","last_unstale":"2026-02-23T13:16:06.693426+0000","last_undegraded":"2026-02-23T13:16:06.693426+0000","last_fullsized":"2026-02-23T13:16:06.693426+0000","mapping_epoch":96,"log_start":"111'35973","ondisk_log_start":"111'35973","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'33186","last_scrub_stamp":"2026-02-23T13:16:00.821941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:00.821941+0000","objects_scrubbed":32277,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:02.918773+0000","scrub_duration":3732,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2357723136,"num_objects":35976,"num_object_clones":0,"num_object_copies":107928,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35976,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35976,"num_write_kb":2302464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"111'35720","reported_seq":35760,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:06.691204+0000","last_change":"2026-02-23T13:14:49.711150+0000","last_active":"2026-02-23T13:16:06.691204+0000","last_peered":"2026-02-23T13:16:06.691204+0000","last_clean":"2026-02-23T13:16:06.691204+0000","last_became_active":"2026-02-23T13:14:49.710759+0000","last_became_peered":"2026-02-23T13:14:49.710759+0000","last_unstale":"2026-02-23T13:16:06.691204+0000","last_undegraded":"2026-02-23T13:16:06.691204+0000","last_fullsized":"2026-02-23T13:16:06.691204+0000","mapping_epoch":96,"log_start":"111'35717","ondisk_log_start":"111'35717","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:09.130033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2340945920,"num_objects":35720,"num_object_clones":0,"num_object_copies":107160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35720,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35720,"num_write_kb":2286080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"111'36184","reported_seq":36223,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:06.800913+0000","last_change":"2026-02-23T13:14:49.711353+0000","last_active":"2026-02-23T13:16:06.800913+0000","last_peered":"2026-02-23T13:16:06.800913+0000","last_clean":"2026-02-23T13:16:06.800913+0000","last_became_active":"2026-02-23T13:14:49.710648+0000","last_became_peered":"2026-02-23T13:14:49.710648+0000","last_unstale":"2026-02-23T13:16:06.800913+0000","last_undegraded":"2026-02-23T13:16:06.800913+0000","last_fullsized":"2026-02-23T13:16:06.800913+0000","mapping_epoch":96,"log_start":"111'36181","ondisk_log_start":"111'36181","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2371354624,"num_objects":36184,"num_object_clones":0,"num_object_copies":108552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36184,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36184,"num_write_kb":2315776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"111'35883","reported_seq":35922,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:06.797693+0000","last_change":"2026-02-23T13:14:49.710716+0000","last_active":"2026-02-23T13:16:06.797693+0000","last_peered":"2026-02-23T13:16:06.797693+0000","last_clean":"2026-02-23T13:16:06.797693+0000","last_became_active":"2026-02-23T13:14:49.709875+0000","last_became_peered":"2026-02-23T13:14:49.709875+0000","last_unstale":"2026-02-23T13:16:06.797693+0000","last_undegraded":"2026-02-23T13:16:06.797693+0000","last_fullsized":"2026-02-23T13:16:06.797693+0000","mapping_epoch":96,"log_start":"111'35880","ondisk_log_start":"111'35880","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:08.189503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2351628288,"num_objects":35883,"num_object_clones":0,"num_object_copies":107649,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35883,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35883,"num_write_kb":2296512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"111'36021","reported_seq":36060,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:06.690540+0000","last_change":"2026-02-23T13:14:49.710292+0000","last_active":"2026-02-23T13:16:06.690540+0000","last_peered":"2026-02-23T13:16:06.690540+0000","last_clean":"2026-02-23T13:16:06.690540+0000","last_became_active":"2026-02-23T13:14:49.709618+0000","last_became_peered":"2026-02-23T13:14:49.709618+0000","last_unstale":"2026-02-23T13:16:06.690540+0000","last_undegraded":"2026-02-23T13:16:06.690540+0000","last_fullsized":"2026-02-23T13:16:06.690540+0000","mapping_epoch":96,"log_start":"111'36018","ondisk_log_start":"111'36018","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:12.895714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2360672256,"num_objects":36021,"num_object_clones":0,"num_object_copies":108063,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36021,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36021,"num_write_kb":2305344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"111'35679","reported_seq":35719,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:06.706758+0000","last_change":"2026-02-23T13:14:49.711809+0000","last_active":"2026-02-23T13:16:06.706758+0000","last_peered":"2026-02-23T13:16:06.706758+0000","last_clean":"2026-02-23T13:16:06.706758+0000","last_became_active":"2026-02-23T13:14:49.711647+0000","last_became_peered":"2026-02-23T13:14:49.711647+0000","last_unstale":"2026-02-23T13:16:06.706758+0000","last_undegraded":"2026-02-23T13:16:06.706758+0000","last_fullsized":"2026-02-23T13:16:06.706758+0000","mapping_epoch":96,"log_start":"111'35676","ondisk_log_start":"111'35676","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:16.696834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2338258944,"num_objects":35679,"num_object_clones":0,"num_object_copies":107037,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35679,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35679,"num_write_kb":2283456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"111'35544","reported_seq":35584,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:06.683339+0000","last_change":"2026-02-23T13:14:49.710392+0000","last_active":"2026-02-23T13:16:06.683339+0000","last_peered":"2026-02-23T13:16:06.683339+0000","last_clean":"2026-02-23T13:16:06.683339+0000","last_became_active":"2026-02-23T13:14:49.710064+0000","last_became_peered":"2026-02-23T13:14:49.710064+0000","last_unstale":"2026-02-23T13:16:06.683339+0000","last_undegraded":"2026-02-23T13:16:06.683339+0000","last_fullsized":"2026-02-23T13:16:06.683339+0000","mapping_epoch":96,"log_start":"111'35541","ondisk_log_start":"111'35541","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:07.281706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2329411584,"num_objects":35544,"num_object_clones":0,"num_object_copies":106632,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35544,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35544,"num_write_kb":2274816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"111'35782","reported_seq":35822,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:06.831174+0000","last_change":"2026-02-23T13:14:49.711523+0000","last_active":"2026-02-23T13:16:06.831174+0000","last_peered":"2026-02-23T13:16:06.831174+0000","last_clean":"2026-02-23T13:16:06.831174+0000","last_became_active":"2026-02-23T13:14:49.711227+0000","last_became_peered":"2026-02-23T13:14:49.711227+0000","last_unstale":"2026-02-23T13:16:06.831174+0000","last_undegraded":"2026-02-23T13:16:06.831174+0000","last_fullsized":"2026-02-23T13:16:06.831174+0000","mapping_epoch":96,"log_start":"111'35779","ondisk_log_start":"111'35779","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:09.568570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2345009152,"num_objects":35782,"num_object_clones":0,"num_object_copies":107346,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35782,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35782,"num_write_kb":2290048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"111'35988","reported_seq":36028,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:06.693375+0000","last_change":"2026-02-23T13:14:49.710830+0000","last_active":"2026-02-23T13:16:06.693375+0000","last_peered":"2026-02-23T13:16:06.693375+0000","last_clean":"2026-02-23T13:16:06.693375+0000","last_became_active":"2026-02-23T13:14:49.710282+0000","last_became_peered":"2026-02-23T13:14:49.710282+0000","last_unstale":"2026-02-23T13:16:06.693375+0000","last_undegraded":"2026-02-23T13:16:06.693375+0000","last_fullsized":"2026-02-23T13:16:06.693375+0000","mapping_epoch":96,"log_start":"111'35985","ondisk_log_start":"111'35985","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2358509568,"num_objects":35988,"num_object_clones":0,"num_object_copies":107964,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35988,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35988,"num_write_kb":2303232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"111'36075","reported_seq":36114,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:06.800628+0000","last_change":"2026-02-23T13:14:49.711384+0000","last_active":"2026-02-23T13:16:06.800628+0000","last_peered":"2026-02-23T13:16:06.800628+0000","last_clean":"2026-02-23T13:16:06.800628+0000","last_became_active":"2026-02-23T13:14:49.710940+0000","last_became_peered":"2026-02-23T13:14:49.710940+0000","last_unstale":"2026-02-23T13:16:06.800628+0000","last_undegraded":"2026-02-23T13:16:06.800628+0000","last_fullsized":"2026-02-23T13:16:06.800628+0000","mapping_epoch":96,"log_start":"111'36072","ondisk_log_start":"111'36072","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2364211200,"num_objects":36075,"num_object_clones":0,"num_object_copies":108225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36075,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36075,"num_write_kb":2308800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"111'35692","reported_seq":35732,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:06.694669+0000","last_change":"2026-02-23T13:14:49.709045+0000","last_active":"2026-02-23T13:16:06.694669+0000","last_peered":"2026-02-23T13:16:06.694669+0000","last_clean":"2026-02-23T13:16:06.694669+0000","last_became_active":"2026-02-23T13:14:49.708668+0000","last_became_peered":"2026-02-23T13:14:49.708668+0000","last_unstale":"2026-02-23T13:16:06.694669+0000","last_undegraded":"2026-02-23T13:16:06.694669+0000","last_fullsized":"2026-02-23T13:16:06.694669+0000","mapping_epoch":96,"log_start":"111'35689","ondisk_log_start":"111'35689","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2339110912,"num_objects":35692,"num_object_clones":0,"num_object_copies":107076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35692,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35692,"num_write_kb":2284288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"111'35941","reported_seq":36333,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:06.688081+0000","last_change":"2026-02-23T13:16:04.164271+0000","last_active":"2026-02-23T13:16:06.688081+0000","last_peered":"2026-02-23T13:16:06.688081+0000","last_clean":"2026-02-23T13:16:06.688081+0000","last_became_active":"2026-02-23T13:14:49.709202+0000","last_became_peered":"2026-02-23T13:14:49.709202+0000","last_unstale":"2026-02-23T13:16:06.688081+0000","last_undegraded":"2026-02-23T13:16:06.688081+0000","last_fullsized":"2026-02-23T13:16:06.688081+0000","mapping_epoch":96,"log_start":"111'35938","ondisk_log_start":"111'35938","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'34863","last_scrub_stamp":"2026-02-23T13:16:04.164237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:04.164237+0000","objects_scrubbed":34093,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:14.024939+0000","scrub_duration":3016,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2355429376,"num_objects":35941,"num_object_clones":0,"num_object_copies":107823,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35941,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35941,"num_write_kb":2300224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"111'36293","reported_seq":36333,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:06.797571+0000","last_change":"2026-02-23T13:14:49.711071+0000","last_active":"2026-02-23T13:16:06.797571+0000","last_peered":"2026-02-23T13:16:06.797571+0000","last_clean":"2026-02-23T13:16:06.797571+0000","last_became_active":"2026-02-23T13:14:49.710193+0000","last_became_peered":"2026-02-23T13:14:49.710193+0000","last_unstale":"2026-02-23T13:16:06.797571+0000","last_undegraded":"2026-02-23T13:16:06.797571+0000","last_fullsized":"2026-02-23T13:16:06.797571+0000","mapping_epoch":96,"log_start":"111'36290","ondisk_log_start":"111'36290","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:15.360867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2378498048,"num_objects":36293,"num_object_clones":0,"num_object_copies":108879,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36293,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36293,"num_write_kb":2322752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"111'35892","reported_seq":35932,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:06.705202+0000","last_change":"2026-02-23T13:14:49.710077+0000","last_active":"2026-02-23T13:16:06.705202+0000","last_peered":"2026-02-23T13:16:06.705202+0000","last_clean":"2026-02-23T13:16:06.705202+0000","last_became_active":"2026-02-23T13:14:49.709781+0000","last_became_peered":"2026-02-23T13:14:49.709781+0000","last_unstale":"2026-02-23T13:16:06.705202+0000","last_undegraded":"2026-02-23T13:16:06.705202+0000","last_fullsized":"2026-02-23T13:16:06.705202+0000","mapping_epoch":96,"log_start":"111'35889","ondisk_log_start":"111'35889","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:16.674175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2352218112,"num_objects":35892,"num_object_clones":0,"num_object_copies":107676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35892,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35892,"num_write_kb":2297088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"111'35665","reported_seq":35705,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:06.688870+0000","last_change":"2026-02-23T13:14:49.709980+0000","last_active":"2026-02-23T13:16:06.688870+0000","last_peered":"2026-02-23T13:16:06.688870+0000","last_clean":"2026-02-23T13:16:06.688870+0000","last_became_active":"2026-02-23T13:14:49.709715+0000","last_became_peered":"2026-02-23T13:14:49.709715+0000","last_unstale":"2026-02-23T13:16:06.688870+0000","last_undegraded":"2026-02-23T13:16:06.688870+0000","last_fullsized":"2026-02-23T13:16:06.688870+0000","mapping_epoch":96,"log_start":"111'35662","ondisk_log_start":"111'35662","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:07.659456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2337341440,"num_objects":35665,"num_object_clones":0,"num_object_copies":106995,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35665,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35665,"num_write_kb":2282560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":436,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:37.760599+0000","last_change":"2026-02-23T13:15:25.299766+0000","last_active":"2026-02-23T13:15:37.760599+0000","last_peered":"2026-02-23T13:15:37.760599+0000","last_clean":"2026-02-23T13:15:37.760599+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:15:37.760599+0000","last_undegraded":"2026-02-23T13:15:37.760599+0000","last_fullsized":"2026-02-23T13:15:37.760599+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:15:25.299737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:15:25.299737+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:42.738354+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":37634834432,"num_objects":574262,"num_object_clones":0,"num_object_copies":1722786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":574262,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":574262,"num_write_kb":36752768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":112893362176,"data_stored":112893362176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1681,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247968,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":24750960,"kb_used_data":22814236,"kb_used_omap":28,"kb_used_meta":1936675,"kb_avail":709252240,"statfs":{"total":751619276800,"available":726274293760,"internally_reserved":0,"allocated":23361777664,"data_stored":23361173265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29212,"internal_metadata":1983155684},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444195,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":29383728,"kb_used_data":27409180,"kb_used_omap":31,"kb_used_meta":1974496,"kb_avail":704619472,"statfs":{"total":751619276800,"available":721530339328,"internally_reserved":0,"allocated":28067000320,"data_stored":28066395921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32654,"internal_metadata":2021884018},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,6],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575013,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":34051052,"kb_used_data":31982168,"kb_used_omap":29,"kb_used_meta":2068834,"kb_avail":699952148,"statfs":{"total":751619276800,"available":716750999552,"internally_reserved":0,"allocated":32749740032,"data_stored":32749139185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30494,"internal_metadata":2118486242},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,1,0,0,2,3],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705830,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":29454448,"kb_used_data":27559708,"kb_used_omap":26,"kb_used_meta":1894693,"kb_avail":704548752,"statfs":{"total":751619276800,"available":721457922048,"internally_reserved":0,"allocated":28221140992,"data_stored":28220536593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27352,"internal_metadata":1940165928},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1681,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28244115456,"data_stored":28244115456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32947503104,"data_stored":32947503104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28230221824,"data_stored":28230221824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":23471521792,"data_stored":23471521792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:16:12.628 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:16:12.772 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:12.805 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 82 16 605924 605908 461.78 312.938 0.00201405 0.00216417 2026-02-23T13:16:12.897 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:12.896+0000 7f544f01f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:12.898 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:12.897+0000 7f544f01f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:12.914 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:16:12.914 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:16:12.928 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:16:12.928 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:16:12.941 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:16:12.941 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:16:12.955 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:16:12.955 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:16:13.805 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 83 16 610737 610721 459.84 300.812 0.00154356 0.00217327 2026-02-23T13:16:14.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:13 trial046 ceph-mon[38575]: from='client.15570 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:16:14.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:13 trial046 ceph-mon[38575]: pgmap v483: 17 pgs: 5 active+clean+scrubbing, 12 active+clean; 37 GiB data, 117 GiB used, 2.6 TiB / 2.7 TiB avail; 522 MiB/s wr, 8.35k op/s 2026-02-23T13:16:14.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:13 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1757825329' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:16:14.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:13 trial046 ceph-mon[38575]: 6.7 scrub starts 2026-02-23T13:16:14.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:13 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-23T13:16:14.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:13 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:16:14.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:13 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-23T13:16:14.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:13 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:16:14.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:13 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-23T13:16:14.805 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 84 16 615751 615735 458.096 313.375 0.00138804 0.00218157 2026-02-23T13:16:15.002 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:16:15.029 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:14 trial046 ceph-mon[38575]: 6.c scrub ok 2026-02-23T13:16:15.163 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:15.307 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:15.306+0000 7ff67d5ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:15.307 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:15.306+0000 7ff67d5ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:15.322 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:16:15.322 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:16:15.335 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:16:15.336 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:16:15.349 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:16:15.349 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:16:15.361 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:16:15.362 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:16:15.805 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 85 16 622204 622188 457.452 403.312 0.0016366 0.00218468 2026-02-23T13:16:16.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:15 trial046 ceph-mon[38575]: 6.6 scrub starts 2026-02-23T13:16:16.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:15 trial046 ceph-mon[38575]: 6.3 scrub ok 2026-02-23T13:16:16.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:15 trial046 ceph-mon[38575]: 6.8 scrub ok 2026-02-23T13:16:16.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:15 trial046 ceph-mon[38575]: 6.4 scrub ok 2026-02-23T13:16:16.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:15 trial046 ceph-mon[38575]: pgmap v484: 17 pgs: 5 active+clean+scrubbing, 12 active+clean; 37 GiB data, 117 GiB used, 2.6 TiB / 2.7 TiB avail; 329 MiB/s wr, 5.26k op/s 2026-02-23T13:16:16.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:15 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2780713085' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:16:16.468 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:16:16 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:16:16.087Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:16:16.539 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:16:16 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:16:16] "GET /metrics HTTP/1.1" 200 4218 "" "Prometheus/3.6.0" 2026-02-23T13:16:16.806 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 86 16 628503 628487 456.71 393.688 0.0015671 0.00218822 2026-02-23T13:16:17.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:16 trial046 ceph-mon[38575]: 6.b scrub ok 2026-02-23T13:16:17.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:16 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:16:17.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:16 trial046 ceph-mon[38575]: 6.7 scrub ok 2026-02-23T13:16:17.209 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:16:17.210 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:16:17.210 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_4 2026-02-23T13:16:17.210 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:16:17.358 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:17.411 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:16:17.541 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:17.694 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:17.687+0000 7fb28d23d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:17.694 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:17.687+0000 7fb28d23d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:17.805 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 87 16 632741 632725 454.505 264.875 0.00669684 0.00219833 2026-02-23T13:16:17.812 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:16:17.812 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:16:18.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:17 trial046 ceph-mon[38575]: 6.d scrub starts 2026-02-23T13:16:18.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:17 trial046 ceph-mon[38575]: pgmap v485: 17 pgs: 4 active+clean+scrubbing, 13 active+clean; 37 GiB data, 118 GiB used, 2.6 TiB / 2.7 TiB avail; 355 MiB/s wr, 5.68k op/s 2026-02-23T13:16:18.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:17 trial046 ceph-mon[38575]: 6.0 scrub starts 2026-02-23T13:16:18.430 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:18.407+0000 7ff9403a9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:18.430 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:18.407+0000 7ff9403a9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:18.439 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:16:18.439 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:16:18.449 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":485,"stamp":"2026-02-23T13:16:16.698597+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":39701578272,"num_objects":605791,"num_object_clones":0,"num_object_copies":1817373,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":605791,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":605924,"num_write_kb":38772646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":124094204,"kb_used_data":115966508,"kb_used_omap":85,"kb_used_meta":8127530,"kb_avail":2811918596,"statfs":{"total":3006477107200,"available":2879404642304,"internally_reserved":0,"allocated":118749704192,"data_stored":118747290148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87244,"internal_metadata":8322591540},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,2,6,4,6],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4471390208,"num_objects":68228,"num_object_clones":0,"num_object_copies":204684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68228,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68228,"num_write_kb":4366592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001677"},"pg_stats":[{"pgid":"6.f","version":"111'37623","reported_seq":37663,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:11.819819+0000","last_change":"2026-02-23T13:14:49.711212+0000","last_active":"2026-02-23T13:16:11.819819+0000","last_peered":"2026-02-23T13:16:11.819819+0000","last_clean":"2026-02-23T13:16:11.819819+0000","last_became_active":"2026-02-23T13:14:49.710909+0000","last_became_peered":"2026-02-23T13:14:49.710909+0000","last_unstale":"2026-02-23T13:16:11.819819+0000","last_undegraded":"2026-02-23T13:16:11.819819+0000","last_fullsized":"2026-02-23T13:16:11.819819+0000","mapping_epoch":96,"log_start":"111'37620","ondisk_log_start":"111'37620","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:18.401390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2465660928,"num_objects":37623,"num_object_clones":0,"num_object_copies":112869,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37623,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37623,"num_write_kb":2407872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"111'37584","reported_seq":37956,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:11.685893+0000","last_change":"2026-02-23T13:16:00.821994+0000","last_active":"2026-02-23T13:16:11.685893+0000","last_peered":"2026-02-23T13:16:11.685893+0000","last_clean":"2026-02-23T13:16:11.685893+0000","last_became_active":"2026-02-23T13:14:49.710608+0000","last_became_peered":"2026-02-23T13:14:49.710608+0000","last_unstale":"2026-02-23T13:16:11.685893+0000","last_undegraded":"2026-02-23T13:16:11.685893+0000","last_fullsized":"2026-02-23T13:16:11.685893+0000","mapping_epoch":96,"log_start":"111'37581","ondisk_log_start":"111'37581","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'33186","last_scrub_stamp":"2026-02-23T13:16:00.821941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:00.821941+0000","objects_scrubbed":32277,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:02.918773+0000","scrub_duration":3732,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2463105024,"num_objects":37584,"num_object_clones":0,"num_object_copies":112752,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37584,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37584,"num_write_kb":2405376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"111'37339","reported_seq":37379,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:11.691486+0000","last_change":"2026-02-23T13:14:49.711150+0000","last_active":"2026-02-23T13:16:11.691486+0000","last_peered":"2026-02-23T13:16:11.691486+0000","last_clean":"2026-02-23T13:16:11.691486+0000","last_became_active":"2026-02-23T13:14:49.710759+0000","last_became_peered":"2026-02-23T13:14:49.710759+0000","last_unstale":"2026-02-23T13:16:11.691486+0000","last_undegraded":"2026-02-23T13:16:11.691486+0000","last_fullsized":"2026-02-23T13:16:11.691486+0000","mapping_epoch":96,"log_start":"111'37336","ondisk_log_start":"111'37336","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2447048704,"num_objects":37339,"num_object_clones":0,"num_object_copies":112017,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37339,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37339,"num_write_kb":2389696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"111'37855","reported_seq":38204,"reported_epoch":111,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:16:11.832843+0000","last_change":"2026-02-23T13:16:07.260376+0000","last_active":"2026-02-23T13:16:11.832843+0000","last_peered":"2026-02-23T13:16:11.832843+0000","last_clean":"2026-02-23T13:16:11.832843+0000","last_became_active":"2026-02-23T13:14:49.710648+0000","last_became_peered":"2026-02-23T13:14:49.710648+0000","last_unstale":"2026-02-23T13:16:11.832843+0000","last_undegraded":"2026-02-23T13:16:11.832843+0000","last_fullsized":"2026-02-23T13:16:11.832843+0000","mapping_epoch":96,"log_start":"111'37852","ondisk_log_start":"111'37852","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":30449,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 5s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2480865280,"num_objects":37855,"num_object_clones":0,"num_object_copies":113565,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37855,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37855,"num_write_kb":2422720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"111'37534","reported_seq":37686,"reported_epoch":111,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:16:11.832283+0000","last_change":"2026-02-23T13:16:10.325662+0000","last_active":"2026-02-23T13:16:11.832283+0000","last_peered":"2026-02-23T13:16:11.832283+0000","last_clean":"2026-02-23T13:16:11.832283+0000","last_became_active":"2026-02-23T13:14:49.709875+0000","last_became_peered":"2026-02-23T13:14:49.709875+0000","last_unstale":"2026-02-23T13:16:11.832283+0000","last_undegraded":"2026-02-23T13:16:11.832283+0000","last_fullsized":"2026-02-23T13:16:11.832283+0000","mapping_epoch":96,"log_start":"111'37531","ondisk_log_start":"111'37531","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":10999,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2459828224,"num_objects":37534,"num_object_clones":0,"num_object_copies":112602,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37534,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37534,"num_write_kb":2402176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"111'37746","reported_seq":37786,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:11.693857+0000","last_change":"2026-02-23T13:14:49.710292+0000","last_active":"2026-02-23T13:16:11.693857+0000","last_peered":"2026-02-23T13:16:11.693857+0000","last_clean":"2026-02-23T13:16:11.693857+0000","last_became_active":"2026-02-23T13:14:49.709618+0000","last_became_peered":"2026-02-23T13:14:49.709618+0000","last_unstale":"2026-02-23T13:16:11.693857+0000","last_undegraded":"2026-02-23T13:16:11.693857+0000","last_fullsized":"2026-02-23T13:16:11.693857+0000","mapping_epoch":96,"log_start":"111'37743","ondisk_log_start":"111'37743","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:12.895714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2473721856,"num_objects":37746,"num_object_clones":0,"num_object_copies":113238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37746,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37746,"num_write_kb":2415744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"111'37298","reported_seq":37338,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:11.706925+0000","last_change":"2026-02-23T13:14:49.711809+0000","last_active":"2026-02-23T13:16:11.706925+0000","last_peered":"2026-02-23T13:16:11.706925+0000","last_clean":"2026-02-23T13:16:11.706925+0000","last_became_active":"2026-02-23T13:14:49.711647+0000","last_became_peered":"2026-02-23T13:14:49.711647+0000","last_unstale":"2026-02-23T13:16:11.706925+0000","last_undegraded":"2026-02-23T13:16:11.706925+0000","last_fullsized":"2026-02-23T13:16:11.706925+0000","mapping_epoch":96,"log_start":"111'37295","ondisk_log_start":"111'37295","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:16.696834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2444361728,"num_objects":37298,"num_object_clones":0,"num_object_copies":111894,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37298,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37298,"num_write_kb":2387072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"111'38822","reported_seq":39246,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:16.686034+0000","last_change":"2026-02-23T13:16:14.478890+0000","last_active":"2026-02-23T13:16:16.686034+0000","last_peered":"2026-02-23T13:16:16.686034+0000","last_clean":"2026-02-23T13:16:16.686034+0000","last_became_active":"2026-02-23T13:14:49.710064+0000","last_became_peered":"2026-02-23T13:14:49.710064+0000","last_unstale":"2026-02-23T13:16:16.686034+0000","last_undegraded":"2026-02-23T13:16:16.686034+0000","last_fullsized":"2026-02-23T13:16:16.686034+0000","mapping_epoch":96,"log_start":"111'38819","ondisk_log_start":"111'38819","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'37982","last_scrub_stamp":"2026-02-23T13:16:14.478836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.478836+0000","objects_scrubbed":37503,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:35.874054+0000","scrub_duration":3268,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2544238592,"num_objects":38822,"num_object_clones":0,"num_object_copies":116466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38822,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38822,"num_write_kb":2484608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"111'37420","reported_seq":37460,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:11.829187+0000","last_change":"2026-02-23T13:14:49.711523+0000","last_active":"2026-02-23T13:16:11.829187+0000","last_peered":"2026-02-23T13:16:11.829187+0000","last_clean":"2026-02-23T13:16:11.829187+0000","last_became_active":"2026-02-23T13:14:49.711227+0000","last_became_peered":"2026-02-23T13:14:49.711227+0000","last_unstale":"2026-02-23T13:16:11.829187+0000","last_undegraded":"2026-02-23T13:16:11.829187+0000","last_fullsized":"2026-02-23T13:16:11.829187+0000","mapping_epoch":96,"log_start":"111'37417","ondisk_log_start":"111'37417","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2452357120,"num_objects":37420,"num_object_clones":0,"num_object_copies":112260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37420,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37420,"num_write_kb":2394880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"111'37633","reported_seq":38047,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:11.689606+0000","last_change":"2026-02-23T13:16:09.977947+0000","last_active":"2026-02-23T13:16:11.689606+0000","last_peered":"2026-02-23T13:16:11.689606+0000","last_clean":"2026-02-23T13:16:11.689606+0000","last_became_active":"2026-02-23T13:14:49.710282+0000","last_became_peered":"2026-02-23T13:14:49.710282+0000","last_unstale":"2026-02-23T13:16:11.689606+0000","last_undegraded":"2026-02-23T13:16:11.689606+0000","last_fullsized":"2026-02-23T13:16:11.689606+0000","mapping_epoch":96,"log_start":"111'37630","ondisk_log_start":"111'37630","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'37114","last_scrub_stamp":"2026-02-23T13:16:09.977889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:09.977889+0000","objects_scrubbed":36647,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:17.287339+0000","scrub_duration":2946,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2466316288,"num_objects":37633,"num_object_clones":0,"num_object_copies":112899,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37633,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37633,"num_write_kb":2408512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"111'37719","reported_seq":37904,"reported_epoch":111,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:16:11.832453+0000","last_change":"2026-02-23T13:16:09.264514+0000","last_active":"2026-02-23T13:16:11.832453+0000","last_peered":"2026-02-23T13:16:11.832453+0000","last_clean":"2026-02-23T13:16:11.832453+0000","last_became_active":"2026-02-23T13:14:49.710940+0000","last_became_peered":"2026-02-23T13:14:49.710940+0000","last_unstale":"2026-02-23T13:16:11.832453+0000","last_undegraded":"2026-02-23T13:16:11.832453+0000","last_fullsized":"2026-02-23T13:16:11.832453+0000","mapping_epoch":96,"log_start":"111'37716","ondisk_log_start":"111'37716","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":14049,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 3s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2471952384,"num_objects":37719,"num_object_clones":0,"num_object_copies":113157,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37719,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37719,"num_write_kb":2414016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"111'37301","reported_seq":37484,"reported_epoch":111,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:16:11.690985+0000","last_change":"2026-02-23T13:16:09.963882+0000","last_active":"2026-02-23T13:16:11.690985+0000","last_peered":"2026-02-23T13:16:11.690985+0000","last_clean":"2026-02-23T13:16:11.690985+0000","last_became_active":"2026-02-23T13:14:49.708668+0000","last_became_peered":"2026-02-23T13:14:49.708668+0000","last_unstale":"2026-02-23T13:16:11.690985+0000","last_undegraded":"2026-02-23T13:16:11.690985+0000","last_fullsized":"2026-02-23T13:16:11.690985+0000","mapping_epoch":96,"log_start":"111'37297","ondisk_log_start":"111'37297","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":14199,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2444558336,"num_objects":37301,"num_object_clones":0,"num_object_copies":111903,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37301,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37301,"num_write_kb":2387264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"111'39309","reported_seq":39701,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:16.685275+0000","last_change":"2026-02-23T13:16:04.164271+0000","last_active":"2026-02-23T13:16:16.685275+0000","last_peered":"2026-02-23T13:16:16.685275+0000","last_clean":"2026-02-23T13:16:16.685275+0000","last_became_active":"2026-02-23T13:14:49.709202+0000","last_became_peered":"2026-02-23T13:14:49.709202+0000","last_unstale":"2026-02-23T13:16:16.685275+0000","last_undegraded":"2026-02-23T13:16:16.685275+0000","last_fullsized":"2026-02-23T13:16:16.685275+0000","mapping_epoch":96,"log_start":"111'39306","ondisk_log_start":"111'39306","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'34863","last_scrub_stamp":"2026-02-23T13:16:04.164237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:04.164237+0000","objects_scrubbed":34093,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:14.024939+0000","scrub_duration":3016,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2576154624,"num_objects":39309,"num_object_clones":0,"num_object_copies":117927,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39309,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39309,"num_write_kb":2515776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"111'37952","reported_seq":37992,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:11.828799+0000","last_change":"2026-02-23T13:14:49.711071+0000","last_active":"2026-02-23T13:16:11.828799+0000","last_peered":"2026-02-23T13:16:11.828799+0000","last_clean":"2026-02-23T13:16:11.828799+0000","last_became_active":"2026-02-23T13:14:49.710193+0000","last_became_peered":"2026-02-23T13:14:49.710193+0000","last_unstale":"2026-02-23T13:16:11.828799+0000","last_undegraded":"2026-02-23T13:16:11.828799+0000","last_fullsized":"2026-02-23T13:16:11.828799+0000","mapping_epoch":96,"log_start":"111'37949","ondisk_log_start":"111'37949","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:15.360867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2487222272,"num_objects":37952,"num_object_clones":0,"num_object_copies":113856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37952,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37952,"num_write_kb":2428928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"111'37544","reported_seq":37584,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:11.702866+0000","last_change":"2026-02-23T13:14:49.710077+0000","last_active":"2026-02-23T13:16:11.702866+0000","last_peered":"2026-02-23T13:16:11.702866+0000","last_clean":"2026-02-23T13:16:11.702866+0000","last_became_active":"2026-02-23T13:14:49.709781+0000","last_became_peered":"2026-02-23T13:14:49.709781+0000","last_unstale":"2026-02-23T13:16:11.702866+0000","last_undegraded":"2026-02-23T13:16:11.702866+0000","last_fullsized":"2026-02-23T13:16:11.702866+0000","mapping_epoch":96,"log_start":"111'37541","ondisk_log_start":"111'37541","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:16.674175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2460483584,"num_objects":37544,"num_object_clones":0,"num_object_copies":112632,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37544,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37544,"num_write_kb":2402816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"111'39110","reported_seq":39541,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:16.687931+0000","last_change":"2026-02-23T13:16:16.274976+0000","last_active":"2026-02-23T13:16:16.687931+0000","last_peered":"2026-02-23T13:16:16.687931+0000","last_clean":"2026-02-23T13:16:16.687931+0000","last_became_active":"2026-02-23T13:14:49.709715+0000","last_became_peered":"2026-02-23T13:14:49.709715+0000","last_unstale":"2026-02-23T13:16:16.687931+0000","last_undegraded":"2026-02-23T13:16:16.687931+0000","last_fullsized":"2026-02-23T13:16:16.687931+0000","mapping_epoch":96,"log_start":"111'39107","ondisk_log_start":"111'39107","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38978","last_scrub_stamp":"2026-02-23T13:16:16.274911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:16.274911+0000","objects_scrubbed":38345,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:18.192168+0000","scrub_duration":4034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2563112960,"num_objects":39110,"num_object_clones":0,"num_object_copies":117330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39110,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39110,"num_write_kb":2503040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":436,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:37.760599+0000","last_change":"2026-02-23T13:15:25.299766+0000","last_active":"2026-02-23T13:15:37.760599+0000","last_peered":"2026-02-23T13:15:37.760599+0000","last_clean":"2026-02-23T13:15:37.760599+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:15:37.760599+0000","last_undegraded":"2026-02-23T13:15:37.760599+0000","last_fullsized":"2026-02-23T13:15:37.760599+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:15:25.299737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:15:25.299737+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:42.738354+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":39700987904,"num_objects":605789,"num_object_clones":0,"num_object_copies":1817367,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":605789,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":605789,"num_write_kb":38770496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":119213719552,"data_stored":119213719552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1681,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247970,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":26908784,"kb_used_data":24954396,"kb_used_omap":6,"kb_used_meta":1954361,"kb_avail":707094416,"statfs":{"total":751619276800,"available":724064681984,"internally_reserved":0,"allocated":25553301504,"data_stored":25552697105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6905,"internal_metadata":2001265927},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,1,3,4],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444196,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":30694320,"kb_used_data":28665628,"kb_used_omap":31,"kb_used_meta":2028640,"kb_avail":703308880,"statfs":{"total":751619276800,"available":720188293120,"internally_reserved":0,"allocated":29353603072,"data_stored":29352998673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32654,"internal_metadata":2077327474},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,6],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575014,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":35673452,"kb_used_data":33495768,"kb_used_omap":19,"kb_used_meta":2177644,"kb_avail":698329748,"statfs":{"total":751619276800,"available":715089661952,"internally_reserved":0,"allocated":34299666432,"data_stored":34299065585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20333,"internal_metadata":2229907603},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,1,3],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705831,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":30817648,"kb_used_data":28850716,"kb_used_omap":26,"kb_used_meta":1966885,"kb_avail":703185552,"statfs":{"total":751619276800,"available":720062005248,"internally_reserved":0,"allocated":29543133184,"data_stored":29542528785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27352,"internal_metadata":2014090536},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1681,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29541728256,"data_stored":29541728256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":34452930560,"data_stored":34452930560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29534388224,"data_stored":29534388224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25684672512,"data_stored":25684672512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:16:18.451 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:16:18.451 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_4 pg_num 66 2026-02-23T13:16:18.455 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:16:18.455 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:16:18.468 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:16:18.469 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:16:18.481 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:16:18.482 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:16:18.601 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:18.734 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:18.733+0000 7fb248d41640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:18.734 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:18.733+0000 7fb248d41640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:18.805 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 88 16 636824 636808 452.239 255.188 0.00310152 0.00220984 2026-02-23T13:16:18.875 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:16:18.882 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:18 trial046 ceph-mon[38575]: 6.a scrub starts 2026-02-23T13:16:18.882 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:18 trial046 ceph-mon[38575]: from='client.15576 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:16:18.882 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:18 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1775090729' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:16:18.917 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:16:19.806 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 89 16 641762 641746 450.625 308.625 0.000906822 0.00221777 2026-02-23T13:16:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:19 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:16:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:19 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:16:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:19 trial046 ceph-mon[38575]: 6.6 scrub ok 2026-02-23T13:16:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:19 trial046 ceph-mon[38575]: 6.1 scrub starts 2026-02-23T13:16:20.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:19 trial046 ceph-mon[38575]: pgmap v486: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 38 GiB data, 121 GiB used, 2.6 TiB / 2.7 TiB avail; 377 MiB/s wr, 6.03k op/s 2026-02-23T13:16:20.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:19 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2805851515' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pg_num", "val": "66"} : dispatch 2026-02-23T13:16:20.530 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:16:20.678 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:20.806 INFO:tasks.radosbench.radosbench.0.trial046.stdout: 90 14 646494 646480 448.906 295.875 0.0432231 0.0022255 2026-02-23T13:16:20.808 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:20 trial046 ceph-mon[38575]: 6.f scrub starts 2026-02-23T13:16:20.808 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:20 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:16:20.808 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:20 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:16:20.808 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:20 trial046 ceph-mon[38575]: 6.9 scrub starts 2026-02-23T13:16:21.180 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:16:21.181 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:16:21.181 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:16:21.181 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:16:21.181 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:21.111+0000 7f336313e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:21.181 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:21.111+0000 7f336313e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:21.181 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:16:21.181 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:16:21.182 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:16:21.182 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:16:21.806 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Total time run: 90.0102 2026-02-23T13:16:21.806 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Total writes made: 646494 2026-02-23T13:16:21.806 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Write size: 65536 2026-02-23T13:16:21.807 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Object size: 65536 2026-02-23T13:16:21.807 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Bandwidth (MB/sec): 448.903 2026-02-23T13:16:21.807 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Stddev Bandwidth: 74.4484 2026-02-23T13:16:21.807 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Max bandwidth (MB/sec): 535.375 2026-02-23T13:16:21.807 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Min bandwidth (MB/sec): 252.812 2026-02-23T13:16:21.807 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Average IOPS: 7182 2026-02-23T13:16:21.807 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Stddev IOPS: 1191.17 2026-02-23T13:16:21.807 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Max IOPS: 8566 2026-02-23T13:16:21.807 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Min IOPS: 4045 2026-02-23T13:16:21.807 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Average Latency(s): 0.00222631 2026-02-23T13:16:21.807 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Stddev Latency(s): 0.00202951 2026-02-23T13:16:21.807 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Max latency(s): 0.0610893 2026-02-23T13:16:21.808 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Min latency(s): 0.000705438 2026-02-23T13:16:21.815 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Cleaning up (deleting benchmark objects) 2026-02-23T13:16:22.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:21 trial046 ceph-mon[38575]: 6.d scrub ok 2026-02-23T13:16:22.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:21 trial046 ceph-mon[38575]: 6.0 scrub ok 2026-02-23T13:16:22.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:21 trial046 ceph-mon[38575]: pgmap v487: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 38 GiB data, 121 GiB used, 2.6 TiB / 2.7 TiB avail; 281 MiB/s wr, 4.49k op/s 2026-02-23T13:16:22.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:21 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1525060916' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:16:23.038 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:22 trial046 ceph-mon[38575]: 6.a scrub ok 2026-02-23T13:16:23.847 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:16:23.918 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:16:23.919 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:16:23.919 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_4 2026-02-23T13:16:23.919 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:16:23.995 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:24.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:23 trial046 ceph-mon[38575]: 6.1 scrub ok 2026-02-23T13:16:24.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:23 trial046 ceph-mon[38575]: pgmap v488: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 39 GiB data, 125 GiB used, 2.6 TiB / 2.7 TiB avail; 376 MiB/s wr, 6.02k op/s 2026-02-23T13:16:24.072 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:24.126 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:24.125+0000 7f3652251640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:24.126 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:24.125+0000 7f3652251640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:24.141 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:16:24.141 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:16:24.157 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:16:24.158 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:16:24.171 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:16:24.171 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:16:24.184 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:16:24.184 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:16:24.205 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:24.204+0000 7f763b7a8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:24.205 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:24.205+0000 7f763b7a8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:24.353 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:16:24.353 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:16:24.399 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":488,"stamp":"2026-02-23T13:16:22.699565+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":42364830240,"num_objects":646429,"num_object_clones":0,"num_object_copies":1939287,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":646429,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":646696,"num_write_kb":41377766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":130674236,"kb_used_data":124132268,"kb_used_omap":65,"kb_used_meta":6541822,"kb_avail":2805338564,"statfs":{"total":3006477107200,"available":2872666689536,"internally_reserved":0,"allocated":127111442432,"data_stored":127109028388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":67143,"internal_metadata":6698826169},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4729405440,"num_objects":72165,"num_object_clones":0,"num_object_copies":216495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72165,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72299,"num_write_kb":4622848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001785"},"pg_stats":[{"pgid":"6.f","version":"111'40501","reported_seq":40830,"reported_epoch":111,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:16:21.842764+0000","last_change":"2026-02-23T13:16:19.250804+0000","last_active":"2026-02-23T13:16:21.842764+0000","last_peered":"2026-02-23T13:16:21.842764+0000","last_clean":"2026-02-23T13:16:21.842764+0000","last_became_active":"2026-02-23T13:14:49.710909+0000","last_became_peered":"2026-02-23T13:14:49.710909+0000","last_unstale":"2026-02-23T13:16:21.842764+0000","last_undegraded":"2026-02-23T13:16:21.842764+0000","last_fullsized":"2026-02-23T13:16:21.842764+0000","mapping_epoch":96,"log_start":"111'40498","ondisk_log_start":"111'40498","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":28599,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 3s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2652962816,"num_objects":40481,"num_object_clones":0,"num_object_copies":121443,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40481,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40501,"num_write_kb":2591424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"111'40468","reported_seq":40840,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:20.762213+0000","last_change":"2026-02-23T13:16:00.821994+0000","last_active":"2026-02-23T13:16:20.762213+0000","last_peered":"2026-02-23T13:16:20.762213+0000","last_clean":"2026-02-23T13:16:20.762213+0000","last_became_active":"2026-02-23T13:14:49.710608+0000","last_became_peered":"2026-02-23T13:14:49.710608+0000","last_unstale":"2026-02-23T13:16:20.762213+0000","last_undegraded":"2026-02-23T13:16:20.762213+0000","last_fullsized":"2026-02-23T13:16:20.762213+0000","mapping_epoch":96,"log_start":"111'40465","ondisk_log_start":"111'40465","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'33186","last_scrub_stamp":"2026-02-23T13:16:00.821941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:00.821941+0000","objects_scrubbed":32277,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:02.918773+0000","scrub_duration":3732,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2652110848,"num_objects":40468,"num_object_clones":0,"num_object_copies":121404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40468,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40468,"num_write_kb":2589952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"111'40251","reported_seq":40695,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:20.768166+0000","last_change":"2026-02-23T13:16:20.125449+0000","last_active":"2026-02-23T13:16:20.768166+0000","last_peered":"2026-02-23T13:16:20.768166+0000","last_clean":"2026-02-23T13:16:20.768166+0000","last_became_active":"2026-02-23T13:14:49.710759+0000","last_became_peered":"2026-02-23T13:14:49.710759+0000","last_unstale":"2026-02-23T13:16:20.768166+0000","last_undegraded":"2026-02-23T13:16:20.768166+0000","last_fullsized":"2026-02-23T13:16:20.768166+0000","mapping_epoch":96,"log_start":"111'40248","ondisk_log_start":"111'40248","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40044","last_scrub_stamp":"2026-02-23T13:16:20.125397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:20.125397+0000","objects_scrubbed":39489,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:35.607693+0000","scrub_duration":4187,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2637889536,"num_objects":40251,"num_object_clones":0,"num_object_copies":120753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40251,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40251,"num_write_kb":2576064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"111'40783","reported_seq":41205,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:21.838971+0000","last_change":"2026-02-23T13:16:12.911605+0000","last_active":"2026-02-23T13:16:21.838971+0000","last_peered":"2026-02-23T13:16:21.838971+0000","last_clean":"2026-02-23T13:16:21.838971+0000","last_became_active":"2026-02-23T13:14:49.710648+0000","last_became_peered":"2026-02-23T13:14:49.710648+0000","last_unstale":"2026-02-23T13:16:21.838971+0000","last_undegraded":"2026-02-23T13:16:21.838971+0000","last_fullsized":"2026-02-23T13:16:21.838971+0000","mapping_epoch":96,"log_start":"111'40780","ondisk_log_start":"111'40780","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38184","last_scrub_stamp":"2026-02-23T13:16:12.911442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:12.911442+0000","objects_scrubbed":37197,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:25.172701+0000","scrub_duration":5652,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2671312896,"num_objects":40761,"num_object_clones":0,"num_object_copies":122283,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40761,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40783,"num_write_kb":2609408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"111'40389","reported_seq":40818,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:21.839559+0000","last_change":"2026-02-23T13:16:14.901799+0000","last_active":"2026-02-23T13:16:21.839559+0000","last_peered":"2026-02-23T13:16:21.839559+0000","last_clean":"2026-02-23T13:16:21.839559+0000","last_became_active":"2026-02-23T13:14:49.709875+0000","last_became_peered":"2026-02-23T13:14:49.709875+0000","last_unstale":"2026-02-23T13:16:21.839559+0000","last_undegraded":"2026-02-23T13:16:21.839559+0000","last_fullsized":"2026-02-23T13:16:21.839559+0000","mapping_epoch":96,"log_start":"111'40386","ondisk_log_start":"111'40386","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38474","last_scrub_stamp":"2026-02-23T13:16:14.901765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.901765+0000","objects_scrubbed":37818,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:23.823920+0000","scrub_duration":4577,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2645753856,"num_objects":40371,"num_object_clones":0,"num_object_copies":121113,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40371,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40389,"num_write_kb":2584320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"111'40588","reported_seq":41037,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:20.991460+0000","last_change":"2026-02-23T13:16:20.991460+0000","last_active":"2026-02-23T13:16:20.991460+0000","last_peered":"2026-02-23T13:16:20.991460+0000","last_clean":"2026-02-23T13:16:20.991460+0000","last_became_active":"2026-02-23T13:14:49.709618+0000","last_became_peered":"2026-02-23T13:14:49.709618+0000","last_unstale":"2026-02-23T13:16:20.991460+0000","last_undegraded":"2026-02-23T13:16:20.991460+0000","last_fullsized":"2026-02-23T13:16:20.991460+0000","mapping_epoch":96,"log_start":"111'40585","ondisk_log_start":"111'40585","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40588","last_scrub_stamp":"2026-02-23T13:16:20.991398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:20.991398+0000","objects_scrubbed":40089,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:21.036471+0000","scrub_duration":4040,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2659975168,"num_objects":40588,"num_object_clones":0,"num_object_copies":121764,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40588,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40588,"num_write_kb":2597632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"111'40138","reported_seq":40366,"reported_epoch":111,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:16:21.710585+0000","last_change":"2026-02-23T13:16:17.766909+0000","last_active":"2026-02-23T13:16:21.710585+0000","last_peered":"2026-02-23T13:16:21.710585+0000","last_clean":"2026-02-23T13:16:21.710585+0000","last_became_active":"2026-02-23T13:14:49.711647+0000","last_became_peered":"2026-02-23T13:14:49.711647+0000","last_unstale":"2026-02-23T13:16:21.710585+0000","last_undegraded":"2026-02-23T13:16:21.710585+0000","last_fullsized":"2026-02-23T13:16:21.710585+0000","mapping_epoch":96,"log_start":"111'40135","ondisk_log_start":"111'40135","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":18399,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 4s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2630483968,"num_objects":40138,"num_object_clones":0,"num_object_copies":120414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40138,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40138,"num_write_kb":2568832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"111'39994","reported_seq":40418,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:20.769123+0000","last_change":"2026-02-23T13:16:14.478890+0000","last_active":"2026-02-23T13:16:20.769123+0000","last_peered":"2026-02-23T13:16:20.769123+0000","last_clean":"2026-02-23T13:16:20.769123+0000","last_became_active":"2026-02-23T13:14:49.710064+0000","last_became_peered":"2026-02-23T13:14:49.710064+0000","last_unstale":"2026-02-23T13:16:20.769123+0000","last_undegraded":"2026-02-23T13:16:20.769123+0000","last_fullsized":"2026-02-23T13:16:20.769123+0000","mapping_epoch":96,"log_start":"111'39991","ondisk_log_start":"111'39991","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'37982","last_scrub_stamp":"2026-02-23T13:16:14.478836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.478836+0000","objects_scrubbed":37503,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:35.874054+0000","scrub_duration":3268,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621046784,"num_objects":39994,"num_object_clones":0,"num_object_copies":119982,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39994,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39994,"num_write_kb":2559616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"111'40260","reported_seq":40699,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:21.840171+0000","last_change":"2026-02-23T13:16:18.449205+0000","last_active":"2026-02-23T13:16:21.840171+0000","last_peered":"2026-02-23T13:16:21.840171+0000","last_clean":"2026-02-23T13:16:21.840171+0000","last_became_active":"2026-02-23T13:14:49.711227+0000","last_became_peered":"2026-02-23T13:14:49.711227+0000","last_unstale":"2026-02-23T13:16:21.840171+0000","last_undegraded":"2026-02-23T13:16:21.840171+0000","last_fullsized":"2026-02-23T13:16:21.840171+0000","mapping_epoch":96,"log_start":"111'40257","ondisk_log_start":"111'40257","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'39520","last_scrub_stamp":"2026-02-23T13:16:18.449176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:18.449176+0000","objects_scrubbed":38818,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:46.860861+0000","scrub_duration":4228,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2636644352,"num_objects":40232,"num_object_clones":0,"num_object_copies":120696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40232,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40260,"num_write_kb":2575744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"111'40516","reported_seq":40930,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:20.765345+0000","last_change":"2026-02-23T13:16:09.977947+0000","last_active":"2026-02-23T13:16:20.765345+0000","last_peered":"2026-02-23T13:16:20.765345+0000","last_clean":"2026-02-23T13:16:20.765345+0000","last_became_active":"2026-02-23T13:14:49.710282+0000","last_became_peered":"2026-02-23T13:14:49.710282+0000","last_unstale":"2026-02-23T13:16:20.765345+0000","last_undegraded":"2026-02-23T13:16:20.765345+0000","last_fullsized":"2026-02-23T13:16:20.765345+0000","mapping_epoch":96,"log_start":"111'40513","ondisk_log_start":"111'40513","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'37114","last_scrub_stamp":"2026-02-23T13:16:09.977889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:09.977889+0000","objects_scrubbed":36647,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:17.287339+0000","scrub_duration":2946,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2655256576,"num_objects":40516,"num_object_clones":0,"num_object_copies":121548,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40516,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40516,"num_write_kb":2593024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"111'40521","reported_seq":40950,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:21.841042+0000","last_change":"2026-02-23T13:16:14.521114+0000","last_active":"2026-02-23T13:16:21.841042+0000","last_peered":"2026-02-23T13:16:21.841042+0000","last_clean":"2026-02-23T13:16:21.841042+0000","last_became_active":"2026-02-23T13:14:49.710940+0000","last_became_peered":"2026-02-23T13:14:49.710940+0000","last_unstale":"2026-02-23T13:16:21.841042+0000","last_undegraded":"2026-02-23T13:16:21.841042+0000","last_fullsized":"2026-02-23T13:16:21.841042+0000","mapping_epoch":96,"log_start":"111'40518","ondisk_log_start":"111'40518","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38521","last_scrub_stamp":"2026-02-23T13:16:14.521031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.521031+0000","objects_scrubbed":37865,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:27.481651+0000","scrub_duration":5257,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2653749248,"num_objects":40493,"num_object_clones":0,"num_object_copies":121479,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40493,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40521,"num_write_kb":2592448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"111'40181","reported_seq":40606,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:20.766103+0000","last_change":"2026-02-23T13:16:14.247596+0000","last_active":"2026-02-23T13:16:20.766103+0000","last_peered":"2026-02-23T13:16:20.766103+0000","last_clean":"2026-02-23T13:16:20.766103+0000","last_became_active":"2026-02-23T13:14:49.708668+0000","last_became_peered":"2026-02-23T13:14:49.708668+0000","last_unstale":"2026-02-23T13:16:20.766103+0000","last_undegraded":"2026-02-23T13:16:20.766103+0000","last_fullsized":"2026-02-23T13:16:20.766103+0000","mapping_epoch":96,"log_start":"111'40178","ondisk_log_start":"111'40178","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38121","last_scrub_stamp":"2026-02-23T13:16:14.247558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.247558+0000","objects_scrubbed":37453,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:30.117734+0000","scrub_duration":4283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2633302016,"num_objects":40181,"num_object_clones":0,"num_object_copies":120543,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40181,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40181,"num_write_kb":2571584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"111'40451","reported_seq":40843,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:20.765438+0000","last_change":"2026-02-23T13:16:04.164271+0000","last_active":"2026-02-23T13:16:20.765438+0000","last_peered":"2026-02-23T13:16:20.765438+0000","last_clean":"2026-02-23T13:16:20.765438+0000","last_became_active":"2026-02-23T13:14:49.709202+0000","last_became_peered":"2026-02-23T13:14:49.709202+0000","last_unstale":"2026-02-23T13:16:20.765438+0000","last_undegraded":"2026-02-23T13:16:20.765438+0000","last_fullsized":"2026-02-23T13:16:20.765438+0000","mapping_epoch":96,"log_start":"111'40448","ondisk_log_start":"111'40448","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'34863","last_scrub_stamp":"2026-02-23T13:16:04.164237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:04.164237+0000","objects_scrubbed":34093,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:14.024939+0000","scrub_duration":3016,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2650996736,"num_objects":40451,"num_object_clones":0,"num_object_copies":121353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40451,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40451,"num_write_kb":2588864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"111'40847","reported_seq":41241,"reported_epoch":111,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:16:21.841680+0000","last_change":"2026-02-23T13:16:17.260284+0000","last_active":"2026-02-23T13:16:21.841680+0000","last_peered":"2026-02-23T13:16:21.841680+0000","last_clean":"2026-02-23T13:16:21.841680+0000","last_became_active":"2026-02-23T13:14:49.710193+0000","last_became_peered":"2026-02-23T13:14:49.710193+0000","last_unstale":"2026-02-23T13:16:21.841680+0000","last_undegraded":"2026-02-23T13:16:21.841680+0000","last_fullsized":"2026-02-23T13:16:21.841680+0000","mapping_epoch":96,"log_start":"111'40844","ondisk_log_start":"111'40844","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:14:48.699972+0000","objects_scrubbed":35149,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 5s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2675769344,"num_objects":40829,"num_object_clones":0,"num_object_copies":122487,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40829,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40847,"num_write_kb":2613632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"111'40365","reported_seq":40813,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:20.766858+0000","last_change":"2026-02-23T13:16:20.211692+0000","last_active":"2026-02-23T13:16:20.766858+0000","last_peered":"2026-02-23T13:16:20.766858+0000","last_clean":"2026-02-23T13:16:20.766858+0000","last_became_active":"2026-02-23T13:14:49.709781+0000","last_became_peered":"2026-02-23T13:14:49.709781+0000","last_unstale":"2026-02-23T13:16:20.766858+0000","last_undegraded":"2026-02-23T13:16:20.766858+0000","last_fullsized":"2026-02-23T13:16:20.766858+0000","mapping_epoch":96,"log_start":"111'40362","ondisk_log_start":"111'40362","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40173","last_scrub_stamp":"2026-02-23T13:16:20.211648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:20.211648+0000","objects_scrubbed":39712,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:32.063367+0000","scrub_duration":3503,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2645360640,"num_objects":40365,"num_object_clones":0,"num_object_copies":121095,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40365,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40365,"num_write_kb":2583360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"111'40308","reported_seq":40739,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:20.806633+0000","last_change":"2026-02-23T13:16:16.274976+0000","last_active":"2026-02-23T13:16:20.806633+0000","last_peered":"2026-02-23T13:16:20.806633+0000","last_clean":"2026-02-23T13:16:20.806633+0000","last_became_active":"2026-02-23T13:14:49.709715+0000","last_became_peered":"2026-02-23T13:14:49.709715+0000","last_unstale":"2026-02-23T13:16:20.806633+0000","last_undegraded":"2026-02-23T13:16:20.806633+0000","last_fullsized":"2026-02-23T13:16:20.806633+0000","mapping_epoch":96,"log_start":"111'40305","ondisk_log_start":"111'40305","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38978","last_scrub_stamp":"2026-02-23T13:16:16.274911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:16.274911+0000","objects_scrubbed":38345,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:18.192168+0000","scrub_duration":4034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2641625088,"num_objects":40308,"num_object_clones":0,"num_object_copies":120924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40308,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40308,"num_write_kb":2579712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":436,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:37.760599+0000","last_change":"2026-02-23T13:15:25.299766+0000","last_active":"2026-02-23T13:15:37.760599+0000","last_peered":"2026-02-23T13:15:37.760599+0000","last_clean":"2026-02-23T13:15:37.760599+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:15:37.760599+0000","last_undegraded":"2026-02-23T13:15:37.760599+0000","last_fullsized":"2026-02-23T13:15:37.760599+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:15:25.299737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:15:25.299737+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:42.738354+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":42364239872,"num_objects":646427,"num_object_clones":0,"num_object_copies":1939281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":646427,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":646561,"num_write_kb":41375616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":127096197120,"data_stored":127096193048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1681,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247971,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27746608,"kb_used_data":25828252,"kb_used_omap":8,"kb_used_meta":1918327,"kb_avail":706256592,"statfs":{"total":751619276800,"available":723206750208,"internally_reserved":0,"allocated":26448130048,"data_stored":26447525649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8542,"internal_metadata":1964367522},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444198,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":33214128,"kb_used_data":31059292,"kb_used_omap":10,"kb_used_meta":2154805,"kb_avail":700789072,"statfs":{"total":751619276800,"available":717608009728,"internally_reserved":0,"allocated":31804715008,"data_stored":31804110609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10262,"internal_metadata":2206521322},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575016,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":36570156,"kb_used_data":36194648,"kb_used_omap":19,"kb_used_meta":375468,"kb_avail":697433044,"statfs":{"total":751619276800,"available":714171437056,"internally_reserved":0,"allocated":37063319552,"data_stored":37062718705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20333,"internal_metadata":384479379},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705833,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":33143344,"kb_used_data":31050076,"kb_used_omap":27,"kb_used_meta":2093220,"kb_avail":700859856,"statfs":{"total":751619276800,"available":717680492544,"internally_reserved":0,"allocated":31795277824,"data_stored":31794673425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28006,"internal_metadata":2143457946},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1681,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31793741824,"data_stored":31793741824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":37052682240,"data_stored":37052678168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":31803179008,"data_stored":31803179008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26446594048,"data_stored":26446594048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:16:24.401 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:16:24.401 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_4 pg_num 76 2026-02-23T13:16:24.541 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:24.679 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:24.678+0000 7f668f2ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:24.679 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:24.678+0000 7f668f2ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:24.835 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:16:24.861 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:24 trial046 ceph-mon[38575]: 6.f scrub ok 2026-02-23T13:16:24.861 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:24 trial046 ceph-mon[38575]: 6.9 scrub ok 2026-02-23T13:16:24.861 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:24 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2761234399' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:16:24.875 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:16:26.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:25 trial046 ceph-mon[38575]: from='client.15586 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:16:26.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:25 trial046 ceph-mon[38575]: pgmap v489: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 39 GiB data, 125 GiB used, 2.6 TiB / 2.7 TiB avail; 239 MiB/s wr, 3.82k op/s 2026-02-23T13:16:26.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:25 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2267506957' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pg_num", "val": "76"} : dispatch 2026-02-23T13:16:26.226 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:16:26.372 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:26.398 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:16:26 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:16:26] "GET /metrics HTTP/1.1" 200 4218 "" "Prometheus/3.6.0" 2026-02-23T13:16:26.505 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:26.503+0000 7f35ea5af640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:26.506 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:26.504+0000 7f35ea5af640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:26.523 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:16:26.523 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:16:26.539 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:16:26.539 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:16:26.552 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:16:26.553 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:16:26.560 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:16:26 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:16:26.087Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:16:26.565 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:16:26.566 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:16:27.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:26 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3101062373' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:16:28.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:27 trial046 ceph-mon[38575]: pgmap v490: 17 pgs: 3 active+clean+scrubbing, 14 active+clean; 38 GiB data, 122 GiB used, 2.6 TiB / 2.7 TiB avail; 85 B/s rd, 239 MiB/s wr, 5.47k op/s 2026-02-23T13:16:28.611 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:16:28.764 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:28.888 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:28.886+0000 7f93baf82640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:28.888 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:28.886+0000 7f93baf82640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:28.905 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:16:28.905 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:16:28.921 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:16:28.921 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:16:28.936 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:16:28.936 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:16:28.950 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:16:28.950 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:16:29.876 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:16:29.877 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:16:29.877 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_4 2026-02-23T13:16:29.877 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:16:30.029 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:30.056 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:29 trial046 ceph-mon[38575]: pgmap v491: 17 pgs: 17 active+clean; 37 GiB data, 119 GiB used, 2.6 TiB / 2.7 TiB avail; 85 B/s rd, 212 MiB/s wr, 6.74k op/s 2026-02-23T13:16:30.056 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:29 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1422198183' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:16:30.156 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:30.154+0000 7f98bd831640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:30.156 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:30.154+0000 7f98bd831640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:30.301 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:16:30.302 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:16:30.350 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":491,"stamp":"2026-02-23T13:16:28.700389+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":39736246840,"num_objects":606321,"num_object_clones":0,"num_object_copies":1818963,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":606321,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":686806,"num_write_kb":41377767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":124266632,"kb_used_data":117562552,"kb_used_omap":44,"kb_used_meta":6703955,"kb_avail":2811746168,"statfs":{"total":3006477107200,"available":2879228076032,"internally_reserved":0,"allocated":120384053248,"data_stored":120381626988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45706,"internal_metadata":6864850294},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34668568,"num_objects":530,"num_object_clones":0,"num_object_copies":1590,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":530,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":80882,"num_write_kb":2605121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001791"},"pg_stats":[{"pgid":"6.f","version":"111'43077","reported_seq":43529,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:26.840740+0000","last_change":"2026-02-23T13:16:23.280934+0000","last_active":"2026-02-23T13:16:26.840740+0000","last_peered":"2026-02-23T13:16:26.840740+0000","last_clean":"2026-02-23T13:16:26.840740+0000","last_became_active":"2026-02-23T13:14:49.710909+0000","last_became_peered":"2026-02-23T13:14:49.710909+0000","last_unstale":"2026-02-23T13:16:26.840740+0000","last_undegraded":"2026-02-23T13:16:26.840740+0000","last_fullsized":"2026-02-23T13:16:26.840740+0000","mapping_epoch":96,"log_start":"111'43074","ondisk_log_start":"111'43074","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'41083","last_scrub_stamp":"2026-02-23T13:16:23.280817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:23.280817+0000","objects_scrubbed":40316,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:26.278733+0000","scrub_duration":4030,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2484142080,"num_objects":37905,"num_object_clones":0,"num_object_copies":113715,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37905,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43077,"num_write_kb":2591424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"111'42990","reported_seq":43361,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:26.696148+0000","last_change":"2026-02-23T13:16:00.821994+0000","last_active":"2026-02-23T13:16:26.696148+0000","last_peered":"2026-02-23T13:16:26.696148+0000","last_clean":"2026-02-23T13:16:26.696148+0000","last_became_active":"2026-02-23T13:14:49.710608+0000","last_became_peered":"2026-02-23T13:14:49.710608+0000","last_unstale":"2026-02-23T13:16:26.696148+0000","last_undegraded":"2026-02-23T13:16:26.696148+0000","last_fullsized":"2026-02-23T13:16:26.696148+0000","mapping_epoch":96,"log_start":"111'42987","ondisk_log_start":"111'42987","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'33186","last_scrub_stamp":"2026-02-23T13:16:00.821941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:00.821941+0000","objects_scrubbed":32277,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:02.918773+0000","scrub_duration":3732,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2486829056,"num_objects":37946,"num_object_clones":0,"num_object_copies":113838,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37946,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42990,"num_write_kb":2589952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"111'42737","reported_seq":43182,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:26.696725+0000","last_change":"2026-02-23T13:16:20.125449+0000","last_active":"2026-02-23T13:16:26.696725+0000","last_peered":"2026-02-23T13:16:26.696725+0000","last_clean":"2026-02-23T13:16:26.696725+0000","last_became_active":"2026-02-23T13:14:49.710759+0000","last_became_peered":"2026-02-23T13:14:49.710759+0000","last_unstale":"2026-02-23T13:16:26.696725+0000","last_undegraded":"2026-02-23T13:16:26.696725+0000","last_fullsized":"2026-02-23T13:16:26.696725+0000","mapping_epoch":96,"log_start":"111'42734","ondisk_log_start":"111'42734","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40044","last_scrub_stamp":"2026-02-23T13:16:20.125397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:20.125397+0000","objects_scrubbed":39489,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:35.607693+0000","scrub_duration":4187,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2475032600,"num_objects":37767,"num_object_clones":0,"num_object_copies":113301,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37767,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":42737,"num_write_kb":2576065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"111'43403","reported_seq":43825,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:26.841709+0000","last_change":"2026-02-23T13:16:12.911605+0000","last_active":"2026-02-23T13:16:26.841709+0000","last_peered":"2026-02-23T13:16:26.841709+0000","last_clean":"2026-02-23T13:16:26.841709+0000","last_became_active":"2026-02-23T13:14:49.710648+0000","last_became_peered":"2026-02-23T13:14:49.710648+0000","last_unstale":"2026-02-23T13:16:26.841709+0000","last_undegraded":"2026-02-23T13:16:26.841709+0000","last_fullsized":"2026-02-23T13:16:26.841709+0000","mapping_epoch":96,"log_start":"111'43400","ondisk_log_start":"111'43400","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38184","last_scrub_stamp":"2026-02-23T13:16:12.911442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:12.911442+0000","objects_scrubbed":37197,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:25.172701+0000","scrub_duration":5652,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2499608576,"num_objects":38141,"num_object_clones":0,"num_object_copies":114423,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38141,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43403,"num_write_kb":2609408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"111'42961","reported_seq":43390,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:26.841623+0000","last_change":"2026-02-23T13:16:14.901799+0000","last_active":"2026-02-23T13:16:26.841623+0000","last_peered":"2026-02-23T13:16:26.841623+0000","last_clean":"2026-02-23T13:16:26.841623+0000","last_became_active":"2026-02-23T13:14:49.709875+0000","last_became_peered":"2026-02-23T13:14:49.709875+0000","last_unstale":"2026-02-23T13:16:26.841623+0000","last_undegraded":"2026-02-23T13:16:26.841623+0000","last_fullsized":"2026-02-23T13:16:26.841623+0000","mapping_epoch":96,"log_start":"111'42958","ondisk_log_start":"111'42958","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38474","last_scrub_stamp":"2026-02-23T13:16:14.901765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.901765+0000","objects_scrubbed":37818,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:23.823920+0000","scrub_duration":4577,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2477195264,"num_objects":37799,"num_object_clones":0,"num_object_copies":113397,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37799,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42961,"num_write_kb":2584320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"111'43123","reported_seq":43571,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:26.697154+0000","last_change":"2026-02-23T13:16:20.991460+0000","last_active":"2026-02-23T13:16:26.697154+0000","last_peered":"2026-02-23T13:16:26.697154+0000","last_clean":"2026-02-23T13:16:26.697154+0000","last_became_active":"2026-02-23T13:14:49.709618+0000","last_became_peered":"2026-02-23T13:14:49.709618+0000","last_unstale":"2026-02-23T13:16:26.697154+0000","last_undegraded":"2026-02-23T13:16:26.697154+0000","last_fullsized":"2026-02-23T13:16:26.697154+0000","mapping_epoch":96,"log_start":"111'43120","ondisk_log_start":"111'43120","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40588","last_scrub_stamp":"2026-02-23T13:16:20.991398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:20.991398+0000","objects_scrubbed":40089,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:21.036471+0000","scrub_duration":4040,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2493841408,"num_objects":38053,"num_object_clones":0,"num_object_copies":114159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38053,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43123,"num_write_kb":2597632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"111'42566","reported_seq":43016,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:26.713538+0000","last_change":"2026-02-23T13:16:23.670756+0000","last_active":"2026-02-23T13:16:26.713538+0000","last_peered":"2026-02-23T13:16:26.713538+0000","last_clean":"2026-02-23T13:16:26.713538+0000","last_became_active":"2026-02-23T13:14:49.711647+0000","last_became_peered":"2026-02-23T13:14:49.711647+0000","last_unstale":"2026-02-23T13:16:26.713538+0000","last_undegraded":"2026-02-23T13:16:26.713538+0000","last_fullsized":"2026-02-23T13:16:26.713538+0000","mapping_epoch":96,"log_start":"111'42563","ondisk_log_start":"111'42563","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40918","last_scrub_stamp":"2026-02-23T13:16:23.670714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:23.670714+0000","objects_scrubbed":39913,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:29.633725+0000","scrub_duration":5904,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2471362560,"num_objects":37710,"num_object_clones":0,"num_object_copies":113130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37710,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42566,"num_write_kb":2568832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"111'42373","reported_seq":42797,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:26.690820+0000","last_change":"2026-02-23T13:16:14.478890+0000","last_active":"2026-02-23T13:16:26.690820+0000","last_peered":"2026-02-23T13:16:26.690820+0000","last_clean":"2026-02-23T13:16:26.690820+0000","last_became_active":"2026-02-23T13:14:49.710064+0000","last_became_peered":"2026-02-23T13:14:49.710064+0000","last_unstale":"2026-02-23T13:16:26.690820+0000","last_undegraded":"2026-02-23T13:16:26.690820+0000","last_fullsized":"2026-02-23T13:16:26.690820+0000","mapping_epoch":96,"log_start":"111'42370","ondisk_log_start":"111'42370","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'37982","last_scrub_stamp":"2026-02-23T13:16:14.478836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.478836+0000","objects_scrubbed":37503,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:35.874054+0000","scrub_duration":3268,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2465136640,"num_objects":37615,"num_object_clones":0,"num_object_copies":112845,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37615,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42373,"num_write_kb":2559616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"111'42830","reported_seq":43269,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:26.839013+0000","last_change":"2026-02-23T13:16:18.449205+0000","last_active":"2026-02-23T13:16:26.839013+0000","last_peered":"2026-02-23T13:16:26.839013+0000","last_clean":"2026-02-23T13:16:26.839013+0000","last_became_active":"2026-02-23T13:14:49.711227+0000","last_became_peered":"2026-02-23T13:14:49.711227+0000","last_unstale":"2026-02-23T13:16:26.839013+0000","last_undegraded":"2026-02-23T13:16:26.839013+0000","last_fullsized":"2026-02-23T13:16:26.839013+0000","mapping_epoch":96,"log_start":"111'42827","ondisk_log_start":"111'42827","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'39520","last_scrub_stamp":"2026-02-23T13:16:18.449176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:18.449176+0000","objects_scrubbed":38818,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:46.860861+0000","scrub_duration":4228,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2468216832,"num_objects":37662,"num_object_clones":0,"num_object_copies":112986,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37662,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42830,"num_write_kb":2575744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"111'43072","reported_seq":43486,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:26.694312+0000","last_change":"2026-02-23T13:16:09.977947+0000","last_active":"2026-02-23T13:16:26.694312+0000","last_peered":"2026-02-23T13:16:26.694312+0000","last_clean":"2026-02-23T13:16:26.694312+0000","last_became_active":"2026-02-23T13:14:49.710282+0000","last_became_peered":"2026-02-23T13:14:49.710282+0000","last_unstale":"2026-02-23T13:16:26.694312+0000","last_undegraded":"2026-02-23T13:16:26.694312+0000","last_fullsized":"2026-02-23T13:16:26.694312+0000","mapping_epoch":96,"log_start":"111'43069","ondisk_log_start":"111'43069","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'37114","last_scrub_stamp":"2026-02-23T13:16:09.977889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:09.977889+0000","objects_scrubbed":36647,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:17.287339+0000","scrub_duration":2946,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2487746560,"num_objects":37960,"num_object_clones":0,"num_object_copies":113880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37960,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43072,"num_write_kb":2593024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"111'42960","reported_seq":43389,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:26.843867+0000","last_change":"2026-02-23T13:16:14.521114+0000","last_active":"2026-02-23T13:16:26.843867+0000","last_peered":"2026-02-23T13:16:26.843867+0000","last_clean":"2026-02-23T13:16:26.843867+0000","last_became_active":"2026-02-23T13:14:49.710940+0000","last_became_peered":"2026-02-23T13:14:49.710940+0000","last_unstale":"2026-02-23T13:16:26.843867+0000","last_undegraded":"2026-02-23T13:16:26.843867+0000","last_fullsized":"2026-02-23T13:16:26.843867+0000","mapping_epoch":96,"log_start":"111'42957","ondisk_log_start":"111'42957","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38521","last_scrub_stamp":"2026-02-23T13:16:14.521031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.521031+0000","objects_scrubbed":37865,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:27.481651+0000","scrub_duration":5257,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2493906944,"num_objects":38054,"num_object_clones":0,"num_object_copies":114162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38054,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42960,"num_write_kb":2592448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"111'42596","reported_seq":43021,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:26.697053+0000","last_change":"2026-02-23T13:16:14.247596+0000","last_active":"2026-02-23T13:16:26.697053+0000","last_peered":"2026-02-23T13:16:26.697053+0000","last_clean":"2026-02-23T13:16:26.697053+0000","last_became_active":"2026-02-23T13:14:49.708668+0000","last_became_peered":"2026-02-23T13:14:49.708668+0000","last_unstale":"2026-02-23T13:16:26.697053+0000","last_undegraded":"2026-02-23T13:16:26.697053+0000","last_fullsized":"2026-02-23T13:16:26.697053+0000","mapping_epoch":96,"log_start":"111'42593","ondisk_log_start":"111'42593","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38121","last_scrub_stamp":"2026-02-23T13:16:14.247558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.247558+0000","objects_scrubbed":37453,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:30.117734+0000","scrub_duration":4283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2475032576,"num_objects":37766,"num_object_clones":0,"num_object_copies":113298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37766,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42596,"num_write_kb":2571584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"111'42846","reported_seq":43238,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:26.689674+0000","last_change":"2026-02-23T13:16:04.164271+0000","last_active":"2026-02-23T13:16:26.689674+0000","last_peered":"2026-02-23T13:16:26.689674+0000","last_clean":"2026-02-23T13:16:26.689674+0000","last_became_active":"2026-02-23T13:14:49.709202+0000","last_became_peered":"2026-02-23T13:14:49.709202+0000","last_unstale":"2026-02-23T13:16:26.689674+0000","last_undegraded":"2026-02-23T13:16:26.689674+0000","last_fullsized":"2026-02-23T13:16:26.689674+0000","mapping_epoch":96,"log_start":"111'42843","ondisk_log_start":"111'42843","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'34863","last_scrub_stamp":"2026-02-23T13:16:04.164237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:04.164237+0000","objects_scrubbed":34093,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:14.024939+0000","scrub_duration":3016,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2494038016,"num_objects":38056,"num_object_clones":0,"num_object_copies":114168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38056,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42846,"num_write_kb":2588864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"111'43420","reported_seq":43876,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:26.837117+0000","last_change":"2026-02-23T13:16:22.619866+0000","last_active":"2026-02-23T13:16:26.837117+0000","last_peered":"2026-02-23T13:16:26.837117+0000","last_clean":"2026-02-23T13:16:26.837117+0000","last_became_active":"2026-02-23T13:14:49.710193+0000","last_became_peered":"2026-02-23T13:14:49.710193+0000","last_unstale":"2026-02-23T13:16:26.837117+0000","last_undegraded":"2026-02-23T13:16:26.837117+0000","last_fullsized":"2026-02-23T13:16:26.837117+0000","mapping_epoch":96,"log_start":"111'43417","ondisk_log_start":"111'43417","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'41143","last_scrub_stamp":"2026-02-23T13:16:22.619816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:22.619816+0000","objects_scrubbed":40610,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:26.460041+0000","scrub_duration":5359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2507145216,"num_objects":38256,"num_object_clones":0,"num_object_copies":114768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38256,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43420,"num_write_kb":2613632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"111'42901","reported_seq":43349,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:26.706986+0000","last_change":"2026-02-23T13:16:20.211692+0000","last_active":"2026-02-23T13:16:26.706986+0000","last_peered":"2026-02-23T13:16:26.706986+0000","last_clean":"2026-02-23T13:16:26.706986+0000","last_became_active":"2026-02-23T13:14:49.709781+0000","last_became_peered":"2026-02-23T13:14:49.709781+0000","last_unstale":"2026-02-23T13:16:26.706986+0000","last_undegraded":"2026-02-23T13:16:26.706986+0000","last_fullsized":"2026-02-23T13:16:26.706986+0000","mapping_epoch":96,"log_start":"111'42898","ondisk_log_start":"111'42898","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40173","last_scrub_stamp":"2026-02-23T13:16:20.211648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:20.211648+0000","objects_scrubbed":39712,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:32.063367+0000","scrub_duration":3503,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2479161344,"num_objects":37829,"num_object_clones":0,"num_object_copies":113487,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37829,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42901,"num_write_kb":2583360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"111'42816","reported_seq":43246,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:26.691499+0000","last_change":"2026-02-23T13:16:16.274976+0000","last_active":"2026-02-23T13:16:26.691499+0000","last_peered":"2026-02-23T13:16:26.691499+0000","last_clean":"2026-02-23T13:16:26.691499+0000","last_became_active":"2026-02-23T13:14:49.709715+0000","last_became_peered":"2026-02-23T13:14:49.709715+0000","last_unstale":"2026-02-23T13:16:26.691499+0000","last_undegraded":"2026-02-23T13:16:26.691499+0000","last_fullsized":"2026-02-23T13:16:26.691499+0000","mapping_epoch":96,"log_start":"111'42813","ondisk_log_start":"111'42813","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38978","last_scrub_stamp":"2026-02-23T13:16:16.274911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:16.274911+0000","objects_scrubbed":38345,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:18.192168+0000","scrub_duration":4034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2477260800,"num_objects":37800,"num_object_clones":0,"num_object_copies":113400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37800,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42816,"num_write_kb":2579712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":436,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:37.760599+0000","last_change":"2026-02-23T13:15:25.299766+0000","last_active":"2026-02-23T13:15:37.760599+0000","last_peered":"2026-02-23T13:15:37.760599+0000","last_clean":"2026-02-23T13:15:37.760599+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:15:37.760599+0000","last_undegraded":"2026-02-23T13:15:37.760599+0000","last_fullsized":"2026-02-23T13:15:37.760599+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:15:25.299737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:15:25.299737+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:42.738354+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":39735656472,"num_objects":606319,"num_object_clones":0,"num_object_copies":1818957,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":606319,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":686671,"num_write_kb":41375617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":119223627776,"data_stored":119223615560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1681,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247972,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":26406000,"kb_used_data":24433500,"kb_used_omap":8,"kb_used_meta":1972471,"kb_avail":707597200,"statfs":{"total":751619276800,"available":724579532800,"internally_reserved":0,"allocated":25019904000,"data_stored":25019299601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8542,"internal_metadata":2019810978},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444199,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":31566196,"kb_used_data":29429344,"kb_used_omap":11,"kb_used_meta":2136820,"kb_avail":702437004,"statfs":{"total":751619276800,"available":719295492096,"internally_reserved":0,"allocated":30135648256,"data_stored":30135039785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11351,"internal_metadata":2188104617},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575017,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":34608816,"kb_used_data":34161116,"kb_used_omap":19,"kb_used_meta":447660,"kb_avail":699394384,"statfs":{"total":751619276800,"available":716179849216,"internally_reserved":0,"allocated":34980982784,"data_stored":34980377865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20333,"internal_metadata":458403987},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705834,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":31685620,"kb_used_data":29538592,"kb_used_omap":5,"kb_used_meta":2147002,"kb_avail":702317580,"statfs":{"total":751619276800,"available":719173201920,"internally_reserved":0,"allocated":30247518208,"data_stored":30246909737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5480,"internal_metadata":2198530712},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1681,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29836578816,"data_stored":29836574744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":34711932928,"data_stored":34711928856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29844443136,"data_stored":29844439064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24830672896,"data_stored":24830672896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:16:30.352 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:16:30.352 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_4 pg_num 86 2026-02-23T13:16:30.502 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:30.625 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:30.623+0000 7eff08d9f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:30.625 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:30.623+0000 7eff08d9f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:30.774 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:16:30.815 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:16:30.997 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:16:31.022 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:30 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/822618391' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pg_num", "val": "86"} : dispatch 2026-02-23T13:16:31.147 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:31.282 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:31.280+0000 7fd0edcfc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:31.282 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:31.280+0000 7fd0edcfc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:31.296 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:16:31.296 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:16:31.311 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:16:31.311 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:16:31.324 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:16:31.324 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:16:31.337 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:16:31.337 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:16:32.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:31 trial046 ceph-mon[38575]: from='client.15594 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:16:32.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:31 trial046 ceph-mon[38575]: pgmap v492: 17 pgs: 17 active+clean; 37 GiB data, 119 GiB used, 2.6 TiB / 2.7 TiB avail; 85 B/s rd, 95 MiB/s wr, 4.87k op/s 2026-02-23T13:16:32.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:31 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:16:32.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:31 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3803754008' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:16:33.383 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:16:33.529 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:33.656 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:33.654+0000 7f56065b0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:33.657 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:33.655+0000 7f56065b0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:33.672 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:16:33.672 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:16:33.687 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:16:33.687 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:16:33.701 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:16:33.702 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:16:33.713 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:16:33.714 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:16:34.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:33 trial046 ceph-mon[38575]: pgmap v493: 17 pgs: 17 active+clean; 34 GiB data, 108 GiB used, 2.6 TiB / 2.7 TiB avail; 85 B/s rd, 95 MiB/s wr, 8.77k op/s 2026-02-23T13:16:34.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:33 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2770520809' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:16:35.758 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:16:35.816 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:16:35.816 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:16:35.816 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:16:35.817 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:16:35.916 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:35.964 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:36.034 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:35 trial046 ceph-mon[38575]: pgmap v494: 17 pgs: 17 active+clean; 34 GiB data, 108 GiB used, 2.6 TiB / 2.7 TiB avail; 85 B/s rd, 85 B/s wr, 7.24k op/s 2026-02-23T13:16:36.036 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:36.034+0000 7ff5184be640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:36.036 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:36.034+0000 7ff5184be640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:36.051 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:16:36.052 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:16:36.065 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:16:36.065 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:16:36.079 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:16:36.079 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:16:36.086 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:36.085+0000 7f2f6625c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:36.087 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:36.085+0000 7f2f6625c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:36.092 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:16:36.092 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:16:36.239 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:16:36.240 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:16:36.283 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":494,"stamp":"2026-02-23T13:16:34.701269+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":36667720248,"num_objects":559499,"num_object_clones":0,"num_object_copies":1678497,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":559499,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":733628,"num_write_kb":41377767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53,"ondisk_log_size":53,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":112907784,"kb_used_data":108638200,"kb_used_omap":45,"kb_used_meta":4269458,"kb_avail":2823105016,"statfs":{"total":3006477107200,"available":2890859536384,"internally_reserved":0,"allocated":111245516800,"data_stored":111243090540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46795,"internal_metadata":4371925301},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,5],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5697109992,"num_objects":-86930,"num_object_clones":0,"num_object_copies":-260790,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-86930,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":86932,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001704"},"pg_stats":[{"pgid":"6.f","version":"111'46028","reported_seq":46480,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:31.842660+0000","last_change":"2026-02-23T13:16:23.280934+0000","last_active":"2026-02-23T13:16:31.842660+0000","last_peered":"2026-02-23T13:16:31.842660+0000","last_clean":"2026-02-23T13:16:31.842660+0000","last_became_active":"2026-02-23T13:14:49.710909+0000","last_became_peered":"2026-02-23T13:14:49.710909+0000","last_unstale":"2026-02-23T13:16:31.842660+0000","last_undegraded":"2026-02-23T13:16:31.842660+0000","last_fullsized":"2026-02-23T13:16:31.842660+0000","mapping_epoch":96,"log_start":"111'46025","ondisk_log_start":"111'46025","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'41083","last_scrub_stamp":"2026-02-23T13:16:23.280817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:23.280817+0000","objects_scrubbed":40316,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:26.278733+0000","scrub_duration":4030,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2290745344,"num_objects":34954,"num_object_clones":0,"num_object_copies":104862,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34954,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46028,"num_write_kb":2591424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"111'45938","reported_seq":46310,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:31.698250+0000","last_change":"2026-02-23T13:16:00.821994+0000","last_active":"2026-02-23T13:16:31.698250+0000","last_peered":"2026-02-23T13:16:31.698250+0000","last_clean":"2026-02-23T13:16:31.698250+0000","last_became_active":"2026-02-23T13:14:49.710608+0000","last_became_peered":"2026-02-23T13:14:49.710608+0000","last_unstale":"2026-02-23T13:16:31.698250+0000","last_undegraded":"2026-02-23T13:16:31.698250+0000","last_fullsized":"2026-02-23T13:16:31.698250+0000","mapping_epoch":96,"log_start":"111'45935","ondisk_log_start":"111'45935","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'33186","last_scrub_stamp":"2026-02-23T13:16:00.821941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:00.821941+0000","objects_scrubbed":32277,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:02.918773+0000","scrub_duration":3732,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293628928,"num_objects":34998,"num_object_clones":0,"num_object_copies":104994,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34998,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45938,"num_write_kb":2589952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"111'45633","reported_seq":46078,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:31.696529+0000","last_change":"2026-02-23T13:16:20.125449+0000","last_active":"2026-02-23T13:16:31.696529+0000","last_peered":"2026-02-23T13:16:31.696529+0000","last_clean":"2026-02-23T13:16:31.696529+0000","last_became_active":"2026-02-23T13:14:49.710759+0000","last_became_peered":"2026-02-23T13:14:49.710759+0000","last_unstale":"2026-02-23T13:16:31.696529+0000","last_undegraded":"2026-02-23T13:16:31.696529+0000","last_fullsized":"2026-02-23T13:16:31.696529+0000","mapping_epoch":96,"log_start":"111'45630","ondisk_log_start":"111'45630","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40044","last_scrub_stamp":"2026-02-23T13:16:20.125397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:20.125397+0000","objects_scrubbed":39489,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:35.607693+0000","scrub_duration":4187,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2285240344,"num_objects":34871,"num_object_clones":0,"num_object_copies":104613,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34871,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":45633,"num_write_kb":2576065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"111'46245","reported_seq":46667,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:31.845411+0000","last_change":"2026-02-23T13:16:12.911605+0000","last_active":"2026-02-23T13:16:31.845411+0000","last_peered":"2026-02-23T13:16:31.845411+0000","last_clean":"2026-02-23T13:16:31.845411+0000","last_became_active":"2026-02-23T13:14:49.710648+0000","last_became_peered":"2026-02-23T13:14:49.710648+0000","last_unstale":"2026-02-23T13:16:31.845411+0000","last_undegraded":"2026-02-23T13:16:31.845411+0000","last_fullsized":"2026-02-23T13:16:31.845411+0000","mapping_epoch":96,"log_start":"111'46242","ondisk_log_start":"111'46242","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38184","last_scrub_stamp":"2026-02-23T13:16:12.911442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:12.911442+0000","objects_scrubbed":37197,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:25.172701+0000","scrub_duration":5652,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2313355264,"num_objects":35299,"num_object_clones":0,"num_object_copies":105897,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35299,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46245,"num_write_kb":2609408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"111'45890","reported_seq":46319,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:31.843681+0000","last_change":"2026-02-23T13:16:14.901799+0000","last_active":"2026-02-23T13:16:31.843681+0000","last_peered":"2026-02-23T13:16:31.843681+0000","last_clean":"2026-02-23T13:16:31.843681+0000","last_became_active":"2026-02-23T13:14:49.709875+0000","last_became_peered":"2026-02-23T13:14:49.709875+0000","last_unstale":"2026-02-23T13:16:31.843681+0000","last_undegraded":"2026-02-23T13:16:31.843681+0000","last_fullsized":"2026-02-23T13:16:31.843681+0000","mapping_epoch":96,"log_start":"111'45886","ondisk_log_start":"111'45886","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38474","last_scrub_stamp":"2026-02-23T13:16:14.901765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.901765+0000","objects_scrubbed":37818,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:23.823920+0000","scrub_duration":4577,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2285240320,"num_objects":34870,"num_object_clones":0,"num_object_copies":104610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34870,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45890,"num_write_kb":2584320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"111'46081","reported_seq":46530,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:31.694700+0000","last_change":"2026-02-23T13:16:20.991460+0000","last_active":"2026-02-23T13:16:31.694700+0000","last_peered":"2026-02-23T13:16:31.694700+0000","last_clean":"2026-02-23T13:16:31.694700+0000","last_became_active":"2026-02-23T13:14:49.709618+0000","last_became_peered":"2026-02-23T13:14:49.709618+0000","last_unstale":"2026-02-23T13:16:31.694700+0000","last_undegraded":"2026-02-23T13:16:31.694700+0000","last_fullsized":"2026-02-23T13:16:31.694700+0000","mapping_epoch":96,"log_start":"111'46078","ondisk_log_start":"111'46078","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40588","last_scrub_stamp":"2026-02-23T13:16:20.991398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:20.991398+0000","objects_scrubbed":40089,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:21.036471+0000","scrub_duration":4040,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2299985920,"num_objects":35095,"num_object_clones":0,"num_object_copies":105285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35095,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46081,"num_write_kb":2597632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"111'45435","reported_seq":45885,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:31.711293+0000","last_change":"2026-02-23T13:16:23.670756+0000","last_active":"2026-02-23T13:16:31.711293+0000","last_peered":"2026-02-23T13:16:31.711293+0000","last_clean":"2026-02-23T13:16:31.711293+0000","last_became_active":"2026-02-23T13:14:49.711647+0000","last_became_peered":"2026-02-23T13:14:49.711647+0000","last_unstale":"2026-02-23T13:16:31.711293+0000","last_undegraded":"2026-02-23T13:16:31.711293+0000","last_fullsized":"2026-02-23T13:16:31.711293+0000","mapping_epoch":96,"log_start":"111'45432","ondisk_log_start":"111'45432","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40918","last_scrub_stamp":"2026-02-23T13:16:23.670714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:23.670714+0000","objects_scrubbed":39913,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:29.633725+0000","scrub_duration":5904,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2283339776,"num_objects":34841,"num_object_clones":0,"num_object_copies":104523,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34841,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45435,"num_write_kb":2568832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"111'45313","reported_seq":45735,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:31.689154+0000","last_change":"2026-02-23T13:16:14.478890+0000","last_active":"2026-02-23T13:16:31.689154+0000","last_peered":"2026-02-23T13:16:31.689154+0000","last_clean":"2026-02-23T13:16:31.689154+0000","last_became_active":"2026-02-23T13:14:49.710064+0000","last_became_peered":"2026-02-23T13:14:49.710064+0000","last_unstale":"2026-02-23T13:16:31.689154+0000","last_undegraded":"2026-02-23T13:16:31.689154+0000","last_fullsized":"2026-02-23T13:16:31.689154+0000","mapping_epoch":96,"log_start":"111'45310","ondisk_log_start":"111'45310","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'37982","last_scrub_stamp":"2026-02-23T13:16:14.478836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.478836+0000","objects_scrubbed":37503,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:35.874054+0000","scrub_duration":3268,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2272460800,"num_objects":34675,"num_object_clones":0,"num_object_copies":104025,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34675,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45313,"num_write_kb":2559616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"111'45786","reported_seq":46225,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:31.843443+0000","last_change":"2026-02-23T13:16:18.449205+0000","last_active":"2026-02-23T13:16:31.843443+0000","last_peered":"2026-02-23T13:16:31.843443+0000","last_clean":"2026-02-23T13:16:31.843443+0000","last_became_active":"2026-02-23T13:14:49.711227+0000","last_became_peered":"2026-02-23T13:14:49.711227+0000","last_unstale":"2026-02-23T13:16:31.843443+0000","last_undegraded":"2026-02-23T13:16:31.843443+0000","last_fullsized":"2026-02-23T13:16:31.843443+0000","mapping_epoch":96,"log_start":"111'45783","ondisk_log_start":"111'45783","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'39520","last_scrub_stamp":"2026-02-23T13:16:18.449176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:18.449176+0000","objects_scrubbed":38818,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:46.860861+0000","scrub_duration":4228,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2274492416,"num_objects":34706,"num_object_clones":0,"num_object_copies":104118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34706,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45786,"num_write_kb":2575744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"111'46015","reported_seq":46429,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:31.695600+0000","last_change":"2026-02-23T13:16:09.977947+0000","last_active":"2026-02-23T13:16:31.695600+0000","last_peered":"2026-02-23T13:16:31.695600+0000","last_clean":"2026-02-23T13:16:31.695600+0000","last_became_active":"2026-02-23T13:14:49.710282+0000","last_became_peered":"2026-02-23T13:14:49.710282+0000","last_unstale":"2026-02-23T13:16:31.695600+0000","last_undegraded":"2026-02-23T13:16:31.695600+0000","last_fullsized":"2026-02-23T13:16:31.695600+0000","mapping_epoch":96,"log_start":"111'46012","ondisk_log_start":"111'46012","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'37114","last_scrub_stamp":"2026-02-23T13:16:09.977889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:09.977889+0000","objects_scrubbed":36647,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:17.287339+0000","scrub_duration":2946,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2294874112,"num_objects":35017,"num_object_clones":0,"num_object_copies":105051,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35017,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46015,"num_write_kb":2593024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"111'45951","reported_seq":46380,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:31.842475+0000","last_change":"2026-02-23T13:16:14.521114+0000","last_active":"2026-02-23T13:16:31.842475+0000","last_peered":"2026-02-23T13:16:31.842475+0000","last_clean":"2026-02-23T13:16:31.842475+0000","last_became_active":"2026-02-23T13:14:49.710940+0000","last_became_peered":"2026-02-23T13:14:49.710940+0000","last_unstale":"2026-02-23T13:16:31.842475+0000","last_undegraded":"2026-02-23T13:16:31.842475+0000","last_fullsized":"2026-02-23T13:16:31.842475+0000","mapping_epoch":96,"log_start":"111'45947","ondisk_log_start":"111'45947","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38521","last_scrub_stamp":"2026-02-23T13:16:14.521031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.521031+0000","objects_scrubbed":37865,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:27.481651+0000","scrub_duration":5257,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2297888768,"num_objects":35063,"num_object_clones":0,"num_object_copies":105189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35063,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45951,"num_write_kb":2592448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"111'45552","reported_seq":45977,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:31.698421+0000","last_change":"2026-02-23T13:16:14.247596+0000","last_active":"2026-02-23T13:16:31.698421+0000","last_peered":"2026-02-23T13:16:31.698421+0000","last_clean":"2026-02-23T13:16:31.698421+0000","last_became_active":"2026-02-23T13:14:49.708668+0000","last_became_peered":"2026-02-23T13:14:49.708668+0000","last_unstale":"2026-02-23T13:16:31.698421+0000","last_undegraded":"2026-02-23T13:16:31.698421+0000","last_fullsized":"2026-02-23T13:16:31.698421+0000","mapping_epoch":96,"log_start":"111'45549","ondisk_log_start":"111'45549","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38121","last_scrub_stamp":"2026-02-23T13:16:14.247558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.247558+0000","objects_scrubbed":37453,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:30.117734+0000","scrub_duration":4283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2281308160,"num_objects":34810,"num_object_clones":0,"num_object_copies":104430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34810,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45552,"num_write_kb":2571584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"111'45795","reported_seq":46187,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:31.692156+0000","last_change":"2026-02-23T13:16:04.164271+0000","last_active":"2026-02-23T13:16:31.692156+0000","last_peered":"2026-02-23T13:16:31.692156+0000","last_clean":"2026-02-23T13:16:31.692156+0000","last_became_active":"2026-02-23T13:14:49.709202+0000","last_became_peered":"2026-02-23T13:14:49.709202+0000","last_unstale":"2026-02-23T13:16:31.692156+0000","last_undegraded":"2026-02-23T13:16:31.692156+0000","last_fullsized":"2026-02-23T13:16:31.692156+0000","mapping_epoch":96,"log_start":"111'45792","ondisk_log_start":"111'45792","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'34863","last_scrub_stamp":"2026-02-23T13:16:04.164237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:04.164237+0000","objects_scrubbed":34093,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:14.024939+0000","scrub_duration":3016,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2300772352,"num_objects":35107,"num_object_clones":0,"num_object_copies":105321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35107,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45795,"num_write_kb":2588864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"111'46327","reported_seq":46783,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:31.839330+0000","last_change":"2026-02-23T13:16:22.619866+0000","last_active":"2026-02-23T13:16:31.839330+0000","last_peered":"2026-02-23T13:16:31.839330+0000","last_clean":"2026-02-23T13:16:31.839330+0000","last_became_active":"2026-02-23T13:14:49.710193+0000","last_became_peered":"2026-02-23T13:14:49.710193+0000","last_unstale":"2026-02-23T13:16:31.839330+0000","last_undegraded":"2026-02-23T13:16:31.839330+0000","last_fullsized":"2026-02-23T13:16:31.839330+0000","mapping_epoch":96,"log_start":"111'46324","ondisk_log_start":"111'46324","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'41143","last_scrub_stamp":"2026-02-23T13:16:22.619816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:22.619816+0000","objects_scrubbed":40610,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:26.460041+0000","scrub_duration":5359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2316632064,"num_objects":35349,"num_object_clones":0,"num_object_copies":106047,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35349,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46327,"num_write_kb":2613632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"111'45829","reported_seq":46277,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:31.714008+0000","last_change":"2026-02-23T13:16:20.211692+0000","last_active":"2026-02-23T13:16:31.714008+0000","last_peered":"2026-02-23T13:16:31.714008+0000","last_clean":"2026-02-23T13:16:31.714008+0000","last_became_active":"2026-02-23T13:14:49.709781+0000","last_became_peered":"2026-02-23T13:14:49.709781+0000","last_unstale":"2026-02-23T13:16:31.714008+0000","last_undegraded":"2026-02-23T13:16:31.714008+0000","last_fullsized":"2026-02-23T13:16:31.714008+0000","mapping_epoch":96,"log_start":"111'45826","ondisk_log_start":"111'45826","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40173","last_scrub_stamp":"2026-02-23T13:16:20.211648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:20.211648+0000","objects_scrubbed":39712,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:32.063367+0000","scrub_duration":3503,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2287271936,"num_objects":34901,"num_object_clones":0,"num_object_copies":104703,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34901,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45829,"num_write_kb":2583360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"111'45675","reported_seq":46106,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:31.688501+0000","last_change":"2026-02-23T13:16:16.274976+0000","last_active":"2026-02-23T13:16:31.688501+0000","last_peered":"2026-02-23T13:16:31.688501+0000","last_clean":"2026-02-23T13:16:31.688501+0000","last_became_active":"2026-02-23T13:14:49.709715+0000","last_became_peered":"2026-02-23T13:14:49.709715+0000","last_unstale":"2026-02-23T13:16:31.688501+0000","last_undegraded":"2026-02-23T13:16:31.688501+0000","last_fullsized":"2026-02-23T13:16:31.688501+0000","mapping_epoch":96,"log_start":"111'45672","ondisk_log_start":"111'45672","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38978","last_scrub_stamp":"2026-02-23T13:16:16.274911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:16.274911+0000","objects_scrubbed":38345,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:18.192168+0000","scrub_duration":4034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2289893376,"num_objects":34941,"num_object_clones":0,"num_object_copies":104823,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34941,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45675,"num_write_kb":2579712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":436,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:37.760599+0000","last_change":"2026-02-23T13:15:25.299766+0000","last_active":"2026-02-23T13:15:37.760599+0000","last_peered":"2026-02-23T13:15:37.760599+0000","last_clean":"2026-02-23T13:15:37.760599+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:15:37.760599+0000","last_undegraded":"2026-02-23T13:15:37.760599+0000","last_fullsized":"2026-02-23T13:15:37.760599+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:15:25.299737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:15:25.299737+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:42.738354+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":36667129880,"num_objects":559497,"num_object_clones":0,"num_object_copies":1678491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":559497,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":733493,"num_write_kb":41375617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110015688704,"data_stored":110015676488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":50,"ondisk_log_size":50,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1681,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247973,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":24596784,"kb_used_data":22588188,"kb_used_omap":8,"kb_used_meta":2008567,"kb_avail":709406416,"statfs":{"total":751619276800,"available":726432169984,"internally_reserved":0,"allocated":23130304512,"data_stored":23129700113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8542,"internal_metadata":2056773282},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444200,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27608180,"kb_used_data":27238176,"kb_used_omap":11,"kb_used_meta":369972,"kb_avail":706395020,"statfs":{"total":751619276800,"available":723348500480,"internally_reserved":0,"allocated":27891892224,"data_stored":27891283753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11351,"internal_metadata":378852265},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575018,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32034992,"kb_used_data":31515100,"kb_used_omap":19,"kb_used_meta":519852,"kb_avail":701968208,"statfs":{"total":751619276800,"available":718815444992,"internally_reserved":0,"allocated":32271462400,"data_stored":32270857481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20333,"internal_metadata":532328595},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,4],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705835,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28667828,"kb_used_data":27296736,"kb_used_omap":6,"kb_used_meta":1371065,"kb_avail":705335372,"statfs":{"total":751619276800,"available":722263420928,"internally_reserved":0,"allocated":27951857664,"data_stored":27951249193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6569,"internal_metadata":1403971159},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1681,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27533643776,"data_stored":27533639704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32027250688,"data_stored":32027246616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27542294528,"data_stored":27542290456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":22912499712,"data_stored":22912499712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:16:36.285 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:16:36.286 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 351 2026-02-23T13:16:36.289 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:16:36 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:16:36] "GET /metrics HTTP/1.1" 200 4229 "" "Prometheus/3.6.0" 2026-02-23T13:16:36.436 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:36.560 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:16:36 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:16:36.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:16:36.568 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:36.566+0000 7f748aafb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:36.568 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:36.566+0000 7f748aafb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:36.714 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:16:36.757 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:16:36.947 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:36 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3999469945' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:16:36.947 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:36 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3620116767' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "351"} : dispatch 2026-02-23T13:16:38.139 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:16:38.164 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:37 trial046 ceph-mon[38575]: from='client.15604 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:16:38.164 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:37 trial046 ceph-mon[38575]: pgmap v495: 17 pgs: 17 active+clean; 33 GiB data, 104 GiB used, 2.6 TiB / 2.7 TiB avail; 85 B/s rd, 85 B/s wr, 9.09k op/s 2026-02-23T13:16:38.297 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:38.676 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:38.638+0000 7fa29d068640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:38.676 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:38.638+0000 7fa29d068640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:38.676 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:16:38.676 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:16:38.677 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:16:38.677 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:16:38.686 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:16:38.687 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:16:38.700 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:16:38.701 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:16:39.025 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:38 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3249144083' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:16:40.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:39 trial046 ceph-mon[38575]: pgmap v496: 17 pgs: 17 active+clean; 31 GiB data, 99 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 9.28k op/s 2026-02-23T13:16:41.350 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:16:41.498 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:41.619 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:41.617+0000 7fd500a3b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:41.620 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:41.618+0000 7fd500a3b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:41.634 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:16:41.634 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:16:41.648 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:16:41.648 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:16:41.661 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:16:41.661 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:16:41.674 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:16:41.674 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:16:41.758 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:16:41.758 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:16:41.758 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:16:41.759 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:16:41.909 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:41.935 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:41 trial046 ceph-mon[38575]: pgmap v497: 17 pgs: 17 active+clean; 31 GiB data, 99 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 7.59k op/s 2026-02-23T13:16:41.935 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:41 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3039907491' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:16:42.036 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:42.034+0000 7f97d4c6a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:42.036 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:42.035+0000 7f97d4c6a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:42.177 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:16:42.178 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:16:42.224 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":497,"stamp":"2026-02-23T13:16:40.702099+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":33766703672,"num_objects":515233,"num_object_clones":0,"num_object_copies":1545699,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":515233,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":777894,"num_write_kb":41377767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":104248904,"kb_used_data":99997240,"kb_used_omap":46,"kb_used_meta":4251473,"kb_avail":2831763896,"statfs":{"total":3006477107200,"available":2899726229504,"internally_reserved":0,"allocated":102397173760,"data_stored":102394747500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47884,"internal_metadata":4353508596},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9,4],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5969543168,"num_objects":-91088,"num_object_clones":0,"num_object_copies":-273264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-91088,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91088,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001710"},"pg_stats":[{"pgid":"6.f","version":"111'48800","reported_seq":49252,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:36.843341+0000","last_change":"2026-02-23T13:16:23.280934+0000","last_active":"2026-02-23T13:16:36.843341+0000","last_peered":"2026-02-23T13:16:36.843341+0000","last_clean":"2026-02-23T13:16:36.843341+0000","last_became_active":"2026-02-23T13:14:49.710909+0000","last_became_peered":"2026-02-23T13:14:49.710909+0000","last_unstale":"2026-02-23T13:16:36.843341+0000","last_undegraded":"2026-02-23T13:16:36.843341+0000","last_fullsized":"2026-02-23T13:16:36.843341+0000","mapping_epoch":96,"log_start":"111'48797","ondisk_log_start":"111'48797","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'41083","last_scrub_stamp":"2026-02-23T13:16:23.280817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:23.280817+0000","objects_scrubbed":40316,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:26.278733+0000","scrub_duration":4030,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2109079552,"num_objects":32182,"num_object_clones":0,"num_object_copies":96546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32182,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48800,"num_write_kb":2591424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"111'48704","reported_seq":49076,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:36.697232+0000","last_change":"2026-02-23T13:16:00.821994+0000","last_active":"2026-02-23T13:16:36.697232+0000","last_peered":"2026-02-23T13:16:36.697232+0000","last_clean":"2026-02-23T13:16:36.697232+0000","last_became_active":"2026-02-23T13:14:49.710608+0000","last_became_peered":"2026-02-23T13:14:49.710608+0000","last_unstale":"2026-02-23T13:16:36.697232+0000","last_undegraded":"2026-02-23T13:16:36.697232+0000","last_fullsized":"2026-02-23T13:16:36.697232+0000","mapping_epoch":96,"log_start":"111'48701","ondisk_log_start":"111'48701","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'33186","last_scrub_stamp":"2026-02-23T13:16:00.821941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:00.821941+0000","objects_scrubbed":32277,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:02.918773+0000","scrub_duration":3732,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2112356352,"num_objects":32232,"num_object_clones":0,"num_object_copies":96696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32232,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48704,"num_write_kb":2589952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"111'48472","reported_seq":48917,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:36.698158+0000","last_change":"2026-02-23T13:16:20.125449+0000","last_active":"2026-02-23T13:16:36.698158+0000","last_peered":"2026-02-23T13:16:36.698158+0000","last_clean":"2026-02-23T13:16:36.698158+0000","last_became_active":"2026-02-23T13:14:49.710759+0000","last_became_peered":"2026-02-23T13:14:49.710759+0000","last_unstale":"2026-02-23T13:16:36.698158+0000","last_undegraded":"2026-02-23T13:16:36.698158+0000","last_fullsized":"2026-02-23T13:16:36.698158+0000","mapping_epoch":96,"log_start":"111'48469","ondisk_log_start":"111'48469","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40044","last_scrub_stamp":"2026-02-23T13:16:20.125397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:20.125397+0000","objects_scrubbed":39489,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:35.607693+0000","scrub_duration":4187,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2099183640,"num_objects":32032,"num_object_clones":0,"num_object_copies":96096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32032,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":48472,"num_write_kb":2576065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"111'49042","reported_seq":49464,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:36.846763+0000","last_change":"2026-02-23T13:16:12.911605+0000","last_active":"2026-02-23T13:16:36.846763+0000","last_peered":"2026-02-23T13:16:36.846763+0000","last_clean":"2026-02-23T13:16:36.846763+0000","last_became_active":"2026-02-23T13:14:49.710648+0000","last_became_peered":"2026-02-23T13:14:49.710648+0000","last_unstale":"2026-02-23T13:16:36.846763+0000","last_undegraded":"2026-02-23T13:16:36.846763+0000","last_fullsized":"2026-02-23T13:16:36.846763+0000","mapping_epoch":96,"log_start":"111'49039","ondisk_log_start":"111'49039","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38184","last_scrub_stamp":"2026-02-23T13:16:12.911442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:12.911442+0000","objects_scrubbed":37197,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:25.172701+0000","scrub_duration":5652,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2130051072,"num_objects":32502,"num_object_clones":0,"num_object_copies":97506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32502,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49042,"num_write_kb":2609408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"111'48624","reported_seq":49053,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:36.841976+0000","last_change":"2026-02-23T13:16:14.901799+0000","last_active":"2026-02-23T13:16:36.841976+0000","last_peered":"2026-02-23T13:16:36.841976+0000","last_clean":"2026-02-23T13:16:36.841976+0000","last_became_active":"2026-02-23T13:14:49.709875+0000","last_became_peered":"2026-02-23T13:14:49.709875+0000","last_unstale":"2026-02-23T13:16:36.841976+0000","last_undegraded":"2026-02-23T13:16:36.841976+0000","last_fullsized":"2026-02-23T13:16:36.841976+0000","mapping_epoch":96,"log_start":"111'48621","ondisk_log_start":"111'48621","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38474","last_scrub_stamp":"2026-02-23T13:16:14.901765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.901765+0000","objects_scrubbed":37818,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:23.823920+0000","scrub_duration":4577,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2106064896,"num_objects":32136,"num_object_clones":0,"num_object_copies":96408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32136,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48624,"num_write_kb":2584320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"111'48826","reported_seq":49275,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:36.697138+0000","last_change":"2026-02-23T13:16:20.991460+0000","last_active":"2026-02-23T13:16:36.697138+0000","last_peered":"2026-02-23T13:16:36.697138+0000","last_clean":"2026-02-23T13:16:36.697138+0000","last_became_active":"2026-02-23T13:14:49.709618+0000","last_became_peered":"2026-02-23T13:14:49.709618+0000","last_unstale":"2026-02-23T13:16:36.697138+0000","last_undegraded":"2026-02-23T13:16:36.697138+0000","last_fullsized":"2026-02-23T13:16:36.697138+0000","mapping_epoch":96,"log_start":"111'48823","ondisk_log_start":"111'48823","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40588","last_scrub_stamp":"2026-02-23T13:16:20.991398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:20.991398+0000","objects_scrubbed":40089,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:21.036471+0000","scrub_duration":4040,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2120089600,"num_objects":32350,"num_object_clones":0,"num_object_copies":97050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32350,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48826,"num_write_kb":2597632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"111'48172","reported_seq":48622,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:36.712990+0000","last_change":"2026-02-23T13:16:23.670756+0000","last_active":"2026-02-23T13:16:36.712990+0000","last_peered":"2026-02-23T13:16:36.712990+0000","last_clean":"2026-02-23T13:16:36.712990+0000","last_became_active":"2026-02-23T13:14:49.711647+0000","last_became_peered":"2026-02-23T13:14:49.711647+0000","last_unstale":"2026-02-23T13:16:36.712990+0000","last_undegraded":"2026-02-23T13:16:36.712990+0000","last_fullsized":"2026-02-23T13:16:36.712990+0000","mapping_epoch":96,"log_start":"111'48169","ondisk_log_start":"111'48169","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40918","last_scrub_stamp":"2026-02-23T13:16:23.670714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:23.670714+0000","objects_scrubbed":39913,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:29.633725+0000","scrub_duration":5904,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2103967744,"num_objects":32104,"num_object_clones":0,"num_object_copies":96312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32104,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48172,"num_write_kb":2568832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"111'48008","reported_seq":48432,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:36.689819+0000","last_change":"2026-02-23T13:16:14.478890+0000","last_active":"2026-02-23T13:16:36.689819+0000","last_peered":"2026-02-23T13:16:36.689819+0000","last_clean":"2026-02-23T13:16:36.689819+0000","last_became_active":"2026-02-23T13:14:49.710064+0000","last_became_peered":"2026-02-23T13:14:49.710064+0000","last_unstale":"2026-02-23T13:16:36.689819+0000","last_undegraded":"2026-02-23T13:16:36.689819+0000","last_fullsized":"2026-02-23T13:16:36.689819+0000","mapping_epoch":96,"log_start":"111'48005","ondisk_log_start":"111'48005","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'37982","last_scrub_stamp":"2026-02-23T13:16:14.478836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.478836+0000","objects_scrubbed":37503,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:35.874054+0000","scrub_duration":3268,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2095841280,"num_objects":31980,"num_object_clones":0,"num_object_copies":95940,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31980,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48008,"num_write_kb":2559616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"111'48524","reported_seq":48963,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:36.843230+0000","last_change":"2026-02-23T13:16:18.449205+0000","last_active":"2026-02-23T13:16:36.843230+0000","last_peered":"2026-02-23T13:16:36.843230+0000","last_clean":"2026-02-23T13:16:36.843230+0000","last_became_active":"2026-02-23T13:14:49.711227+0000","last_became_peered":"2026-02-23T13:14:49.711227+0000","last_unstale":"2026-02-23T13:16:36.843230+0000","last_undegraded":"2026-02-23T13:16:36.843230+0000","last_fullsized":"2026-02-23T13:16:36.843230+0000","mapping_epoch":96,"log_start":"111'48521","ondisk_log_start":"111'48521","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'39520","last_scrub_stamp":"2026-02-23T13:16:18.449176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:18.449176+0000","objects_scrubbed":38818,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:46.860861+0000","scrub_duration":4228,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2095054848,"num_objects":31968,"num_object_clones":0,"num_object_copies":95904,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31968,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48524,"num_write_kb":2575744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"111'48816","reported_seq":49230,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:36.699031+0000","last_change":"2026-02-23T13:16:09.977947+0000","last_active":"2026-02-23T13:16:36.699031+0000","last_peered":"2026-02-23T13:16:36.699031+0000","last_clean":"2026-02-23T13:16:36.699031+0000","last_became_active":"2026-02-23T13:14:49.710282+0000","last_became_peered":"2026-02-23T13:14:49.710282+0000","last_unstale":"2026-02-23T13:16:36.699031+0000","last_undegraded":"2026-02-23T13:16:36.699031+0000","last_fullsized":"2026-02-23T13:16:36.699031+0000","mapping_epoch":96,"log_start":"111'48813","ondisk_log_start":"111'48813","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'37114","last_scrub_stamp":"2026-02-23T13:16:09.977889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:09.977889+0000","objects_scrubbed":36647,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:17.287339+0000","scrub_duration":2946,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2111307776,"num_objects":32216,"num_object_clones":0,"num_object_copies":96648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32216,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48816,"num_write_kb":2593024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"111'48699","reported_seq":49127,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:36.845994+0000","last_change":"2026-02-23T13:16:14.521114+0000","last_active":"2026-02-23T13:16:36.845994+0000","last_peered":"2026-02-23T13:16:36.845994+0000","last_clean":"2026-02-23T13:16:36.845994+0000","last_became_active":"2026-02-23T13:14:49.710940+0000","last_became_peered":"2026-02-23T13:14:49.710940+0000","last_unstale":"2026-02-23T13:16:36.845994+0000","last_undegraded":"2026-02-23T13:16:36.845994+0000","last_fullsized":"2026-02-23T13:16:36.845994+0000","mapping_epoch":96,"log_start":"111'48696","ondisk_log_start":"111'48696","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38521","last_scrub_stamp":"2026-02-23T13:16:14.521031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.521031+0000","objects_scrubbed":37865,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:27.481651+0000","scrub_duration":5257,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2117795840,"num_objects":32315,"num_object_clones":0,"num_object_copies":96945,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32315,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48699,"num_write_kb":2592448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"111'48325","reported_seq":48750,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:36.696783+0000","last_change":"2026-02-23T13:16:14.247596+0000","last_active":"2026-02-23T13:16:36.696783+0000","last_peered":"2026-02-23T13:16:36.696783+0000","last_clean":"2026-02-23T13:16:36.696783+0000","last_became_active":"2026-02-23T13:14:49.708668+0000","last_became_peered":"2026-02-23T13:14:49.708668+0000","last_unstale":"2026-02-23T13:16:36.696783+0000","last_undegraded":"2026-02-23T13:16:36.696783+0000","last_fullsized":"2026-02-23T13:16:36.696783+0000","mapping_epoch":96,"log_start":"111'48322","ondisk_log_start":"111'48322","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38121","last_scrub_stamp":"2026-02-23T13:16:14.247558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.247558+0000","objects_scrubbed":37453,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:30.117734+0000","scrub_duration":4283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2099576832,"num_objects":32037,"num_object_clones":0,"num_object_copies":96111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32037,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48325,"num_write_kb":2571584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"111'48658","reported_seq":49050,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:36.692872+0000","last_change":"2026-02-23T13:16:04.164271+0000","last_active":"2026-02-23T13:16:36.692872+0000","last_peered":"2026-02-23T13:16:36.692872+0000","last_clean":"2026-02-23T13:16:36.692872+0000","last_became_active":"2026-02-23T13:14:49.709202+0000","last_became_peered":"2026-02-23T13:14:49.709202+0000","last_unstale":"2026-02-23T13:16:36.692872+0000","last_undegraded":"2026-02-23T13:16:36.692872+0000","last_fullsized":"2026-02-23T13:16:36.692872+0000","mapping_epoch":96,"log_start":"111'48655","ondisk_log_start":"111'48655","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'34863","last_scrub_stamp":"2026-02-23T13:16:04.164237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:04.164237+0000","objects_scrubbed":34093,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:14.024939+0000","scrub_duration":3016,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2113142784,"num_objects":32244,"num_object_clones":0,"num_object_copies":96732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32244,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48658,"num_write_kb":2588864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"111'49092","reported_seq":49548,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:36.846144+0000","last_change":"2026-02-23T13:16:22.619866+0000","last_active":"2026-02-23T13:16:36.846144+0000","last_peered":"2026-02-23T13:16:36.846144+0000","last_clean":"2026-02-23T13:16:36.846144+0000","last_became_active":"2026-02-23T13:14:49.710193+0000","last_became_peered":"2026-02-23T13:14:49.710193+0000","last_unstale":"2026-02-23T13:16:36.846144+0000","last_undegraded":"2026-02-23T13:16:36.846144+0000","last_fullsized":"2026-02-23T13:16:36.846144+0000","mapping_epoch":96,"log_start":"111'49089","ondisk_log_start":"111'49089","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'41143","last_scrub_stamp":"2026-02-23T13:16:22.619816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:22.619816+0000","objects_scrubbed":40610,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:26.460041+0000","scrub_duration":5359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2135425024,"num_objects":32584,"num_object_clones":0,"num_object_copies":97752,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32584,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49092,"num_write_kb":2613632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"111'48629","reported_seq":49077,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:36.713896+0000","last_change":"2026-02-23T13:16:20.211692+0000","last_active":"2026-02-23T13:16:36.713896+0000","last_peered":"2026-02-23T13:16:36.713896+0000","last_clean":"2026-02-23T13:16:36.713896+0000","last_became_active":"2026-02-23T13:14:49.709781+0000","last_became_peered":"2026-02-23T13:14:49.709781+0000","last_unstale":"2026-02-23T13:16:36.713896+0000","last_undegraded":"2026-02-23T13:16:36.713896+0000","last_fullsized":"2026-02-23T13:16:36.713896+0000","mapping_epoch":96,"log_start":"111'48626","ondisk_log_start":"111'48626","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40173","last_scrub_stamp":"2026-02-23T13:16:20.211648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:20.211648+0000","objects_scrubbed":39712,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:32.063367+0000","scrub_duration":3503,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2103771136,"num_objects":32101,"num_object_clones":0,"num_object_copies":96303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32101,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48629,"num_write_kb":2583360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"111'48368","reported_seq":48799,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:36.692269+0000","last_change":"2026-02-23T13:16:16.274976+0000","last_active":"2026-02-23T13:16:36.692269+0000","last_peered":"2026-02-23T13:16:36.692269+0000","last_clean":"2026-02-23T13:16:36.692269+0000","last_became_active":"2026-02-23T13:14:49.709715+0000","last_became_peered":"2026-02-23T13:14:49.709715+0000","last_unstale":"2026-02-23T13:16:36.692269+0000","last_undegraded":"2026-02-23T13:16:36.692269+0000","last_fullsized":"2026-02-23T13:16:36.692269+0000","mapping_epoch":96,"log_start":"111'48365","ondisk_log_start":"111'48365","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38978","last_scrub_stamp":"2026-02-23T13:16:16.274911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:16.274911+0000","objects_scrubbed":38345,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:18.192168+0000","scrub_duration":4034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2113404928,"num_objects":32248,"num_object_clones":0,"num_object_copies":96744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32248,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48368,"num_write_kb":2579712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":436,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:15:37.760599+0000","last_change":"2026-02-23T13:15:25.299766+0000","last_active":"2026-02-23T13:15:37.760599+0000","last_peered":"2026-02-23T13:15:37.760599+0000","last_clean":"2026-02-23T13:15:37.760599+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:15:37.760599+0000","last_undegraded":"2026-02-23T13:15:37.760599+0000","last_fullsized":"2026-02-23T13:15:37.760599+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:15:25.299737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:15:25.299737+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:16:42.738354+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":33766113304,"num_objects":515231,"num_object_clones":0,"num_object_copies":1545693,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":515231,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":777759,"num_write_kb":41375617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":101309820928,"data_stored":101309808712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1681,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247974,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":22561776,"kb_used_data":20751644,"kb_used_omap":9,"kb_used_meta":1810102,"kb_avail":711441424,"statfs":{"total":751619276800,"available":728516018176,"internally_reserved":0,"allocated":21249683456,"data_stored":21249079057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9631,"internal_metadata":1853545057},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444201,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":25453044,"kb_used_data":25028832,"kb_used_omap":11,"kb_used_meta":424116,"kb_avail":708550156,"statfs":{"total":751619276800,"available":725555359744,"internally_reserved":0,"allocated":25629523968,"data_stored":25628915497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11351,"internal_metadata":434295721},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575019,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":29621360,"kb_used_data":29047324,"kb_used_omap":19,"kb_used_meta":573996,"kb_avail":704381840,"statfs":{"total":751619276800,"available":721287004160,"internally_reserved":0,"allocated":29744459776,"data_stored":29743854857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20333,"internal_metadata":587772051},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705836,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":26612724,"kb_used_data":25169440,"kb_used_omap":6,"kb_used_meta":1443257,"kb_avail":707390476,"statfs":{"total":751619276800,"available":724367847424,"internally_reserved":0,"allocated":25773506560,"data_stored":25772898089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6569,"internal_metadata":1477895767},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1681,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25352343552,"data_stored":25352339480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29496905728,"data_stored":29496901656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25355227136,"data_stored":25355223064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21105344512,"data_stored":21105344512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:16:42.226 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:16:42.226 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 361 2026-02-23T13:16:42.379 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:42.511 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:42.509+0000 7f8a69dcc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:42.511 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:42.509+0000 7f8a69dcc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:42.651 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:16:42.693 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:16:43.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:42 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2327472905' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "361"} : dispatch 2026-02-23T13:16:43.721 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:16:43.868 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:43.989 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:43.986+0000 7f9917b6e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:43.989 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:43.987+0000 7f9917b6e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:44.004 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:16:44.005 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:16:44.005 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:43 trial046 ceph-mon[38575]: from='client.15612 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:16:44.005 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:43 trial046 ceph-mon[38575]: pgmap v498: 17 pgs: 17 active+clean; 29 GiB data, 92 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 11.12k op/s 2026-02-23T13:16:44.005 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:43 trial046 ceph-mon[38575]: 1.0 scrub starts 2026-02-23T13:16:44.005 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:43 trial046 ceph-mon[38575]: 1.0 scrub ok 2026-02-23T13:16:44.020 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:16:44.020 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:16:44.034 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:16:44.034 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:16:44.047 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:16:44.047 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:16:45.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:44 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4225474103' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:16:46.087 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:45 trial046 ceph-mon[38575]: pgmap v499: 17 pgs: 17 active+clean; 29 GiB data, 92 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 7.22k op/s 2026-02-23T13:16:46.090 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:16:46.233 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:46.351 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:16:46 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:16:46] "GET /metrics HTTP/1.1" 200 4224 "" "Prometheus/3.6.0" 2026-02-23T13:16:46.469 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:16:46 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:16:46.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:16:46.562 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:46.554+0000 7fd449ebf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:46.562 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:46.555+0000 7fd449ebf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:46.575 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:16:46.575 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:16:46.590 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:16:46.590 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:16:46.603 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:16:46.603 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:16:46.615 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:16:46.615 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:16:47.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:46 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:16:47.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:46 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2588891061' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:16:47.694 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:16:47.694 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:16:47.695 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_4 2026-02-23T13:16:47.695 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:16:47.842 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:48.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:47 trial046 ceph-mon[38575]: pgmap v500: 17 pgs: 17 active+clean; 28 GiB data, 88 GiB used, 2.6 TiB / 2.7 TiB avail; 0 B/s wr, 9.05k op/s 2026-02-23T13:16:48.179 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:48.174+0000 7fe1165df640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:48.179 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:48.174+0000 7fe1165df640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:48.322 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:16:48.323 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:16:48.884 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":500,"stamp":"2026-02-23T13:16:46.702894+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29547102776,"num_objects":450847,"num_object_clones":0,"num_object_copies":1352541,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":450847,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":842280,"num_write_kb":41377767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":92125256,"kb_used_data":87494648,"kb_used_omap":46,"kb_used_meta":4630481,"kb_avail":2843887544,"statfs":{"total":3006477107200,"available":2912140845056,"internally_reserved":0,"allocated":89594519552,"data_stored":89592093292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47946,"internal_metadata":4741612726},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7120617472,"num_objects":-108652,"num_object_clones":0,"num_object_copies":-325956,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-108652,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108652,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001624"},"pg_stats":[{"pgid":"6.f","version":"111'51561","reported_seq":52011,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:41.846662+0000","last_change":"2026-02-23T13:16:23.280934+0000","last_active":"2026-02-23T13:16:41.846662+0000","last_peered":"2026-02-23T13:16:41.846662+0000","last_clean":"2026-02-23T13:16:41.846662+0000","last_became_active":"2026-02-23T13:14:49.710909+0000","last_became_peered":"2026-02-23T13:14:49.710909+0000","last_unstale":"2026-02-23T13:16:41.846662+0000","last_undegraded":"2026-02-23T13:16:41.846662+0000","last_fullsized":"2026-02-23T13:16:41.846662+0000","mapping_epoch":96,"log_start":"111'51558","ondisk_log_start":"111'51558","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'41083","last_scrub_stamp":"2026-02-23T13:16:23.280817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:23.280817+0000","objects_scrubbed":40316,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:26.278733+0000","scrub_duration":4030,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1928134656,"num_objects":29421,"num_object_clones":0,"num_object_copies":88263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29421,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51561,"num_write_kb":2591424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"111'54139","reported_seq":54511,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:46.700316+0000","last_change":"2026-02-23T13:16:00.821994+0000","last_active":"2026-02-23T13:16:46.700316+0000","last_peered":"2026-02-23T13:16:46.700316+0000","last_clean":"2026-02-23T13:16:46.700316+0000","last_became_active":"2026-02-23T13:14:49.710608+0000","last_became_peered":"2026-02-23T13:14:49.710608+0000","last_unstale":"2026-02-23T13:16:46.700316+0000","last_undegraded":"2026-02-23T13:16:46.700316+0000","last_fullsized":"2026-02-23T13:16:46.700316+0000","mapping_epoch":96,"log_start":"111'54136","ondisk_log_start":"111'54136","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'33186","last_scrub_stamp":"2026-02-23T13:16:00.821941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:00.821941+0000","objects_scrubbed":32277,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:02.918773+0000","scrub_duration":3732,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1756168192,"num_objects":26797,"num_object_clones":0,"num_object_copies":80391,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26797,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54139,"num_write_kb":2589952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"111'53904","reported_seq":54349,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:46.694700+0000","last_change":"2026-02-23T13:16:20.125449+0000","last_active":"2026-02-23T13:16:46.694700+0000","last_peered":"2026-02-23T13:16:46.694700+0000","last_clean":"2026-02-23T13:16:46.694700+0000","last_became_active":"2026-02-23T13:14:49.710759+0000","last_became_peered":"2026-02-23T13:14:49.710759+0000","last_unstale":"2026-02-23T13:16:46.694700+0000","last_undegraded":"2026-02-23T13:16:46.694700+0000","last_fullsized":"2026-02-23T13:16:46.694700+0000","mapping_epoch":96,"log_start":"111'53901","ondisk_log_start":"111'53901","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40044","last_scrub_stamp":"2026-02-23T13:16:20.125397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:20.125397+0000","objects_scrubbed":39489,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:35.607693+0000","scrub_duration":4187,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1743192088,"num_objects":26600,"num_object_clones":0,"num_object_copies":79800,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26600,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":53904,"num_write_kb":2576065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"111'51706","reported_seq":52128,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:41.841324+0000","last_change":"2026-02-23T13:16:12.911605+0000","last_active":"2026-02-23T13:16:41.841324+0000","last_peered":"2026-02-23T13:16:41.841324+0000","last_clean":"2026-02-23T13:16:41.841324+0000","last_became_active":"2026-02-23T13:14:49.710648+0000","last_became_peered":"2026-02-23T13:14:49.710648+0000","last_unstale":"2026-02-23T13:16:41.841324+0000","last_undegraded":"2026-02-23T13:16:41.841324+0000","last_fullsized":"2026-02-23T13:16:41.841324+0000","mapping_epoch":96,"log_start":"111'51703","ondisk_log_start":"111'51703","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38184","last_scrub_stamp":"2026-02-23T13:16:12.911442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:12.911442+0000","objects_scrubbed":37197,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:25.172701+0000","scrub_duration":5652,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1955463168,"num_objects":29838,"num_object_clones":0,"num_object_copies":89514,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29838,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51706,"num_write_kb":2609408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"111'51209","reported_seq":51638,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:41.846552+0000","last_change":"2026-02-23T13:16:14.901799+0000","last_active":"2026-02-23T13:16:41.846552+0000","last_peered":"2026-02-23T13:16:41.846552+0000","last_clean":"2026-02-23T13:16:41.846552+0000","last_became_active":"2026-02-23T13:14:49.709875+0000","last_became_peered":"2026-02-23T13:14:49.709875+0000","last_unstale":"2026-02-23T13:16:41.846552+0000","last_undegraded":"2026-02-23T13:16:41.846552+0000","last_fullsized":"2026-02-23T13:16:41.846552+0000","mapping_epoch":96,"log_start":"111'51206","ondisk_log_start":"111'51206","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38474","last_scrub_stamp":"2026-02-23T13:16:14.901765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.901765+0000","objects_scrubbed":37818,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:23.823920+0000","scrub_duration":4577,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1936654336,"num_objects":29551,"num_object_clones":0,"num_object_copies":88653,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29551,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51209,"num_write_kb":2584320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"111'54257","reported_seq":54705,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:46.698399+0000","last_change":"2026-02-23T13:16:20.991460+0000","last_active":"2026-02-23T13:16:46.698399+0000","last_peered":"2026-02-23T13:16:46.698399+0000","last_clean":"2026-02-23T13:16:46.698399+0000","last_became_active":"2026-02-23T13:14:49.709618+0000","last_became_peered":"2026-02-23T13:14:49.709618+0000","last_unstale":"2026-02-23T13:16:46.698399+0000","last_undegraded":"2026-02-23T13:16:46.698399+0000","last_fullsized":"2026-02-23T13:16:46.698399+0000","mapping_epoch":96,"log_start":"111'54254","ondisk_log_start":"111'54254","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40588","last_scrub_stamp":"2026-02-23T13:16:20.991398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:20.991398+0000","objects_scrubbed":40089,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:21.036471+0000","scrub_duration":4040,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1764163584,"num_objects":26919,"num_object_clones":0,"num_object_copies":80757,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26919,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54257,"num_write_kb":2597632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"111'50844","reported_seq":51294,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:41.712711+0000","last_change":"2026-02-23T13:16:23.670756+0000","last_active":"2026-02-23T13:16:41.712711+0000","last_peered":"2026-02-23T13:16:41.712711+0000","last_clean":"2026-02-23T13:16:41.712711+0000","last_became_active":"2026-02-23T13:14:49.711647+0000","last_became_peered":"2026-02-23T13:14:49.711647+0000","last_unstale":"2026-02-23T13:16:41.712711+0000","last_undegraded":"2026-02-23T13:16:41.712711+0000","last_fullsized":"2026-02-23T13:16:41.712711+0000","mapping_epoch":96,"log_start":"111'50841","ondisk_log_start":"111'50841","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40918","last_scrub_stamp":"2026-02-23T13:16:23.670714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:23.670714+0000","objects_scrubbed":39913,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:29.633725+0000","scrub_duration":5904,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1928855552,"num_objects":29432,"num_object_clones":0,"num_object_copies":88296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29432,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50844,"num_write_kb":2568832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"111'53398","reported_seq":53822,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:46.690663+0000","last_change":"2026-02-23T13:16:14.478890+0000","last_active":"2026-02-23T13:16:46.690663+0000","last_peered":"2026-02-23T13:16:46.690663+0000","last_clean":"2026-02-23T13:16:46.690663+0000","last_became_active":"2026-02-23T13:14:49.710064+0000","last_became_peered":"2026-02-23T13:14:49.710064+0000","last_unstale":"2026-02-23T13:16:46.690663+0000","last_undegraded":"2026-02-23T13:16:46.690663+0000","last_fullsized":"2026-02-23T13:16:46.690663+0000","mapping_epoch":96,"log_start":"111'53395","ondisk_log_start":"111'53395","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'37982","last_scrub_stamp":"2026-02-23T13:16:14.478836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.478836+0000","objects_scrubbed":37503,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:35.874054+0000","scrub_duration":3268,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1742602240,"num_objects":26590,"num_object_clones":0,"num_object_copies":79770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26590,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53398,"num_write_kb":2559616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"111'51174","reported_seq":51613,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:41.843848+0000","last_change":"2026-02-23T13:16:18.449205+0000","last_active":"2026-02-23T13:16:41.843848+0000","last_peered":"2026-02-23T13:16:41.843848+0000","last_clean":"2026-02-23T13:16:41.843848+0000","last_became_active":"2026-02-23T13:14:49.711227+0000","last_became_peered":"2026-02-23T13:14:49.711227+0000","last_unstale":"2026-02-23T13:16:41.843848+0000","last_undegraded":"2026-02-23T13:16:41.843848+0000","last_fullsized":"2026-02-23T13:16:41.843848+0000","mapping_epoch":96,"log_start":"111'51171","ondisk_log_start":"111'51171","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'39520","last_scrub_stamp":"2026-02-23T13:16:18.449176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:18.449176+0000","objects_scrubbed":38818,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:46.860861+0000","scrub_duration":4228,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1921384448,"num_objects":29318,"num_object_clones":0,"num_object_copies":87954,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29318,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51174,"num_write_kb":2575744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"111'54305","reported_seq":54719,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:46.699680+0000","last_change":"2026-02-23T13:16:09.977947+0000","last_active":"2026-02-23T13:16:46.699680+0000","last_peered":"2026-02-23T13:16:46.699680+0000","last_clean":"2026-02-23T13:16:46.699680+0000","last_became_active":"2026-02-23T13:14:49.710282+0000","last_became_peered":"2026-02-23T13:14:49.710282+0000","last_unstale":"2026-02-23T13:16:46.699680+0000","last_undegraded":"2026-02-23T13:16:46.699680+0000","last_fullsized":"2026-02-23T13:16:46.699680+0000","mapping_epoch":96,"log_start":"111'54302","ondisk_log_start":"111'54302","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'37114","last_scrub_stamp":"2026-02-23T13:16:09.977889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:09.977889+0000","objects_scrubbed":36647,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:17.287339+0000","scrub_duration":2946,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1751580672,"num_objects":26727,"num_object_clones":0,"num_object_copies":80181,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26727,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54305,"num_write_kb":2593024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"111'51306","reported_seq":51735,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:41.843349+0000","last_change":"2026-02-23T13:16:14.521114+0000","last_active":"2026-02-23T13:16:41.843349+0000","last_peered":"2026-02-23T13:16:41.843349+0000","last_clean":"2026-02-23T13:16:41.843349+0000","last_became_active":"2026-02-23T13:14:49.710940+0000","last_became_peered":"2026-02-23T13:14:49.710940+0000","last_unstale":"2026-02-23T13:16:41.843349+0000","last_undegraded":"2026-02-23T13:16:41.843349+0000","last_fullsized":"2026-02-23T13:16:41.843349+0000","mapping_epoch":96,"log_start":"111'51303","ondisk_log_start":"111'51303","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38521","last_scrub_stamp":"2026-02-23T13:16:14.521031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.521031+0000","objects_scrubbed":37865,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:27.481651+0000","scrub_duration":5257,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1946943488,"num_objects":29708,"num_object_clones":0,"num_object_copies":89124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29708,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51306,"num_write_kb":2592448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"111'53558","reported_seq":53983,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:46.696905+0000","last_change":"2026-02-23T13:16:14.247596+0000","last_active":"2026-02-23T13:16:46.696905+0000","last_peered":"2026-02-23T13:16:46.696905+0000","last_clean":"2026-02-23T13:16:46.696905+0000","last_became_active":"2026-02-23T13:14:49.708668+0000","last_became_peered":"2026-02-23T13:14:49.708668+0000","last_unstale":"2026-02-23T13:16:46.696905+0000","last_undegraded":"2026-02-23T13:16:46.696905+0000","last_fullsized":"2026-02-23T13:16:46.696905+0000","mapping_epoch":96,"log_start":"111'53555","ondisk_log_start":"111'53555","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38121","last_scrub_stamp":"2026-02-23T13:16:14.247558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.247558+0000","objects_scrubbed":37453,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:30.117734+0000","scrub_duration":4283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1756626944,"num_objects":26804,"num_object_clones":0,"num_object_copies":80412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26804,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53558,"num_write_kb":2571584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"111'54177","reported_seq":54569,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:46.693397+0000","last_change":"2026-02-23T13:16:04.164271+0000","last_active":"2026-02-23T13:16:46.693397+0000","last_peered":"2026-02-23T13:16:46.693397+0000","last_clean":"2026-02-23T13:16:46.693397+0000","last_became_active":"2026-02-23T13:14:49.709202+0000","last_became_peered":"2026-02-23T13:14:49.709202+0000","last_unstale":"2026-02-23T13:16:46.693397+0000","last_undegraded":"2026-02-23T13:16:46.693397+0000","last_fullsized":"2026-02-23T13:16:46.693397+0000","mapping_epoch":96,"log_start":"111'54174","ondisk_log_start":"111'54174","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'34863","last_scrub_stamp":"2026-02-23T13:16:04.164237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:04.164237+0000","objects_scrubbed":34093,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:14.024939+0000","scrub_duration":3016,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1751449600,"num_objects":26725,"num_object_clones":0,"num_object_copies":80175,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26725,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54177,"num_write_kb":2588864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"111'51696","reported_seq":52152,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:41.844355+0000","last_change":"2026-02-23T13:16:22.619866+0000","last_active":"2026-02-23T13:16:41.844355+0000","last_peered":"2026-02-23T13:16:41.844355+0000","last_clean":"2026-02-23T13:16:41.844355+0000","last_became_active":"2026-02-23T13:14:49.710193+0000","last_became_peered":"2026-02-23T13:14:49.710193+0000","last_unstale":"2026-02-23T13:16:41.844355+0000","last_undegraded":"2026-02-23T13:16:41.844355+0000","last_fullsized":"2026-02-23T13:16:41.844355+0000","mapping_epoch":96,"log_start":"111'51693","ondisk_log_start":"111'51693","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'41143","last_scrub_stamp":"2026-02-23T13:16:22.619816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:22.619816+0000","objects_scrubbed":40610,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:26.460041+0000","scrub_duration":5359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1964769280,"num_objects":29980,"num_object_clones":0,"num_object_copies":89940,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29980,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51696,"num_write_kb":2613632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"111'51165","reported_seq":51613,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:41.712280+0000","last_change":"2026-02-23T13:16:20.211692+0000","last_active":"2026-02-23T13:16:41.712280+0000","last_peered":"2026-02-23T13:16:41.712280+0000","last_clean":"2026-02-23T13:16:41.712280+0000","last_became_active":"2026-02-23T13:14:49.709781+0000","last_became_peered":"2026-02-23T13:14:49.709781+0000","last_unstale":"2026-02-23T13:16:41.712280+0000","last_undegraded":"2026-02-23T13:16:41.712280+0000","last_fullsized":"2026-02-23T13:16:41.712280+0000","mapping_epoch":96,"log_start":"111'51162","ondisk_log_start":"111'51162","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40173","last_scrub_stamp":"2026-02-23T13:16:20.211648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:20.211648+0000","objects_scrubbed":39712,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:32.063367+0000","scrub_duration":3503,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1937571840,"num_objects":29565,"num_object_clones":0,"num_object_copies":88695,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29565,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51165,"num_write_kb":2583360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"111'53746","reported_seq":54177,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:46.692546+0000","last_change":"2026-02-23T13:16:16.274976+0000","last_active":"2026-02-23T13:16:46.692546+0000","last_peered":"2026-02-23T13:16:46.692546+0000","last_clean":"2026-02-23T13:16:46.692546+0000","last_became_active":"2026-02-23T13:14:49.709715+0000","last_became_peered":"2026-02-23T13:14:49.709715+0000","last_unstale":"2026-02-23T13:16:46.692546+0000","last_undegraded":"2026-02-23T13:16:46.692546+0000","last_fullsized":"2026-02-23T13:16:46.692546+0000","mapping_epoch":96,"log_start":"111'53743","ondisk_log_start":"111'53743","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38978","last_scrub_stamp":"2026-02-23T13:16:16.274911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:16.274911+0000","objects_scrubbed":38345,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:18.192168+0000","scrub_duration":4034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1760952320,"num_objects":26870,"num_object_clones":0,"num_object_copies":80610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26870,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53746,"num_write_kb":2579712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":444,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:43.312805+0000","last_change":"2026-02-23T13:16:43.312805+0000","last_active":"2026-02-23T13:16:43.312805+0000","last_peered":"2026-02-23T13:16:43.312805+0000","last_clean":"2026-02-23T13:16:43.312805+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:16:43.312805+0000","last_undegraded":"2026-02-23T13:16:43.312805+0000","last_fullsized":"2026-02-23T13:16:43.312805+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:16:43.312764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:16:43.312764+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:54.076451+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":29546512408,"num_objects":450845,"num_object_clones":0,"num_object_copies":1352535,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":450845,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":842145,"num_write_kb":41375617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":89021427712,"data_stored":89021415496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2157,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247976,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":19145072,"kb_used_data":17226652,"kb_used_omap":9,"kb_used_meta":1918390,"kb_avail":714858128,"statfs":{"total":751619276800,"available":732014723072,"internally_reserved":0,"allocated":17640091648,"data_stored":17639487249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9693,"internal_metadata":1964431907},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444203,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":21406324,"kb_used_data":20855840,"kb_used_omap":11,"kb_used_meta":550452,"kb_avail":712596876,"statfs":{"total":751619276800,"available":729699201024,"internally_reserved":0,"allocated":21356380160,"data_stored":21355771689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11351,"internal_metadata":563663785},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575020,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27318448,"kb_used_data":26672220,"kb_used_omap":19,"kb_used_meta":646188,"kb_avail":706684752,"statfs":{"total":751619276800,"available":723645186048,"internally_reserved":0,"allocated":27312353280,"data_stored":27311748361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20333,"internal_metadata":661696659},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705837,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":24255412,"kb_used_data":22739936,"kb_used_omap":6,"kb_used_meta":1515449,"kb_avail":709747788,"statfs":{"total":751619276800,"available":726781734912,"internally_reserved":0,"allocated":23285694464,"data_stored":23285085993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6569,"internal_metadata":1551820375},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2157,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23271378944,"data_stored":23271374872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27073777664,"data_stored":27073773592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21106724864,"data_stored":21106720792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17569546240,"data_stored":17569546240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:16:48.886 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:16:48.887 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_4 pg_num 96 2026-02-23T13:16:49.034 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:49.083 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:16:49.217 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:49.306 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:49.304+0000 7fbf97bb9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:49.306 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:49.304+0000 7fbf97bb9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:49.337 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:49.336+0000 7f552370f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:49.338 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:49.336+0000 7f552370f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:49.354 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:16:49.354 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:16:49.367 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:16:49.367 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:16:49.381 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:16:49.381 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:16:49.395 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:16:49.395 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:16:49.472 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:16:49.511 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:16:50.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:49 trial046 ceph-mon[38575]: from='client.15620 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:16:50.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:49 trial046 ceph-mon[38575]: pgmap v501: 17 pgs: 17 active+clean; 26 GiB data, 84 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 9.03k op/s 2026-02-23T13:16:50.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:49 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/106784703' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:16:50.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:49 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1462577487' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pg_num", "val": "96"} : dispatch 2026-02-23T13:16:51.441 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:16:51.589 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:51.709 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:51.707+0000 7f4d85e92640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:51.709 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:51.707+0000 7f4d85e92640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:51.722 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:16:51.722 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:16:51.735 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:16:51.735 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:16:51.750 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:16:51.750 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:16:51.763 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:16:51.763 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:16:52.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:51 trial046 ceph-mon[38575]: pgmap v502: 17 pgs: 17 active+clean; 26 GiB data, 84 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 7.19k op/s 2026-02-23T13:16:52.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:51 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1908444592' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:16:53.807 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:16:53.962 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:54.080 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:53 trial046 ceph-mon[38575]: pgmap v503: 17 pgs: 17 active+clean; 24 GiB data, 76 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 10.63k op/s 2026-02-23T13:16:54.094 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:54.092+0000 7f082f04d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:54.094 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:54.092+0000 7f082f04d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:54.108 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:16:54.108 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:16:54.121 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:16:54.121 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:16:54.137 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:16:54.137 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:16:54.152 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:16:54.152 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:16:54.512 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:16:54.513 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:16:54.513 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_4 2026-02-23T13:16:54.513 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:16:54.660 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:55.082 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:54 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2630248089' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:16:55.095 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:55.080+0000 7f62ac5f8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:55.095 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:55.080+0000 7f62ac5f8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:55.226 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:16:55.226 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:16:55.637 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":504,"stamp":"2026-02-23T13:16:54.703914+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":25403458104,"num_objects":387620,"num_object_clones":0,"num_object_copies":1162860,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":387620,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":905507,"num_write_kb":41377767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":80104840,"kb_used_data":75166328,"kb_used_omap":46,"kb_used_meta":4938065,"kb_avail":2855907960,"statfs":{"total":3006477107200,"available":2924449751040,"internally_reserved":0,"allocated":76970319872,"data_stored":76967893612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47946,"internal_metadata":5056578742},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5588123648,"num_objects":-85268,"num_object_clones":0,"num_object_copies":-255804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-85268,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85268,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001554"},"pg_stats":[{"pgid":"6.f","version":"111'56862","reported_seq":57314,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:51.868870+0000","last_change":"2026-02-23T13:16:23.280934+0000","last_active":"2026-02-23T13:16:51.868870+0000","last_peered":"2026-02-23T13:16:51.868870+0000","last_clean":"2026-02-23T13:16:51.868870+0000","last_became_active":"2026-02-23T13:14:49.710909+0000","last_became_peered":"2026-02-23T13:14:49.710909+0000","last_unstale":"2026-02-23T13:16:51.868870+0000","last_undegraded":"2026-02-23T13:16:51.868870+0000","last_fullsized":"2026-02-23T13:16:51.868870+0000","mapping_epoch":96,"log_start":"111'56859","ondisk_log_start":"111'56859","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'41083","last_scrub_stamp":"2026-02-23T13:16:23.280817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:23.280817+0000","objects_scrubbed":40316,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:26.278733+0000","scrub_duration":4030,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1580728320,"num_objects":24120,"num_object_clones":0,"num_object_copies":72360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24120,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56862,"num_write_kb":2591424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"111'56725","reported_seq":57097,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:51.693577+0000","last_change":"2026-02-23T13:16:00.821994+0000","last_active":"2026-02-23T13:16:51.693577+0000","last_peered":"2026-02-23T13:16:51.693577+0000","last_clean":"2026-02-23T13:16:51.693577+0000","last_became_active":"2026-02-23T13:14:49.710608+0000","last_became_peered":"2026-02-23T13:14:49.710608+0000","last_unstale":"2026-02-23T13:16:51.693577+0000","last_undegraded":"2026-02-23T13:16:51.693577+0000","last_fullsized":"2026-02-23T13:16:51.693577+0000","mapping_epoch":96,"log_start":"111'56722","ondisk_log_start":"111'56722","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'33186","last_scrub_stamp":"2026-02-23T13:16:00.821941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:00.821941+0000","objects_scrubbed":32277,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:02.918773+0000","scrub_duration":3732,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1586692096,"num_objects":24211,"num_object_clones":0,"num_object_copies":72633,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24211,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56725,"num_write_kb":2589952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"111'56437","reported_seq":56882,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:51.699584+0000","last_change":"2026-02-23T13:16:20.125449+0000","last_active":"2026-02-23T13:16:51.699584+0000","last_peered":"2026-02-23T13:16:51.699584+0000","last_clean":"2026-02-23T13:16:51.699584+0000","last_became_active":"2026-02-23T13:14:49.710759+0000","last_became_peered":"2026-02-23T13:14:49.710759+0000","last_unstale":"2026-02-23T13:16:51.699584+0000","last_undegraded":"2026-02-23T13:16:51.699584+0000","last_fullsized":"2026-02-23T13:16:51.699584+0000","mapping_epoch":96,"log_start":"111'56434","ondisk_log_start":"111'56434","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40044","last_scrub_stamp":"2026-02-23T13:16:20.125397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:20.125397+0000","objects_scrubbed":39489,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:35.607693+0000","scrub_duration":4187,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1577189400,"num_objects":24067,"num_object_clones":0,"num_object_copies":72201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24067,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":56437,"num_write_kb":2576065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"111'57122","reported_seq":57544,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:51.869195+0000","last_change":"2026-02-23T13:16:12.911605+0000","last_active":"2026-02-23T13:16:51.869195+0000","last_peered":"2026-02-23T13:16:51.869195+0000","last_clean":"2026-02-23T13:16:51.869195+0000","last_became_active":"2026-02-23T13:14:49.710648+0000","last_became_peered":"2026-02-23T13:14:49.710648+0000","last_unstale":"2026-02-23T13:16:51.869195+0000","last_undegraded":"2026-02-23T13:16:51.869195+0000","last_fullsized":"2026-02-23T13:16:51.869195+0000","mapping_epoch":96,"log_start":"111'57119","ondisk_log_start":"111'57119","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38184","last_scrub_stamp":"2026-02-23T13:16:12.911442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:12.911442+0000","objects_scrubbed":37197,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:25.172701+0000","scrub_duration":5652,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1600520192,"num_objects":24422,"num_object_clones":0,"num_object_copies":73266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24422,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57122,"num_write_kb":2609408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"111'56530","reported_seq":56959,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:51.869409+0000","last_change":"2026-02-23T13:16:14.901799+0000","last_active":"2026-02-23T13:16:51.869409+0000","last_peered":"2026-02-23T13:16:51.869409+0000","last_clean":"2026-02-23T13:16:51.869409+0000","last_became_active":"2026-02-23T13:14:49.709875+0000","last_became_peered":"2026-02-23T13:14:49.709875+0000","last_unstale":"2026-02-23T13:16:51.869409+0000","last_undegraded":"2026-02-23T13:16:51.869409+0000","last_fullsized":"2026-02-23T13:16:51.869409+0000","mapping_epoch":96,"log_start":"111'56527","ondisk_log_start":"111'56527","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38474","last_scrub_stamp":"2026-02-23T13:16:14.901765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.901765+0000","objects_scrubbed":37818,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:23.823920+0000","scrub_duration":4577,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1587937280,"num_objects":24230,"num_object_clones":0,"num_object_copies":72690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24230,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56530,"num_write_kb":2584320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"111'56897","reported_seq":57346,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:51.699507+0000","last_change":"2026-02-23T13:16:20.991460+0000","last_active":"2026-02-23T13:16:51.699507+0000","last_peered":"2026-02-23T13:16:51.699507+0000","last_clean":"2026-02-23T13:16:51.699507+0000","last_became_active":"2026-02-23T13:14:49.709618+0000","last_became_peered":"2026-02-23T13:14:49.709618+0000","last_unstale":"2026-02-23T13:16:51.699507+0000","last_undegraded":"2026-02-23T13:16:51.699507+0000","last_fullsized":"2026-02-23T13:16:51.699507+0000","mapping_epoch":96,"log_start":"111'56894","ondisk_log_start":"111'56894","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40588","last_scrub_stamp":"2026-02-23T13:16:20.991398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:20.991398+0000","objects_scrubbed":40089,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:21.036471+0000","scrub_duration":4040,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1591148544,"num_objects":24279,"num_object_clones":0,"num_object_copies":72837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24279,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56897,"num_write_kb":2597632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"111'56058","reported_seq":56507,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:51.716958+0000","last_change":"2026-02-23T13:16:23.670756+0000","last_active":"2026-02-23T13:16:51.716958+0000","last_peered":"2026-02-23T13:16:51.716958+0000","last_clean":"2026-02-23T13:16:51.716958+0000","last_became_active":"2026-02-23T13:14:49.711647+0000","last_became_peered":"2026-02-23T13:14:49.711647+0000","last_unstale":"2026-02-23T13:16:51.716958+0000","last_undegraded":"2026-02-23T13:16:51.716958+0000","last_fullsized":"2026-02-23T13:16:51.716958+0000","mapping_epoch":96,"log_start":"111'56055","ondisk_log_start":"111'56055","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40918","last_scrub_stamp":"2026-02-23T13:16:23.670714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:23.670714+0000","objects_scrubbed":39913,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:29.633725+0000","scrub_duration":5904,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1587150848,"num_objects":24218,"num_object_clones":0,"num_object_copies":72654,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24218,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56058,"num_write_kb":2568832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"111'55959","reported_seq":56382,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:51.693394+0000","last_change":"2026-02-23T13:16:14.478890+0000","last_active":"2026-02-23T13:16:51.693394+0000","last_peered":"2026-02-23T13:16:51.693394+0000","last_clean":"2026-02-23T13:16:51.693394+0000","last_became_active":"2026-02-23T13:14:49.710064+0000","last_became_peered":"2026-02-23T13:14:49.710064+0000","last_unstale":"2026-02-23T13:16:51.693394+0000","last_undegraded":"2026-02-23T13:16:51.693394+0000","last_fullsized":"2026-02-23T13:16:51.693394+0000","mapping_epoch":96,"log_start":"111'55956","ondisk_log_start":"111'55956","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'37982","last_scrub_stamp":"2026-02-23T13:16:14.478836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.478836+0000","objects_scrubbed":37503,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:35.874054+0000","scrub_duration":3268,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1574764544,"num_objects":24029,"num_object_clones":0,"num_object_copies":72087,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24029,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55959,"num_write_kb":2559616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"111'56479","reported_seq":56918,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:51.870762+0000","last_change":"2026-02-23T13:16:18.449205+0000","last_active":"2026-02-23T13:16:51.870762+0000","last_peered":"2026-02-23T13:16:51.870762+0000","last_clean":"2026-02-23T13:16:51.870762+0000","last_became_active":"2026-02-23T13:14:49.711227+0000","last_became_peered":"2026-02-23T13:14:49.711227+0000","last_unstale":"2026-02-23T13:16:51.870762+0000","last_undegraded":"2026-02-23T13:16:51.870762+0000","last_fullsized":"2026-02-23T13:16:51.870762+0000","mapping_epoch":96,"log_start":"111'56476","ondisk_log_start":"111'56476","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'39520","last_scrub_stamp":"2026-02-23T13:16:18.449176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:18.449176+0000","objects_scrubbed":38818,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:46.860861+0000","scrub_duration":4228,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1573715968,"num_objects":24013,"num_object_clones":0,"num_object_copies":72039,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24013,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56479,"num_write_kb":2575744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"111'56814","reported_seq":57228,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:51.700936+0000","last_change":"2026-02-23T13:16:09.977947+0000","last_active":"2026-02-23T13:16:51.700936+0000","last_peered":"2026-02-23T13:16:51.700936+0000","last_clean":"2026-02-23T13:16:51.700936+0000","last_became_active":"2026-02-23T13:14:49.710282+0000","last_became_peered":"2026-02-23T13:14:49.710282+0000","last_unstale":"2026-02-23T13:16:51.700936+0000","last_undegraded":"2026-02-23T13:16:51.700936+0000","last_fullsized":"2026-02-23T13:16:51.700936+0000","mapping_epoch":96,"log_start":"111'56811","ondisk_log_start":"111'56811","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'37114","last_scrub_stamp":"2026-02-23T13:16:09.977889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:09.977889+0000","objects_scrubbed":36647,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:17.287339+0000","scrub_duration":2946,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1587150848,"num_objects":24218,"num_object_clones":0,"num_object_copies":72654,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24218,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56814,"num_write_kb":2593024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"111'56767","reported_seq":57196,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:51.866073+0000","last_change":"2026-02-23T13:16:14.521114+0000","last_active":"2026-02-23T13:16:51.866073+0000","last_peered":"2026-02-23T13:16:51.866073+0000","last_clean":"2026-02-23T13:16:51.866073+0000","last_became_active":"2026-02-23T13:14:49.710940+0000","last_became_peered":"2026-02-23T13:14:49.710940+0000","last_unstale":"2026-02-23T13:16:51.866073+0000","last_undegraded":"2026-02-23T13:16:51.866073+0000","last_fullsized":"2026-02-23T13:16:51.866073+0000","mapping_epoch":96,"log_start":"111'56764","ondisk_log_start":"111'56764","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38521","last_scrub_stamp":"2026-02-23T13:16:14.521031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.521031+0000","objects_scrubbed":37865,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:27.481651+0000","scrub_duration":5257,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1589051392,"num_objects":24247,"num_object_clones":0,"num_object_copies":72741,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24247,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56767,"num_write_kb":2592448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"111'56063","reported_seq":56488,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:51.692835+0000","last_change":"2026-02-23T13:16:14.247596+0000","last_active":"2026-02-23T13:16:51.692835+0000","last_peered":"2026-02-23T13:16:51.692835+0000","last_clean":"2026-02-23T13:16:51.692835+0000","last_became_active":"2026-02-23T13:14:49.708668+0000","last_became_peered":"2026-02-23T13:14:49.708668+0000","last_unstale":"2026-02-23T13:16:51.692835+0000","last_undegraded":"2026-02-23T13:16:51.692835+0000","last_fullsized":"2026-02-23T13:16:51.692835+0000","mapping_epoch":96,"log_start":"111'56060","ondisk_log_start":"111'56060","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38121","last_scrub_stamp":"2026-02-23T13:16:14.247558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.247558+0000","objects_scrubbed":37453,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:30.117734+0000","scrub_duration":4283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1592459264,"num_objects":24299,"num_object_clones":0,"num_object_copies":72897,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24299,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56063,"num_write_kb":2571584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"111'56708","reported_seq":57100,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:51.694188+0000","last_change":"2026-02-23T13:16:04.164271+0000","last_active":"2026-02-23T13:16:51.694188+0000","last_peered":"2026-02-23T13:16:51.694188+0000","last_clean":"2026-02-23T13:16:51.694188+0000","last_became_active":"2026-02-23T13:14:49.709202+0000","last_became_peered":"2026-02-23T13:14:49.709202+0000","last_unstale":"2026-02-23T13:16:51.694188+0000","last_undegraded":"2026-02-23T13:16:51.694188+0000","last_fullsized":"2026-02-23T13:16:51.694188+0000","mapping_epoch":96,"log_start":"111'56705","ondisk_log_start":"111'56705","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'34863","last_scrub_stamp":"2026-02-23T13:16:04.164237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:04.164237+0000","objects_scrubbed":34093,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:14.024939+0000","scrub_duration":3016,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1585577984,"num_objects":24194,"num_object_clones":0,"num_object_copies":72582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24194,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56708,"num_write_kb":2588864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"111'57067","reported_seq":57523,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:51.869325+0000","last_change":"2026-02-23T13:16:22.619866+0000","last_active":"2026-02-23T13:16:51.869325+0000","last_peered":"2026-02-23T13:16:51.869325+0000","last_clean":"2026-02-23T13:16:51.869325+0000","last_became_active":"2026-02-23T13:14:49.710193+0000","last_became_peered":"2026-02-23T13:14:49.710193+0000","last_unstale":"2026-02-23T13:16:51.869325+0000","last_undegraded":"2026-02-23T13:16:51.869325+0000","last_fullsized":"2026-02-23T13:16:51.869325+0000","mapping_epoch":96,"log_start":"111'57064","ondisk_log_start":"111'57064","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'41143","last_scrub_stamp":"2026-02-23T13:16:22.619816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:22.619816+0000","objects_scrubbed":40610,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:26.460041+0000","scrub_duration":5359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612775424,"num_objects":24609,"num_object_clones":0,"num_object_copies":73827,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24609,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57067,"num_write_kb":2613632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"111'56513","reported_seq":56961,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:51.716617+0000","last_change":"2026-02-23T13:16:20.211692+0000","last_active":"2026-02-23T13:16:51.716617+0000","last_peered":"2026-02-23T13:16:51.716617+0000","last_clean":"2026-02-23T13:16:51.716617+0000","last_became_active":"2026-02-23T13:14:49.709781+0000","last_became_peered":"2026-02-23T13:14:49.709781+0000","last_unstale":"2026-02-23T13:16:51.716617+0000","last_undegraded":"2026-02-23T13:16:51.716617+0000","last_fullsized":"2026-02-23T13:16:51.716617+0000","mapping_epoch":96,"log_start":"111'56510","ondisk_log_start":"111'56510","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40173","last_scrub_stamp":"2026-02-23T13:16:20.211648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:20.211648+0000","objects_scrubbed":39712,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:32.063367+0000","scrub_duration":3503,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1587085312,"num_objects":24217,"num_object_clones":0,"num_object_copies":72651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24217,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56513,"num_write_kb":2583360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"111'56371","reported_seq":56802,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:51.692735+0000","last_change":"2026-02-23T13:16:16.274976+0000","last_active":"2026-02-23T13:16:51.692735+0000","last_peered":"2026-02-23T13:16:51.692735+0000","last_clean":"2026-02-23T13:16:51.692735+0000","last_became_active":"2026-02-23T13:14:49.709715+0000","last_became_peered":"2026-02-23T13:14:49.709715+0000","last_unstale":"2026-02-23T13:16:51.692735+0000","last_undegraded":"2026-02-23T13:16:51.692735+0000","last_fullsized":"2026-02-23T13:16:51.692735+0000","mapping_epoch":96,"log_start":"111'56368","ondisk_log_start":"111'56368","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38978","last_scrub_stamp":"2026-02-23T13:16:16.274911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:16.274911+0000","objects_scrubbed":38345,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:18.192168+0000","scrub_duration":4034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1588920320,"num_objects":24245,"num_object_clones":0,"num_object_copies":72735,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24245,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56371,"num_write_kb":2579712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":444,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:43.312805+0000","last_change":"2026-02-23T13:16:43.312805+0000","last_active":"2026-02-23T13:16:43.312805+0000","last_peered":"2026-02-23T13:16:43.312805+0000","last_clean":"2026-02-23T13:16:43.312805+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:16:43.312805+0000","last_undegraded":"2026-02-23T13:16:43.312805+0000","last_fullsized":"2026-02-23T13:16:43.312805+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:16:43.312764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:16:43.312764+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:54.076451+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":25402867736,"num_objects":387618,"num_object_clones":0,"num_object_copies":1162854,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":387618,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":905372,"num_write_kb":41375617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":76227817472,"data_stored":76227805256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2157,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247977,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":17604080,"kb_used_data":15649564,"kb_used_omap":9,"kb_used_meta":1954486,"kb_avail":716399120,"statfs":{"total":751619276800,"available":733592698880,"internally_reserved":0,"allocated":16025153536,"data_stored":16024549137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9693,"internal_metadata":2001394211},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444204,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":19547764,"kb_used_data":18961120,"kb_used_omap":11,"kb_used_meta":586548,"kb_avail":714455436,"statfs":{"total":751619276800,"available":731602366464,"internally_reserved":0,"allocated":19416186880,"data_stored":19415578409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11351,"internal_metadata":600626089},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575022,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":22686128,"kb_used_data":21913500,"kb_used_omap":19,"kb_used_meta":772524,"kb_avail":711317072,"statfs":{"total":751619276800,"available":728388681728,"internally_reserved":0,"allocated":22439424000,"data_stored":22438819081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20333,"internal_metadata":791064723},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705839,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":20266868,"kb_used_data":18642144,"kb_used_omap":6,"kb_used_meta":1624505,"kb_avail":713736332,"statfs":{"total":751619276800,"available":730866003968,"internally_reserved":0,"allocated":19089555456,"data_stored":19088946985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6569,"internal_metadata":1663493719},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2157,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":19071111168,"data_stored":19071107096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22178107392,"data_stored":22178103320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19079827456,"data_stored":19079823384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15898771456,"data_stored":15898771456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:16:55.639 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:16:55.640 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_4 pg_num 106 2026-02-23T13:16:55.787 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:56.030 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:55 trial046 ceph-mon[38575]: pgmap v504: 17 pgs: 17 active+clean; 24 GiB data, 76 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 7.10k op/s 2026-02-23T13:16:56.196 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:56.183+0000 7fbca0b20640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:56.196 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:56.184+0000 7fbca0b20640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:56.198 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:16:56.289 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:16:56 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:16:56] "GET /metrics HTTP/1.1" 200 4224 "" "Prometheus/3.6.0" 2026-02-23T13:16:56.337 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:16:56.354 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:56.378 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:16:56.477 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:56.475+0000 7ffbbff75640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:56.477 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:56.476+0000 7ffbbff75640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:56.493 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:16:56.493 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:16:56.507 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:16:56.508 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:16:56.521 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:16:56.521 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:16:56.534 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:16:56.534 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:16:56.560 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:16:56 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:16:56.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:16:57.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:56 trial046 ceph-mon[38575]: from='client.15630 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:16:57.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:56 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/54989530' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pg_num", "val": "106"} : dispatch 2026-02-23T13:16:57.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:56 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3771343476' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:16:58.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:57 trial046 ceph-mon[38575]: pgmap v505: 17 pgs: 17 active+clean; 22 GiB data, 73 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 8.79k op/s 2026-02-23T13:16:58.584 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:16:58.724 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:16:59.177 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:59.167+0000 7fa0369ff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:59.177 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:16:59.168+0000 7fa0369ff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:16:59.189 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:16:59.189 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:16:59.206 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:16:59.206 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:16:59.223 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:16:59.223 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:16:59.238 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:16:59.238 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:17:00.004 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:59 trial046 ceph-mon[38575]: pgmap v506: 17 pgs: 17 active+clean; 21 GiB data, 69 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 8.65k op/s 2026-02-23T13:17:00.004 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:16:59 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/949905440' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:17:01.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:00 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:17:01.380 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:17:01.380 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:17:01.381 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_4 2026-02-23T13:17:01.381 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:17:01.527 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:01.653 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:01.652+0000 7fa286361640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:01.654 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:01.653+0000 7fa286361640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:01.805 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:17:01.805 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:17:01.848 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":507,"stamp":"2026-02-23T13:17:00.704720+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22742434360,"num_objects":347016,"num_object_clones":0,"num_object_copies":1041048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":347016,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":946111,"num_write_kb":41377767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":72555592,"kb_used_data":67382712,"kb_used_omap":46,"kb_used_meta":5172689,"kb_avail":2863457208,"statfs":{"total":3006477107200,"available":2932180180992,"internally_reserved":0,"allocated":68999897088,"data_stored":68997470828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47946,"internal_metadata":5296833718},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5369626624,"num_objects":-81934,"num_object_clones":0,"num_object_copies":-245802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-81934,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81934,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001588"},"pg_stats":[{"pgid":"6.f","version":"111'59362","reported_seq":59814,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:56.868711+0000","last_change":"2026-02-23T13:16:23.280934+0000","last_active":"2026-02-23T13:16:56.868711+0000","last_peered":"2026-02-23T13:16:56.868711+0000","last_clean":"2026-02-23T13:16:56.868711+0000","last_became_active":"2026-02-23T13:14:49.710909+0000","last_became_peered":"2026-02-23T13:14:49.710909+0000","last_unstale":"2026-02-23T13:16:56.868711+0000","last_undegraded":"2026-02-23T13:16:56.868711+0000","last_fullsized":"2026-02-23T13:16:56.868711+0000","mapping_epoch":96,"log_start":"111'59359","ondisk_log_start":"111'59359","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'41083","last_scrub_stamp":"2026-02-23T13:16:23.280817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:23.280817+0000","objects_scrubbed":40316,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:26.278733+0000","scrub_duration":4030,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1416888320,"num_objects":21620,"num_object_clones":0,"num_object_copies":64860,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21620,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59362,"num_write_kb":2591424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"111'59257","reported_seq":59629,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:56.697215+0000","last_change":"2026-02-23T13:16:00.821994+0000","last_active":"2026-02-23T13:16:56.697215+0000","last_peered":"2026-02-23T13:16:56.697215+0000","last_clean":"2026-02-23T13:16:56.697215+0000","last_became_active":"2026-02-23T13:14:49.710608+0000","last_became_peered":"2026-02-23T13:14:49.710608+0000","last_unstale":"2026-02-23T13:16:56.697215+0000","last_undegraded":"2026-02-23T13:16:56.697215+0000","last_fullsized":"2026-02-23T13:16:56.697215+0000","mapping_epoch":96,"log_start":"111'59254","ondisk_log_start":"111'59254","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'33186","last_scrub_stamp":"2026-02-23T13:16:00.821941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:00.821941+0000","objects_scrubbed":32277,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:02.918773+0000","scrub_duration":3732,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1420754944,"num_objects":21679,"num_object_clones":0,"num_object_copies":65037,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21679,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59257,"num_write_kb":2589952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"111'58863","reported_seq":59308,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:56.700843+0000","last_change":"2026-02-23T13:16:20.125449+0000","last_active":"2026-02-23T13:16:56.700843+0000","last_peered":"2026-02-23T13:16:56.700843+0000","last_clean":"2026-02-23T13:16:56.700843+0000","last_became_active":"2026-02-23T13:14:49.710759+0000","last_became_peered":"2026-02-23T13:14:49.710759+0000","last_unstale":"2026-02-23T13:16:56.700843+0000","last_undegraded":"2026-02-23T13:16:56.700843+0000","last_fullsized":"2026-02-23T13:16:56.700843+0000","mapping_epoch":96,"log_start":"111'58860","ondisk_log_start":"111'58860","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40044","last_scrub_stamp":"2026-02-23T13:16:20.125397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:20.125397+0000","objects_scrubbed":39489,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:35.607693+0000","scrub_duration":4187,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1418199064,"num_objects":21641,"num_object_clones":0,"num_object_copies":64923,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21641,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":58863,"num_write_kb":2576065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"111'59752","reported_seq":60174,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:56.869127+0000","last_change":"2026-02-23T13:16:12.911605+0000","last_active":"2026-02-23T13:16:56.869127+0000","last_peered":"2026-02-23T13:16:56.869127+0000","last_clean":"2026-02-23T13:16:56.869127+0000","last_became_active":"2026-02-23T13:14:49.710648+0000","last_became_peered":"2026-02-23T13:14:49.710648+0000","last_unstale":"2026-02-23T13:16:56.869127+0000","last_undegraded":"2026-02-23T13:16:56.869127+0000","last_fullsized":"2026-02-23T13:16:56.869127+0000","mapping_epoch":96,"log_start":"111'59749","ondisk_log_start":"111'59749","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38184","last_scrub_stamp":"2026-02-23T13:16:12.911442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:12.911442+0000","objects_scrubbed":37197,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:25.172701+0000","scrub_duration":5652,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1428160512,"num_objects":21792,"num_object_clones":0,"num_object_copies":65376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21792,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59752,"num_write_kb":2609408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"111'59044","reported_seq":59473,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:56.871294+0000","last_change":"2026-02-23T13:16:14.901799+0000","last_active":"2026-02-23T13:16:56.871294+0000","last_peered":"2026-02-23T13:16:56.871294+0000","last_clean":"2026-02-23T13:16:56.871294+0000","last_became_active":"2026-02-23T13:14:49.709875+0000","last_became_peered":"2026-02-23T13:14:49.709875+0000","last_unstale":"2026-02-23T13:16:56.871294+0000","last_undegraded":"2026-02-23T13:16:56.871294+0000","last_fullsized":"2026-02-23T13:16:56.871294+0000","mapping_epoch":96,"log_start":"111'59041","ondisk_log_start":"111'59041","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38474","last_scrub_stamp":"2026-02-23T13:16:14.901765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.901765+0000","objects_scrubbed":37818,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:23.823920+0000","scrub_duration":4577,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1423179776,"num_objects":21716,"num_object_clones":0,"num_object_copies":65148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21716,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59044,"num_write_kb":2584320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"111'59481","reported_seq":59930,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:56.700589+0000","last_change":"2026-02-23T13:16:20.991460+0000","last_active":"2026-02-23T13:16:56.700589+0000","last_peered":"2026-02-23T13:16:56.700589+0000","last_clean":"2026-02-23T13:16:56.700589+0000","last_became_active":"2026-02-23T13:14:49.709618+0000","last_became_peered":"2026-02-23T13:14:49.709618+0000","last_unstale":"2026-02-23T13:16:56.700589+0000","last_undegraded":"2026-02-23T13:16:56.700589+0000","last_fullsized":"2026-02-23T13:16:56.700589+0000","mapping_epoch":96,"log_start":"111'59478","ondisk_log_start":"111'59478","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40588","last_scrub_stamp":"2026-02-23T13:16:20.991398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:20.991398+0000","objects_scrubbed":40089,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:21.036471+0000","scrub_duration":4040,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1421803520,"num_objects":21695,"num_object_clones":0,"num_object_copies":65085,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21695,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59481,"num_write_kb":2597632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"111'58603","reported_seq":59053,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:56.716593+0000","last_change":"2026-02-23T13:16:23.670756+0000","last_active":"2026-02-23T13:16:56.716593+0000","last_peered":"2026-02-23T13:16:56.716593+0000","last_clean":"2026-02-23T13:16:56.716593+0000","last_became_active":"2026-02-23T13:14:49.711647+0000","last_became_peered":"2026-02-23T13:14:49.711647+0000","last_unstale":"2026-02-23T13:16:56.716593+0000","last_undegraded":"2026-02-23T13:16:56.716593+0000","last_fullsized":"2026-02-23T13:16:56.716593+0000","mapping_epoch":96,"log_start":"111'58600","ondisk_log_start":"111'58600","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40918","last_scrub_stamp":"2026-02-23T13:16:23.670714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:23.670714+0000","objects_scrubbed":39913,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:29.633725+0000","scrub_duration":5904,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1420361728,"num_objects":21673,"num_object_clones":0,"num_object_copies":65019,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21673,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58603,"num_write_kb":2568832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"111'58488","reported_seq":58912,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:56.692964+0000","last_change":"2026-02-23T13:16:14.478890+0000","last_active":"2026-02-23T13:16:56.692964+0000","last_peered":"2026-02-23T13:16:56.692964+0000","last_clean":"2026-02-23T13:16:56.692964+0000","last_became_active":"2026-02-23T13:14:49.710064+0000","last_became_peered":"2026-02-23T13:14:49.710064+0000","last_unstale":"2026-02-23T13:16:56.692964+0000","last_undegraded":"2026-02-23T13:16:56.692964+0000","last_fullsized":"2026-02-23T13:16:56.692964+0000","mapping_epoch":96,"log_start":"111'58485","ondisk_log_start":"111'58485","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'37982","last_scrub_stamp":"2026-02-23T13:16:14.478836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.478836+0000","objects_scrubbed":37503,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:35.874054+0000","scrub_duration":3268,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1409024000,"num_objects":21500,"num_object_clones":0,"num_object_copies":64500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21500,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58488,"num_write_kb":2559616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"111'58978","reported_seq":59417,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:56.865823+0000","last_change":"2026-02-23T13:16:18.449205+0000","last_active":"2026-02-23T13:16:56.865823+0000","last_peered":"2026-02-23T13:16:56.865823+0000","last_clean":"2026-02-23T13:16:56.865823+0000","last_became_active":"2026-02-23T13:14:49.711227+0000","last_became_peered":"2026-02-23T13:14:49.711227+0000","last_unstale":"2026-02-23T13:16:56.865823+0000","last_undegraded":"2026-02-23T13:16:56.865823+0000","last_fullsized":"2026-02-23T13:16:56.865823+0000","mapping_epoch":96,"log_start":"111'58975","ondisk_log_start":"111'58975","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'39520","last_scrub_stamp":"2026-02-23T13:16:18.449176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:18.449176+0000","objects_scrubbed":38818,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:46.860861+0000","scrub_duration":4228,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1409941504,"num_objects":21514,"num_object_clones":0,"num_object_copies":64542,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21514,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58978,"num_write_kb":2575744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"111'59315","reported_seq":59729,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:56.700152+0000","last_change":"2026-02-23T13:16:09.977947+0000","last_active":"2026-02-23T13:16:56.700152+0000","last_peered":"2026-02-23T13:16:56.700152+0000","last_clean":"2026-02-23T13:16:56.700152+0000","last_became_active":"2026-02-23T13:14:49.710282+0000","last_became_peered":"2026-02-23T13:14:49.710282+0000","last_unstale":"2026-02-23T13:16:56.700152+0000","last_undegraded":"2026-02-23T13:16:56.700152+0000","last_fullsized":"2026-02-23T13:16:56.700152+0000","mapping_epoch":96,"log_start":"111'59312","ondisk_log_start":"111'59312","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'37114","last_scrub_stamp":"2026-02-23T13:16:09.977889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:09.977889+0000","objects_scrubbed":36647,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:17.287339+0000","scrub_duration":2946,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1423245312,"num_objects":21717,"num_object_clones":0,"num_object_copies":65151,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21717,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59315,"num_write_kb":2593024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"111'59311","reported_seq":59740,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:56.869243+0000","last_change":"2026-02-23T13:16:14.521114+0000","last_active":"2026-02-23T13:16:56.869243+0000","last_peered":"2026-02-23T13:16:56.869243+0000","last_clean":"2026-02-23T13:16:56.869243+0000","last_became_active":"2026-02-23T13:14:49.710940+0000","last_became_peered":"2026-02-23T13:14:49.710940+0000","last_unstale":"2026-02-23T13:16:56.869243+0000","last_undegraded":"2026-02-23T13:16:56.869243+0000","last_fullsized":"2026-02-23T13:16:56.869243+0000","mapping_epoch":96,"log_start":"111'59308","ondisk_log_start":"111'59308","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38521","last_scrub_stamp":"2026-02-23T13:16:14.521031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.521031+0000","objects_scrubbed":37865,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:27.481651+0000","scrub_duration":5257,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1422327808,"num_objects":21703,"num_object_clones":0,"num_object_copies":65109,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21703,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59311,"num_write_kb":2592448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"111'58674","reported_seq":59099,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:56.691591+0000","last_change":"2026-02-23T13:16:14.247596+0000","last_active":"2026-02-23T13:16:56.691591+0000","last_peered":"2026-02-23T13:16:56.691591+0000","last_clean":"2026-02-23T13:16:56.691591+0000","last_became_active":"2026-02-23T13:14:49.708668+0000","last_became_peered":"2026-02-23T13:14:49.708668+0000","last_unstale":"2026-02-23T13:16:56.691591+0000","last_undegraded":"2026-02-23T13:16:56.691591+0000","last_fullsized":"2026-02-23T13:16:56.691591+0000","mapping_epoch":96,"log_start":"111'58671","ondisk_log_start":"111'58671","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38121","last_scrub_stamp":"2026-02-23T13:16:14.247558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.247558+0000","objects_scrubbed":37453,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:30.117734+0000","scrub_duration":4283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1421344768,"num_objects":21688,"num_object_clones":0,"num_object_copies":65064,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21688,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58674,"num_write_kb":2571584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"111'59289","reported_seq":59681,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:56.694365+0000","last_change":"2026-02-23T13:16:04.164271+0000","last_active":"2026-02-23T13:16:56.694365+0000","last_peered":"2026-02-23T13:16:56.694365+0000","last_clean":"2026-02-23T13:16:56.694365+0000","last_became_active":"2026-02-23T13:14:49.709202+0000","last_became_peered":"2026-02-23T13:14:49.709202+0000","last_unstale":"2026-02-23T13:16:56.694365+0000","last_undegraded":"2026-02-23T13:16:56.694365+0000","last_fullsized":"2026-02-23T13:16:56.694365+0000","mapping_epoch":96,"log_start":"111'59286","ondisk_log_start":"111'59286","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'34863","last_scrub_stamp":"2026-02-23T13:16:04.164237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:04.164237+0000","objects_scrubbed":34093,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:14.024939+0000","scrub_duration":3016,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1416429568,"num_objects":21613,"num_object_clones":0,"num_object_copies":64839,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21613,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59289,"num_write_kb":2588864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"111'59638","reported_seq":60094,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:56.870889+0000","last_change":"2026-02-23T13:16:22.619866+0000","last_active":"2026-02-23T13:16:56.870889+0000","last_peered":"2026-02-23T13:16:56.870889+0000","last_clean":"2026-02-23T13:16:56.870889+0000","last_became_active":"2026-02-23T13:14:49.710193+0000","last_became_peered":"2026-02-23T13:14:49.710193+0000","last_unstale":"2026-02-23T13:16:56.870889+0000","last_undegraded":"2026-02-23T13:16:56.870889+0000","last_fullsized":"2026-02-23T13:16:56.870889+0000","mapping_epoch":96,"log_start":"111'59635","ondisk_log_start":"111'59635","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'41143","last_scrub_stamp":"2026-02-23T13:16:22.619816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:22.619816+0000","objects_scrubbed":40610,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:26.460041+0000","scrub_duration":5359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1444282368,"num_objects":22038,"num_object_clones":0,"num_object_copies":66114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22038,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59638,"num_write_kb":2613632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"111'59050","reported_seq":59498,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:56.715547+0000","last_change":"2026-02-23T13:16:20.211692+0000","last_active":"2026-02-23T13:16:56.715547+0000","last_peered":"2026-02-23T13:16:56.715547+0000","last_clean":"2026-02-23T13:16:56.715547+0000","last_became_active":"2026-02-23T13:14:49.709781+0000","last_became_peered":"2026-02-23T13:14:49.709781+0000","last_unstale":"2026-02-23T13:16:56.715547+0000","last_undegraded":"2026-02-23T13:16:56.715547+0000","last_fullsized":"2026-02-23T13:16:56.715547+0000","mapping_epoch":96,"log_start":"111'59047","ondisk_log_start":"111'59047","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40173","last_scrub_stamp":"2026-02-23T13:16:20.211648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:20.211648+0000","objects_scrubbed":39712,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:32.063367+0000","scrub_duration":3503,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1420820480,"num_objects":21680,"num_object_clones":0,"num_object_copies":65040,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21680,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59050,"num_write_kb":2583360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"111'58871","reported_seq":59302,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:56.691427+0000","last_change":"2026-02-23T13:16:16.274976+0000","last_active":"2026-02-23T13:16:56.691427+0000","last_peered":"2026-02-23T13:16:56.691427+0000","last_clean":"2026-02-23T13:16:56.691427+0000","last_became_active":"2026-02-23T13:14:49.709715+0000","last_became_peered":"2026-02-23T13:14:49.709715+0000","last_unstale":"2026-02-23T13:16:56.691427+0000","last_undegraded":"2026-02-23T13:16:56.691427+0000","last_fullsized":"2026-02-23T13:16:56.691427+0000","mapping_epoch":96,"log_start":"111'58868","ondisk_log_start":"111'58868","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38978","last_scrub_stamp":"2026-02-23T13:16:16.274911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:16.274911+0000","objects_scrubbed":38345,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:18.192168+0000","scrub_duration":4034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1425080320,"num_objects":21745,"num_object_clones":0,"num_object_copies":65235,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21745,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58871,"num_write_kb":2579712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":444,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:43.312805+0000","last_change":"2026-02-23T13:16:43.312805+0000","last_active":"2026-02-23T13:16:43.312805+0000","last_peered":"2026-02-23T13:16:43.312805+0000","last_clean":"2026-02-23T13:16:43.312805+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:16:43.312805+0000","last_undegraded":"2026-02-23T13:16:43.312805+0000","last_fullsized":"2026-02-23T13:16:43.312805+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:16:43.312764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:16:43.312764+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:54.076451+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":22741843992,"num_objects":347014,"num_object_clones":0,"num_object_copies":1041042,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":347014,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":945976,"num_write_kb":41375617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":68243697664,"data_stored":68243685448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2157,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247978,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":16051888,"kb_used_data":14061276,"kb_used_omap":9,"kb_used_meta":1990582,"kb_avail":717951312,"statfs":{"total":751619276800,"available":735182143488,"internally_reserved":0,"allocated":14398746624,"data_stored":14398142225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9693,"internal_metadata":2038356515},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444205,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":17628852,"kb_used_data":16970080,"kb_used_omap":11,"kb_used_meta":658740,"kb_avail":716374348,"statfs":{"total":751619276800,"available":733567332352,"internally_reserved":0,"allocated":17377361920,"data_stored":17376753449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11351,"internal_metadata":674550697},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575023,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":20479664,"kb_used_data":19634844,"kb_used_omap":19,"kb_used_meta":844716,"kb_avail":713523536,"statfs":{"total":751619276800,"available":730648100864,"internally_reserved":0,"allocated":20106080256,"data_stored":20105475337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20333,"internal_metadata":864989331},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705840,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":18395188,"kb_used_data":16716512,"kb_used_omap":6,"kb_used_meta":1678649,"kb_avail":715608012,"statfs":{"total":751619276800,"available":732782604288,"internally_reserved":0,"allocated":17117708288,"data_stored":17117099817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6569,"internal_metadata":1718937175},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2157,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17074688000,"data_stored":17074683928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19851776000,"data_stored":19851771928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17081896960,"data_stored":17081892888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14235336704,"data_stored":14235336704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:17:01.850 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_4 pgp_num 106 2026-02-23T13:17:01.992 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:02.027 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:17:02.057 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:01 trial046 ceph-mon[38575]: pgmap v507: 17 pgs: 17 active+clean; 21 GiB data, 69 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 6.83k op/s 2026-02-23T13:17:02.118 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:02.118+0000 7fe60ee39640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:02.119 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:02.118+0000 7fe60ee39640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:02.182 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:02.267 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-23T13:17:02.306 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:02.306+0000 7f42f7092640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:02.306 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:02.306+0000 7f42f7092640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:02.314 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:17:02.321 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:17:02.321 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:17:02.336 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:17:02.336 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:17:02.349 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:17:02.349 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:17:02.361 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:17:02.362 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:17:03.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:02 trial046 ceph-mon[38575]: from='client.15638 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:17:03.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:02 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3112685543' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pgp_num", "val": "106"} : dispatch 2026-02-23T13:17:03.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:02 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4071113245' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:17:04.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:03 trial046 ceph-mon[38575]: pgmap v508: 17 pgs: 17 active+clean; 19 GiB data, 61 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 10.27k op/s 2026-02-23T13:17:04.406 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:17:04.555 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:04.687 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:04.686+0000 7f304b56d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:04.687 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:04.686+0000 7f304b56d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:04.702 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:17:04.702 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:17:04.716 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:17:04.716 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:17:04.729 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:17:04.729 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:17:04.743 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:17:04.743 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:17:06.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:05 trial046 ceph-mon[38575]: 6.e scrub starts 2026-02-23T13:17:06.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:05 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1727489993' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:17:06.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:05 trial046 ceph-mon[38575]: pgmap v509: 17 pgs: 17 active+clean; 19 GiB data, 61 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 6.83k op/s 2026-02-23T13:17:06.539 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:17:06 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:17:06] "GET /metrics HTTP/1.1" 200 4232 "" "Prometheus/3.6.0" 2026-02-23T13:17:06.560 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:17:06 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:17:06.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:17:06.789 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:17:06.941 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:07.075 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:07.074+0000 7f09ab6e8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:07.075 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:07.074+0000 7f09ab6e8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:07.090 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:17:07.090 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:17:07.102 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:17:07.102 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:17:07.115 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:17:07.115 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:17:07.127 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:17:07.127 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:17:07.315 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:17:07.315 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:17:07.315 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:17:07.316 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:17:07.459 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:07.588 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:07.587+0000 7f9369228640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:07.588 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:07.587+0000 7f9369228640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:07.744 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:17:07.744 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:17:07.790 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":510,"stamp":"2026-02-23T13:17:06.705546+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":18609668664,"num_objects":283955,"num_object_clones":0,"num_object_copies":851865,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":283955,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":1009172,"num_write_kb":41377767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53,"ondisk_log_size":53,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":60008520,"kb_used_data":55610296,"kb_used_omap":46,"kb_used_meta":4398097,"kb_avail":2876004280,"statfs":{"total":3006477107200,"available":2945028382720,"internally_reserved":0,"allocated":56944943104,"data_stored":56942516844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":48039,"internal_metadata":4503651417},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6793789440,"num_objects":-103665,"num_object_clones":0,"num_object_copies":-310995,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-103665,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103665,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001631"},"pg_stats":[{"pgid":"6.f","version":"111'61946","reported_seq":62398,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:01.872861+0000","last_change":"2026-02-23T13:16:23.280934+0000","last_active":"2026-02-23T13:17:01.872861+0000","last_peered":"2026-02-23T13:17:01.872861+0000","last_clean":"2026-02-23T13:17:01.872861+0000","last_became_active":"2026-02-23T13:14:49.710909+0000","last_became_peered":"2026-02-23T13:14:49.710909+0000","last_unstale":"2026-02-23T13:17:01.872861+0000","last_undegraded":"2026-02-23T13:17:01.872861+0000","last_fullsized":"2026-02-23T13:17:01.872861+0000","mapping_epoch":96,"log_start":"111'61943","ondisk_log_start":"111'61943","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'41083","last_scrub_stamp":"2026-02-23T13:16:23.280817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:23.280817+0000","objects_scrubbed":40316,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:26.278733+0000","scrub_duration":4030,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1247543296,"num_objects":19036,"num_object_clones":0,"num_object_copies":57108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19036,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61946,"num_write_kb":2591424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"111'64512","reported_seq":65068,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:06.700810+0000","last_change":"2026-02-23T13:17:06.151399+0000","last_active":"2026-02-23T13:17:06.700810+0000","last_peered":"2026-02-23T13:17:06.700810+0000","last_clean":"2026-02-23T13:17:06.700810+0000","last_became_active":"2026-02-23T13:14:49.710608+0000","last_became_peered":"2026-02-23T13:14:49.710608+0000","last_unstale":"2026-02-23T13:17:06.700810+0000","last_undegraded":"2026-02-23T13:17:06.700810+0000","last_fullsized":"2026-02-23T13:17:06.700810+0000","mapping_epoch":96,"log_start":"111'64509","ondisk_log_start":"111'64509","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'64208","last_scrub_stamp":"2026-02-23T13:17:06.151332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:17:06.151332+0000","objects_scrubbed":17266,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:18:31.988951+0000","scrub_duration":2143,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1076363264,"num_objects":16424,"num_object_clones":0,"num_object_copies":49272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16424,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64512,"num_write_kb":2589952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"111'64144","reported_seq":64589,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:06.701291+0000","last_change":"2026-02-23T13:16:20.125449+0000","last_active":"2026-02-23T13:17:06.701291+0000","last_peered":"2026-02-23T13:17:06.701291+0000","last_clean":"2026-02-23T13:17:06.701291+0000","last_became_active":"2026-02-23T13:14:49.710759+0000","last_became_peered":"2026-02-23T13:14:49.710759+0000","last_unstale":"2026-02-23T13:17:06.701291+0000","last_undegraded":"2026-02-23T13:17:06.701291+0000","last_fullsized":"2026-02-23T13:17:06.701291+0000","mapping_epoch":96,"log_start":"111'64141","ondisk_log_start":"111'64141","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40044","last_scrub_stamp":"2026-02-23T13:16:20.125397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:20.125397+0000","objects_scrubbed":39489,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:35.607693+0000","scrub_duration":4187,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1072103448,"num_objects":16360,"num_object_clones":0,"num_object_copies":49080,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16360,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":64144,"num_write_kb":2576065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"111'62230","reported_seq":62652,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:01.870577+0000","last_change":"2026-02-23T13:16:12.911605+0000","last_active":"2026-02-23T13:17:01.870577+0000","last_peered":"2026-02-23T13:17:01.870577+0000","last_clean":"2026-02-23T13:17:01.870577+0000","last_became_active":"2026-02-23T13:14:49.710648+0000","last_became_peered":"2026-02-23T13:14:49.710648+0000","last_unstale":"2026-02-23T13:17:01.870577+0000","last_undegraded":"2026-02-23T13:17:01.870577+0000","last_fullsized":"2026-02-23T13:17:01.870577+0000","mapping_epoch":96,"log_start":"111'62227","ondisk_log_start":"111'62227","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38184","last_scrub_stamp":"2026-02-23T13:16:12.911442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:12.911442+0000","objects_scrubbed":37197,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:25.172701+0000","scrub_duration":5652,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1265762304,"num_objects":19314,"num_object_clones":0,"num_object_copies":57942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19314,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62230,"num_write_kb":2609408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"111'61615","reported_seq":62041,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:01.871683+0000","last_change":"2026-02-23T13:16:14.901799+0000","last_active":"2026-02-23T13:17:01.871683+0000","last_peered":"2026-02-23T13:17:01.871683+0000","last_clean":"2026-02-23T13:17:01.871683+0000","last_became_active":"2026-02-23T13:14:49.709875+0000","last_became_peered":"2026-02-23T13:14:49.709875+0000","last_unstale":"2026-02-23T13:17:01.871683+0000","last_undegraded":"2026-02-23T13:17:01.871683+0000","last_fullsized":"2026-02-23T13:17:01.871683+0000","mapping_epoch":96,"log_start":"111'61611","ondisk_log_start":"111'61611","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38474","last_scrub_stamp":"2026-02-23T13:16:14.901765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.901765+0000","objects_scrubbed":37818,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:23.823920+0000","scrub_duration":4577,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1254686720,"num_objects":19145,"num_object_clones":0,"num_object_copies":57435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19145,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61615,"num_write_kb":2584320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"111'64787","reported_seq":65237,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:06.697813+0000","last_change":"2026-02-23T13:16:20.991460+0000","last_active":"2026-02-23T13:17:06.697813+0000","last_peered":"2026-02-23T13:17:06.697813+0000","last_clean":"2026-02-23T13:17:06.697813+0000","last_became_active":"2026-02-23T13:14:49.709618+0000","last_became_peered":"2026-02-23T13:14:49.709618+0000","last_unstale":"2026-02-23T13:17:06.697813+0000","last_undegraded":"2026-02-23T13:17:06.697813+0000","last_fullsized":"2026-02-23T13:17:06.697813+0000","mapping_epoch":96,"log_start":"111'64784","ondisk_log_start":"111'64784","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40588","last_scrub_stamp":"2026-02-23T13:16:20.991398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:20.991398+0000","objects_scrubbed":40089,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:21.036471+0000","scrub_duration":4040,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1074069504,"num_objects":16389,"num_object_clones":0,"num_object_copies":49167,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16389,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64787,"num_write_kb":2597632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"111'61230","reported_seq":61680,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:01.715873+0000","last_change":"2026-02-23T13:16:23.670756+0000","last_active":"2026-02-23T13:17:01.715873+0000","last_peered":"2026-02-23T13:17:01.715873+0000","last_clean":"2026-02-23T13:17:01.715873+0000","last_became_active":"2026-02-23T13:14:49.711647+0000","last_became_peered":"2026-02-23T13:14:49.711647+0000","last_unstale":"2026-02-23T13:17:01.715873+0000","last_undegraded":"2026-02-23T13:17:01.715873+0000","last_fullsized":"2026-02-23T13:17:01.715873+0000","mapping_epoch":96,"log_start":"111'61227","ondisk_log_start":"111'61227","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40918","last_scrub_stamp":"2026-02-23T13:16:23.670714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:23.670714+0000","objects_scrubbed":39913,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:29.633725+0000","scrub_duration":5904,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1248198656,"num_objects":19046,"num_object_clones":0,"num_object_copies":57138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19046,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61230,"num_write_kb":2568832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"111'63757","reported_seq":64181,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:06.693490+0000","last_change":"2026-02-23T13:16:14.478890+0000","last_active":"2026-02-23T13:17:06.693490+0000","last_peered":"2026-02-23T13:17:06.693490+0000","last_clean":"2026-02-23T13:17:06.693490+0000","last_became_active":"2026-02-23T13:14:49.710064+0000","last_became_peered":"2026-02-23T13:14:49.710064+0000","last_unstale":"2026-02-23T13:17:06.693490+0000","last_undegraded":"2026-02-23T13:17:06.693490+0000","last_fullsized":"2026-02-23T13:17:06.693490+0000","mapping_epoch":96,"log_start":"111'63754","ondisk_log_start":"111'63754","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'37982","last_scrub_stamp":"2026-02-23T13:16:14.478836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.478836+0000","objects_scrubbed":37503,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:35.874054+0000","scrub_duration":3268,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1063714816,"num_objects":16231,"num_object_clones":0,"num_object_copies":48693,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16231,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63757,"num_write_kb":2559616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"111'61623","reported_seq":62062,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:01.873564+0000","last_change":"2026-02-23T13:16:18.449205+0000","last_active":"2026-02-23T13:17:01.873564+0000","last_peered":"2026-02-23T13:17:01.873564+0000","last_clean":"2026-02-23T13:17:01.873564+0000","last_became_active":"2026-02-23T13:14:49.711227+0000","last_became_peered":"2026-02-23T13:14:49.711227+0000","last_unstale":"2026-02-23T13:17:01.873564+0000","last_undegraded":"2026-02-23T13:17:01.873564+0000","last_fullsized":"2026-02-23T13:17:01.873564+0000","mapping_epoch":96,"log_start":"111'61619","ondisk_log_start":"111'61619","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'39520","last_scrub_stamp":"2026-02-23T13:16:18.449176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:18.449176+0000","objects_scrubbed":38818,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:46.860861+0000","scrub_duration":4228,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1236598784,"num_objects":18869,"num_object_clones":0,"num_object_copies":56607,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18869,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61623,"num_write_kb":2575744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"111'64634","reported_seq":65049,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:06.701686+0000","last_change":"2026-02-23T13:16:09.977947+0000","last_active":"2026-02-23T13:17:06.701686+0000","last_peered":"2026-02-23T13:17:06.701686+0000","last_clean":"2026-02-23T13:17:06.701686+0000","last_became_active":"2026-02-23T13:14:49.710282+0000","last_became_peered":"2026-02-23T13:14:49.710282+0000","last_unstale":"2026-02-23T13:17:06.701686+0000","last_undegraded":"2026-02-23T13:17:06.701686+0000","last_fullsized":"2026-02-23T13:17:06.701686+0000","mapping_epoch":96,"log_start":"111'64631","ondisk_log_start":"111'64631","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'37114","last_scrub_stamp":"2026-02-23T13:16:09.977889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:09.977889+0000","objects_scrubbed":36647,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:17.287339+0000","scrub_duration":2946,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1074659328,"num_objects":16398,"num_object_clones":0,"num_object_copies":49194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16398,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64634,"num_write_kb":2593024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"111'61849","reported_seq":62278,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:01.870033+0000","last_change":"2026-02-23T13:16:14.521114+0000","last_active":"2026-02-23T13:17:01.870033+0000","last_peered":"2026-02-23T13:17:01.870033+0000","last_clean":"2026-02-23T13:17:01.870033+0000","last_became_active":"2026-02-23T13:14:49.710940+0000","last_became_peered":"2026-02-23T13:14:49.710940+0000","last_unstale":"2026-02-23T13:17:01.870033+0000","last_undegraded":"2026-02-23T13:17:01.870033+0000","last_fullsized":"2026-02-23T13:17:01.870033+0000","mapping_epoch":96,"log_start":"111'61846","ondisk_log_start":"111'61846","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38521","last_scrub_stamp":"2026-02-23T13:16:14.521031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.521031+0000","objects_scrubbed":37865,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:27.481651+0000","scrub_duration":5257,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1255997440,"num_objects":19165,"num_object_clones":0,"num_object_copies":57495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19165,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61849,"num_write_kb":2592448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"111'63970","reported_seq":64395,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:06.699870+0000","last_change":"2026-02-23T13:16:14.247596+0000","last_active":"2026-02-23T13:17:06.699870+0000","last_peered":"2026-02-23T13:17:06.699870+0000","last_clean":"2026-02-23T13:17:06.699870+0000","last_became_active":"2026-02-23T13:14:49.708668+0000","last_became_peered":"2026-02-23T13:14:49.708668+0000","last_unstale":"2026-02-23T13:17:06.699870+0000","last_undegraded":"2026-02-23T13:17:06.699870+0000","last_fullsized":"2026-02-23T13:17:06.699870+0000","mapping_epoch":96,"log_start":"111'63967","ondisk_log_start":"111'63967","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38121","last_scrub_stamp":"2026-02-23T13:16:14.247558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.247558+0000","objects_scrubbed":37453,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:30.117734+0000","scrub_duration":4283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1074266112,"num_objects":16392,"num_object_clones":0,"num_object_copies":49176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16392,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63970,"num_write_kb":2571584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"111'64520","reported_seq":64912,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:06.694240+0000","last_change":"2026-02-23T13:16:04.164271+0000","last_active":"2026-02-23T13:17:06.694240+0000","last_peered":"2026-02-23T13:17:06.694240+0000","last_clean":"2026-02-23T13:17:06.694240+0000","last_became_active":"2026-02-23T13:14:49.709202+0000","last_became_peered":"2026-02-23T13:14:49.709202+0000","last_unstale":"2026-02-23T13:17:06.694240+0000","last_undegraded":"2026-02-23T13:17:06.694240+0000","last_fullsized":"2026-02-23T13:17:06.694240+0000","mapping_epoch":96,"log_start":"111'64517","ondisk_log_start":"111'64517","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'34863","last_scrub_stamp":"2026-02-23T13:16:04.164237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:04.164237+0000","objects_scrubbed":34093,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:14.024939+0000","scrub_duration":3016,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1073610752,"num_objects":16382,"num_object_clones":0,"num_object_copies":49146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16382,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64520,"num_write_kb":2588864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"111'62289","reported_seq":62745,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:01.872960+0000","last_change":"2026-02-23T13:16:22.619866+0000","last_active":"2026-02-23T13:17:01.872960+0000","last_peered":"2026-02-23T13:17:01.872960+0000","last_clean":"2026-02-23T13:17:01.872960+0000","last_became_active":"2026-02-23T13:14:49.710193+0000","last_became_peered":"2026-02-23T13:14:49.710193+0000","last_unstale":"2026-02-23T13:17:01.872960+0000","last_undegraded":"2026-02-23T13:17:01.872960+0000","last_fullsized":"2026-02-23T13:17:01.872960+0000","mapping_epoch":96,"log_start":"111'62286","ondisk_log_start":"111'62286","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'41143","last_scrub_stamp":"2026-02-23T13:16:22.619816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:22.619816+0000","objects_scrubbed":40610,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:26.460041+0000","scrub_duration":5359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1270546432,"num_objects":19387,"num_object_clones":0,"num_object_copies":58161,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19387,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62289,"num_write_kb":2613632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"111'61691","reported_seq":62139,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:01.712503+0000","last_change":"2026-02-23T13:16:20.211692+0000","last_active":"2026-02-23T13:17:01.712503+0000","last_peered":"2026-02-23T13:17:01.712503+0000","last_clean":"2026-02-23T13:17:01.712503+0000","last_became_active":"2026-02-23T13:14:49.709781+0000","last_became_peered":"2026-02-23T13:14:49.709781+0000","last_unstale":"2026-02-23T13:17:01.712503+0000","last_undegraded":"2026-02-23T13:17:01.712503+0000","last_fullsized":"2026-02-23T13:17:01.712503+0000","mapping_epoch":96,"log_start":"111'61688","ondisk_log_start":"111'61688","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40173","last_scrub_stamp":"2026-02-23T13:16:20.211648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:20.211648+0000","objects_scrubbed":39712,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:32.063367+0000","scrub_duration":3503,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1247739904,"num_objects":19039,"num_object_clones":0,"num_object_copies":57117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19039,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61691,"num_write_kb":2583360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"111'64240","reported_seq":64672,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:06.690933+0000","last_change":"2026-02-23T13:16:16.274976+0000","last_active":"2026-02-23T13:17:06.690933+0000","last_peered":"2026-02-23T13:17:06.690933+0000","last_clean":"2026-02-23T13:17:06.690933+0000","last_became_active":"2026-02-23T13:14:49.709715+0000","last_became_peered":"2026-02-23T13:14:49.709715+0000","last_unstale":"2026-02-23T13:17:06.690933+0000","last_undegraded":"2026-02-23T13:17:06.690933+0000","last_fullsized":"2026-02-23T13:17:06.690933+0000","mapping_epoch":96,"log_start":"111'64237","ondisk_log_start":"111'64237","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38978","last_scrub_stamp":"2026-02-23T13:16:16.274911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:16.274911+0000","objects_scrubbed":38345,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:18.192168+0000","scrub_duration":4034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1073217536,"num_objects":16376,"num_object_clones":0,"num_object_copies":49128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16376,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64240,"num_write_kb":2579712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":445,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:43.312869+0000","last_change":"2026-02-23T13:16:43.312805+0000","last_active":"2026-02-23T13:16:43.312869+0000","last_peered":"2026-02-23T13:16:43.312869+0000","last_clean":"2026-02-23T13:16:43.312869+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:16:43.312869+0000","last_undegraded":"2026-02-23T13:16:43.312869+0000","last_fullsized":"2026-02-23T13:16:43.312869+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:16:43.312764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:16:43.312764+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:54.076451+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":18609078296,"num_objects":283953,"num_object_clones":0,"num_object_copies":851859,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":283953,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1009037,"num_write_kb":41375617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":56177733632,"data_stored":56177721416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93,"internal_metadata":0},"log_size":50,"ondisk_log_size":50,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2157,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247980,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":11692784,"kb_used_data":10675292,"kb_used_omap":9,"kb_used_meta":1017462,"kb_avail":722310416,"statfs":{"total":751619276800,"available":739645865984,"internally_reserved":0,"allocated":10931499008,"data_stored":10930894609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9693,"internal_metadata":1041881635},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444207,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":13673588,"kb_used_data":12906528,"kb_used_omap":11,"kb_used_meta":767028,"kb_avail":720329612,"statfs":{"total":751619276800,"available":737617522688,"internally_reserved":0,"allocated":13216284672,"data_stored":13215676201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11444,"internal_metadata":785437516},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575024,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":18164272,"kb_used_data":17283420,"kb_used_omap":19,"kb_used_meta":880812,"kb_avail":715838928,"statfs":{"total":751619276800,"available":733019062272,"internally_reserved":0,"allocated":17698222080,"data_stored":17697617161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20333,"internal_metadata":901951635},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705841,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":16477876,"kb_used_data":14745056,"kb_used_omap":6,"kb_used_meta":1732793,"kb_avail":717525324,"statfs":{"total":751619276800,"available":734745931776,"internally_reserved":0,"allocated":15098937344,"data_stored":15098328873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6569,"internal_metadata":1774380631},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2157,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15039598592,"data_stored":15039594520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17482584064,"data_stored":17482579992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12909023232,"data_stored":12909019160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10746527744,"data_stored":10746527744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:17:07.792 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:17:07.792 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 371 2026-02-23T13:17:07.938 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:07.966 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:07 trial046 ceph-mon[38575]: 6.e scrub ok 2026-02-23T13:17:07.966 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:07 trial046 ceph-mon[38575]: pgmap v510: 17 pgs: 17 active+clean; 17 GiB data, 57 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 8.64k op/s 2026-02-23T13:17:07.967 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:07 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1744048666' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:17:08.070 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:08.069+0000 7fdbcbfd5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:08.070 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:08.069+0000 7fdbcbfd5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:08.220 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:17:08.259 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:17:09.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:08 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:17:09.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:08 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:17:09.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:08 trial046 ceph-mon[38575]: from='client.15648 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:17:09.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:08 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2234913071' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "371"} : dispatch 2026-02-23T13:17:09.171 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:17:09.312 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:09.439 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:09.438+0000 7f21aaef8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:09.439 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:09.438+0000 7f21aaef8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:09.454 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:17:09.455 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:17:09.470 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:17:09.470 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:17:09.484 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:17:09.485 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:17:09.497 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:17:09.497 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:17:10.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:09 trial046 ceph-mon[38575]: pgmap v511: 17 pgs: 17 active+clean; 16 GiB data, 53 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 8.78k op/s 2026-02-23T13:17:10.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:09 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2831028303' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:17:11.544 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:17:11.697 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:11.829 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:11 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:17:11.829 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:11 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:17:11.830 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:11 trial046 ceph-mon[38575]: pgmap v512: 17 pgs: 17 active+clean; 16 GiB data, 53 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 7.08k op/s 2026-02-23T13:17:12.121 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:12.052+0000 7faea65c4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:12.121 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:12.052+0000 7faea65c4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:12.121 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:17:12.122 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:17:12.122 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:17:12.122 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:17:12.122 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:17:12.122 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:17:12.122 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:17:12.122 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:17:13.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:12 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3877568611' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:17:13.260 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:17:13.260 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:17:13.260 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_4 2026-02-23T13:17:13.261 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:17:13.412 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:13.553 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:13.551+0000 7fe8d7d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:13.553 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:13.551+0000 7fe8d7d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:13.711 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:17:13.711 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:17:13.759 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":513,"stamp":"2026-02-23T13:17:12.706292+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":14166000184,"num_objects":216150,"num_object_clones":0,"num_object_copies":648450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":216150,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":1076977,"num_write_kb":41377767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":46724296,"kb_used_data":42328376,"kb_used_omap":48,"kb_used_meta":4395599,"kb_avail":2889288504,"statfs":{"total":3006477107200,"available":2958631428096,"internally_reserved":0,"allocated":43344257024,"data_stored":43341830764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49342,"internal_metadata":4501094210},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,3],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8576434176,"num_objects":-130866,"num_object_clones":0,"num_object_copies":-392598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-130866,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130866,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001572"},"pg_stats":[{"pgid":"6.f","version":"111'67490","reported_seq":67942,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:11.872751+0000","last_change":"2026-02-23T13:16:23.280934+0000","last_active":"2026-02-23T13:17:11.872751+0000","last_peered":"2026-02-23T13:17:11.872751+0000","last_clean":"2026-02-23T13:17:11.872751+0000","last_became_active":"2026-02-23T13:14:49.710909+0000","last_became_peered":"2026-02-23T13:14:49.710909+0000","last_unstale":"2026-02-23T13:17:11.872751+0000","last_undegraded":"2026-02-23T13:17:11.872751+0000","last_fullsized":"2026-02-23T13:17:11.872751+0000","mapping_epoch":96,"log_start":"111'67487","ondisk_log_start":"111'67487","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'41083","last_scrub_stamp":"2026-02-23T13:16:23.280817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:23.280817+0000","objects_scrubbed":40316,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:26.278733+0000","scrub_duration":4030,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":884211712,"num_objects":13492,"num_object_clones":0,"num_object_copies":40476,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13492,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67490,"num_write_kb":2591424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"111'67396","reported_seq":67952,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:11.700173+0000","last_change":"2026-02-23T13:17:06.151399+0000","last_active":"2026-02-23T13:17:11.700173+0000","last_peered":"2026-02-23T13:17:11.700173+0000","last_clean":"2026-02-23T13:17:11.700173+0000","last_became_active":"2026-02-23T13:14:49.710608+0000","last_became_peered":"2026-02-23T13:14:49.710608+0000","last_unstale":"2026-02-23T13:17:11.700173+0000","last_undegraded":"2026-02-23T13:17:11.700173+0000","last_fullsized":"2026-02-23T13:17:11.700173+0000","mapping_epoch":96,"log_start":"111'67393","ondisk_log_start":"111'67393","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'64208","last_scrub_stamp":"2026-02-23T13:17:06.151332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:17:06.151332+0000","objects_scrubbed":17266,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:18:31.988951+0000","scrub_duration":2143,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":887357440,"num_objects":13540,"num_object_clones":0,"num_object_copies":40620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13540,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67396,"num_write_kb":2589952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"111'67011","reported_seq":67456,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:11.702014+0000","last_change":"2026-02-23T13:16:20.125449+0000","last_active":"2026-02-23T13:17:11.702014+0000","last_peered":"2026-02-23T13:17:11.702014+0000","last_clean":"2026-02-23T13:17:11.702014+0000","last_became_active":"2026-02-23T13:14:49.710759+0000","last_became_peered":"2026-02-23T13:14:49.710759+0000","last_unstale":"2026-02-23T13:17:11.702014+0000","last_undegraded":"2026-02-23T13:17:11.702014+0000","last_fullsized":"2026-02-23T13:17:11.702014+0000","mapping_epoch":96,"log_start":"111'67008","ondisk_log_start":"111'67008","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40044","last_scrub_stamp":"2026-02-23T13:16:20.125397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:20.125397+0000","objects_scrubbed":39489,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:35.607693+0000","scrub_duration":4187,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":884211736,"num_objects":13493,"num_object_clones":0,"num_object_copies":40479,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13493,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":67011,"num_write_kb":2576065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"111'67851","reported_seq":68272,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:11.872167+0000","last_change":"2026-02-23T13:16:12.911605+0000","last_active":"2026-02-23T13:17:11.872167+0000","last_peered":"2026-02-23T13:17:11.872167+0000","last_clean":"2026-02-23T13:17:11.872167+0000","last_became_active":"2026-02-23T13:14:49.710648+0000","last_became_peered":"2026-02-23T13:14:49.710648+0000","last_unstale":"2026-02-23T13:17:11.872167+0000","last_undegraded":"2026-02-23T13:17:11.872167+0000","last_fullsized":"2026-02-23T13:17:11.872167+0000","mapping_epoch":96,"log_start":"111'67848","ondisk_log_start":"111'67848","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38184","last_scrub_stamp":"2026-02-23T13:16:12.911442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:12.911442+0000","objects_scrubbed":37197,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:25.172701+0000","scrub_duration":5652,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897384448,"num_objects":13693,"num_object_clones":0,"num_object_copies":41079,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13693,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67851,"num_write_kb":2609408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"111'67257","reported_seq":67686,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:11.839850+0000","last_change":"2026-02-23T13:16:14.901799+0000","last_active":"2026-02-23T13:17:11.839850+0000","last_peered":"2026-02-23T13:17:11.839850+0000","last_clean":"2026-02-23T13:17:11.839850+0000","last_became_active":"2026-02-23T13:14:49.709875+0000","last_became_peered":"2026-02-23T13:14:49.709875+0000","last_unstale":"2026-02-23T13:17:11.839850+0000","last_undegraded":"2026-02-23T13:17:11.839850+0000","last_fullsized":"2026-02-23T13:17:11.839850+0000","mapping_epoch":96,"log_start":"111'67254","ondisk_log_start":"111'67254","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38474","last_scrub_stamp":"2026-02-23T13:16:14.901765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.901765+0000","objects_scrubbed":37818,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:23.823920+0000","scrub_duration":4577,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":884932608,"num_objects":13503,"num_object_clones":0,"num_object_copies":40509,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13503,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67257,"num_write_kb":2584320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"111'67643","reported_seq":68093,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:11.701938+0000","last_change":"2026-02-23T13:16:20.991460+0000","last_active":"2026-02-23T13:17:11.701938+0000","last_peered":"2026-02-23T13:17:11.701938+0000","last_clean":"2026-02-23T13:17:11.701938+0000","last_became_active":"2026-02-23T13:14:49.709618+0000","last_became_peered":"2026-02-23T13:14:49.709618+0000","last_unstale":"2026-02-23T13:17:11.701938+0000","last_undegraded":"2026-02-23T13:17:11.701938+0000","last_fullsized":"2026-02-23T13:17:11.701938+0000","mapping_epoch":96,"log_start":"111'67640","ondisk_log_start":"111'67640","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40588","last_scrub_stamp":"2026-02-23T13:16:20.991398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:20.991398+0000","objects_scrubbed":40089,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:21.036471+0000","scrub_duration":4040,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":886898688,"num_objects":13533,"num_object_clones":0,"num_object_copies":40599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13533,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67643,"num_write_kb":2597632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"111'66797","reported_seq":67247,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:11.712688+0000","last_change":"2026-02-23T13:16:23.670756+0000","last_active":"2026-02-23T13:17:11.712688+0000","last_peered":"2026-02-23T13:17:11.712688+0000","last_clean":"2026-02-23T13:17:11.712688+0000","last_became_active":"2026-02-23T13:14:49.711647+0000","last_became_peered":"2026-02-23T13:14:49.711647+0000","last_unstale":"2026-02-23T13:17:11.712688+0000","last_undegraded":"2026-02-23T13:17:11.712688+0000","last_fullsized":"2026-02-23T13:17:11.712688+0000","mapping_epoch":96,"log_start":"111'66794","ondisk_log_start":"111'66794","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40918","last_scrub_stamp":"2026-02-23T13:16:23.670714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:23.670714+0000","objects_scrubbed":39913,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:29.633725+0000","scrub_duration":5904,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":883359744,"num_objects":13479,"num_object_clones":0,"num_object_copies":40437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13479,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66797,"num_write_kb":2568832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"111'66620","reported_seq":67044,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:11.694730+0000","last_change":"2026-02-23T13:16:14.478890+0000","last_active":"2026-02-23T13:17:11.694730+0000","last_peered":"2026-02-23T13:17:11.694730+0000","last_clean":"2026-02-23T13:17:11.694730+0000","last_became_active":"2026-02-23T13:14:49.710064+0000","last_became_peered":"2026-02-23T13:14:49.710064+0000","last_unstale":"2026-02-23T13:17:11.694730+0000","last_undegraded":"2026-02-23T13:17:11.694730+0000","last_fullsized":"2026-02-23T13:17:11.694730+0000","mapping_epoch":96,"log_start":"111'66616","ondisk_log_start":"111'66616","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'37982","last_scrub_stamp":"2026-02-23T13:16:14.478836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.478836+0000","objects_scrubbed":37503,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:35.874054+0000","scrub_duration":3268,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":876085248,"num_objects":13368,"num_object_clones":0,"num_object_copies":40104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13368,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66620,"num_write_kb":2559616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"111'67095","reported_seq":67533,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:11.874561+0000","last_change":"2026-02-23T13:16:18.449205+0000","last_active":"2026-02-23T13:17:11.874561+0000","last_peered":"2026-02-23T13:17:11.874561+0000","last_clean":"2026-02-23T13:17:11.874561+0000","last_became_active":"2026-02-23T13:14:49.711227+0000","last_became_peered":"2026-02-23T13:14:49.711227+0000","last_unstale":"2026-02-23T13:17:11.874561+0000","last_undegraded":"2026-02-23T13:17:11.874561+0000","last_fullsized":"2026-02-23T13:17:11.874561+0000","mapping_epoch":96,"log_start":"111'67092","ondisk_log_start":"111'67092","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'39520","last_scrub_stamp":"2026-02-23T13:16:18.449176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:18.449176+0000","objects_scrubbed":38818,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:46.860861+0000","scrub_duration":4228,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":877985792,"num_objects":13397,"num_object_clones":0,"num_object_copies":40191,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13397,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67095,"num_write_kb":2575744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"111'67506","reported_seq":67921,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:11.701120+0000","last_change":"2026-02-23T13:16:09.977947+0000","last_active":"2026-02-23T13:17:11.701120+0000","last_peered":"2026-02-23T13:17:11.701120+0000","last_clean":"2026-02-23T13:17:11.701120+0000","last_became_active":"2026-02-23T13:14:49.710282+0000","last_became_peered":"2026-02-23T13:14:49.710282+0000","last_unstale":"2026-02-23T13:17:11.701120+0000","last_undegraded":"2026-02-23T13:17:11.701120+0000","last_fullsized":"2026-02-23T13:17:11.701120+0000","mapping_epoch":96,"log_start":"111'67503","ondisk_log_start":"111'67503","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'37114","last_scrub_stamp":"2026-02-23T13:16:09.977889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:09.977889+0000","objects_scrubbed":36647,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:17.287339+0000","scrub_duration":2946,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":886439936,"num_objects":13526,"num_object_clones":0,"num_object_copies":40578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13526,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67506,"num_write_kb":2593024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"111'67552","reported_seq":67981,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:11.872077+0000","last_change":"2026-02-23T13:16:14.521114+0000","last_active":"2026-02-23T13:17:11.872077+0000","last_peered":"2026-02-23T13:17:11.872077+0000","last_clean":"2026-02-23T13:17:11.872077+0000","last_became_active":"2026-02-23T13:14:49.710940+0000","last_became_peered":"2026-02-23T13:14:49.710940+0000","last_unstale":"2026-02-23T13:17:11.872077+0000","last_undegraded":"2026-02-23T13:17:11.872077+0000","last_fullsized":"2026-02-23T13:17:11.872077+0000","mapping_epoch":96,"log_start":"111'67549","ondisk_log_start":"111'67549","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38521","last_scrub_stamp":"2026-02-23T13:16:14.521031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.521031+0000","objects_scrubbed":37865,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:27.481651+0000","scrub_duration":5257,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":882245632,"num_objects":13462,"num_object_clones":0,"num_object_copies":40386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13462,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67552,"num_write_kb":2592448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"111'66830","reported_seq":67255,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:11.699089+0000","last_change":"2026-02-23T13:16:14.247596+0000","last_active":"2026-02-23T13:17:11.699089+0000","last_peered":"2026-02-23T13:17:11.699089+0000","last_clean":"2026-02-23T13:17:11.699089+0000","last_became_active":"2026-02-23T13:14:49.708668+0000","last_became_peered":"2026-02-23T13:14:49.708668+0000","last_unstale":"2026-02-23T13:17:11.699089+0000","last_undegraded":"2026-02-23T13:17:11.699089+0000","last_fullsized":"2026-02-23T13:17:11.699089+0000","mapping_epoch":96,"log_start":"111'66827","ondisk_log_start":"111'66827","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38121","last_scrub_stamp":"2026-02-23T13:16:14.247558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.247558+0000","objects_scrubbed":37453,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:30.117734+0000","scrub_duration":4283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":886833152,"num_objects":13532,"num_object_clones":0,"num_object_copies":40596,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13532,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66830,"num_write_kb":2571584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"111'67341","reported_seq":67733,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:11.687852+0000","last_change":"2026-02-23T13:16:04.164271+0000","last_active":"2026-02-23T13:17:11.687852+0000","last_peered":"2026-02-23T13:17:11.687852+0000","last_clean":"2026-02-23T13:17:11.687852+0000","last_became_active":"2026-02-23T13:14:49.709202+0000","last_became_peered":"2026-02-23T13:14:49.709202+0000","last_unstale":"2026-02-23T13:17:11.687852+0000","last_undegraded":"2026-02-23T13:17:11.687852+0000","last_fullsized":"2026-02-23T13:17:11.687852+0000","mapping_epoch":96,"log_start":"111'67338","ondisk_log_start":"111'67338","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'34863","last_scrub_stamp":"2026-02-23T13:16:04.164237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:04.164237+0000","objects_scrubbed":34093,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:14.024939+0000","scrub_duration":3016,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":888733696,"num_objects":13561,"num_object_clones":0,"num_object_copies":40683,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67341,"num_write_kb":2588864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"111'67986","reported_seq":68441,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:11.874587+0000","last_change":"2026-02-23T13:16:22.619866+0000","last_active":"2026-02-23T13:17:11.874587+0000","last_peered":"2026-02-23T13:17:11.874587+0000","last_clean":"2026-02-23T13:17:11.874587+0000","last_became_active":"2026-02-23T13:14:49.710193+0000","last_became_peered":"2026-02-23T13:14:49.710193+0000","last_unstale":"2026-02-23T13:17:11.874587+0000","last_undegraded":"2026-02-23T13:17:11.874587+0000","last_fullsized":"2026-02-23T13:17:11.874587+0000","mapping_epoch":96,"log_start":"111'67983","ondisk_log_start":"111'67983","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'41143","last_scrub_stamp":"2026-02-23T13:16:22.619816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:22.619816+0000","objects_scrubbed":40610,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:26.460041+0000","scrub_duration":5359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897187840,"num_objects":13690,"num_object_clones":0,"num_object_copies":41070,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13690,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67986,"num_write_kb":2613632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"111'67381","reported_seq":67829,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:11.715982+0000","last_change":"2026-02-23T13:16:20.211692+0000","last_active":"2026-02-23T13:17:11.715982+0000","last_peered":"2026-02-23T13:17:11.715982+0000","last_clean":"2026-02-23T13:17:11.715982+0000","last_became_active":"2026-02-23T13:14:49.709781+0000","last_became_peered":"2026-02-23T13:14:49.709781+0000","last_unstale":"2026-02-23T13:17:11.715982+0000","last_undegraded":"2026-02-23T13:17:11.715982+0000","last_fullsized":"2026-02-23T13:17:11.715982+0000","mapping_epoch":96,"log_start":"111'67378","ondisk_log_start":"111'67378","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40173","last_scrub_stamp":"2026-02-23T13:16:20.211648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:20.211648+0000","objects_scrubbed":39712,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:32.063367+0000","scrub_duration":3503,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":874840064,"num_objects":13349,"num_object_clones":0,"num_object_copies":40047,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13349,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67381,"num_write_kb":2583360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"111'67086","reported_seq":67518,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:11.695882+0000","last_change":"2026-02-23T13:16:16.274976+0000","last_active":"2026-02-23T13:17:11.695882+0000","last_peered":"2026-02-23T13:17:11.695882+0000","last_clean":"2026-02-23T13:17:11.695882+0000","last_became_active":"2026-02-23T13:14:49.709715+0000","last_became_peered":"2026-02-23T13:14:49.709715+0000","last_unstale":"2026-02-23T13:17:11.695882+0000","last_undegraded":"2026-02-23T13:17:11.695882+0000","last_fullsized":"2026-02-23T13:17:11.695882+0000","mapping_epoch":96,"log_start":"111'67083","ondisk_log_start":"111'67083","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38978","last_scrub_stamp":"2026-02-23T13:16:16.274911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:16.274911+0000","objects_scrubbed":38345,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:18.192168+0000","scrub_duration":4034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":886702080,"num_objects":13530,"num_object_clones":0,"num_object_copies":40590,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13530,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67086,"num_write_kb":2579712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":445,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:43.312869+0000","last_change":"2026-02-23T13:16:43.312805+0000","last_active":"2026-02-23T13:16:43.312869+0000","last_peered":"2026-02-23T13:16:43.312869+0000","last_clean":"2026-02-23T13:16:43.312869+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:16:43.312869+0000","last_undegraded":"2026-02-23T13:16:43.312869+0000","last_fullsized":"2026-02-23T13:16:43.312869+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:16:43.312764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:16:43.312764+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:54.076451+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":14165409816,"num_objects":216148,"num_object_clones":0,"num_object_copies":648444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":216148,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1076842,"num_write_kb":41375617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":42512363520,"data_stored":42512351304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":558,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2157,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247981,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":9500848,"kb_used_data":8810588,"kb_used_omap":9,"kb_used_meta":690102,"kb_avail":724502352,"statfs":{"total":751619276800,"available":741890408448,"internally_reserved":0,"allocated":9022042112,"data_stored":9021437713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9693,"internal_metadata":706664995},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444208,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":11504116,"kb_used_data":10682912,"kb_used_omap":11,"kb_used_meta":821172,"kb_avail":722499084,"statfs":{"total":751619276800,"available":739839062016,"internally_reserved":0,"allocated":10939301888,"data_stored":10938693417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12095,"internal_metadata":840880321},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575026,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":13353968,"kb_used_data":12328732,"kb_used_omap":20,"kb_used_meta":1025195,"kb_avail":720649232,"statfs":{"total":751619276800,"available":737944813568,"internally_reserved":0,"allocated":12624621568,"data_stored":12624016649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20985,"internal_metadata":1049800199},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,3],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705843,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":12365364,"kb_used_data":10506144,"kb_used_omap":6,"kb_used_meta":1859129,"kb_avail":721637836,"statfs":{"total":751619276800,"available":738957144064,"internally_reserved":0,"allocated":10758291456,"data_stored":10757682985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6569,"internal_metadata":1903748695},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2157,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10634137600,"data_stored":10634133528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12358914048,"data_stored":12358909976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":10647638016,"data_stored":10647633944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":558,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8871673856,"data_stored":8871673856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T13:17:13.761 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_4 pgp_num 106 2026-02-23T13:17:13.916 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:13.945 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:13 trial046 ceph-mon[38575]: pgmap v513: 17 pgs: 17 active+clean; 13 GiB data, 45 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 10.90k op/s 2026-02-23T13:17:13.946 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:13 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-23T13:17:14.053 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:14.051+0000 7f9f97510640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:14.053 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:14.052+0000 7f9f97510640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:14.199 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-23T13:17:14.241 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:17:14.708 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:17:14.857 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:14.992 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:14.990+0000 7f7d7434b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:14.993 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:14.990+0000 7f7d7434b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:14.993 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:14 trial046 ceph-mon[38575]: from='client.15656 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:17:14.993 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:14 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-23T13:17:14.993 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:14 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-23T13:17:14.993 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:14 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' 2026-02-23T13:17:14.993 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:14 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-23T13:17:14.994 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:14 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/841236876' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pgp_num", "val": "106"} : dispatch 2026-02-23T13:17:15.008 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:17:15.009 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:17:15.024 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:17:15.024 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:17:15.038 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:17:15.038 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:17:15.051 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:17:15.052 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:17:16.088 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:15 trial046 ceph-mon[38575]: pgmap v514: 17 pgs: 17 active+clean; 13 GiB data, 45 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 7.46k op/s 2026-02-23T13:17:16.088 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:15 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1857057237' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:17:16.088 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:15 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:17:16.470 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:17:16 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:17:16.087Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:17:16.539 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:17:16 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:17:16] "GET /metrics HTTP/1.1" 200 4226 "" "Prometheus/3.6.0" 2026-02-23T13:17:17.101 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:17:17.127 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:16 trial046 ceph-mon[38575]: 6.2 scrub starts 2026-02-23T13:17:17.249 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:17.580 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:17.574+0000 7f574f5ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:17.580 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:17.574+0000 7f574f5ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:17.592 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:17:17.592 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:17:17.606 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:17:17.606 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:17:17.619 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:17:17.619 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:17:17.634 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:17:17.634 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:17:18.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:17 trial046 ceph-mon[38575]: pgmap v515: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 12 GiB data, 41 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 9.14k op/s 2026-02-23T13:17:18.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:17 trial046 ceph-mon[38575]: 6.2 scrub ok 2026-02-23T13:17:18.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:17 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3245095620' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:17:19.242 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:17:19.242 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:17:19.242 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-23T13:17:19.243 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:17:19.376 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:19.828 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:19.764+0000 7f5f655e2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:19.828 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:19.764+0000 7f5f655e2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:19.904 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:17:19.905 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:17:19.905 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:19 trial046 ceph-mon[38575]: pgmap v516: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 11 GiB data, 36 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 9.03k op/s 2026-02-23T13:17:19.905 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:19 trial046 ceph-mon[38575]: 6.7 scrub starts 2026-02-23T13:17:20.268 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:17:20.627 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":516,"stamp":"2026-02-23T13:17:18.707086+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":11503796792,"num_objects":175528,"num_object_clones":0,"num_object_copies":526584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":175528,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":1117599,"num_write_kb":41377767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":37304392,"kb_used_data":34640632,"kb_used_omap":48,"kb_used_meta":2663503,"kb_avail":2898708408,"statfs":{"total":3006477107200,"available":2968277409792,"internally_reserved":0,"allocated":35472007168,"data_stored":35469580908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49342,"internal_metadata":2727427906},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7105871872,"num_objects":-108427,"num_object_clones":0,"num_object_copies":-325281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-108427,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108427,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001540"},"pg_stats":[{"pgid":"6.f","version":"111'70004","reported_seq":70456,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:16.871106+0000","last_change":"2026-02-23T13:16:23.280934+0000","last_active":"2026-02-23T13:17:16.871106+0000","last_peered":"2026-02-23T13:17:16.871106+0000","last_clean":"2026-02-23T13:17:16.871106+0000","last_became_active":"2026-02-23T13:14:49.710909+0000","last_became_peered":"2026-02-23T13:14:49.710909+0000","last_unstale":"2026-02-23T13:17:16.871106+0000","last_undegraded":"2026-02-23T13:17:16.871106+0000","last_fullsized":"2026-02-23T13:17:16.871106+0000","mapping_epoch":96,"log_start":"111'70001","ondisk_log_start":"111'70001","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'41083","last_scrub_stamp":"2026-02-23T13:16:23.280817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:23.280817+0000","objects_scrubbed":40316,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:26.278733+0000","scrub_duration":4030,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":719454208,"num_objects":10978,"num_object_clones":0,"num_object_copies":32934,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10978,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70004,"num_write_kb":2591424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"111'69892","reported_seq":70448,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:16.700937+0000","last_change":"2026-02-23T13:17:06.151399+0000","last_active":"2026-02-23T13:17:16.700937+0000","last_peered":"2026-02-23T13:17:16.700937+0000","last_clean":"2026-02-23T13:17:16.700937+0000","last_became_active":"2026-02-23T13:14:49.710608+0000","last_became_peered":"2026-02-23T13:14:49.710608+0000","last_unstale":"2026-02-23T13:17:16.700937+0000","last_undegraded":"2026-02-23T13:17:16.700937+0000","last_fullsized":"2026-02-23T13:17:16.700937+0000","mapping_epoch":96,"log_start":"111'69889","ondisk_log_start":"111'69889","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'64208","last_scrub_stamp":"2026-02-23T13:17:06.151332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:17:06.151332+0000","objects_scrubbed":17266,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:18:31.988951+0000","scrub_duration":2143,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723779584,"num_objects":11044,"num_object_clones":0,"num_object_copies":33132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11044,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69892,"num_write_kb":2589952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"111'69503","reported_seq":69947,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:16.701944+0000","last_change":"2026-02-23T13:16:20.125449+0000","last_active":"2026-02-23T13:17:16.701944+0000","last_peered":"2026-02-23T13:17:16.701944+0000","last_clean":"2026-02-23T13:17:16.701944+0000","last_became_active":"2026-02-23T13:14:49.710759+0000","last_became_peered":"2026-02-23T13:14:49.710759+0000","last_unstale":"2026-02-23T13:17:16.701944+0000","last_undegraded":"2026-02-23T13:17:16.701944+0000","last_fullsized":"2026-02-23T13:17:16.701944+0000","mapping_epoch":96,"log_start":"111'69500","ondisk_log_start":"111'69500","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40044","last_scrub_stamp":"2026-02-23T13:16:20.125397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:20.125397+0000","objects_scrubbed":39489,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:35.607693+0000","scrub_duration":4187,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896024,"num_objects":11001,"num_object_clones":0,"num_object_copies":33003,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11001,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":69503,"num_write_kb":2576065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"111'70469","reported_seq":70891,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:16.867444+0000","last_change":"2026-02-23T13:16:12.911605+0000","last_active":"2026-02-23T13:17:16.867444+0000","last_peered":"2026-02-23T13:17:16.867444+0000","last_clean":"2026-02-23T13:17:16.867444+0000","last_became_active":"2026-02-23T13:14:49.710648+0000","last_became_peered":"2026-02-23T13:14:49.710648+0000","last_unstale":"2026-02-23T13:17:16.867444+0000","last_undegraded":"2026-02-23T13:17:16.867444+0000","last_fullsized":"2026-02-23T13:17:16.867444+0000","mapping_epoch":96,"log_start":"111'70466","ondisk_log_start":"111'70466","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38184","last_scrub_stamp":"2026-02-23T13:16:12.911442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:12.911442+0000","objects_scrubbed":37197,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:25.172701+0000","scrub_duration":5652,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":725811200,"num_objects":11075,"num_object_clones":0,"num_object_copies":33225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11075,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70469,"num_write_kb":2609408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"111'69821","reported_seq":70250,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:16.871580+0000","last_change":"2026-02-23T13:16:14.901799+0000","last_active":"2026-02-23T13:17:16.871580+0000","last_peered":"2026-02-23T13:17:16.871580+0000","last_clean":"2026-02-23T13:17:16.871580+0000","last_became_active":"2026-02-23T13:14:49.709875+0000","last_became_peered":"2026-02-23T13:14:49.709875+0000","last_unstale":"2026-02-23T13:17:16.871580+0000","last_undegraded":"2026-02-23T13:17:16.871580+0000","last_fullsized":"2026-02-23T13:17:16.871580+0000","mapping_epoch":96,"log_start":"111'69818","ondisk_log_start":"111'69818","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38474","last_scrub_stamp":"2026-02-23T13:16:14.901765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.901765+0000","objects_scrubbed":37818,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:23.823920+0000","scrub_duration":4577,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":716898304,"num_objects":10939,"num_object_clones":0,"num_object_copies":32817,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10939,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69821,"num_write_kb":2584320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"111'70137","reported_seq":70587,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:16.699512+0000","last_change":"2026-02-23T13:16:20.991460+0000","last_active":"2026-02-23T13:17:16.699512+0000","last_peered":"2026-02-23T13:17:16.699512+0000","last_clean":"2026-02-23T13:17:16.699512+0000","last_became_active":"2026-02-23T13:14:49.709618+0000","last_became_peered":"2026-02-23T13:14:49.709618+0000","last_unstale":"2026-02-23T13:17:16.699512+0000","last_undegraded":"2026-02-23T13:17:16.699512+0000","last_fullsized":"2026-02-23T13:17:16.699512+0000","mapping_epoch":96,"log_start":"111'70134","ondisk_log_start":"111'70134","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40588","last_scrub_stamp":"2026-02-23T13:16:20.991398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:20.991398+0000","objects_scrubbed":40089,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:21.036471+0000","scrub_duration":4040,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723451904,"num_objects":11039,"num_object_clones":0,"num_object_copies":33117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11039,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70137,"num_write_kb":2597632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"111'69358","reported_seq":69808,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:16.706611+0000","last_change":"2026-02-23T13:16:23.670756+0000","last_active":"2026-02-23T13:17:16.706611+0000","last_peered":"2026-02-23T13:17:16.706611+0000","last_clean":"2026-02-23T13:17:16.706611+0000","last_became_active":"2026-02-23T13:14:49.711647+0000","last_became_peered":"2026-02-23T13:14:49.711647+0000","last_unstale":"2026-02-23T13:17:16.706611+0000","last_undegraded":"2026-02-23T13:17:16.706611+0000","last_fullsized":"2026-02-23T13:17:16.706611+0000","mapping_epoch":96,"log_start":"111'69355","ondisk_log_start":"111'69355","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40918","last_scrub_stamp":"2026-02-23T13:16:23.670714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:23.670714+0000","objects_scrubbed":39913,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:29.633725+0000","scrub_duration":5904,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":715522048,"num_objects":10918,"num_object_clones":0,"num_object_copies":32754,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10918,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69358,"num_write_kb":2568832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"111'69130","reported_seq":69554,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:16.701413+0000","last_change":"2026-02-23T13:16:14.478890+0000","last_active":"2026-02-23T13:17:16.701413+0000","last_peered":"2026-02-23T13:17:16.701413+0000","last_clean":"2026-02-23T13:17:16.701413+0000","last_became_active":"2026-02-23T13:14:49.710064+0000","last_became_peered":"2026-02-23T13:14:49.710064+0000","last_unstale":"2026-02-23T13:17:16.701413+0000","last_undegraded":"2026-02-23T13:17:16.701413+0000","last_fullsized":"2026-02-23T13:17:16.701413+0000","mapping_epoch":96,"log_start":"111'69127","ondisk_log_start":"111'69127","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'37982","last_scrub_stamp":"2026-02-23T13:16:14.478836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.478836+0000","objects_scrubbed":37503,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:35.874054+0000","scrub_duration":3268,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711589888,"num_objects":10858,"num_object_clones":0,"num_object_copies":32574,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10858,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69130,"num_write_kb":2559616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"111'69639","reported_seq":70078,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:16.873797+0000","last_change":"2026-02-23T13:16:18.449205+0000","last_active":"2026-02-23T13:17:16.873797+0000","last_peered":"2026-02-23T13:17:16.873797+0000","last_clean":"2026-02-23T13:17:16.873797+0000","last_became_active":"2026-02-23T13:14:49.711227+0000","last_became_peered":"2026-02-23T13:14:49.711227+0000","last_unstale":"2026-02-23T13:17:16.873797+0000","last_undegraded":"2026-02-23T13:17:16.873797+0000","last_fullsized":"2026-02-23T13:17:16.873797+0000","mapping_epoch":96,"log_start":"111'69636","ondisk_log_start":"111'69636","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'39520","last_scrub_stamp":"2026-02-23T13:16:18.449176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:18.449176+0000","objects_scrubbed":38818,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:46.860861+0000","scrub_duration":4228,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711262208,"num_objects":10853,"num_object_clones":0,"num_object_copies":32559,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10853,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69639,"num_write_kb":2575744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"111'70022","reported_seq":70437,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:16.695961+0000","last_change":"2026-02-23T13:16:09.977947+0000","last_active":"2026-02-23T13:17:16.695961+0000","last_peered":"2026-02-23T13:17:16.695961+0000","last_clean":"2026-02-23T13:17:16.695961+0000","last_became_active":"2026-02-23T13:14:49.710282+0000","last_became_peered":"2026-02-23T13:14:49.710282+0000","last_unstale":"2026-02-23T13:17:16.695961+0000","last_undegraded":"2026-02-23T13:17:16.695961+0000","last_fullsized":"2026-02-23T13:17:16.695961+0000","mapping_epoch":96,"log_start":"111'70019","ondisk_log_start":"111'70019","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'37114","last_scrub_stamp":"2026-02-23T13:16:09.977889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:09.977889+0000","objects_scrubbed":36647,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:17.287339+0000","scrub_duration":2946,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":721551360,"num_objects":11010,"num_object_clones":0,"num_object_copies":33030,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11010,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70022,"num_write_kb":2593024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"111'70146","reported_seq":70575,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:16.867221+0000","last_change":"2026-02-23T13:16:14.521114+0000","last_active":"2026-02-23T13:17:16.867221+0000","last_peered":"2026-02-23T13:17:16.867221+0000","last_clean":"2026-02-23T13:17:16.867221+0000","last_became_active":"2026-02-23T13:14:49.710940+0000","last_became_peered":"2026-02-23T13:14:49.710940+0000","last_unstale":"2026-02-23T13:17:16.867221+0000","last_undegraded":"2026-02-23T13:17:16.867221+0000","last_fullsized":"2026-02-23T13:17:16.867221+0000","mapping_epoch":96,"log_start":"111'70143","ondisk_log_start":"111'70143","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38521","last_scrub_stamp":"2026-02-23T13:16:14.521031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.521031+0000","objects_scrubbed":37865,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:27.481651+0000","scrub_duration":5257,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":712245248,"num_objects":10868,"num_object_clones":0,"num_object_copies":32604,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10868,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70146,"num_write_kb":2592448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"111'69358","reported_seq":69783,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:16.701529+0000","last_change":"2026-02-23T13:16:14.247596+0000","last_active":"2026-02-23T13:17:16.701529+0000","last_peered":"2026-02-23T13:17:16.701529+0000","last_clean":"2026-02-23T13:17:16.701529+0000","last_became_active":"2026-02-23T13:14:49.708668+0000","last_became_peered":"2026-02-23T13:14:49.708668+0000","last_unstale":"2026-02-23T13:17:16.701529+0000","last_undegraded":"2026-02-23T13:17:16.701529+0000","last_fullsized":"2026-02-23T13:17:16.701529+0000","mapping_epoch":96,"log_start":"111'69355","ondisk_log_start":"111'69355","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38121","last_scrub_stamp":"2026-02-23T13:16:14.247558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.247558+0000","objects_scrubbed":37453,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:30.117734+0000","scrub_duration":4283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":721158144,"num_objects":11004,"num_object_clones":0,"num_object_copies":33012,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11004,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69358,"num_write_kb":2571584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"111'69957","reported_seq":70423,"reported_epoch":111,"state":"active+clean+scrubbing","last_fresh":"2026-02-23T13:17:16.702889+0000","last_change":"2026-02-23T13:17:16.193734+0000","last_active":"2026-02-23T13:17:16.702889+0000","last_peered":"2026-02-23T13:17:16.702889+0000","last_clean":"2026-02-23T13:17:16.702889+0000","last_became_active":"2026-02-23T13:14:49.709202+0000","last_became_peered":"2026-02-23T13:14:49.709202+0000","last_unstale":"2026-02-23T13:17:16.702889+0000","last_undegraded":"2026-02-23T13:17:16.702889+0000","last_fullsized":"2026-02-23T13:17:16.702889+0000","mapping_epoch":96,"log_start":"111'69953","ondisk_log_start":"111'69953","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'34863","last_scrub_stamp":"2026-02-23T13:16:04.164237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:04.164237+0000","objects_scrubbed":6849,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"scrubbing for 1s","scrub_duration":3016,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":717291520,"num_objects":10945,"num_object_clones":0,"num_object_copies":32835,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10945,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69957,"num_write_kb":2588864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"111'70621","reported_seq":71077,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:16.873218+0000","last_change":"2026-02-23T13:16:22.619866+0000","last_active":"2026-02-23T13:17:16.873218+0000","last_peered":"2026-02-23T13:17:16.873218+0000","last_clean":"2026-02-23T13:17:16.873218+0000","last_became_active":"2026-02-23T13:14:49.710193+0000","last_became_peered":"2026-02-23T13:14:49.710193+0000","last_unstale":"2026-02-23T13:17:16.873218+0000","last_undegraded":"2026-02-23T13:17:16.873218+0000","last_fullsized":"2026-02-23T13:17:16.873218+0000","mapping_epoch":96,"log_start":"111'70618","ondisk_log_start":"111'70618","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'41143","last_scrub_stamp":"2026-02-23T13:16:22.619816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:22.619816+0000","objects_scrubbed":40610,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:26.460041+0000","scrub_duration":5359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":724500480,"num_objects":11055,"num_object_clones":0,"num_object_copies":33165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11055,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70621,"num_write_kb":2613632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"111'69860","reported_seq":70308,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:16.715375+0000","last_change":"2026-02-23T13:16:20.211692+0000","last_active":"2026-02-23T13:17:16.715375+0000","last_peered":"2026-02-23T13:17:16.715375+0000","last_clean":"2026-02-23T13:17:16.715375+0000","last_became_active":"2026-02-23T13:14:49.709781+0000","last_became_peered":"2026-02-23T13:14:49.709781+0000","last_unstale":"2026-02-23T13:17:16.715375+0000","last_undegraded":"2026-02-23T13:17:16.715375+0000","last_fullsized":"2026-02-23T13:17:16.715375+0000","mapping_epoch":96,"log_start":"111'69857","ondisk_log_start":"111'69857","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40173","last_scrub_stamp":"2026-02-23T13:16:20.211648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:20.211648+0000","objects_scrubbed":39712,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:32.063367+0000","scrub_duration":3503,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":712376320,"num_objects":10870,"num_object_clones":0,"num_object_copies":32610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10870,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69860,"num_write_kb":2583360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"111'69547","reported_seq":69979,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:16.702251+0000","last_change":"2026-02-23T13:16:16.274976+0000","last_active":"2026-02-23T13:17:16.702251+0000","last_peered":"2026-02-23T13:17:16.702251+0000","last_clean":"2026-02-23T13:17:16.702251+0000","last_became_active":"2026-02-23T13:14:49.709715+0000","last_became_peered":"2026-02-23T13:14:49.709715+0000","last_unstale":"2026-02-23T13:17:16.702251+0000","last_undegraded":"2026-02-23T13:17:16.702251+0000","last_fullsized":"2026-02-23T13:17:16.702251+0000","mapping_epoch":96,"log_start":"111'69544","ondisk_log_start":"111'69544","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38978","last_scrub_stamp":"2026-02-23T13:16:16.274911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:16.274911+0000","objects_scrubbed":38345,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:18.192168+0000","scrub_duration":4034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":725417984,"num_objects":11069,"num_object_clones":0,"num_object_copies":33207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11069,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69547,"num_write_kb":2579712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":445,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:43.312869+0000","last_change":"2026-02-23T13:16:43.312805+0000","last_active":"2026-02-23T13:16:43.312869+0000","last_peered":"2026-02-23T13:16:43.312869+0000","last_clean":"2026-02-23T13:16:43.312869+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:16:43.312869+0000","last_undegraded":"2026-02-23T13:16:43.312869+0000","last_fullsized":"2026-02-23T13:16:43.312869+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:16:43.312764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:16:43.312764+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:54.076451+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":11503206424,"num_objects":175526,"num_object_clones":0,"num_object_copies":526578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":175526,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1117464,"num_write_kb":41375617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34521755648,"data_stored":34521743432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":651,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2157,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247982,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":7954416,"kb_used_data":7210140,"kb_used_omap":9,"kb_used_meta":744246,"kb_avail":726048784,"statfs":{"total":751619276800,"available":743473954816,"internally_reserved":0,"allocated":7383183360,"data_stored":7382578961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9693,"internal_metadata":762108451},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444209,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":9449524,"kb_used_data":8754656,"kb_used_omap":11,"kb_used_meta":694836,"kb_avail":724553676,"statfs":{"total":751619276800,"available":741942964224,"internally_reserved":0,"allocated":8964767744,"data_stored":8964159273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12095,"internal_metadata":711512257},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575027,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":11155440,"kb_used_data":10075996,"kb_used_omap":20,"kb_used_meta":1079339,"kb_avail":722847760,"statfs":{"total":751619276800,"available":740196106240,"internally_reserved":0,"allocated":10317819904,"data_stored":10317214985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20985,"internal_metadata":1105243655},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705844,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":8745012,"kb_used_data":8599840,"kb_used_omap":6,"kb_used_meta":145081,"kb_avail":725258188,"statfs":{"total":751619276800,"available":742664384512,"internally_reserved":0,"allocated":8806236160,"data_stored":8805627689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6569,"internal_metadata":148563543},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2157,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8637845504,"data_stored":8637841432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10014953472,"data_stored":10014949400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8662355968,"data_stored":8662351896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":558,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7206600704,"data_stored":7206600704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93,"internal_metadata":0}]}} 2026-02-23T13:17:20.629 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:17:20.630 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pg_num 381 2026-02-23T13:17:20.635 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:20.815 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:20.876 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:20 trial046 ceph-mon[38575]: 6.5 scrub starts 2026-02-23T13:17:20.898 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:20.897+0000 7fb30d113640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:20.899 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:20.897+0000 7fb30d113640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:20.915 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:17:20.915 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:17:20.930 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:17:20.931 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:17:20.943 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:17:20.943 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:17:20.954 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:20.952+0000 7fbba8ecd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:20.954 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:20.952+0000 7fbba8ecd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:20.956 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:17:20.956 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:17:21.114 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:17:21.156 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:17:22.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:21 trial046 ceph-mon[38575]: from='client.15664 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:17:22.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:21 trial046 ceph-mon[38575]: 6.5 scrub ok 2026-02-23T13:17:22.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:21 trial046 ceph-mon[38575]: 6.7 scrub ok 2026-02-23T13:17:22.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:21 trial046 ceph-mon[38575]: pgmap v517: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 11 GiB data, 36 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 7.20k op/s 2026-02-23T13:17:22.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:21 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1768821842' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:17:22.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:21 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2239274720' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "381"} : dispatch 2026-02-23T13:17:23.001 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:17:23.139 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:23.165 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:22 trial046 ceph-mon[38575]: 6.a scrub starts 2026-02-23T13:17:23.266 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:23.264+0000 7f358d2c5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:23.266 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:23.264+0000 7f358d2c5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:23.280 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:17:23.281 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:17:23.295 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:17:23.296 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:17:23.309 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:17:23.309 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:17:23.322 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:17:23.322 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:17:24.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:23 trial046 ceph-mon[38575]: 6.a scrub ok 2026-02-23T13:17:24.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:23 trial046 ceph-mon[38575]: pgmap v518: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.6 GiB data, 29 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 10.14k op/s 2026-02-23T13:17:24.289 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:23 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1177524190' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:17:25.368 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:17:25.516 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:25.647 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:25.645+0000 7f97b04b6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:25.648 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:25.646+0000 7f97b04b6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:25.648 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:25 trial046 ceph-mon[38575]: 6.b scrub starts 2026-02-23T13:17:25.648 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:25 trial046 ceph-mon[38575]: pgmap v519: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 8.6 GiB data, 29 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 6.32k op/s 2026-02-23T13:17:25.662 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:17:25.662 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:17:25.677 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:17:25.677 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:17:25.691 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:17:25.691 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:17:25.705 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:17:25.706 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:17:26.158 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:17:26.158 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:17:26.158 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:17:26.310 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:26.429 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:17:26 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:17:26] "GET /metrics HTTP/1.1" 200 4226 "" "Prometheus/3.6.0" 2026-02-23T13:17:26.560 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:17:26 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:17:26.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:17:26.717 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:26 trial046 ceph-mon[38575]: 6.b scrub ok 2026-02-23T13:17:26.717 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:26 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3751571195' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:17:26.829 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:26.767+0000 7f3a45780640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:26.829 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:26.767+0000 7f3a45780640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:26.905 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:17:26.906 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:17:27.441 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":520,"stamp":"2026-02-23T13:17:26.708154+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7809466936,"num_objects":119157,"num_object_clones":0,"num_object_copies":357471,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":119157,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":1173970,"num_write_kb":41377767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":27040776,"kb_used_data":24070328,"kb_used_omap":48,"kb_used_meta":2970319,"kb_avail":2908972024,"statfs":{"total":3006477107200,"available":2978787352576,"internally_reserved":0,"allocated":24648015872,"data_stored":24645589612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49652,"internal_metadata":3041607180},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6356533248,"num_objects":-96993,"num_object_clones":0,"num_object_copies":-290979,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-96993,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96993,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001570"},"pg_stats":[{"pgid":"6.f","version":"111'72235","reported_seq":72687,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:21.870214+0000","last_change":"2026-02-23T13:16:23.280934+0000","last_active":"2026-02-23T13:17:21.870214+0000","last_peered":"2026-02-23T13:17:21.870214+0000","last_clean":"2026-02-23T13:17:21.870214+0000","last_became_active":"2026-02-23T13:14:49.710909+0000","last_became_peered":"2026-02-23T13:14:49.710909+0000","last_unstale":"2026-02-23T13:17:21.870214+0000","last_undegraded":"2026-02-23T13:17:21.870214+0000","last_fullsized":"2026-02-23T13:17:21.870214+0000","mapping_epoch":96,"log_start":"111'72232","ondisk_log_start":"111'72232","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'41083","last_scrub_stamp":"2026-02-23T13:16:23.280817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:23.280817+0000","objects_scrubbed":40316,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:26.278733+0000","scrub_duration":4030,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":573243392,"num_objects":8747,"num_object_clones":0,"num_object_copies":26241,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8747,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72235,"num_write_kb":2591424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"111'74752","reported_seq":75307,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:26.704896+0000","last_change":"2026-02-23T13:17:06.151399+0000","last_active":"2026-02-23T13:17:26.704896+0000","last_peered":"2026-02-23T13:17:26.704896+0000","last_clean":"2026-02-23T13:17:26.704896+0000","last_became_active":"2026-02-23T13:14:49.710608+0000","last_became_peered":"2026-02-23T13:14:49.710608+0000","last_unstale":"2026-02-23T13:17:26.704896+0000","last_undegraded":"2026-02-23T13:17:26.704896+0000","last_fullsized":"2026-02-23T13:17:26.704896+0000","mapping_epoch":96,"log_start":"111'74749","ondisk_log_start":"111'74749","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'64208","last_scrub_stamp":"2026-02-23T13:17:06.151332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:17:06.151332+0000","objects_scrubbed":17266,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:18:31.988951+0000","scrub_duration":2143,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405274624,"num_objects":6184,"num_object_clones":0,"num_object_copies":18552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6184,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74752,"num_write_kb":2589952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"111'74356","reported_seq":74801,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:26.701949+0000","last_change":"2026-02-23T13:16:20.125449+0000","last_active":"2026-02-23T13:17:26.701949+0000","last_peered":"2026-02-23T13:17:26.701949+0000","last_clean":"2026-02-23T13:17:26.701949+0000","last_became_active":"2026-02-23T13:14:49.710759+0000","last_became_peered":"2026-02-23T13:14:49.710759+0000","last_unstale":"2026-02-23T13:17:26.701949+0000","last_undegraded":"2026-02-23T13:17:26.701949+0000","last_fullsized":"2026-02-23T13:17:26.701949+0000","mapping_epoch":96,"log_start":"111'74353","ondisk_log_start":"111'74353","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40044","last_scrub_stamp":"2026-02-23T13:16:20.125397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:20.125397+0000","objects_scrubbed":39489,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:35.607693+0000","scrub_duration":4187,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":402849816,"num_objects":6148,"num_object_clones":0,"num_object_copies":18444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6148,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":74356,"num_write_kb":2576065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"111'72673","reported_seq":73094,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:21.873776+0000","last_change":"2026-02-23T13:16:12.911605+0000","last_active":"2026-02-23T13:17:21.873776+0000","last_peered":"2026-02-23T13:17:21.873776+0000","last_clean":"2026-02-23T13:17:21.873776+0000","last_became_active":"2026-02-23T13:14:49.710648+0000","last_became_peered":"2026-02-23T13:14:49.710648+0000","last_unstale":"2026-02-23T13:17:21.873776+0000","last_undegraded":"2026-02-23T13:17:21.873776+0000","last_fullsized":"2026-02-23T13:17:21.873776+0000","mapping_epoch":96,"log_start":"111'72670","ondisk_log_start":"111'72670","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38184","last_scrub_stamp":"2026-02-23T13:16:12.911442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:12.911442+0000","objects_scrubbed":37197,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:25.172701+0000","scrub_duration":5652,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":581369856,"num_objects":8871,"num_object_clones":0,"num_object_copies":26613,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8871,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72673,"num_write_kb":2609408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"111'71982","reported_seq":72411,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:21.873691+0000","last_change":"2026-02-23T13:16:14.901799+0000","last_active":"2026-02-23T13:17:21.873691+0000","last_peered":"2026-02-23T13:17:21.873691+0000","last_clean":"2026-02-23T13:17:21.873691+0000","last_became_active":"2026-02-23T13:14:49.709875+0000","last_became_peered":"2026-02-23T13:14:49.709875+0000","last_unstale":"2026-02-23T13:17:21.873691+0000","last_undegraded":"2026-02-23T13:17:21.873691+0000","last_fullsized":"2026-02-23T13:17:21.873691+0000","mapping_epoch":96,"log_start":"111'71979","ondisk_log_start":"111'71979","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38474","last_scrub_stamp":"2026-02-23T13:16:14.901765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.901765+0000","objects_scrubbed":37818,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:23.823920+0000","scrub_duration":4577,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575275008,"num_objects":8778,"num_object_clones":0,"num_object_copies":26334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8778,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71982,"num_write_kb":2584320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"111'75010","reported_seq":75559,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:26.699401+0000","last_change":"2026-02-23T13:17:22.234798+0000","last_active":"2026-02-23T13:17:26.699401+0000","last_peered":"2026-02-23T13:17:26.699401+0000","last_clean":"2026-02-23T13:17:26.699401+0000","last_became_active":"2026-02-23T13:14:49.709618+0000","last_became_peered":"2026-02-23T13:14:49.709618+0000","last_unstale":"2026-02-23T13:17:26.699401+0000","last_undegraded":"2026-02-23T13:17:26.699401+0000","last_fullsized":"2026-02-23T13:17:26.699401+0000","mapping_epoch":96,"log_start":"111'75007","ondisk_log_start":"111'75007","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'72605","last_scrub_stamp":"2026-02-23T13:17:22.234720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:17:22.234720+0000","objects_scrubbed":8851,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:18:42.082026+0000","scrub_duration":1106,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404094976,"num_objects":6166,"num_object_clones":0,"num_object_copies":18498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6166,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75010,"num_write_kb":2597632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"111'71555","reported_seq":72005,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:21.719876+0000","last_change":"2026-02-23T13:16:23.670756+0000","last_active":"2026-02-23T13:17:21.719876+0000","last_peered":"2026-02-23T13:17:21.719876+0000","last_clean":"2026-02-23T13:17:21.719876+0000","last_became_active":"2026-02-23T13:14:49.711647+0000","last_became_peered":"2026-02-23T13:14:49.711647+0000","last_unstale":"2026-02-23T13:17:21.719876+0000","last_undegraded":"2026-02-23T13:17:21.719876+0000","last_fullsized":"2026-02-23T13:17:21.719876+0000","mapping_epoch":96,"log_start":"111'71552","ondisk_log_start":"111'71552","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40918","last_scrub_stamp":"2026-02-23T13:16:23.670714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:23.670714+0000","objects_scrubbed":39913,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:29.633725+0000","scrub_duration":5904,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":571539456,"num_objects":8721,"num_object_clones":0,"num_object_copies":26163,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8721,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71555,"num_write_kb":2568832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"111'73996","reported_seq":74420,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:26.699955+0000","last_change":"2026-02-23T13:16:14.478890+0000","last_active":"2026-02-23T13:17:26.699955+0000","last_peered":"2026-02-23T13:17:26.699955+0000","last_clean":"2026-02-23T13:17:26.699955+0000","last_became_active":"2026-02-23T13:14:49.710064+0000","last_became_peered":"2026-02-23T13:14:49.710064+0000","last_unstale":"2026-02-23T13:17:26.699955+0000","last_undegraded":"2026-02-23T13:17:26.699955+0000","last_fullsized":"2026-02-23T13:17:26.699955+0000","mapping_epoch":96,"log_start":"111'73993","ondisk_log_start":"111'73993","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'37982","last_scrub_stamp":"2026-02-23T13:16:14.478836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.478836+0000","objects_scrubbed":37503,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:35.874054+0000","scrub_duration":3268,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392691712,"num_objects":5992,"num_object_clones":0,"num_object_copies":17976,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5992,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73996,"num_write_kb":2559616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"111'71789","reported_seq":72228,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:21.872906+0000","last_change":"2026-02-23T13:16:18.449205+0000","last_active":"2026-02-23T13:17:21.872906+0000","last_peered":"2026-02-23T13:17:21.872906+0000","last_clean":"2026-02-23T13:17:21.872906+0000","last_became_active":"2026-02-23T13:14:49.711227+0000","last_became_peered":"2026-02-23T13:14:49.711227+0000","last_unstale":"2026-02-23T13:17:21.872906+0000","last_undegraded":"2026-02-23T13:17:21.872906+0000","last_fullsized":"2026-02-23T13:17:21.872906+0000","mapping_epoch":96,"log_start":"111'71786","ondisk_log_start":"111'71786","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'39520","last_scrub_stamp":"2026-02-23T13:16:18.449176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:18.449176+0000","objects_scrubbed":38818,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:46.860861+0000","scrub_duration":4228,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570359808,"num_objects":8703,"num_object_clones":0,"num_object_copies":26109,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8703,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71789,"num_write_kb":2575744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"111'74875","reported_seq":75396,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:26.700383+0000","last_change":"2026-02-23T13:17:20.094051+0000","last_active":"2026-02-23T13:17:26.700383+0000","last_peered":"2026-02-23T13:17:26.700383+0000","last_clean":"2026-02-23T13:17:26.700383+0000","last_became_active":"2026-02-23T13:14:49.710282+0000","last_became_peered":"2026-02-23T13:14:49.710282+0000","last_unstale":"2026-02-23T13:17:26.700383+0000","last_undegraded":"2026-02-23T13:17:26.700383+0000","last_fullsized":"2026-02-23T13:17:26.700383+0000","mapping_epoch":96,"log_start":"111'74872","ondisk_log_start":"111'74872","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'71531","last_scrub_stamp":"2026-02-23T13:17:20.093988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:17:20.093988+0000","objects_scrubbed":9661,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:18:32.564986+0000","scrub_duration":1005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":403505152,"num_objects":6157,"num_object_clones":0,"num_object_copies":18471,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6157,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74875,"num_write_kb":2593024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"111'72313","reported_seq":72742,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:21.874950+0000","last_change":"2026-02-23T13:16:14.521114+0000","last_active":"2026-02-23T13:17:21.874950+0000","last_peered":"2026-02-23T13:17:21.874950+0000","last_clean":"2026-02-23T13:17:21.874950+0000","last_became_active":"2026-02-23T13:14:49.710940+0000","last_became_peered":"2026-02-23T13:14:49.710940+0000","last_unstale":"2026-02-23T13:17:21.874950+0000","last_undegraded":"2026-02-23T13:17:21.874950+0000","last_fullsized":"2026-02-23T13:17:21.874950+0000","mapping_epoch":96,"log_start":"111'72310","ondisk_log_start":"111'72310","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38521","last_scrub_stamp":"2026-02-23T13:16:14.521031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.521031+0000","objects_scrubbed":37865,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:27.481651+0000","scrub_duration":5257,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570228736,"num_objects":8701,"num_object_clones":0,"num_object_copies":26103,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8701,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72313,"num_write_kb":2592448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"111'74248","reported_seq":74673,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:26.704662+0000","last_change":"2026-02-23T13:16:14.247596+0000","last_active":"2026-02-23T13:17:26.704662+0000","last_peered":"2026-02-23T13:17:26.704662+0000","last_clean":"2026-02-23T13:17:26.704662+0000","last_became_active":"2026-02-23T13:14:49.708668+0000","last_became_peered":"2026-02-23T13:14:49.708668+0000","last_unstale":"2026-02-23T13:17:26.704662+0000","last_undegraded":"2026-02-23T13:17:26.704662+0000","last_fullsized":"2026-02-23T13:17:26.704662+0000","mapping_epoch":96,"log_start":"111'74245","ondisk_log_start":"111'74245","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38121","last_scrub_stamp":"2026-02-23T13:16:14.247558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.247558+0000","objects_scrubbed":37453,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:30.117734+0000","scrub_duration":4283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":400687104,"num_objects":6114,"num_object_clones":0,"num_object_copies":18342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74248,"num_write_kb":2571584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"111'74750","reported_seq":75262,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:26.697704+0000","last_change":"2026-02-23T13:17:17.014835+0000","last_active":"2026-02-23T13:17:26.697704+0000","last_peered":"2026-02-23T13:17:26.697704+0000","last_clean":"2026-02-23T13:17:26.697704+0000","last_became_active":"2026-02-23T13:14:49.709202+0000","last_became_peered":"2026-02-23T13:14:49.709202+0000","last_unstale":"2026-02-23T13:17:26.697704+0000","last_undegraded":"2026-02-23T13:17:26.697704+0000","last_fullsized":"2026-02-23T13:17:26.697704+0000","mapping_epoch":96,"log_start":"111'74747","ondisk_log_start":"111'74747","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'70132","last_scrub_stamp":"2026-02-23T13:17:17.014780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:17:17.014780+0000","objects_scrubbed":10997,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:18:40.940651+0000","scrub_duration":821,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":403177472,"num_objects":6152,"num_object_clones":0,"num_object_copies":18456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6152,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74750,"num_write_kb":2588864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"111'72903","reported_seq":73357,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:21.875655+0000","last_change":"2026-02-23T13:16:22.619866+0000","last_active":"2026-02-23T13:17:21.875655+0000","last_peered":"2026-02-23T13:17:21.875655+0000","last_clean":"2026-02-23T13:17:21.875655+0000","last_became_active":"2026-02-23T13:14:49.710193+0000","last_became_peered":"2026-02-23T13:14:49.710193+0000","last_unstale":"2026-02-23T13:17:21.875655+0000","last_undegraded":"2026-02-23T13:17:21.875655+0000","last_fullsized":"2026-02-23T13:17:21.875655+0000","mapping_epoch":96,"log_start":"111'72900","ondisk_log_start":"111'72900","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'41143","last_scrub_stamp":"2026-02-23T13:16:22.619816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:22.619816+0000","objects_scrubbed":40610,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:26.460041+0000","scrub_duration":5359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574947328,"num_objects":8773,"num_object_clones":0,"num_object_copies":26319,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8773,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72903,"num_write_kb":2613632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"111'72066","reported_seq":72514,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:21.707815+0000","last_change":"2026-02-23T13:16:20.211692+0000","last_active":"2026-02-23T13:17:21.707815+0000","last_peered":"2026-02-23T13:17:21.707815+0000","last_clean":"2026-02-23T13:17:21.707815+0000","last_became_active":"2026-02-23T13:14:49.709781+0000","last_became_peered":"2026-02-23T13:14:49.709781+0000","last_unstale":"2026-02-23T13:17:21.707815+0000","last_undegraded":"2026-02-23T13:17:21.707815+0000","last_fullsized":"2026-02-23T13:17:21.707815+0000","mapping_epoch":96,"log_start":"111'72063","ondisk_log_start":"111'72063","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40173","last_scrub_stamp":"2026-02-23T13:16:20.211648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:20.211648+0000","objects_scrubbed":39712,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:32.063367+0000","scrub_duration":3503,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":567803904,"num_objects":8664,"num_object_clones":0,"num_object_copies":25992,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8664,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72066,"num_write_kb":2583360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"111'74332","reported_seq":74871,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:26.697783+0000","last_change":"2026-02-23T13:17:20.408610+0000","last_active":"2026-02-23T13:17:26.697783+0000","last_peered":"2026-02-23T13:17:26.697783+0000","last_clean":"2026-02-23T13:17:26.697783+0000","last_became_active":"2026-02-23T13:14:49.709715+0000","last_became_peered":"2026-02-23T13:14:49.709715+0000","last_unstale":"2026-02-23T13:17:26.697783+0000","last_undegraded":"2026-02-23T13:17:26.697783+0000","last_fullsized":"2026-02-23T13:17:26.697783+0000","mapping_epoch":96,"log_start":"111'74329","ondisk_log_start":"111'74329","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'71136","last_scrub_stamp":"2026-02-23T13:17:20.408544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:17:20.408544+0000","objects_scrubbed":9683,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:18:22.516214+0000","scrub_duration":1209,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411828224,"num_objects":6284,"num_object_clones":0,"num_object_copies":18852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6284,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74332,"num_write_kb":2579712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":445,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:43.312869+0000","last_change":"2026-02-23T13:16:43.312805+0000","last_active":"2026-02-23T13:16:43.312869+0000","last_peered":"2026-02-23T13:16:43.312869+0000","last_clean":"2026-02-23T13:16:43.312869+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:16:43.312869+0000","last_undegraded":"2026-02-23T13:16:43.312869+0000","last_fullsized":"2026-02-23T13:16:43.312869+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:16:43.312764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:16:43.312764+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:54.076451+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":7808876568,"num_objects":119155,"num_object_clones":0,"num_object_copies":357465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":119155,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1173835,"num_write_kb":41375617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":23813894144,"data_stored":23813881928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":868,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2157,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247984,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4886320,"kb_used_data":4051804,"kb_used_omap":9,"kb_used_meta":834486,"kb_avail":729116880,"statfs":{"total":751619276800,"available":746615685120,"internally_reserved":0,"allocated":4149047296,"data_stored":4148442897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9817,"internal_metadata":854514087},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444211,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":5800820,"kb_used_data":4997664,"kb_used_omap":11,"kb_used_meta":803124,"kb_avail":728202380,"statfs":{"total":751619276800,"available":745679237120,"internally_reserved":0,"allocated":5117607936,"data_stored":5116999465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12281,"internal_metadata":822398983},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575028,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":9219888,"kb_used_data":8086364,"kb_used_omap":20,"kb_used_meta":1133483,"kb_avail":724783312,"statfs":{"total":751619276800,"available":742178111488,"internally_reserved":0,"allocated":8280436736,"data_stored":8279831817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20985,"internal_metadata":1160687111},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705845,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":7133748,"kb_used_data":6934496,"kb_used_omap":6,"kb_used_meta":199225,"kb_avail":726869452,"statfs":{"total":751619276800,"available":744314318848,"internally_reserved":0,"allocated":7100923904,"data_stored":7100315433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6569,"internal_metadata":204006999},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2157,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6909005824,"data_stored":6909001752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8000180224,"data_stored":8000176152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4863430656,"data_stored":4863426584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":744,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4041277440,"data_stored":4041277440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":124,"internal_metadata":0}]}} 2026-02-23T13:17:27.750 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:17:27.775 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:27 trial046 ceph-mon[38575]: pgmap v520: 17 pgs: 17 active+clean; 7.3 GiB data, 26 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 8.08k op/s 2026-02-23T13:17:27.902 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:28.330 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:28.261+0000 7f2d6b55f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:28.330 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:28.262+0000 7f2d6b55f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:28.330 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:17:28.331 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:17:28.331 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:17:28.331 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:17:28.331 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:17:28.331 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:17:28.331 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:17:28.332 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:17:29.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:28 trial046 ceph-mon[38575]: from='client.15674 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:17:29.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:28 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/733257673' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:17:30.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:29 trial046 ceph-mon[38575]: pgmap v521: 17 pgs: 17 active+clean; 6.0 GiB data, 22 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 8.14k op/s 2026-02-23T13:17:30.849 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:17:30.995 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:31.117 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:31.115+0000 7fdee14c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:31.117 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:31.115+0000 7fdee14c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:31.132 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:17:31.132 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:17:31.147 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:17:31.148 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:17:31.163 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:17:31.163 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:17:31.176 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:17:31.176 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:17:32.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:31 trial046 ceph-mon[38575]: pgmap v522: 17 pgs: 17 active+clean; 6.0 GiB data, 22 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 6.44k op/s 2026-02-23T13:17:32.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:31 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:17:32.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:31 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1917813675' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:17:32.443 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:17:32.444 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:17:32.444 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-23T13:17:32.444 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:17:32.582 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:32.937 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:32.887+0000 7f2e112eb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:32.937 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:32.887+0000 7f2e112eb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:33.031 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:17:33.031 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:32 trial046 ceph-mon[38575]: osdmap e112: 4 total, 4 up, 4 in 2026-02-23T13:17:33.032 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:17:33.219 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:17:33.286 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":524,"stamp":"2026-02-23T13:17:32.708923+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3852665400,"num_objects":58781,"num_object_clones":0,"num_object_copies":176343,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58781,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":1234346,"num_write_kb":41377767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":15594696,"kb_used_data":12299256,"kb_used_omap":48,"kb_used_meta":3295183,"kb_avail":2920418104,"statfs":{"total":3006477107200,"available":2990508138496,"internally_reserved":0,"allocated":12594438144,"data_stored":12592011884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49744,"internal_metadata":3374267824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[13,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5343870976,"num_objects":-81541,"num_object_clones":0,"num_object_copies":-244623,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-81541,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81541,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001305"},"pg_stats":[{"pgid":"6.f","version":"112'77325","reported_seq":77779,"reported_epoch":112,"state":"active+clean","last_fresh":"2026-02-23T13:17:31.871448+0000","last_change":"2026-02-23T13:16:23.280934+0000","last_active":"2026-02-23T13:17:31.871448+0000","last_peered":"2026-02-23T13:17:31.871448+0000","last_clean":"2026-02-23T13:17:31.871448+0000","last_became_active":"2026-02-23T13:14:49.710909+0000","last_became_peered":"2026-02-23T13:14:49.710909+0000","last_unstale":"2026-02-23T13:17:31.871448+0000","last_undegraded":"2026-02-23T13:17:31.871448+0000","last_fullsized":"2026-02-23T13:17:31.871448+0000","mapping_epoch":96,"log_start":"112'77322","ondisk_log_start":"112'77322","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'41083","last_scrub_stamp":"2026-02-23T13:16:23.280817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:23.280817+0000","objects_scrubbed":40316,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"queued for scrub","scrub_duration":4030,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239665152,"num_objects":3657,"num_object_clones":0,"num_object_copies":10971,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3657,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77325,"num_write_kb":2591424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"111'77230","reported_seq":77786,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:31.701198+0000","last_change":"2026-02-23T13:17:06.151399+0000","last_active":"2026-02-23T13:17:31.701198+0000","last_peered":"2026-02-23T13:17:31.701198+0000","last_clean":"2026-02-23T13:17:31.701198+0000","last_became_active":"2026-02-23T13:14:49.710608+0000","last_became_peered":"2026-02-23T13:14:49.710608+0000","last_unstale":"2026-02-23T13:17:31.701198+0000","last_undegraded":"2026-02-23T13:17:31.701198+0000","last_fullsized":"2026-02-23T13:17:31.701198+0000","mapping_epoch":96,"log_start":"111'77227","ondisk_log_start":"111'77227","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'64208","last_scrub_stamp":"2026-02-23T13:17:06.151332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:17:06.151332+0000","objects_scrubbed":17266,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:18:31.988951+0000","scrub_duration":2143,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":242876416,"num_objects":3706,"num_object_clones":0,"num_object_copies":11118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3706,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77230,"num_write_kb":2589952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"111'76752","reported_seq":77197,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:31.704327+0000","last_change":"2026-02-23T13:16:20.125449+0000","last_active":"2026-02-23T13:17:31.704327+0000","last_peered":"2026-02-23T13:17:31.704327+0000","last_clean":"2026-02-23T13:17:31.704327+0000","last_became_active":"2026-02-23T13:14:49.710759+0000","last_became_peered":"2026-02-23T13:14:49.710759+0000","last_unstale":"2026-02-23T13:17:31.704327+0000","last_undegraded":"2026-02-23T13:17:31.704327+0000","last_fullsized":"2026-02-23T13:17:31.704327+0000","mapping_epoch":96,"log_start":"111'76749","ondisk_log_start":"111'76749","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40044","last_scrub_stamp":"2026-02-23T13:16:20.125397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:20.125397+0000","objects_scrubbed":39489,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:35.607693+0000","scrub_duration":4187,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":245825560,"num_objects":3752,"num_object_clones":0,"num_object_copies":11256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3752,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":76752,"num_write_kb":2576065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"112'77802","reported_seq":78226,"reported_epoch":112,"state":"active+clean","last_fresh":"2026-02-23T13:17:31.875075+0000","last_change":"2026-02-23T13:16:12.911605+0000","last_active":"2026-02-23T13:17:31.875075+0000","last_peered":"2026-02-23T13:17:31.875075+0000","last_clean":"2026-02-23T13:17:31.875075+0000","last_became_active":"2026-02-23T13:14:49.710648+0000","last_became_peered":"2026-02-23T13:14:49.710648+0000","last_unstale":"2026-02-23T13:17:31.875075+0000","last_undegraded":"2026-02-23T13:17:31.875075+0000","last_fullsized":"2026-02-23T13:17:31.875075+0000","mapping_epoch":96,"log_start":"112'77798","ondisk_log_start":"112'77798","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38184","last_scrub_stamp":"2026-02-23T13:16:12.911442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:12.911442+0000","objects_scrubbed":37197,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"queued for scrub","scrub_duration":5652,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":245235712,"num_objects":3742,"num_object_clones":0,"num_object_copies":11226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3742,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77802,"num_write_kb":2609408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"112'77126","reported_seq":77641,"reported_epoch":112,"state":"active+clean","last_fresh":"2026-02-23T13:17:31.874619+0000","last_change":"2026-02-23T13:17:25.195897+0000","last_active":"2026-02-23T13:17:31.874619+0000","last_peered":"2026-02-23T13:17:31.874619+0000","last_clean":"2026-02-23T13:17:31.874619+0000","last_became_active":"2026-02-23T13:14:49.709875+0000","last_became_peered":"2026-02-23T13:14:49.709875+0000","last_unstale":"2026-02-23T13:17:31.874619+0000","last_undegraded":"2026-02-23T13:17:31.874619+0000","last_fullsized":"2026-02-23T13:17:31.874619+0000","mapping_epoch":96,"log_start":"112'77123","ondisk_log_start":"112'77123","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'73751","last_scrub_stamp":"2026-02-23T13:17:25.195856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:17:25.195856+0000","objects_scrubbed":7256,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:18:38.775897+0000","scrub_duration":990,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238157824,"num_objects":3634,"num_object_clones":0,"num_object_copies":10902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3634,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77126,"num_write_kb":2584320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"111'77476","reported_seq":78025,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:31.700441+0000","last_change":"2026-02-23T13:17:22.234798+0000","last_active":"2026-02-23T13:17:31.700441+0000","last_peered":"2026-02-23T13:17:31.700441+0000","last_clean":"2026-02-23T13:17:31.700441+0000","last_became_active":"2026-02-23T13:14:49.709618+0000","last_became_peered":"2026-02-23T13:14:49.709618+0000","last_unstale":"2026-02-23T13:17:31.700441+0000","last_undegraded":"2026-02-23T13:17:31.700441+0000","last_fullsized":"2026-02-23T13:17:31.700441+0000","mapping_epoch":96,"log_start":"111'77473","ondisk_log_start":"111'77473","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'72605","last_scrub_stamp":"2026-02-23T13:17:22.234720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:17:22.234720+0000","objects_scrubbed":8851,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:18:42.082026+0000","scrub_duration":1106,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":242483200,"num_objects":3700,"num_object_clones":0,"num_object_copies":11100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3700,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77476,"num_write_kb":2597632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"111'76627","reported_seq":77077,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:31.718366+0000","last_change":"2026-02-23T13:16:23.670756+0000","last_active":"2026-02-23T13:17:31.718366+0000","last_peered":"2026-02-23T13:17:31.718366+0000","last_clean":"2026-02-23T13:17:31.718366+0000","last_became_active":"2026-02-23T13:14:49.711647+0000","last_became_peered":"2026-02-23T13:14:49.711647+0000","last_unstale":"2026-02-23T13:17:31.718366+0000","last_undegraded":"2026-02-23T13:17:31.718366+0000","last_fullsized":"2026-02-23T13:17:31.718366+0000","mapping_epoch":96,"log_start":"111'76624","ondisk_log_start":"111'76624","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40918","last_scrub_stamp":"2026-02-23T13:16:23.670714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:23.670714+0000","objects_scrubbed":39913,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"queued for scrub","scrub_duration":5904,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239140864,"num_objects":3649,"num_object_clones":0,"num_object_copies":10947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3649,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76627,"num_write_kb":2568832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"111'76349","reported_seq":76773,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:31.701148+0000","last_change":"2026-02-23T13:16:14.478890+0000","last_active":"2026-02-23T13:17:31.701148+0000","last_peered":"2026-02-23T13:17:31.701148+0000","last_clean":"2026-02-23T13:17:31.701148+0000","last_became_active":"2026-02-23T13:14:49.710064+0000","last_became_peered":"2026-02-23T13:14:49.710064+0000","last_unstale":"2026-02-23T13:17:31.701148+0000","last_undegraded":"2026-02-23T13:17:31.701148+0000","last_fullsized":"2026-02-23T13:17:31.701148+0000","mapping_epoch":96,"log_start":"111'76346","ondisk_log_start":"111'76346","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'37982","last_scrub_stamp":"2026-02-23T13:16:14.478836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.478836+0000","objects_scrubbed":37503,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:35.874054+0000","scrub_duration":3268,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238485504,"num_objects":3639,"num_object_clones":0,"num_object_copies":10917,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3639,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76349,"num_write_kb":2559616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"112'76898","reported_seq":77339,"reported_epoch":112,"state":"active+clean","last_fresh":"2026-02-23T13:17:31.875788+0000","last_change":"2026-02-23T13:16:18.449205+0000","last_active":"2026-02-23T13:17:31.875788+0000","last_peered":"2026-02-23T13:17:31.875788+0000","last_clean":"2026-02-23T13:17:31.875788+0000","last_became_active":"2026-02-23T13:14:49.711227+0000","last_became_peered":"2026-02-23T13:14:49.711227+0000","last_unstale":"2026-02-23T13:17:31.875788+0000","last_undegraded":"2026-02-23T13:17:31.875788+0000","last_fullsized":"2026-02-23T13:17:31.875788+0000","mapping_epoch":96,"log_start":"112'76895","ondisk_log_start":"112'76895","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'39520","last_scrub_stamp":"2026-02-23T13:16:18.449176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:18.449176+0000","objects_scrubbed":38818,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:46.860861+0000","scrub_duration":4228,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":235536384,"num_objects":3594,"num_object_clones":0,"num_object_copies":10782,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3594,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76898,"num_write_kb":2575744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"111'77300","reported_seq":77821,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:31.703796+0000","last_change":"2026-02-23T13:17:20.094051+0000","last_active":"2026-02-23T13:17:31.703796+0000","last_peered":"2026-02-23T13:17:31.703796+0000","last_clean":"2026-02-23T13:17:31.703796+0000","last_became_active":"2026-02-23T13:14:49.710282+0000","last_became_peered":"2026-02-23T13:14:49.710282+0000","last_unstale":"2026-02-23T13:17:31.703796+0000","last_undegraded":"2026-02-23T13:17:31.703796+0000","last_fullsized":"2026-02-23T13:17:31.703796+0000","mapping_epoch":96,"log_start":"111'77297","ondisk_log_start":"111'77297","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'71531","last_scrub_stamp":"2026-02-23T13:17:20.093988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:17:20.093988+0000","objects_scrubbed":9661,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:18:32.564986+0000","scrub_duration":1005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":244580352,"num_objects":3732,"num_object_clones":0,"num_object_copies":11196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3732,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77300,"num_write_kb":2593024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"112'77477","reported_seq":77907,"reported_epoch":112,"state":"active+clean","last_fresh":"2026-02-23T13:17:31.872418+0000","last_change":"2026-02-23T13:16:14.521114+0000","last_active":"2026-02-23T13:17:31.872418+0000","last_peered":"2026-02-23T13:17:31.872418+0000","last_clean":"2026-02-23T13:17:31.872418+0000","last_became_active":"2026-02-23T13:14:49.710940+0000","last_became_peered":"2026-02-23T13:14:49.710940+0000","last_unstale":"2026-02-23T13:17:31.872418+0000","last_undegraded":"2026-02-23T13:17:31.872418+0000","last_fullsized":"2026-02-23T13:17:31.872418+0000","mapping_epoch":96,"log_start":"112'77474","ondisk_log_start":"112'77474","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38521","last_scrub_stamp":"2026-02-23T13:16:14.521031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.521031+0000","objects_scrubbed":37865,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"queued for scrub","scrub_duration":5257,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231800832,"num_objects":3537,"num_object_clones":0,"num_object_copies":10611,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3537,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77477,"num_write_kb":2592448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"111'76694","reported_seq":77119,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:31.703035+0000","last_change":"2026-02-23T13:16:14.247596+0000","last_active":"2026-02-23T13:17:31.703035+0000","last_peered":"2026-02-23T13:17:31.703035+0000","last_clean":"2026-02-23T13:17:31.703035+0000","last_became_active":"2026-02-23T13:14:49.708668+0000","last_became_peered":"2026-02-23T13:14:49.708668+0000","last_unstale":"2026-02-23T13:17:31.703035+0000","last_undegraded":"2026-02-23T13:17:31.703035+0000","last_fullsized":"2026-02-23T13:17:31.703035+0000","mapping_epoch":96,"log_start":"111'76691","ondisk_log_start":"111'76691","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38121","last_scrub_stamp":"2026-02-23T13:16:14.247558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.247558+0000","objects_scrubbed":37453,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"queued for scrub","scrub_duration":4283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":240386048,"num_objects":3668,"num_object_clones":0,"num_object_copies":11004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3668,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76694,"num_write_kb":2571584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"111'77243","reported_seq":77755,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:31.700951+0000","last_change":"2026-02-23T13:17:17.014835+0000","last_active":"2026-02-23T13:17:31.700951+0000","last_peered":"2026-02-23T13:17:31.700951+0000","last_clean":"2026-02-23T13:17:31.700951+0000","last_became_active":"2026-02-23T13:14:49.709202+0000","last_became_peered":"2026-02-23T13:14:49.709202+0000","last_unstale":"2026-02-23T13:17:31.700951+0000","last_undegraded":"2026-02-23T13:17:31.700951+0000","last_fullsized":"2026-02-23T13:17:31.700951+0000","mapping_epoch":96,"log_start":"111'77240","ondisk_log_start":"111'77240","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'70132","last_scrub_stamp":"2026-02-23T13:17:17.014780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:17:17.014780+0000","objects_scrubbed":10997,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:18:40.940651+0000","scrub_duration":821,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239796224,"num_objects":3659,"num_object_clones":0,"num_object_copies":10977,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3659,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77243,"num_write_kb":2588864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"112'78007","reported_seq":78465,"reported_epoch":112,"state":"active+clean","last_fresh":"2026-02-23T13:17:31.871992+0000","last_change":"2026-02-23T13:16:22.619866+0000","last_active":"2026-02-23T13:17:31.871992+0000","last_peered":"2026-02-23T13:17:31.871992+0000","last_clean":"2026-02-23T13:17:31.871992+0000","last_became_active":"2026-02-23T13:14:49.710193+0000","last_became_peered":"2026-02-23T13:14:49.710193+0000","last_unstale":"2026-02-23T13:17:31.871992+0000","last_undegraded":"2026-02-23T13:17:31.871992+0000","last_fullsized":"2026-02-23T13:17:31.871992+0000","mapping_epoch":96,"log_start":"112'78004","ondisk_log_start":"112'78004","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'41143","last_scrub_stamp":"2026-02-23T13:16:22.619816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:22.619816+0000","objects_scrubbed":40610,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"queued for scrub","scrub_duration":5359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":240451584,"num_objects":3669,"num_object_clones":0,"num_object_copies":11007,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78007,"num_write_kb":2613632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"111'77126","reported_seq":77574,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:31.716455+0000","last_change":"2026-02-23T13:16:20.211692+0000","last_active":"2026-02-23T13:17:31.716455+0000","last_peered":"2026-02-23T13:17:31.716455+0000","last_clean":"2026-02-23T13:17:31.716455+0000","last_became_active":"2026-02-23T13:14:49.709781+0000","last_became_peered":"2026-02-23T13:14:49.709781+0000","last_unstale":"2026-02-23T13:17:31.716455+0000","last_undegraded":"2026-02-23T13:17:31.716455+0000","last_fullsized":"2026-02-23T13:17:31.716455+0000","mapping_epoch":96,"log_start":"111'77123","ondisk_log_start":"111'77123","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40173","last_scrub_stamp":"2026-02-23T13:16:20.211648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:20.211648+0000","objects_scrubbed":39712,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:32.063367+0000","scrub_duration":3503,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":236191744,"num_objects":3604,"num_object_clones":0,"num_object_copies":10812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3604,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77126,"num_write_kb":2583360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"111'76779","reported_seq":77318,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:17:31.697899+0000","last_change":"2026-02-23T13:17:20.408610+0000","last_active":"2026-02-23T13:17:31.697899+0000","last_peered":"2026-02-23T13:17:31.697899+0000","last_clean":"2026-02-23T13:17:31.697899+0000","last_became_active":"2026-02-23T13:14:49.709715+0000","last_became_peered":"2026-02-23T13:14:49.709715+0000","last_unstale":"2026-02-23T13:17:31.697899+0000","last_undegraded":"2026-02-23T13:17:31.697899+0000","last_fullsized":"2026-02-23T13:17:31.697899+0000","mapping_epoch":96,"log_start":"111'76776","ondisk_log_start":"111'76776","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'71136","last_scrub_stamp":"2026-02-23T13:17:20.408544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:17:20.408544+0000","objects_scrubbed":9683,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:18:22.516214+0000","scrub_duration":1209,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251461632,"num_objects":3837,"num_object_clones":0,"num_object_copies":11511,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3837,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76779,"num_write_kb":2579712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":445,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-23T13:16:43.312869+0000","last_change":"2026-02-23T13:16:43.312805+0000","last_active":"2026-02-23T13:16:43.312869+0000","last_peered":"2026-02-23T13:16:43.312869+0000","last_clean":"2026-02-23T13:16:43.312869+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:16:43.312869+0000","last_undegraded":"2026-02-23T13:16:43.312869+0000","last_fullsized":"2026-02-23T13:16:43.312869+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:16:43.312764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:16:43.312764+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:54.076451+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":3852075032,"num_objects":58779,"num_object_clones":0,"num_object_copies":176337,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58779,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1234211,"num_write_kb":41375617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":11582713856,"data_stored":11582701640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2263,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2157,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247985,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3442544,"kb_used_data":2571868,"kb_used_omap":9,"kb_used_meta":870582,"kb_avail":730560656,"statfs":{"total":751619276800,"available":748094111744,"internally_reserved":0,"allocated":2633592832,"data_stored":2632988433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9817,"internal_metadata":891476391},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444212,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4023924,"kb_used_data":3166624,"kb_used_omap":11,"kb_used_meta":857268,"kb_avail":729979276,"statfs":{"total":751619276800,"available":747498778624,"internally_reserved":0,"allocated":3242622976,"data_stored":3242014505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12281,"internal_metadata":877842439},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[12,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575030,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4796400,"kb_used_data":3536540,"kb_used_omap":20,"kb_used_meta":1259819,"kb_avail":729206800,"statfs":{"total":751619276800,"available":746707763200,"internally_reserved":0,"allocated":3621416960,"data_stored":3620812041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21077,"internal_metadata":1290055083},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705847,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3331828,"kb_used_data":3024224,"kb_used_omap":6,"kb_used_meta":307513,"kb_avail":730671372,"statfs":{"total":751619276800,"available":748207484928,"internally_reserved":0,"allocated":3096805376,"data_stored":3096196905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6569,"internal_metadata":314893911},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2157,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2903248896,"data_stored":2903244824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3321696256,"data_stored":3321692184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1395,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2923171840,"data_stored":2923167768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":744,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2434596864,"data_stored":2434596864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":124,"internal_metadata":0}]}} 2026-02-23T13:17:33.288 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 381 2026-02-23T13:17:33.377 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:33.431 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:33.500 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:33.498+0000 7fd30ed1b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:33.500 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:33.498+0000 7fd30ed1b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:33.514 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:17:33.515 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:17:33.529 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:17:33.530 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:17:33.543 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:17:33.543 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:17:33.556 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:17:33.556 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:17:33.565 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:33.564+0000 7f7cb058b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:33.565 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:33.564+0000 7f7cb058b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:33.712 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-23T13:17:33.755 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:17:34.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:33 trial046 ceph-mon[38575]: pgmap v524: 17 pgs: 17 active+clean; 3.6 GiB data, 15 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 8.15k op/s 2026-02-23T13:17:34.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:33 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2165860155' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:17:34.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:33 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3317642971' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "381"} : dispatch 2026-02-23T13:17:35.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:34 trial046 ceph-mon[38575]: 6.3 scrub starts 2026-02-23T13:17:35.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:34 trial046 ceph-mon[38575]: from='client.15680 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:17:35.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:34 trial046 ceph-mon[38575]: 6.c scrub starts 2026-02-23T13:17:35.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:34 trial046 ceph-mon[38575]: 6.3 scrub ok 2026-02-23T13:17:35.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:34 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:17:35.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:34 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:17:35.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:34 trial046 ceph-mon[38575]: 6.c scrub ok 2026-02-23T13:17:35.040 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:34 trial046 ceph-mon[38575]: osdmap e113: 4 total, 4 up, 4 in 2026-02-23T13:17:35.598 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:17:35.741 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:35.878 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:35 trial046 ceph-mon[38575]: 6.9 scrub starts 2026-02-23T13:17:35.879 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:35 trial046 ceph-mon[38575]: 6.9 scrub ok 2026-02-23T13:17:35.879 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:35 trial046 ceph-mon[38575]: pgmap v526: 17 pgs: 17 active+clean; 3.6 GiB data, 15 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 7.55k op/s 2026-02-23T13:17:36.107 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:36.105+0000 7fd081639640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:36.107 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:36.105+0000 7fd081639640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:36.122 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:17:36.122 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:17:36.137 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:17:36.137 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:17:36.138 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:17:36 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:17:36] "GET /metrics HTTP/1.1" 200 4228 "" "Prometheus/3.6.0" 2026-02-23T13:17:36.150 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:17:36.151 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:17:36.165 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:17:36.165 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:17:36.560 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:17:36 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:17:36.086Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:17:37.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:36 trial046 ceph-mon[38575]: 6.f scrub starts 2026-02-23T13:17:37.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:36 trial046 ceph-mon[38575]: 6.f scrub ok 2026-02-23T13:17:37.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:36 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2229616906' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:17:37.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:36 trial046 ceph-mon[38575]: 6.8 scrub starts 2026-02-23T13:17:38.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:37 trial046 ceph-mon[38575]: 6.8 scrub ok 2026-02-23T13:17:38.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:37 trial046 ceph-mon[38575]: pgmap v527: 17 pgs: 17 active+clean; 2.4 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 7.45k op/s 2026-02-23T13:17:38.209 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-23T13:17:38.350 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:38.476 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:38.474+0000 7fb35af27640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:38.476 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:38.474+0000 7fb35af27640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:38.491 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:17:38.491 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:17:38.506 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:17:38.506 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:17:38.520 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:17:38.520 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:17:38.533 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:17:38.533 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:17:38.757 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-23T13:17:38.757 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-23T13:17:38.757 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_4 2026-02-23T13:17:38.757 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:17:38.944 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:39.026 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:38 trial046 ceph-mon[38575]: 6.1 scrub starts 2026-02-23T13:17:39.026 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:38 trial046 ceph-mon[38575]: 6.1 scrub ok 2026-02-23T13:17:39.027 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:38 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/913267391' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:17:39.077 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Removed 646494 objects 2026-02-23T13:17:39.077 INFO:tasks.radosbench.radosbench.0.trial046.stdout:Clean up completed and total clean up time :77.2613 2026-02-23T13:17:39.445 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:39.443+0000 7f1656621640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:39.445 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:39.443+0000 7f1656621640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:39.553 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:17:39.554 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:17:39.588 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":528,"stamp":"2026-02-23T13:17:38.709703+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1233519160,"num_objects":18816,"num_object_clones":0,"num_object_copies":56448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18816,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":1274311,"num_write_kb":41377767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":8120552,"kb_used_data":4626648,"kb_used_omap":54,"kb_used_meta":3493705,"kb_avail":2927892248,"statfs":{"total":3006477107200,"available":2998161661952,"internally_reserved":0,"allocated":4737687552,"data_stored":4735198396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":55977,"internal_metadata":3577554263},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[13,4,3],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5208080384,"num_objects":-79469,"num_object_clones":0,"num_object_copies":-238407,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-79469,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79469,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001007"},"pg_stats":[{"pgid":"6.f","version":"113'79871","reported_seq":80355,"reported_epoch":113,"state":"active+clean","last_fresh":"2026-02-23T13:17:36.875062+0000","last_change":"2026-02-23T13:17:35.691406+0000","last_active":"2026-02-23T13:17:36.875062+0000","last_peered":"2026-02-23T13:17:36.875062+0000","last_clean":"2026-02-23T13:17:36.875062+0000","last_became_active":"2026-02-23T13:14:49.710909+0000","last_became_peered":"2026-02-23T13:14:49.710909+0000","last_unstale":"2026-02-23T13:17:36.875062+0000","last_undegraded":"2026-02-23T13:17:36.875062+0000","last_fullsized":"2026-02-23T13:17:36.875062+0000","mapping_epoch":96,"log_start":"113'79868","ondisk_log_start":"113'79868","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'79288","last_scrub_stamp":"2026-02-23T13:17:35.691349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:17:35.691349+0000","objects_scrubbed":1779,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:19:01.764243+0000","scrub_duration":347,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72810496,"num_objects":1111,"num_object_clones":0,"num_object_copies":3333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1111,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79871,"num_write_kb":2591424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"113'79709","reported_seq":80269,"reported_epoch":113,"state":"active+clean","last_fresh":"2026-02-23T13:17:36.698173+0000","last_change":"2026-02-23T13:17:06.151399+0000","last_active":"2026-02-23T13:17:36.698173+0000","last_peered":"2026-02-23T13:17:36.698173+0000","last_clean":"2026-02-23T13:17:36.698173+0000","last_became_active":"2026-02-23T13:14:49.710608+0000","last_became_peered":"2026-02-23T13:14:49.710608+0000","last_unstale":"2026-02-23T13:17:36.698173+0000","last_undegraded":"2026-02-23T13:17:36.698173+0000","last_fullsized":"2026-02-23T13:17:36.698173+0000","mapping_epoch":96,"log_start":"113'79706","ondisk_log_start":"113'79706","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'64208","last_scrub_stamp":"2026-02-23T13:17:06.151332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:17:06.151332+0000","objects_scrubbed":17266,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:18:31.988951+0000","scrub_duration":2143,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80412672,"num_objects":1227,"num_object_clones":0,"num_object_copies":3681,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1227,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79709,"num_write_kb":2589952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"113'79334","reported_seq":79782,"reported_epoch":113,"state":"active+clean","last_fresh":"2026-02-23T13:17:36.704236+0000","last_change":"2026-02-23T13:16:20.125449+0000","last_active":"2026-02-23T13:17:36.704236+0000","last_peered":"2026-02-23T13:17:36.704236+0000","last_clean":"2026-02-23T13:17:36.704236+0000","last_became_active":"2026-02-23T13:14:49.710759+0000","last_became_peered":"2026-02-23T13:14:49.710759+0000","last_unstale":"2026-02-23T13:17:36.704236+0000","last_undegraded":"2026-02-23T13:17:36.704236+0000","last_fullsized":"2026-02-23T13:17:36.704236+0000","mapping_epoch":96,"log_start":"113'79331","ondisk_log_start":"113'79331","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40044","last_scrub_stamp":"2026-02-23T13:16:20.125397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:20.125397+0000","objects_scrubbed":39489,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"queued for scrub","scrub_duration":4187,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76611608,"num_objects":1170,"num_object_clones":0,"num_object_copies":3510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1170,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":79334,"num_write_kb":2576065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"113'80375","reported_seq":80840,"reported_epoch":113,"state":"active+clean","last_fresh":"2026-02-23T13:17:36.875014+0000","last_change":"2026-02-23T13:17:33.778597+0000","last_active":"2026-02-23T13:17:36.875014+0000","last_peered":"2026-02-23T13:17:36.875014+0000","last_clean":"2026-02-23T13:17:36.875014+0000","last_became_active":"2026-02-23T13:14:49.710648+0000","last_became_peered":"2026-02-23T13:14:49.710648+0000","last_unstale":"2026-02-23T13:17:36.875014+0000","last_undegraded":"2026-02-23T13:17:36.875014+0000","last_fullsized":"2026-02-23T13:17:36.875014+0000","mapping_epoch":96,"log_start":"113'80372","ondisk_log_start":"113'80372","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'78742","last_scrub_stamp":"2026-02-23T13:17:33.778550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:17:33.778550+0000","objects_scrubbed":2906,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:18:59.464179+0000","scrub_duration":479,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76611584,"num_objects":1169,"num_object_clones":0,"num_object_copies":3507,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1169,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80375,"num_write_kb":2609408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"113'79598","reported_seq":80115,"reported_epoch":113,"state":"active+clean","last_fresh":"2026-02-23T13:17:36.877471+0000","last_change":"2026-02-23T13:17:25.195897+0000","last_active":"2026-02-23T13:17:36.877471+0000","last_peered":"2026-02-23T13:17:36.877471+0000","last_clean":"2026-02-23T13:17:36.877471+0000","last_became_active":"2026-02-23T13:14:49.709875+0000","last_became_peered":"2026-02-23T13:14:49.709875+0000","last_unstale":"2026-02-23T13:17:36.877471+0000","last_undegraded":"2026-02-23T13:17:36.877471+0000","last_fullsized":"2026-02-23T13:17:36.877471+0000","mapping_epoch":96,"log_start":"113'79595","ondisk_log_start":"113'79595","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'73751","last_scrub_stamp":"2026-02-23T13:17:25.195856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:17:25.195856+0000","objects_scrubbed":7256,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:18:38.775897+0000","scrub_duration":990,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76152832,"num_objects":1162,"num_object_clones":0,"num_object_copies":3486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1162,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79598,"num_write_kb":2584320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"113'79945","reported_seq":80498,"reported_epoch":113,"state":"active+clean","last_fresh":"2026-02-23T13:17:36.699950+0000","last_change":"2026-02-23T13:17:22.234798+0000","last_active":"2026-02-23T13:17:36.699950+0000","last_peered":"2026-02-23T13:17:36.699950+0000","last_clean":"2026-02-23T13:17:36.699950+0000","last_became_active":"2026-02-23T13:14:49.709618+0000","last_became_peered":"2026-02-23T13:14:49.709618+0000","last_unstale":"2026-02-23T13:17:36.699950+0000","last_undegraded":"2026-02-23T13:17:36.699950+0000","last_fullsized":"2026-02-23T13:17:36.699950+0000","mapping_epoch":96,"log_start":"113'79942","ondisk_log_start":"113'79942","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'72605","last_scrub_stamp":"2026-02-23T13:17:22.234720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:17:22.234720+0000","objects_scrubbed":8851,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:18:42.082026+0000","scrub_duration":1106,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80674816,"num_objects":1231,"num_object_clones":0,"num_object_copies":3693,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1231,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79945,"num_write_kb":2597632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"113'79075","reported_seq":79563,"reported_epoch":113,"state":"active+clean","last_fresh":"2026-02-23T13:17:36.716055+0000","last_change":"2026-02-23T13:17:34.521718+0000","last_active":"2026-02-23T13:17:36.716055+0000","last_peered":"2026-02-23T13:17:36.716055+0000","last_clean":"2026-02-23T13:17:36.716055+0000","last_became_active":"2026-02-23T13:14:49.711647+0000","last_became_peered":"2026-02-23T13:14:49.711647+0000","last_unstale":"2026-02-23T13:17:36.716055+0000","last_undegraded":"2026-02-23T13:17:36.716055+0000","last_fullsized":"2026-02-23T13:17:36.716055+0000","mapping_epoch":96,"log_start":"113'79072","ondisk_log_start":"113'79072","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'77981","last_scrub_stamp":"2026-02-23T13:17:34.521672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:17:34.521672+0000","objects_scrubbed":2346,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:18:40.913795+0000","scrub_duration":229,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78708736,"num_objects":1201,"num_object_clones":0,"num_object_copies":3603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79075,"num_write_kb":2568832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"113'78779","reported_seq":79229,"reported_epoch":113,"state":"active+clean","last_fresh":"2026-02-23T13:17:36.703516+0000","last_change":"2026-02-23T13:17:36.335765+0000","last_active":"2026-02-23T13:17:36.703516+0000","last_peered":"2026-02-23T13:17:36.703516+0000","last_clean":"2026-02-23T13:17:36.703516+0000","last_became_active":"2026-02-23T13:14:49.710064+0000","last_became_peered":"2026-02-23T13:14:49.710064+0000","last_unstale":"2026-02-23T13:17:36.703516+0000","last_undegraded":"2026-02-23T13:17:36.703516+0000","last_fullsized":"2026-02-23T13:17:36.703516+0000","mapping_epoch":96,"log_start":"113'78776","ondisk_log_start":"113'78776","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'78573","last_scrub_stamp":"2026-02-23T13:17:36.335700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:17:36.335700+0000","objects_scrubbed":1472,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:18:58.037201+0000","scrub_duration":212,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79233024,"num_objects":1209,"num_object_clones":0,"num_object_copies":3627,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1209,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78779,"num_write_kb":2559616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"113'79368","reported_seq":79810,"reported_epoch":113,"state":"active+clean","last_fresh":"2026-02-23T13:17:36.878031+0000","last_change":"2026-02-23T13:16:18.449205+0000","last_active":"2026-02-23T13:17:36.878031+0000","last_peered":"2026-02-23T13:17:36.878031+0000","last_clean":"2026-02-23T13:17:36.878031+0000","last_became_active":"2026-02-23T13:14:49.711227+0000","last_became_peered":"2026-02-23T13:14:49.711227+0000","last_unstale":"2026-02-23T13:17:36.878031+0000","last_undegraded":"2026-02-23T13:17:36.878031+0000","last_fullsized":"2026-02-23T13:17:36.878031+0000","mapping_epoch":96,"log_start":"113'79365","ondisk_log_start":"113'79365","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'39520","last_scrub_stamp":"2026-02-23T13:16:18.449176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:18.449176+0000","objects_scrubbed":38818,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:46.860861+0000","scrub_duration":4228,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73662464,"num_objects":1124,"num_object_clones":0,"num_object_copies":3372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1124,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79368,"num_write_kb":2575744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"113'79841","reported_seq":80365,"reported_epoch":113,"state":"active+clean","last_fresh":"2026-02-23T13:17:36.706070+0000","last_change":"2026-02-23T13:17:20.094051+0000","last_active":"2026-02-23T13:17:36.706070+0000","last_peered":"2026-02-23T13:17:36.706070+0000","last_clean":"2026-02-23T13:17:36.706070+0000","last_became_active":"2026-02-23T13:14:49.710282+0000","last_became_peered":"2026-02-23T13:14:49.710282+0000","last_unstale":"2026-02-23T13:17:36.706070+0000","last_undegraded":"2026-02-23T13:17:36.706070+0000","last_fullsized":"2026-02-23T13:17:36.706070+0000","mapping_epoch":96,"log_start":"113'79838","ondisk_log_start":"113'79838","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'71531","last_scrub_stamp":"2026-02-23T13:17:20.093988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:17:20.093988+0000","objects_scrubbed":9661,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:18:32.564986+0000","scrub_duration":1005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78053376,"num_objects":1191,"num_object_clones":0,"num_object_copies":3573,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1191,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79841,"num_write_kb":2593024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"113'79932","reported_seq":80365,"reported_epoch":113,"state":"active+clean","last_fresh":"2026-02-23T13:17:36.875209+0000","last_change":"2026-02-23T13:16:14.521114+0000","last_active":"2026-02-23T13:17:36.875209+0000","last_peered":"2026-02-23T13:17:36.875209+0000","last_clean":"2026-02-23T13:17:36.875209+0000","last_became_active":"2026-02-23T13:14:49.710940+0000","last_became_peered":"2026-02-23T13:14:49.710940+0000","last_unstale":"2026-02-23T13:17:36.875209+0000","last_undegraded":"2026-02-23T13:17:36.875209+0000","last_fullsized":"2026-02-23T13:17:36.875209+0000","mapping_epoch":96,"log_start":"113'79929","ondisk_log_start":"113'79929","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'38521","last_scrub_stamp":"2026-02-23T13:16:14.521031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:14.521031+0000","objects_scrubbed":37865,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"queued for scrub","scrub_duration":5257,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70909952,"num_objects":1082,"num_object_clones":0,"num_object_copies":3246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1082,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79932,"num_write_kb":2592448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"113'79193","reported_seq":79662,"reported_epoch":113,"state":"active+clean","last_fresh":"2026-02-23T13:17:36.705450+0000","last_change":"2026-02-23T13:17:33.320056+0000","last_active":"2026-02-23T13:17:36.705450+0000","last_peered":"2026-02-23T13:17:36.705450+0000","last_clean":"2026-02-23T13:17:36.705450+0000","last_became_active":"2026-02-23T13:14:49.708668+0000","last_became_peered":"2026-02-23T13:14:49.708668+0000","last_unstale":"2026-02-23T13:17:36.705450+0000","last_undegraded":"2026-02-23T13:17:36.705450+0000","last_fullsized":"2026-02-23T13:17:36.705450+0000","mapping_epoch":96,"log_start":"113'79190","ondisk_log_start":"113'79190","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'77436","last_scrub_stamp":"2026-02-23T13:17:33.319920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:17:33.319920+0000","objects_scrubbed":3005,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:19:02.166493+0000","scrub_duration":443,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76611584,"num_objects":1169,"num_object_clones":0,"num_object_copies":3507,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1169,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79193,"num_write_kb":2571584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"113'79715","reported_seq":80231,"reported_epoch":113,"state":"active+clean","last_fresh":"2026-02-23T13:17:36.702362+0000","last_change":"2026-02-23T13:17:17.014835+0000","last_active":"2026-02-23T13:17:36.702362+0000","last_peered":"2026-02-23T13:17:36.702362+0000","last_clean":"2026-02-23T13:17:36.702362+0000","last_became_active":"2026-02-23T13:14:49.709202+0000","last_became_peered":"2026-02-23T13:14:49.709202+0000","last_unstale":"2026-02-23T13:17:36.702362+0000","last_undegraded":"2026-02-23T13:17:36.702362+0000","last_fullsized":"2026-02-23T13:17:36.702362+0000","mapping_epoch":96,"log_start":"113'79712","ondisk_log_start":"113'79712","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'70132","last_scrub_stamp":"2026-02-23T13:17:17.014780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:17:17.014780+0000","objects_scrubbed":10997,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:18:40.940651+0000","scrub_duration":821,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77791232,"num_objects":1187,"num_object_clones":0,"num_object_copies":3561,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1187,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79715,"num_write_kb":2588864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"113'80550","reported_seq":81009,"reported_epoch":113,"state":"active+clean","last_fresh":"2026-02-23T13:17:36.877511+0000","last_change":"2026-02-23T13:16:22.619866+0000","last_active":"2026-02-23T13:17:36.877511+0000","last_peered":"2026-02-23T13:17:36.877511+0000","last_clean":"2026-02-23T13:17:36.877511+0000","last_became_active":"2026-02-23T13:14:49.710193+0000","last_became_peered":"2026-02-23T13:14:49.710193+0000","last_unstale":"2026-02-23T13:17:36.877511+0000","last_undegraded":"2026-02-23T13:17:36.877511+0000","last_fullsized":"2026-02-23T13:17:36.877511+0000","mapping_epoch":96,"log_start":"113'80546","ondisk_log_start":"113'80546","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'41143","last_scrub_stamp":"2026-02-23T13:16:22.619816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:22.619816+0000","objects_scrubbed":40610,"log_size":4,"log_dups_size":3000,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"queued for scrub","scrub_duration":5359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73793536,"num_objects":1126,"num_object_clones":0,"num_object_copies":3378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1126,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80550,"num_write_kb":2613632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"113'79505","reported_seq":79957,"reported_epoch":113,"state":"active+clean","last_fresh":"2026-02-23T13:17:36.717862+0000","last_change":"2026-02-23T13:16:20.211692+0000","last_active":"2026-02-23T13:17:36.717862+0000","last_peered":"2026-02-23T13:17:36.717862+0000","last_clean":"2026-02-23T13:17:36.717862+0000","last_became_active":"2026-02-23T13:14:49.709781+0000","last_became_peered":"2026-02-23T13:14:49.709781+0000","last_unstale":"2026-02-23T13:17:36.717862+0000","last_undegraded":"2026-02-23T13:17:36.717862+0000","last_fullsized":"2026-02-23T13:17:36.717862+0000","mapping_epoch":96,"log_start":"113'79502","ondisk_log_start":"113'79502","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'40173","last_scrub_stamp":"2026-02-23T13:16:20.211648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:16:20.211648+0000","objects_scrubbed":39712,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"queued for scrub","scrub_duration":3503,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80281600,"num_objects":1225,"num_object_clones":0,"num_object_copies":3675,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1225,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79505,"num_write_kb":2583360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"113'79386","reported_seq":79929,"reported_epoch":113,"state":"active+clean","last_fresh":"2026-02-23T13:17:36.695739+0000","last_change":"2026-02-23T13:17:20.408610+0000","last_active":"2026-02-23T13:17:36.695739+0000","last_peered":"2026-02-23T13:17:36.695739+0000","last_clean":"2026-02-23T13:17:36.695739+0000","last_became_active":"2026-02-23T13:14:49.709715+0000","last_became_peered":"2026-02-23T13:14:49.709715+0000","last_unstale":"2026-02-23T13:17:36.695739+0000","last_undegraded":"2026-02-23T13:17:36.695739+0000","last_fullsized":"2026-02-23T13:17:36.695739+0000","mapping_epoch":96,"log_start":"113'79383","ondisk_log_start":"113'79383","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'71136","last_scrub_stamp":"2026-02-23T13:17:20.408544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:14:48.699972+0000","last_clean_scrub_stamp":"2026-02-23T13:17:20.408544+0000","objects_scrubbed":9683,"log_size":3,"log_dups_size":3000,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:18:22.516214+0000","scrub_duration":1209,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80609280,"num_objects":1230,"num_object_clones":0,"num_object_copies":3690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1230,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79386,"num_write_kb":2579712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'99","reported_seq":449,"reported_epoch":113,"state":"active+clean","last_fresh":"2026-02-23T13:17:34.627621+0000","last_change":"2026-02-23T13:16:43.312805+0000","last_active":"2026-02-23T13:17:34.627621+0000","last_peered":"2026-02-23T13:17:34.627621+0000","last_clean":"2026-02-23T13:17:34.627621+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:17:34.627621+0000","last_undegraded":"2026-02-23T13:17:34.627621+0000","last_fullsized":"2026-02-23T13:17:34.627621+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:16:43.312764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:16:43.312764+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:17:54.076451+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":1232928792,"num_objects":18814,"num_object_clones":0,"num_object_copies":56442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18814,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1274176,"num_write_kb":41375617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3728945152,"data_stored":3728932936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3503,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2487,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247986,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1885896,"kb_used_data":979188,"kb_used_omap":10,"kb_used_meta":906677,"kb_avail":732117304,"statfs":{"total":751619276800,"available":749688119296,"internally_reserved":0,"allocated":1002688512,"data_stored":1002068389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11118,"internal_metadata":928437394},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444213,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2166412,"kb_used_data":1273016,"kb_used_omap":13,"kb_used_meta":893362,"kb_avail":731836788,"statfs":{"total":751619276800,"available":749400870912,"internally_reserved":0,"allocated":1303568384,"data_stored":1302944189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13676,"internal_metadata":914803348},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,4],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575031,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2617672,"kb_used_data":1285556,"kb_used_omap":22,"kb_used_meta":1332009,"kb_avail":731385528,"statfs":{"total":751619276800,"available":748938780672,"internally_reserved":0,"allocated":1316409344,"data_stored":1315788701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22565,"internal_metadata":1363978203},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705848,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1450572,"kb_used_data":1088888,"kb_used_omap":8,"kb_used_meta":361655,"kb_avail":732552628,"statfs":{"total":751619276800,"available":750133891072,"internally_reserved":0,"allocated":1115021312,"data_stored":1114397117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8618,"internal_metadata":370335318},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2487,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":949096448,"data_stored":949092376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1029509120,"data_stored":1029505048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1891,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":954863616,"data_stored":954859544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1302,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":795475968,"data_stored":795475968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":217,"internal_metadata":0}]}} 2026-02-23T13:17:39.589 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-23T13:17:39.589 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool set unique_pool_4 pg_num 116 2026-02-23T13:17:39.706 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:39.809 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:39.807+0000 7f21cc2ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:39.809 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:39 trial046 ceph-mon[38575]: pgmap v528: 17 pgs: 17 active+clean; 1.1 GiB data, 7.7 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 9.93k op/s 2026-02-23T13:17:39.809 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:39.807+0000 7f21cc2ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:39.921 INFO:teuthology.orchestra.run.trial046.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-23T13:17:39.953 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:17:41.029 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-23T13:17:41.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:40 trial046 ceph-mon[38575]: 6.0 scrub starts 2026-02-23T13:17:41.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:40 trial046 ceph-mon[38575]: 6.0 scrub ok 2026-02-23T13:17:41.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:40 trial046 ceph-mon[38575]: from='client.15690 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-23T13:17:41.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:40 trial046 ceph-mon[38575]: 6.d scrub starts 2026-02-23T13:17:41.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:40 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/891724110' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pg_num", "val": "116"} : dispatch 2026-02-23T13:17:41.146 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:41.245 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:41.243+0000 7f7ac364a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:41.245 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:41.243+0000 7f7ac364a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:41.258 INFO:teuthology.orchestra.run.trial046.stdout:osd.0: {} 2026-02-23T13:17:41.258 INFO:teuthology.orchestra.run.trial046.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-23T13:17:41.269 INFO:teuthology.orchestra.run.trial046.stdout:osd.1: {} 2026-02-23T13:17:41.269 INFO:teuthology.orchestra.run.trial046.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-23T13:17:41.280 INFO:teuthology.orchestra.run.trial046.stdout:osd.2: {} 2026-02-23T13:17:41.280 INFO:teuthology.orchestra.run.trial046.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-23T13:17:41.292 INFO:teuthology.orchestra.run.trial046.stdout:osd.3: {} 2026-02-23T13:17:41.292 INFO:teuthology.orchestra.run.trial046.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-23T13:17:41.586 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_4 2026-02-23T13:17:41.587 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd pool rm unique_pool_4 unique_pool_4 --yes-i-really-really-mean-it 2026-02-23T13:17:41.703 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:41.804 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:41.802+0000 7f522894b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:41.804 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:41.802+0000 7f522894b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:42.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:41 trial046 ceph-mon[38575]: 6.d scrub ok 2026-02-23T13:17:42.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:41 trial046 ceph-mon[38575]: pgmap v529: 17 pgs: 17 active+clean; 1.1 GiB data, 7.7 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 6.14k op/s 2026-02-23T13:17:42.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:41 trial046 ceph-mon[38575]: osdmap e114: 4 total, 4 up, 4 in 2026-02-23T13:17:42.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:41 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1203612010' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-23T13:17:42.779 INFO:teuthology.orchestra.run.trial046.stderr:pool 'unique_pool_4' removed 2026-02-23T13:17:42.831 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2026-02-23T13:17:42.846 INFO:tasks.thrashosds:joining thrashosds 2026-02-23T13:17:43.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:42 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/732009841' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "unique_pool_4", "pool2": "unique_pool_4", "yes_i_really_really_mean_it": true} : dispatch 2026-02-23T13:17:44.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:43 trial046 ceph-mon[38575]: pgmap v531: 17 pgs: 17 active+clean; 577 KiB data, 3.4 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 7.27k op/s 2026-02-23T13:17:44.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:43 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/732009841' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_4", "pool2": "unique_pool_4", "yes_i_really_really_mean_it": true}]': finished 2026-02-23T13:17:44.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:43 trial046 ceph-mon[38575]: osdmap e115: 4 total, 4 up, 4 in 2026-02-23T13:17:44.954 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2026-02-23T13:17:45.075 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:45.172 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:45.170+0000 7f9c8e61e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:45.172 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:45.170+0000 7f9c8e61e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:45.179 INFO:teuthology.orchestra.run.trial046.stdout:{} 2026-02-23T13:17:45.179 INFO:teuthology.orchestra.run.trial046.stderr:mon_osd_down_out_interval = '' (not observed, change may require restart) 2026-02-23T13:17:45.211 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-23T13:17:45.330 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:45.431 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:45.429+0000 7f8205e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:45.432 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:45.430+0000 7f8205e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:45.636 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.0 to 1 (10000) 2026-02-23T13:17:45.688 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd primary-affinity 0 1 2026-02-23T13:17:45.804 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:45.903 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:45.902+0000 7fbacfbd0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:45.903 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:45 trial046 ceph-mon[38575]: pgmap v533: 1 pgs: 1 active+clean; 577 KiB data, 3.4 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-23T13:17:45.904 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:45 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/274592620' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-23T13:17:45.904 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:45 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3729168721' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-23T13:17:45.904 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:45.902+0000 7fbacfbd0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:46.289 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:17:46 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:17:46] "GET /metrics HTTP/1.1" 200 3898 "" "Prometheus/3.6.0" 2026-02-23T13:17:46.469 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:17:46 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:17:46.087Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:17:46.636 INFO:teuthology.orchestra.run.trial046.stderr:set osd.0 primary-affinity to 1 (8655362) 2026-02-23T13:17:46.694 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-23T13:17:46.811 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:46.911 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:46.910+0000 7fbc7a3ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:46.911 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:46 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3729168721' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-23T13:17:46.911 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:46 trial046 ceph-mon[38575]: osdmap e116: 4 total, 4 up, 4 in 2026-02-23T13:17:46.911 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:46 trial046 ceph-mon[38575]: purged_snaps scrub starts 2026-02-23T13:17:46.912 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:46 trial046 ceph-mon[38575]: purged_snaps scrub ok 2026-02-23T13:17:46.912 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:46 trial046 ceph-mon[38575]: from='mgr.14283 10.20.193.46:0/3048509653' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-23T13:17:46.912 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:46 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2036807543' entity='client.admin' cmd={"prefix": "osd primary-affinity", "id": 0, "weight": 1.0} : dispatch 2026-02-23T13:17:46.912 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:46.910+0000 7fbc7a3ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:47.642 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.1 to 1 (10000) 2026-02-23T13:17:47.683 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd primary-affinity 1 1 2026-02-23T13:17:47.799 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:47.897 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:47.896+0000 7fab88a35640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:47.897 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:47.896+0000 7fab88a35640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:47.898 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:47 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2036807543' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]': finished 2026-02-23T13:17:47.898 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:47 trial046 ceph-mon[38575]: osdmap e117: 4 total, 4 up, 4 in 2026-02-23T13:17:47.898 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:47 trial046 ceph-mon[38575]: pgmap v536: 1 pgs: 1 active+clean; 577 KiB data, 3.4 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-23T13:17:47.898 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:47 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2612846547' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-23T13:17:48.646 INFO:teuthology.orchestra.run.trial046.stderr:set osd.1 primary-affinity to 1 (8655362) 2026-02-23T13:17:48.685 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-23T13:17:48.800 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:48.903 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:48.902+0000 7f9e87f2a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:48.903 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:48 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2612846547' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-23T13:17:48.904 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:48 trial046 ceph-mon[38575]: osdmap e118: 4 total, 4 up, 4 in 2026-02-23T13:17:48.904 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:48 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4109909527' entity='client.admin' cmd={"prefix": "osd primary-affinity", "id": 1, "weight": 1.0} : dispatch 2026-02-23T13:17:48.904 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:48.903+0000 7f9e87f2a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:49.649 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.2 to 1 (10000) 2026-02-23T13:17:49.688 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd primary-affinity 2 1 2026-02-23T13:17:49.804 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:49.901 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:49.900+0000 7f210f577640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:49.902 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:49 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4109909527' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 1, "weight": 1.0}]': finished 2026-02-23T13:17:49.902 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:49 trial046 ceph-mon[38575]: osdmap e119: 4 total, 4 up, 4 in 2026-02-23T13:17:49.902 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:49 trial046 ceph-mon[38575]: pgmap v539: 1 pgs: 1 active+clean; 577 KiB data, 3.5 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-23T13:17:49.902 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:49 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/611862748' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-23T13:17:49.902 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:49.900+0000 7f210f577640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:50.649 INFO:teuthology.orchestra.run.trial046.stderr:set osd.2 primary-affinity to 1 (8655362) 2026-02-23T13:17:50.689 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-23T13:17:50.804 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:50.903 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:50.902+0000 7f89abba1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:50.903 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:50 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/611862748' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-23T13:17:50.904 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:50 trial046 ceph-mon[38575]: osdmap e120: 4 total, 4 up, 4 in 2026-02-23T13:17:50.904 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:50 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3156692247' entity='client.admin' cmd={"prefix": "osd primary-affinity", "id": 2, "weight": 1.0} : dispatch 2026-02-23T13:17:50.904 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:50.903+0000 7f89abba1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:51.656 INFO:teuthology.orchestra.run.trial046.stderr:reweighted osd.3 to 1 (10000) 2026-02-23T13:17:51.694 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd primary-affinity 3 1 2026-02-23T13:17:51.811 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:51.913 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:51.912+0000 7f7377dda640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:51.913 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:51.912+0000 7f7377dda640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:51.913 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:51 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3156692247' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]': finished 2026-02-23T13:17:51.913 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:51 trial046 ceph-mon[38575]: osdmap e121: 4 total, 4 up, 4 in 2026-02-23T13:17:51.913 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:51 trial046 ceph-mon[38575]: pgmap v542: 1 pgs: 1 active+clean; 577 KiB data, 3.5 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-23T13:17:51.914 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:51 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1879671591' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-23T13:17:52.657 INFO:teuthology.orchestra.run.trial046.stderr:set osd.3 primary-affinity to 1 (8655362) 2026-02-23T13:17:52.703 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2026-02-23T13:17:52.703 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-02-23T13:17:52.703 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd dump --format=json 2026-02-23T13:17:52.819 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:52.925 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:52.924+0000 7effcfb90640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:52.925 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:52.924+0000 7effcfb90640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:52.925 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:52 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1879671591' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-23T13:17:52.925 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:52 trial046 ceph-mon[38575]: osdmap e122: 4 total, 4 up, 4 in 2026-02-23T13:17:52.925 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:52 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2041356950' entity='client.admin' cmd={"prefix": "osd primary-affinity", "id": 3, "weight": 1.0} : dispatch 2026-02-23T13:17:53.035 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:17:53.035 INFO:teuthology.orchestra.run.trial046.stdout:{"epoch":123,"fsid":"c3b3ca7d-10b7-11f1-8efe-d404e6e7d460","created":"2026-02-23T13:01:43.505063+0000","modified":"2026-02-23T13:17:52.655816+0000","last_up_change":"2026-02-23T13:02:52.145963+0000","last_in_change":"2026-02-23T13:02:43.100090+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":10,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-23T13:02:43.566068+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"80ca734b-d032-47a7-be2b-bcab1f5b06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6802","nonce":3215761192},{"type":"v1","addr":"10.20.193.46:6803","nonce":3215761192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6804","nonce":3215761192},{"type":"v1","addr":"10.20.193.46:6805","nonce":3215761192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6808","nonce":3215761192},{"type":"v1","addr":"10.20.193.46:6809","nonce":3215761192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6806","nonce":3215761192},{"type":"v1","addr":"10.20.193.46:6807","nonce":3215761192}]},"public_addr":"10.20.193.46:6803/3215761192","cluster_addr":"10.20.193.46:6805/3215761192","heartbeat_back_addr":"10.20.193.46:6809/3215761192","heartbeat_front_addr":"10.20.193.46:6807/3215761192","state":["exists","up"]},{"osd":1,"uuid":"da77bcad-edc4-46df-a2e0-63010b9b6274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6810","nonce":2402797949},{"type":"v1","addr":"10.20.193.46:6811","nonce":2402797949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6812","nonce":2402797949},{"type":"v1","addr":"10.20.193.46:6813","nonce":2402797949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6816","nonce":2402797949},{"type":"v1","addr":"10.20.193.46:6817","nonce":2402797949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6814","nonce":2402797949},{"type":"v1","addr":"10.20.193.46:6815","nonce":2402797949}]},"public_addr":"10.20.193.46:6811/2402797949","cluster_addr":"10.20.193.46:6813/2402797949","heartbeat_back_addr":"10.20.193.46:6817/2402797949","heartbeat_front_addr":"10.20.193.46:6815/2402797949","state":["exists","up"]},{"osd":2,"uuid":"5a84a299-c810-46ba-8968-8cd5bccf127b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6800","nonce":1243371431},{"type":"v1","addr":"10.20.193.131:6801","nonce":1243371431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6802","nonce":1243371431},{"type":"v1","addr":"10.20.193.131:6803","nonce":1243371431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6806","nonce":1243371431},{"type":"v1","addr":"10.20.193.131:6807","nonce":1243371431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6804","nonce":1243371431},{"type":"v1","addr":"10.20.193.131:6805","nonce":1243371431}]},"public_addr":"10.20.193.131:6801/1243371431","cluster_addr":"10.20.193.131:6803/1243371431","heartbeat_back_addr":"10.20.193.131:6807/1243371431","heartbeat_front_addr":"10.20.193.131:6805/1243371431","state":["exists","up"]},{"osd":3,"uuid":"e53b2547-061e-4bfd-aca1-a53b0e860d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6808","nonce":2723309313},{"type":"v1","addr":"10.20.193.131:6809","nonce":2723309313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6810","nonce":2723309313},{"type":"v1","addr":"10.20.193.131:6811","nonce":2723309313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6814","nonce":2723309313},{"type":"v1","addr":"10.20.193.131:6815","nonce":2723309313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6812","nonce":2723309313},{"type":"v1","addr":"10.20.193.131:6813","nonce":2723309313}]},"public_addr":"10.20.193.131:6809/2723309313","cluster_addr":"10.20.193.131:6811/2723309313","heartbeat_back_addr":"10.20.193.131:6815/2723309313","heartbeat_front_addr":"10.20.193.131:6813/2723309313","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T13:16:18.178551+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T13:17:10.153954+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T13:17:07.733195+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T13:12:24.158894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.46:6801/2807562704":"2026-02-24T13:03:00.585589+0000","10.20.193.46:6800/2807562704":"2026-02-24T13:03:00.585589+0000","10.20.193.46:0/1237070006":"2026-02-24T13:03:00.585589+0000","10.20.193.46:0/62318855":"2026-02-24T13:01:53.536089+0000","10.20.193.46:6801/999693074":"2026-02-24T13:01:53.536089+0000","10.20.193.46:0/2765809326":"2026-02-24T13:03:00.585589+0000","10.20.193.46:6800/999693074":"2026-02-24T13:01:53.536089+0000","10.20.193.46:0/3264800521":"2026-02-24T13:03:00.585589+0000","10.20.193.46:0/4291592014":"2026-02-24T13:01:53.536089+0000","10.20.193.46:0/2607309055":"2026-02-24T13:02:03.355584+0000","10.20.193.46:0/460416185":"2026-02-24T13:01:53.536089+0000","10.20.193.46:6800/3808210501":"2026-02-24T13:02:03.355584+0000","10.20.193.46:6801/3808210501":"2026-02-24T13:02:03.355584+0000","10.20.193.46:0/3910278239":"2026-02-24T13:02:03.355584+0000","10.20.193.46:0/3352548256":"2026-02-24T13:02:03.355584+0000","10.20.193.46:0/1308119843":"2026-02-24T13:03:00.585589+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-23T13:17:53.072 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-02-23T13:17:53.073 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd dump --format=json 2026-02-23T13:17:53.189 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:53.293 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:53.292+0000 7ffa3b331640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:53.293 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:53.292+0000 7ffa3b331640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:53.404 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:17:53.404 INFO:teuthology.orchestra.run.trial046.stdout:{"epoch":123,"fsid":"c3b3ca7d-10b7-11f1-8efe-d404e6e7d460","created":"2026-02-23T13:01:43.505063+0000","modified":"2026-02-23T13:17:52.655816+0000","last_up_change":"2026-02-23T13:02:52.145963+0000","last_in_change":"2026-02-23T13:02:43.100090+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":10,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-23T13:02:43.566068+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"80ca734b-d032-47a7-be2b-bcab1f5b06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6802","nonce":3215761192},{"type":"v1","addr":"10.20.193.46:6803","nonce":3215761192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6804","nonce":3215761192},{"type":"v1","addr":"10.20.193.46:6805","nonce":3215761192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6808","nonce":3215761192},{"type":"v1","addr":"10.20.193.46:6809","nonce":3215761192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6806","nonce":3215761192},{"type":"v1","addr":"10.20.193.46:6807","nonce":3215761192}]},"public_addr":"10.20.193.46:6803/3215761192","cluster_addr":"10.20.193.46:6805/3215761192","heartbeat_back_addr":"10.20.193.46:6809/3215761192","heartbeat_front_addr":"10.20.193.46:6807/3215761192","state":["exists","up"]},{"osd":1,"uuid":"da77bcad-edc4-46df-a2e0-63010b9b6274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6810","nonce":2402797949},{"type":"v1","addr":"10.20.193.46:6811","nonce":2402797949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6812","nonce":2402797949},{"type":"v1","addr":"10.20.193.46:6813","nonce":2402797949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6816","nonce":2402797949},{"type":"v1","addr":"10.20.193.46:6817","nonce":2402797949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6814","nonce":2402797949},{"type":"v1","addr":"10.20.193.46:6815","nonce":2402797949}]},"public_addr":"10.20.193.46:6811/2402797949","cluster_addr":"10.20.193.46:6813/2402797949","heartbeat_back_addr":"10.20.193.46:6817/2402797949","heartbeat_front_addr":"10.20.193.46:6815/2402797949","state":["exists","up"]},{"osd":2,"uuid":"5a84a299-c810-46ba-8968-8cd5bccf127b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6800","nonce":1243371431},{"type":"v1","addr":"10.20.193.131:6801","nonce":1243371431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6802","nonce":1243371431},{"type":"v1","addr":"10.20.193.131:6803","nonce":1243371431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6806","nonce":1243371431},{"type":"v1","addr":"10.20.193.131:6807","nonce":1243371431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6804","nonce":1243371431},{"type":"v1","addr":"10.20.193.131:6805","nonce":1243371431}]},"public_addr":"10.20.193.131:6801/1243371431","cluster_addr":"10.20.193.131:6803/1243371431","heartbeat_back_addr":"10.20.193.131:6807/1243371431","heartbeat_front_addr":"10.20.193.131:6805/1243371431","state":["exists","up"]},{"osd":3,"uuid":"e53b2547-061e-4bfd-aca1-a53b0e860d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6808","nonce":2723309313},{"type":"v1","addr":"10.20.193.131:6809","nonce":2723309313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6810","nonce":2723309313},{"type":"v1","addr":"10.20.193.131:6811","nonce":2723309313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6814","nonce":2723309313},{"type":"v1","addr":"10.20.193.131:6815","nonce":2723309313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.131:6812","nonce":2723309313},{"type":"v1","addr":"10.20.193.131:6813","nonce":2723309313}]},"public_addr":"10.20.193.131:6809/2723309313","cluster_addr":"10.20.193.131:6811/2723309313","heartbeat_back_addr":"10.20.193.131:6815/2723309313","heartbeat_front_addr":"10.20.193.131:6813/2723309313","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T13:16:18.178551+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T13:17:10.153954+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T13:17:07.733195+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T13:12:24.158894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.46:6801/2807562704":"2026-02-24T13:03:00.585589+0000","10.20.193.46:6800/2807562704":"2026-02-24T13:03:00.585589+0000","10.20.193.46:0/1237070006":"2026-02-24T13:03:00.585589+0000","10.20.193.46:0/62318855":"2026-02-24T13:01:53.536089+0000","10.20.193.46:6801/999693074":"2026-02-24T13:01:53.536089+0000","10.20.193.46:0/2765809326":"2026-02-24T13:03:00.585589+0000","10.20.193.46:6800/999693074":"2026-02-24T13:01:53.536089+0000","10.20.193.46:0/3264800521":"2026-02-24T13:03:00.585589+0000","10.20.193.46:0/4291592014":"2026-02-24T13:01:53.536089+0000","10.20.193.46:0/2607309055":"2026-02-24T13:02:03.355584+0000","10.20.193.46:0/460416185":"2026-02-24T13:01:53.536089+0000","10.20.193.46:6800/3808210501":"2026-02-24T13:02:03.355584+0000","10.20.193.46:6801/3808210501":"2026-02-24T13:02:03.355584+0000","10.20.193.46:0/3910278239":"2026-02-24T13:02:03.355584+0000","10.20.193.46:0/3352548256":"2026-02-24T13:02:03.355584+0000","10.20.193.46:0/1308119843":"2026-02-24T13:03:00.585589+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-23T13:17:53.441 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph tell osd.0 flush_pg_stats 2026-02-23T13:17:53.442 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph tell osd.1 flush_pg_stats 2026-02-23T13:17:53.442 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph tell osd.2 flush_pg_stats 2026-02-23T13:17:53.443 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph tell osd.3 flush_pg_stats 2026-02-23T13:17:53.561 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:53.563 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:53.564 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:53.568 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:53.674 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:53.673+0000 7f0ebe9e5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:53.674 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:53.673+0000 7f0ebe9e5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:53.674 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:53.673+0000 7f3f75130640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:53.674 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:53.673+0000 7f3f75130640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:53.675 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:53.674+0000 7f386aa21640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:53.675 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:53.675+0000 7f2baaad5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:53.676 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:53.675+0000 7f386aa21640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:53.676 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:53.675+0000 7f2baaad5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:53.716 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:53 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2041356950' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 3, "weight": 1.0}]': finished 2026-02-23T13:17:53.716 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:53 trial046 ceph-mon[38575]: osdmap e123: 4 total, 4 up, 4 in 2026-02-23T13:17:53.716 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:53 trial046 ceph-mon[38575]: pgmap v545: 1 pgs: 1 active+clean; 577 KiB data, 3.5 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-23T13:17:53.716 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:53 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1108694549' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-23T13:17:53.717 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:53 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1825074098' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-23T13:17:53.726 INFO:teuthology.orchestra.run.trial046.stdout:73014444217 2026-02-23T13:17:53.726 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-23T13:17:53.733 INFO:teuthology.orchestra.run.trial046.stdout:98784247990 2026-02-23T13:17:53.734 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-23T13:17:53.735 INFO:teuthology.orchestra.run.trial046.stdout:55834575035 2026-02-23T13:17:53.735 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-23T13:17:53.753 INFO:teuthology.orchestra.run.trial046.stdout:38654705852 2026-02-23T13:17:53.754 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-23T13:17:53.845 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:53.912 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:53.915 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:53.954 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:53.956 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:53.955+0000 7f0d3f91e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:53.956 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:53.956+0000 7f0d3f91e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:54.024 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:54.023+0000 7f5a3cca4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:54.024 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:54.023+0000 7f5a3cca4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:54.025 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:54.025+0000 7f7e0ab42640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:54.026 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:54.025+0000 7f7e0ab42640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:54.045 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:54.044+0000 7fa5bd729640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:54.045 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:54.044+0000 7fa5bd729640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:54.069 INFO:teuthology.orchestra.run.trial046.stdout:73014444216 2026-02-23T13:17:54.108 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444217 got 73014444216 for osd.2 2026-02-23T13:17:54.136 INFO:teuthology.orchestra.run.trial046.stdout:98784247989 2026-02-23T13:17:54.149 INFO:teuthology.orchestra.run.trial046.stdout:55834575034 2026-02-23T13:17:54.158 INFO:teuthology.orchestra.run.trial046.stdout:38654705851 2026-02-23T13:17:54.178 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247990 got 98784247989 for osd.3 2026-02-23T13:17:54.190 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834575035 got 55834575034 for osd.1 2026-02-23T13:17:54.199 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705852 got 38654705851 for osd.0 2026-02-23T13:17:55.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:54 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4180427465' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-23T13:17:55.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:54 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1674128568' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-23T13:17:55.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:54 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/1313207456' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-23T13:17:55.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:54 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3027259256' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-23T13:17:55.109 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-23T13:17:55.180 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-23T13:17:55.192 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-23T13:17:55.200 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-23T13:17:55.227 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:55.297 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:55.335 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:55.334+0000 7f5c2016a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:55.335 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:55.334+0000 7f5c2016a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:55.344 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:55.346 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:55.413 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:55.412+0000 7f2d8204a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:55.413 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:55.412+0000 7f2d8204a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:55.448 INFO:teuthology.orchestra.run.trial046.stdout:73014444216 2026-02-23T13:17:55.454 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:55.453+0000 7f8c6a34c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:55.454 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:55.453+0000 7f8c6a34c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:55.455 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:55.454+0000 7fd1dabfb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:55.455 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:55.454+0000 7fd1dabfb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:55.490 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444217 got 73014444216 for osd.2 2026-02-23T13:17:55.528 INFO:teuthology.orchestra.run.trial046.stdout:98784247989 2026-02-23T13:17:55.567 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247990 got 98784247989 for osd.3 2026-02-23T13:17:55.568 INFO:teuthology.orchestra.run.trial046.stdout:38654705851 2026-02-23T13:17:55.569 INFO:teuthology.orchestra.run.trial046.stdout:55834575034 2026-02-23T13:17:55.611 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834575035 got 55834575034 for osd.1 2026-02-23T13:17:55.612 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705852 got 38654705851 for osd.0 2026-02-23T13:17:56.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:55 trial046 ceph-mon[38575]: pgmap v546: 1 pgs: 1 active+clean; 577 KiB data, 3.5 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-23T13:17:56.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:55 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/745500814' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-23T13:17:56.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:55 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3758836609' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-23T13:17:56.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:55 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/223236066' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-23T13:17:56.039 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:55 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2717936628' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-23T13:17:56.491 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-23T13:17:56.515 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:17:56 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: ::ffff:10.20.193.131 - - [23/Feb/2026:13:17:56] "GET /metrics HTTP/1.1" 200 3898 "" "Prometheus/3.6.0" 2026-02-23T13:17:56.560 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:17:56 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:17:56.087Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial046:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-23T13:17:56.568 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-23T13:17:56.610 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:56.612 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-23T13:17:56.613 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-23T13:17:56.685 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:56.726 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:56.725+0000 7f845a938640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:56.726 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:56.725+0000 7f845a938640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:56.733 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:56.734 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:56.782 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:56 trial046 ceph-mon[38575]: 1.0 scrub starts 2026-02-23T13:17:56.783 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:56 trial046 ceph-mon[38575]: 1.0 scrub ok 2026-02-23T13:17:56.794 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:56.793+0000 7fd32be09640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:56.794 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:56.794+0000 7fd32be09640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:56.840 INFO:teuthology.orchestra.run.trial046.stdout:73014444217 2026-02-23T13:17:56.842 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:56.841+0000 7f281113a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:56.842 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:56.841+0000 7f281113a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:56.842 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:56.842+0000 7fa6bd23a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:56.843 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:56.842+0000 7fa6bd23a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:56.879 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444217 got 73014444217 for osd.2 2026-02-23T13:17:56.879 DEBUG:teuthology.parallel:result is None 2026-02-23T13:17:56.908 INFO:teuthology.orchestra.run.trial046.stdout:98784247990 2026-02-23T13:17:56.948 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247990 got 98784247990 for osd.3 2026-02-23T13:17:56.948 DEBUG:teuthology.parallel:result is None 2026-02-23T13:17:56.955 INFO:teuthology.orchestra.run.trial046.stdout:55834575035 2026-02-23T13:17:56.959 INFO:teuthology.orchestra.run.trial046.stdout:38654705852 2026-02-23T13:17:56.995 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834575035 got 55834575035 for osd.1 2026-02-23T13:17:56.995 DEBUG:teuthology.parallel:result is None 2026-02-23T13:17:56.998 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705852 got 38654705852 for osd.0 2026-02-23T13:17:56.999 DEBUG:teuthology.parallel:result is None 2026-02-23T13:17:56.999 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-23T13:17:56.999 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:17:57.154 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:57.258 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:57.257+0000 7f0751fdc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:57.258 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:57.257+0000 7f0751fdc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:57.368 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:17:57.369 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:17:57.407 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":548,"stamp":"2026-02-23T13:17:56.712194+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":2936012800,"kb_used":3624668,"kb_used_data":4492,"kb_used_omap":81,"kb_used_meta":3620014,"kb_avail":2932388132,"statfs":{"total":3006477107200,"available":3002765447168,"internally_reserved":0,"allocated":4599808,"data_stored":2808334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":83568,"internal_metadata":3706894736},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000843"},"pg_stats":[{"pgid":"1.0","version":"27'99","reported_seq":477,"reported_epoch":124,"state":"active+clean","last_fresh":"2026-02-23T13:17:56.668890+0000","last_change":"2026-02-23T13:17:56.328224+0000","last_active":"2026-02-23T13:17:56.668890+0000","last_peered":"2026-02-23T13:17:56.668890+0000","last_clean":"2026-02-23T13:17:56.668890+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:17:56.668890+0000","last_undegraded":"2026-02-23T13:17:56.668890+0000","last_fullsized":"2026-02-23T13:17:56.668890+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:17:56.328186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:17:56.328186+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:19:03.170454+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3765,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247991,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":944076,"kb_used_data":1272,"kb_used_omap":18,"kb_used_meta":942765,"kb_avail":733059124,"statfs":{"total":751619276800,"available":750652542976,"internally_reserved":0,"allocated":1302528,"data_stored":851704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18535,"internal_metadata":965392281},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444218,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":930764,"kb_used_data":1272,"kb_used_omap":20,"kb_used_meta":929451,"kb_avail":733072436,"statfs":{"total":751619276800,"available":750666174464,"internally_reserved":0,"allocated":1302528,"data_stored":851704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21099,"internal_metadata":951758229},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575035,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":1368832,"kb_used_data":684,"kb_used_omap":27,"kb_used_meta":1368100,"kb_avail":732634368,"statfs":{"total":751619276800,"available":750217592832,"internally_reserved":0,"allocated":700416,"data_stored":257279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28641,"internal_metadata":1400934431},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":380996,"kb_used_data":1264,"kb_used_omap":14,"kb_used_meta":379697,"kb_avail":733622204,"statfs":{"total":751619276800,"available":751229136896,"internally_reserved":0,"allocated":1294336,"data_stored":847647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15293,"internal_metadata":388809795},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3765,"internal_metadata":0}]}} 2026-02-23T13:17:57.408 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph pg dump --format=json 2026-02-23T13:17:57.526 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:57.629 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:57.629+0000 7f1bdf7cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:57.630 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:57.629+0000 7f1bdf7cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:57.738 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-23T13:17:57.739 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-23T13:17:57.774 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":548,"stamp":"2026-02-23T13:17:56.712194+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":2936012800,"kb_used":3624668,"kb_used_data":4492,"kb_used_omap":81,"kb_used_meta":3620014,"kb_avail":2932388132,"statfs":{"total":3006477107200,"available":3002765447168,"internally_reserved":0,"allocated":4599808,"data_stored":2808334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":83568,"internal_metadata":3706894736},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000843"},"pg_stats":[{"pgid":"1.0","version":"27'99","reported_seq":477,"reported_epoch":124,"state":"active+clean","last_fresh":"2026-02-23T13:17:56.668890+0000","last_change":"2026-02-23T13:17:56.328224+0000","last_active":"2026-02-23T13:17:56.668890+0000","last_peered":"2026-02-23T13:17:56.668890+0000","last_clean":"2026-02-23T13:17:56.668890+0000","last_became_active":"2026-02-23T13:02:55.158360+0000","last_became_peered":"2026-02-23T13:02:55.158360+0000","last_unstale":"2026-02-23T13:17:56.668890+0000","last_undegraded":"2026-02-23T13:17:56.668890+0000","last_fullsized":"2026-02-23T13:17:56.668890+0000","mapping_epoch":25,"log_start":"27'96","ondisk_log_start":"27'96","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2026-02-23T13:17:56.328186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T13:02:44.100679+0000","last_clean_scrub_stamp":"2026-02-23T13:17:56.328186+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":96,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T13:19:03.170454+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3765,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247991,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":944076,"kb_used_data":1272,"kb_used_omap":18,"kb_used_meta":942765,"kb_avail":733059124,"statfs":{"total":751619276800,"available":750652542976,"internally_reserved":0,"allocated":1302528,"data_stored":851704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18535,"internal_metadata":965392281},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444218,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":930764,"kb_used_data":1272,"kb_used_omap":20,"kb_used_meta":929451,"kb_avail":733072436,"statfs":{"total":751619276800,"available":750666174464,"internally_reserved":0,"allocated":1302528,"data_stored":851704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21099,"internal_metadata":951758229},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575035,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":1368832,"kb_used_data":684,"kb_used_omap":27,"kb_used_meta":1368100,"kb_avail":732634368,"statfs":{"total":751619276800,"available":750217592832,"internally_reserved":0,"allocated":700416,"data_stored":257279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28641,"internal_metadata":1400934431},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":380996,"kb_used_data":1264,"kb_used_omap":14,"kb_used_meta":379697,"kb_avail":733622204,"statfs":{"total":751619276800,"available":751229136896,"internally_reserved":0,"allocated":1294336,"data_stored":847647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15293,"internal_metadata":388809795},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3765,"internal_metadata":0}]}} 2026-02-23T13:17:57.775 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-23T13:17:57.776 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2026-02-23T13:17:57.889 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:57.911 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:57 trial046 ceph-mon[38575]: osdmap e124: 4 total, 4 up, 4 in 2026-02-23T13:17:57.911 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:57 trial046 ceph-mon[38575]: pgmap v548: 1 pgs: 1 active+clean; 577 KiB data, 3.5 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-23T13:17:57.911 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:57 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/4204631061' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-23T13:17:57.912 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:57 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/827823798' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-23T13:17:57.912 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:57 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/3308335813' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-23T13:17:57.912 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:57 trial046 ceph-mon[38575]: from='client.? 10.20.193.46:0/2882640924' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-23T13:17:57.990 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:57.989+0000 7f5d624e0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:57.990 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-23T13:17:57.989+0000 7f5d624e0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-23T13:17:58.141 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2026-02-23T13:17:58.151 INFO:tasks.cephadm:Teardown begin 2026-02-23T13:17:58.151 DEBUG:teuthology.orchestra.run.trial046:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-23T13:17:58.176 DEBUG:teuthology.orchestra.run.trial131:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-23T13:17:58.206 INFO:tasks.cephadm:Disabling cephadm mgr module 2026-02-23T13:17:58.206 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 -- ceph mgr module disable cephadm 2026-02-23T13:17:58.331 INFO:teuthology.orchestra.run.trial046.stderr:Inferring config /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/mon.a/config 2026-02-23T13:17:58.351 INFO:teuthology.orchestra.run.trial046.stderr:Error: statfs /etc/ceph/ceph.client.admin.keyring: no such file or directory 2026-02-23T13:17:58.366 DEBUG:teuthology.orchestra.run:got remote process result: 125 2026-02-23T13:17:58.367 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2026-02-23T13:17:58.367 DEBUG:teuthology.orchestra.run.trial046:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-23T13:17:58.384 DEBUG:teuthology.orchestra.run.trial131:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-23T13:17:58.401 INFO:tasks.cephadm:Stopping all daemons... 2026-02-23T13:17:58.402 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2026-02-23T13:17:58.402 DEBUG:teuthology.orchestra.run.trial046:> sudo systemctl stop ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@mon.a 2026-02-23T13:17:58.729 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:17:58 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: [23/Feb/2026:13:17:58] ENGINE Bus STOPPING 2026-02-23T13:17:58.729 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:17:58 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: [23/Feb/2026:13:17:58] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2026-02-23T13:17:58.729 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:17:58 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mgr-x[38846]: [23/Feb/2026:13:17:58] ENGINE Bus STOPPED 2026-02-23T13:17:58.729 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:58 trial046 systemd[1]: Stopping Ceph mon.a for c3b3ca7d-10b7-11f1-8efe-d404e6e7d460... 2026-02-23T13:17:58.729 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:58 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mon-a[38571]: 2026-02-23T13:17:58.526+0000 7f3c8fda5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-23T13:17:58.729 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:58 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mon-a[38571]: 2026-02-23T13:17:58.526+0000 7f3c8fda5640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-23T13:17:58.730 INFO:journalctl@ceph.mon.a.trial046.stdout:Feb 23 13:17:58 trial046 podman[156330]: 2026-02-23 13:17:58.728838395 +0000 UTC m=+0.215540675 container died 7bd9b1f25d33db40c063d65960a9d2000064d0992311fc5c662109a9c18c41ba (image=quay.ceph.io/ceph-ci/ceph:e371433fcd1390a0b82cfb18effc422c1f5d8c1d, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-mon-a, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-shraddhaag-enable-cephadm-tests) 2026-02-23T13:17:58.817 DEBUG:teuthology.orchestra.run.trial046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@mon.a.service' 2026-02-23T13:17:58.854 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-23T13:17:58.855 INFO:tasks.cephadm.mon.a:Stopped mon.a 2026-02-23T13:17:58.855 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2026-02-23T13:17:58.855 DEBUG:teuthology.orchestra.run.trial046:> sudo systemctl stop ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@mgr.x 2026-02-23T13:17:58.986 INFO:journalctl@ceph.mgr.x.trial046.stdout:Feb 23 13:17:58 trial046 systemd[1]: Stopping Ceph mgr.x for c3b3ca7d-10b7-11f1-8efe-d404e6e7d460... 2026-02-23T13:17:59.122 DEBUG:teuthology.orchestra.run.trial046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@mgr.x.service' 2026-02-23T13:17:59.157 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-23T13:17:59.157 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2026-02-23T13:17:59.157 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2026-02-23T13:17:59.158 DEBUG:teuthology.orchestra.run.trial046:> sudo systemctl stop ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@osd.0 2026-02-23T13:17:59.286 INFO:journalctl@ceph.osd.0.trial046.stdout:Feb 23 13:17:59 trial046 systemd[1]: Stopping Ceph osd.0 for c3b3ca7d-10b7-11f1-8efe-d404e6e7d460... 2026-02-23T13:17:59.539 INFO:journalctl@ceph.osd.0.trial046.stdout:Feb 23 13:17:59 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-0[54899]: 2026-02-23T13:17:59.286+0000 7f16ef449640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-23T13:17:59.539 INFO:journalctl@ceph.osd.0.trial046.stdout:Feb 23 13:17:59 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-0[54899]: 2026-02-23T13:17:59.286+0000 7f16ef449640 -1 osd.0 124 *** Got signal Terminated *** 2026-02-23T13:17:59.539 INFO:journalctl@ceph.osd.0.trial046.stdout:Feb 23 13:17:59 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-0[54899]: 2026-02-23T13:17:59.286+0000 7f16ef449640 -1 osd.0 124 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-23T13:18:05.039 INFO:journalctl@ceph.osd.0.trial046.stdout:Feb 23 13:18:04 trial046 podman[156642]: 2026-02-23 13:18:04.729435097 +0000 UTC m=+5.454769475 container died c8d7c8c97f3df95284dfac0dc78a6e9fb5871cfc7cc3e757b3c74f18e7b037fc (image=quay.ceph.io/ceph-ci/ceph@sha256:49621faaa845c39b2aae72e4fa24123ee9b2ac3fb8ae834753907068ee2972ea, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-0, ceph=True, OSD_FLAVOR=default, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_SHA1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d) 2026-02-23T13:18:05.040 INFO:journalctl@ceph.osd.0.trial046.stdout:Feb 23 13:18:04 trial046 podman[156642]: 2026-02-23 13:18:04.741447603 +0000 UTC m=+5.466781971 container remove c8d7c8c97f3df95284dfac0dc78a6e9fb5871cfc7cc3e757b3c74f18e7b037fc (image=quay.ceph.io/ceph-ci/ceph@sha256:49621faaa845c39b2aae72e4fa24123ee9b2ac3fb8ae834753907068ee2972ea, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-0, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.build-date=20260216, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d) 2026-02-23T13:18:05.040 INFO:journalctl@ceph.osd.0.trial046.stdout:Feb 23 13:18:04 trial046 bash[156642]: ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-0 2026-02-23T13:18:05.040 INFO:journalctl@ceph.osd.0.trial046.stdout:Feb 23 13:18:04 trial046 podman[156773]: 2026-02-23 13:18:04.868621291 +0000 UTC m=+0.016725176 container create e153020f566ad8bb88e60630209b83e1828085004f12bca2946eec22a550b612 (image=quay.ceph.io/ceph-ci/ceph@sha256:49621faaa845c39b2aae72e4fa24123ee9b2ac3fb8ae834753907068ee2972ea, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-0-deactivate, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0) 2026-02-23T13:18:05.040 INFO:journalctl@ceph.osd.0.trial046.stdout:Feb 23 13:18:04 trial046 podman[156773]: 2026-02-23 13:18:04.900511226 +0000 UTC m=+0.048615041 container init e153020f566ad8bb88e60630209b83e1828085004f12bca2946eec22a550b612 (image=quay.ceph.io/ceph-ci/ceph@sha256:49621faaa845c39b2aae72e4fa24123ee9b2ac3fb8ae834753907068ee2972ea, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260216, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, CEPH_SHA1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-23T13:18:05.040 INFO:journalctl@ceph.osd.0.trial046.stdout:Feb 23 13:18:04 trial046 podman[156773]: 2026-02-23 13:18:04.903070202 +0000 UTC m=+0.051174017 container start e153020f566ad8bb88e60630209b83e1828085004f12bca2946eec22a550b612 (image=quay.ceph.io/ceph-ci/ceph@sha256:49621faaa845c39b2aae72e4fa24123ee9b2ac3fb8ae834753907068ee2972ea, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-0-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260216, CEPH_SHA1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.license=GPLv2) 2026-02-23T13:18:05.040 INFO:journalctl@ceph.osd.0.trial046.stdout:Feb 23 13:18:04 trial046 podman[156773]: 2026-02-23 13:18:04.903498095 +0000 UTC m=+0.051601910 container attach e153020f566ad8bb88e60630209b83e1828085004f12bca2946eec22a550b612 (image=quay.ceph.io/ceph-ci/ceph@sha256:49621faaa845c39b2aae72e4fa24123ee9b2ac3fb8ae834753907068ee2972ea, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-0-deactivate, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d) 2026-02-23T13:18:05.040 INFO:journalctl@ceph.osd.0.trial046.stdout:Feb 23 13:18:04 trial046 podman[156773]: 2026-02-23 13:18:04.861789973 +0000 UTC m=+0.009893798 image pull 63df4b83db6f95a8ba965919b3671cb27173117c23b5c950aaadc8913f56213c quay.ceph.io/ceph-ci/ceph@sha256:49621faaa845c39b2aae72e4fa24123ee9b2ac3fb8ae834753907068ee2972ea 2026-02-23T13:18:05.092 DEBUG:teuthology.orchestra.run.trial046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@osd.0.service' 2026-02-23T13:18:05.129 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-23T13:18:05.130 INFO:tasks.cephadm.osd.0:Stopped osd.0 2026-02-23T13:18:05.130 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2026-02-23T13:18:05.130 DEBUG:teuthology.orchestra.run.trial046:> sudo systemctl stop ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@osd.1 2026-02-23T13:18:05.539 INFO:journalctl@ceph.osd.1.trial046.stdout:Feb 23 13:18:05 trial046 systemd[1]: Stopping Ceph osd.1 for c3b3ca7d-10b7-11f1-8efe-d404e6e7d460... 2026-02-23T13:18:05.539 INFO:journalctl@ceph.osd.1.trial046.stdout:Feb 23 13:18:05 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-1[62961]: 2026-02-23T13:18:05.278+0000 7f3d7a1d5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-23T13:18:05.539 INFO:journalctl@ceph.osd.1.trial046.stdout:Feb 23 13:18:05 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-1[62961]: 2026-02-23T13:18:05.278+0000 7f3d7a1d5640 -1 osd.1 124 *** Got signal Terminated *** 2026-02-23T13:18:05.539 INFO:journalctl@ceph.osd.1.trial046.stdout:Feb 23 13:18:05 trial046 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-1[62961]: 2026-02-23T13:18:05.278+0000 7f3d7a1d5640 -1 osd.1 124 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-23T13:18:06.060 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:18:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:18:05.708Z level=ERROR source=refresh.go:90 msg="Unable to refresh target groups" component="discovery manager scrape" discovery=http config=node-exporter err="Get \"http://10.20.193.46:8765/sd/prometheus/sd-config?service=node-exporter\": dial tcp 10.20.193.46:8765: connect: connection refused" 2026-02-23T13:18:06.061 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:18:05 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:18:05.708Z level=ERROR source=refresh.go:90 msg="Unable to refresh target groups" component="discovery manager scrape" discovery=http config=ceph err="Get \"http://10.20.193.46:8765/sd/prometheus/sd-config?service=ceph\": dial tcp 10.20.193.46:8765: connect: connection refused" 2026-02-23T13:18:10.928 INFO:journalctl@ceph.osd.1.trial046.stdout:Feb 23 13:18:10 trial046 podman[156909]: 2026-02-23 13:18:10.611958389 +0000 UTC m=+5.346371456 container died edf2794db8f56f7cdc9ac395291f4a6b93923919bb3dd3ef2839af3c1f172ce2 (image=quay.ceph.io/ceph-ci/ceph@sha256:49621faaa845c39b2aae72e4fa24123ee9b2ac3fb8ae834753907068ee2972ea, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-1, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_SHA1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-23T13:18:10.928 INFO:journalctl@ceph.osd.1.trial046.stdout:Feb 23 13:18:10 trial046 podman[156909]: 2026-02-23 13:18:10.623005133 +0000 UTC m=+5.357418210 container remove edf2794db8f56f7cdc9ac395291f4a6b93923919bb3dd3ef2839af3c1f172ce2 (image=quay.ceph.io/ceph-ci/ceph@sha256:49621faaa845c39b2aae72e4fa24123ee9b2ac3fb8ae834753907068ee2972ea, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-1, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, CEPH_SHA1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-23T13:18:10.928 INFO:journalctl@ceph.osd.1.trial046.stdout:Feb 23 13:18:10 trial046 bash[156909]: ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-1 2026-02-23T13:18:10.928 INFO:journalctl@ceph.osd.1.trial046.stdout:Feb 23 13:18:10 trial046 podman[157043]: 2026-02-23 13:18:10.764973251 +0000 UTC m=+0.015303007 container create 43e938c824194837642e768628cc92d7c59669e25d6093484eb7046f73d2ad33 (image=quay.ceph.io/ceph-ci/ceph@sha256:49621faaa845c39b2aae72e4fa24123ee9b2ac3fb8ae834753907068ee2972ea, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-1-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, io.buildah.version=1.41.3) 2026-02-23T13:18:10.929 INFO:journalctl@ceph.osd.1.trial046.stdout:Feb 23 13:18:10 trial046 podman[157043]: 2026-02-23 13:18:10.801458315 +0000 UTC m=+0.051787991 container init 43e938c824194837642e768628cc92d7c59669e25d6093484eb7046f73d2ad33 (image=quay.ceph.io/ceph-ci/ceph@sha256:49621faaa845c39b2aae72e4fa24123ee9b2ac3fb8ae834753907068ee2972ea, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-1-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260216, CEPH_SHA1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, ceph=True, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-23T13:18:10.929 INFO:journalctl@ceph.osd.1.trial046.stdout:Feb 23 13:18:10 trial046 podman[157043]: 2026-02-23 13:18:10.804338605 +0000 UTC m=+0.054668281 container start 43e938c824194837642e768628cc92d7c59669e25d6093484eb7046f73d2ad33 (image=quay.ceph.io/ceph-ci/ceph@sha256:49621faaa845c39b2aae72e4fa24123ee9b2ac3fb8ae834753907068ee2972ea, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-1-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_SHA1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260216, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-23T13:18:10.929 INFO:journalctl@ceph.osd.1.trial046.stdout:Feb 23 13:18:10 trial046 podman[157043]: 2026-02-23 13:18:10.80484242 +0000 UTC m=+0.055172106 container attach 43e938c824194837642e768628cc92d7c59669e25d6093484eb7046f73d2ad33 (image=quay.ceph.io/ceph-ci/ceph@sha256:49621faaa845c39b2aae72e4fa24123ee9b2ac3fb8ae834753907068ee2972ea, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-1-deactivate, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, CEPH_SHA1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260216) 2026-02-23T13:18:10.929 INFO:journalctl@ceph.osd.1.trial046.stdout:Feb 23 13:18:10 trial046 podman[157043]: 2026-02-23 13:18:10.758732359 +0000 UTC m=+0.009062035 image pull 63df4b83db6f95a8ba965919b3671cb27173117c23b5c950aaadc8913f56213c quay.ceph.io/ceph-ci/ceph@sha256:49621faaa845c39b2aae72e4fa24123ee9b2ac3fb8ae834753907068ee2972ea 2026-02-23T13:18:10.929 INFO:journalctl@ceph.osd.1.trial046.stdout:Feb 23 13:18:10 trial046 podman[157043]: 2026-02-23 13:18:10.927073941 +0000 UTC m=+0.177403617 container died 43e938c824194837642e768628cc92d7c59669e25d6093484eb7046f73d2ad33 (image=quay.ceph.io/ceph-ci/ceph@sha256:49621faaa845c39b2aae72e4fa24123ee9b2ac3fb8ae834753907068ee2972ea, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-1-deactivate, org.label-schema.build-date=20260216, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-shraddhaag-enable-cephadm-tests, CEPH_SHA1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-23T13:18:10.964 DEBUG:teuthology.orchestra.run.trial046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@osd.1.service' 2026-02-23T13:18:11.001 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-23T13:18:11.001 INFO:tasks.cephadm.osd.1:Stopped osd.1 2026-02-23T13:18:11.001 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2026-02-23T13:18:11.002 DEBUG:teuthology.orchestra.run.trial131:> sudo systemctl stop ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@osd.2 2026-02-23T13:18:11.310 INFO:journalctl@ceph.osd.2.trial131.stdout:Feb 23 13:18:11 trial131 systemd[1]: Stopping Ceph osd.2 for c3b3ca7d-10b7-11f1-8efe-d404e6e7d460... 2026-02-23T13:18:11.310 INFO:journalctl@ceph.osd.2.trial131.stdout:Feb 23 13:18:11 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-2[46347]: 2026-02-23T13:18:11.104+0000 7f9a31e41640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-23T13:18:11.310 INFO:journalctl@ceph.osd.2.trial131.stdout:Feb 23 13:18:11 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-2[46347]: 2026-02-23T13:18:11.104+0000 7f9a31e41640 -1 osd.2 124 *** Got signal Terminated *** 2026-02-23T13:18:11.310 INFO:journalctl@ceph.osd.2.trial131.stdout:Feb 23 13:18:11 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-2[46347]: 2026-02-23T13:18:11.104+0000 7f9a31e41640 -1 osd.2 124 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-23T13:18:16.698 INFO:journalctl@ceph.osd.2.trial131.stdout:Feb 23 13:18:16 trial131 podman[67984]: 2026-02-23 13:18:16.438631627 +0000 UTC m=+5.346150373 container died fc4215fe470d14935228a68a6e02e4da7caf8883a6273bd71357ee021bb5a421 (image=quay.ceph.io/ceph-ci/ceph@sha256:49621faaa845c39b2aae72e4fa24123ee9b2ac3fb8ae834753907068ee2972ea, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-2, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_SHA1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-23T13:18:16.698 INFO:journalctl@ceph.osd.2.trial131.stdout:Feb 23 13:18:16 trial131 podman[67984]: 2026-02-23 13:18:16.450728198 +0000 UTC m=+5.358246944 container remove fc4215fe470d14935228a68a6e02e4da7caf8883a6273bd71357ee021bb5a421 (image=quay.ceph.io/ceph-ci/ceph@sha256:49621faaa845c39b2aae72e4fa24123ee9b2ac3fb8ae834753907068ee2972ea, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-2, org.label-schema.build-date=20260216, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0) 2026-02-23T13:18:16.698 INFO:journalctl@ceph.osd.2.trial131.stdout:Feb 23 13:18:16 trial131 bash[67984]: ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-2 2026-02-23T13:18:16.698 INFO:journalctl@ceph.osd.2.trial131.stdout:Feb 23 13:18:16 trial131 podman[68120]: 2026-02-23 13:18:16.605643327 +0000 UTC m=+0.016969485 container create 554a32697717fcc4f566d3007802178c68400fb286f436734e347cb6c00a7253 (image=quay.ceph.io/ceph-ci/ceph@sha256:49621faaa845c39b2aae72e4fa24123ee9b2ac3fb8ae834753907068ee2972ea, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-2-deactivate, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.label-schema.build-date=20260216, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2026-02-23T13:18:16.698 INFO:journalctl@ceph.osd.2.trial131.stdout:Feb 23 13:18:16 trial131 podman[68120]: 2026-02-23 13:18:16.635719154 +0000 UTC m=+0.047045312 container init 554a32697717fcc4f566d3007802178c68400fb286f436734e347cb6c00a7253 (image=quay.ceph.io/ceph-ci/ceph@sha256:49621faaa845c39b2aae72e4fa24123ee9b2ac3fb8ae834753907068ee2972ea, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-2-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, CEPH_SHA1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-23T13:18:16.698 INFO:journalctl@ceph.osd.2.trial131.stdout:Feb 23 13:18:16 trial131 podman[68120]: 2026-02-23 13:18:16.63820334 +0000 UTC m=+0.049529508 container start 554a32697717fcc4f566d3007802178c68400fb286f436734e347cb6c00a7253 (image=quay.ceph.io/ceph-ci/ceph@sha256:49621faaa845c39b2aae72e4fa24123ee9b2ac3fb8ae834753907068ee2972ea, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-2-deactivate, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260216, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, CEPH_SHA1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, ceph=True) 2026-02-23T13:18:16.699 INFO:journalctl@ceph.osd.2.trial131.stdout:Feb 23 13:18:16 trial131 podman[68120]: 2026-02-23 13:18:16.638683871 +0000 UTC m=+0.050010039 container attach 554a32697717fcc4f566d3007802178c68400fb286f436734e347cb6c00a7253 (image=quay.ceph.io/ceph-ci/ceph@sha256:49621faaa845c39b2aae72e4fa24123ee9b2ac3fb8ae834753907068ee2972ea, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-2-deactivate, CEPH_SHA1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, OSD_FLAVOR=default, org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-23T13:18:16.699 INFO:journalctl@ceph.osd.2.trial131.stdout:Feb 23 13:18:16 trial131 podman[68120]: 2026-02-23 13:18:16.598398809 +0000 UTC m=+0.009724977 image pull 63df4b83db6f95a8ba965919b3671cb27173117c23b5c950aaadc8913f56213c quay.ceph.io/ceph-ci/ceph@sha256:49621faaa845c39b2aae72e4fa24123ee9b2ac3fb8ae834753907068ee2972ea 2026-02-23T13:18:16.805 DEBUG:teuthology.orchestra.run.trial131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@osd.2.service' 2026-02-23T13:18:16.843 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-23T13:18:16.843 INFO:tasks.cephadm.osd.2:Stopped osd.2 2026-02-23T13:18:16.844 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2026-02-23T13:18:16.844 DEBUG:teuthology.orchestra.run.trial131:> sudo systemctl stop ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@osd.3 2026-02-23T13:18:16.977 INFO:journalctl@ceph.osd.3.trial131.stdout:Feb 23 13:18:16 trial131 systemd[1]: Stopping Ceph osd.3 for c3b3ca7d-10b7-11f1-8efe-d404e6e7d460... 2026-02-23T13:18:17.310 INFO:journalctl@ceph.osd.3.trial131.stdout:Feb 23 13:18:16 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-3[54059]: 2026-02-23T13:18:16.975+0000 7f1ca1af2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-23T13:18:17.310 INFO:journalctl@ceph.osd.3.trial131.stdout:Feb 23 13:18:16 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-3[54059]: 2026-02-23T13:18:16.975+0000 7f1ca1af2640 -1 osd.3 124 *** Got signal Terminated *** 2026-02-23T13:18:17.310 INFO:journalctl@ceph.osd.3.trial131.stdout:Feb 23 13:18:16 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-3[54059]: 2026-02-23T13:18:16.975+0000 7f1ca1af2640 -1 osd.3 124 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-23T13:18:22.757 INFO:journalctl@ceph.osd.3.trial131.stdout:Feb 23 13:18:22 trial131 podman[68259]: 2026-02-23 13:18:22.451520644 +0000 UTC m=+5.487359402 container died 406e7fbcce7df66a5f777cb784746c47da157a72122ef8d09984645363779fe2 (image=quay.ceph.io/ceph-ci/ceph@sha256:49621faaa845c39b2aae72e4fa24123ee9b2ac3fb8ae834753907068ee2972ea, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-3, CEPH_SHA1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-23T13:18:22.758 INFO:journalctl@ceph.osd.3.trial131.stdout:Feb 23 13:18:22 trial131 podman[68259]: 2026-02-23 13:18:22.461072576 +0000 UTC m=+5.496911324 container remove 406e7fbcce7df66a5f777cb784746c47da157a72122ef8d09984645363779fe2 (image=quay.ceph.io/ceph-ci/ceph@sha256:49621faaa845c39b2aae72e4fa24123ee9b2ac3fb8ae834753907068ee2972ea, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, CEPH_SHA1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d, OSD_FLAVOR=default, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0) 2026-02-23T13:18:22.758 INFO:journalctl@ceph.osd.3.trial131.stdout:Feb 23 13:18:22 trial131 bash[68259]: ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-3 2026-02-23T13:18:22.758 INFO:journalctl@ceph.osd.3.trial131.stdout:Feb 23 13:18:22 trial131 podman[68390]: 2026-02-23 13:18:22.586048534 +0000 UTC m=+0.015863442 container create 6e342baeb805cc7580e32cde09438de4eac0f0cc64298b4ef0096675b42aac15 (image=quay.ceph.io/ceph-ci/ceph@sha256:49621faaa845c39b2aae72e4fa24123ee9b2ac3fb8ae834753907068ee2972ea, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-3-deactivate, org.label-schema.license=GPLv2, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, CEPH_SHA1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, org.label-schema.build-date=20260216) 2026-02-23T13:18:22.758 INFO:journalctl@ceph.osd.3.trial131.stdout:Feb 23 13:18:22 trial131 podman[68390]: 2026-02-23 13:18:22.614130915 +0000 UTC m=+0.043945843 container init 6e342baeb805cc7580e32cde09438de4eac0f0cc64298b4ef0096675b42aac15 (image=quay.ceph.io/ceph-ci/ceph@sha256:49621faaa845c39b2aae72e4fa24123ee9b2ac3fb8ae834753907068ee2972ea, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-3-deactivate, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, CEPH_SHA1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True) 2026-02-23T13:18:22.758 INFO:journalctl@ceph.osd.3.trial131.stdout:Feb 23 13:18:22 trial131 podman[68390]: 2026-02-23 13:18:22.616838379 +0000 UTC m=+0.046653297 container start 6e342baeb805cc7580e32cde09438de4eac0f0cc64298b4ef0096675b42aac15 (image=quay.ceph.io/ceph-ci/ceph@sha256:49621faaa845c39b2aae72e4fa24123ee9b2ac3fb8ae834753907068ee2972ea, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-3-deactivate, OSD_FLAVOR=default, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, CEPH_SHA1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-23T13:18:22.758 INFO:journalctl@ceph.osd.3.trial131.stdout:Feb 23 13:18:22 trial131 podman[68390]: 2026-02-23 13:18:22.617269608 +0000 UTC m=+0.047084526 container attach 6e342baeb805cc7580e32cde09438de4eac0f0cc64298b4ef0096675b42aac15 (image=quay.ceph.io/ceph-ci/ceph@sha256:49621faaa845c39b2aae72e4fa24123ee9b2ac3fb8ae834753907068ee2972ea, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-3-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, CEPH_SHA1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216, OSD_FLAVOR=default, ceph=True, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-23T13:18:22.758 INFO:journalctl@ceph.osd.3.trial131.stdout:Feb 23 13:18:22 trial131 podman[68390]: 2026-02-23 13:18:22.579704815 +0000 UTC m=+0.009519733 image pull 63df4b83db6f95a8ba965919b3671cb27173117c23b5c950aaadc8913f56213c quay.ceph.io/ceph-ci/ceph@sha256:49621faaa845c39b2aae72e4fa24123ee9b2ac3fb8ae834753907068ee2972ea 2026-02-23T13:18:22.758 INFO:journalctl@ceph.osd.3.trial131.stdout:Feb 23 13:18:22 trial131 podman[68390]: 2026-02-23 13:18:22.756445699 +0000 UTC m=+0.186260617 container died 6e342baeb805cc7580e32cde09438de4eac0f0cc64298b4ef0096675b42aac15 (image=quay.ceph.io/ceph-ci/ceph@sha256:49621faaa845c39b2aae72e4fa24123ee9b2ac3fb8ae834753907068ee2972ea, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-osd-3-deactivate, CEPH_SHA1=e371433fcd1390a0b82cfb18effc422c1f5d8c1d, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, ceph=True, OSD_FLAVOR=default, io.buildah.version=1.41.3) 2026-02-23T13:18:22.786 DEBUG:teuthology.orchestra.run.trial131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@osd.3.service' 2026-02-23T13:18:22.825 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-23T13:18:22.825 INFO:tasks.cephadm.osd.3:Stopped osd.3 2026-02-23T13:18:22.826 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2026-02-23T13:18:22.826 DEBUG:teuthology.orchestra.run.trial131:> sudo systemctl stop ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@prometheus.a 2026-02-23T13:18:23.007 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:18:22 trial131 systemd[1]: Stopping Ceph prometheus.a for c3b3ca7d-10b7-11f1-8efe-d404e6e7d460... 2026-02-23T13:18:23.008 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:18:22 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:18:22.964Z level=WARN source=main.go:1076 msg="Received an OS signal, exiting gracefully..." signal=terminated 2026-02-23T13:18:23.008 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:18:22 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:18:22.965Z level=INFO source=main.go:1101 msg="Stopping scrape discovery manager..." 2026-02-23T13:18:23.008 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:18:22 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:18:22.965Z level=INFO source=main.go:1115 msg="Stopping notify discovery manager..." 2026-02-23T13:18:23.008 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:18:22 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:18:22.965Z level=INFO source=manager.go:190 msg="Stopping rule manager..." component="rule manager" 2026-02-23T13:18:23.008 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:18:22 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:18:22.965Z level=INFO source=main.go:1097 msg="Scrape discovery manager stopped" 2026-02-23T13:18:23.008 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:18:22 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:18:22.965Z level=INFO source=main.go:1111 msg="Notify discovery manager stopped" 2026-02-23T13:18:23.008 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:18:22 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:18:22.965Z level=INFO source=manager.go:206 msg="Rule manager stopped" component="rule manager" 2026-02-23T13:18:23.008 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:18:22 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:18:22.965Z level=INFO source=main.go:1152 msg="Stopping scrape manager..." 2026-02-23T13:18:23.008 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:18:22 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:18:22.965Z level=INFO source=main.go:1144 msg="Scrape manager stopped" 2026-02-23T13:18:23.009 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:18:22 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:18:22.966Z level=INFO source=manager.go:543 msg="Stopping notification manager..." component=notifier 2026-02-23T13:18:23.009 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:18:22 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:18:22.966Z level=INFO source=manager.go:285 msg="Draining any remaining notifications..." component=notifier 2026-02-23T13:18:23.009 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:18:22 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:18:22.966Z level=INFO source=manager.go:291 msg="Remaining notifications drained" component=notifier 2026-02-23T13:18:23.009 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:18:22 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:18:22.966Z level=INFO source=manager.go:218 msg="Notification manager stopped" component=notifier 2026-02-23T13:18:23.009 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:18:22 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:18:22.966Z level=INFO source=main.go:1422 msg="Notifier manager stopped" 2026-02-23T13:18:23.009 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:18:22 trial131 ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a[65443]: time=2026-02-23T13:18:22.966Z level=INFO source=main.go:1436 msg="See you next time!" 2026-02-23T13:18:23.009 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:18:22 trial131 podman[68529]: 2026-02-23 13:18:22.974825321 +0000 UTC m=+0.024269587 container died 9f37fc66bd1b86995911e3ab5489ef478d0c9f3fb65b754243836ef46d8bd3ce (image=quay.io/prometheus/prometheus:v3.6.0, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a, maintainer=The Prometheus Authors , org.opencontainers.image.source=https://github.com/prometheus/prometheus) 2026-02-23T13:18:23.009 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:18:22 trial131 podman[68529]: 2026-02-23 13:18:22.984546269 +0000 UTC m=+0.033990536 container remove 9f37fc66bd1b86995911e3ab5489ef478d0c9f3fb65b754243836ef46d8bd3ce (image=quay.io/prometheus/prometheus:v3.6.0, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a, maintainer=The Prometheus Authors , org.opencontainers.image.source=https://github.com/prometheus/prometheus) 2026-02-23T13:18:23.009 INFO:journalctl@ceph.prometheus.a.trial131.stdout:Feb 23 13:18:22 trial131 bash[68529]: ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-prometheus-a 2026-02-23T13:18:23.072 DEBUG:teuthology.orchestra.run.trial131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@prometheus.a.service' 2026-02-23T13:18:23.108 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-23T13:18:23.108 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2026-02-23T13:18:23.109 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 --force --keep-logs 2026-02-23T13:18:23.226 INFO:teuthology.orchestra.run.trial046.stdout:Deleting cluster with fsid: c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 2026-02-23T13:18:23.939 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:18:23 trial046 systemd[1]: Stopping Ceph node-exporter.a for c3b3ca7d-10b7-11f1-8efe-d404e6e7d460... 2026-02-23T13:18:23.939 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:18:23 trial046 podman[157382]: 2026-02-23 13:18:23.880702343 +0000 UTC m=+0.023201543 container died 61d859e8cf06e70e690be6f76b220a10a10f8e13ecc5b485fb6819880faf5158 (image=quay.io/prometheus/node-exporter:v1.9.1, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a, maintainer=The Prometheus Authors ) 2026-02-23T13:18:23.940 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:18:23 trial046 podman[157382]: 2026-02-23 13:18:23.890082346 +0000 UTC m=+0.032581536 container remove 61d859e8cf06e70e690be6f76b220a10a10f8e13ecc5b485fb6819880faf5158 (image=quay.io/prometheus/node-exporter:v1.9.1, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a, maintainer=The Prometheus Authors ) 2026-02-23T13:18:23.940 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:18:23 trial046 bash[157382]: ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-a 2026-02-23T13:18:23.940 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:18:23 trial046 systemd[1]: ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2026-02-23T13:18:24.211 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:18:23 trial046 systemd[1]: ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@node-exporter.a.service: Failed with result 'exit-code'. 2026-02-23T13:18:24.211 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:18:23 trial046 systemd[1]: Stopped Ceph node-exporter.a for c3b3ca7d-10b7-11f1-8efe-d404e6e7d460. 2026-02-23T13:18:24.212 INFO:journalctl@ceph.node-exporter.a.trial046.stdout:Feb 23 13:18:23 trial046 systemd[1]: ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@node-exporter.a.service: Consumed 3.151s CPU time. 2026-02-23T13:18:24.461 DEBUG:teuthology.orchestra.run.trial131:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 --force --keep-logs 2026-02-23T13:18:24.578 INFO:teuthology.orchestra.run.trial131.stdout:Deleting cluster with fsid: c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 2026-02-23T13:18:25.287 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:18:25 trial131 systemd[1]: Stopping Ceph node-exporter.b for c3b3ca7d-10b7-11f1-8efe-d404e6e7d460... 2026-02-23T13:18:25.287 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:18:25 trial131 podman[68846]: 2026-02-23 13:18:25.094534204 +0000 UTC m=+0.023209279 container died 96a9e80b9e44d4b784c18884dabf845de6bdb98dac35803921649e2cb830801a (image=quay.io/prometheus/node-exporter:v1.9.1, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b, maintainer=The Prometheus Authors ) 2026-02-23T13:18:25.287 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:18:25 trial131 podman[68846]: 2026-02-23 13:18:25.102703294 +0000 UTC m=+0.031378369 container remove 96a9e80b9e44d4b784c18884dabf845de6bdb98dac35803921649e2cb830801a (image=quay.io/prometheus/node-exporter:v1.9.1, name=ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b, maintainer=The Prometheus Authors ) 2026-02-23T13:18:25.287 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:18:25 trial131 bash[68846]: ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460-node-exporter-b 2026-02-23T13:18:25.287 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:18:25 trial131 systemd[1]: ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2026-02-23T13:18:25.287 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:18:25 trial131 systemd[1]: ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@node-exporter.b.service: Failed with result 'exit-code'. 2026-02-23T13:18:25.287 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:18:25 trial131 systemd[1]: Stopped Ceph node-exporter.b for c3b3ca7d-10b7-11f1-8efe-d404e6e7d460. 2026-02-23T13:18:25.288 INFO:journalctl@ceph.node-exporter.b.trial131.stdout:Feb 23 13:18:25 trial131 systemd[1]: ceph-c3b3ca7d-10b7-11f1-8efe-d404e6e7d460@node-exporter.b.service: Consumed 2.665s CPU time. 2026-02-23T13:18:25.682 DEBUG:teuthology.orchestra.run.trial046:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-23T13:18:25.711 DEBUG:teuthology.orchestra.run.trial131:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-23T13:18:25.738 INFO:tasks.cephadm:Archiving crash dumps... 2026-02-23T13:18:25.741 DEBUG:teuthology.misc:Transferring archived files from trial046:/var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_12:27:41-crimson-rados-main-distro-debug-trial/66427/remote/trial046/crash 2026-02-23T13:18:25.742 DEBUG:teuthology.orchestra.run.trial046:> sudo tar c -f - -C /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/crash -- . 2026-02-23T13:18:25.775 INFO:teuthology.orchestra.run.trial046.stderr:tar: /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-23T13:18:25.775 INFO:teuthology.orchestra.run.trial046.stderr:tar: Error is not recoverable: exiting now 2026-02-23T13:18:25.778 DEBUG:teuthology.misc:Transferring archived files from trial131:/var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_12:27:41-crimson-rados-main-distro-debug-trial/66427/remote/trial131/crash 2026-02-23T13:18:25.779 DEBUG:teuthology.orchestra.run.trial131:> sudo tar c -f - -C /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/crash -- . 2026-02-23T13:18:25.805 INFO:teuthology.orchestra.run.trial131.stderr:tar: /var/lib/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-23T13:18:25.805 INFO:teuthology.orchestra.run.trial131.stderr:tar: Error is not recoverable: exiting now 2026-02-23T13:18:25.806 INFO:tasks.cephadm:Checking cluster log for badness... 2026-02-23T13:18:25.807 DEBUG:teuthology.orchestra.run.trial046:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | grep -E -v 'but it is still running' | grep -E -v 'objects unfound and apparently lost' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSDMAP_FLAGS\)' | grep -E -v '\(OSD_' | grep -E -v '\(PG_' | grep -E -v '\(POOL_' | grep -E -v '\(CACHE_POOL_' | grep -E -v '\(SMALLER_PGP_NUM\)' | grep -E -v '\(OBJECT_' | grep -E -v SLOW_OPS | grep -E -v '\(REQUEST_SLOW\)' | grep -E -v '\(TOO_FEW_PGS\)' | grep -E -v 'slow request' | grep -E -v 'timeout on replica' | grep -E -v 'late reservation from' | grep -E -v MON_DOWN | grep -E -v OSDMAP_FLAGS | grep -E -v OSD_DOWN | grep -E -v PG_DEGRADED | grep -E -v PG_AVAILABILITY | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'mons down' | grep -E -v 'mon down' | grep -E -v 'out of quorum' | grep -E -v noscrub | grep -E -v nodeep-scrub | grep -E -v 'Degraded data redundancy' | grep -E -v 'is down' | grep -E -v 'osds down' | grep -E -v 'pg .*? is .*?degraded.*?, acting' | grep -E -v 'pg .*? is stuck' | grep -E -v 'pg degraded' | grep -E -v PG_BACKFILL_FULL | grep -E -v 'Low space hindering backfill .*? backfill_toofull' | grep -E -v OSD_ROOT_DOWN | grep -E -v 'pgs degraded' | grep -E -v 'pgs undersized' | grep -E -v 'is active.*backfill_toofull.*' | head -n 1 2026-02-23T13:18:25.844 INFO:tasks.cephadm:Compressing logs... 2026-02-23T13:18:25.844 DEBUG:teuthology.orchestra.run.trial046:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-23T13:18:25.886 DEBUG:teuthology.orchestra.run.trial131:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-23T13:18:25.907 INFO:teuthology.orchestra.run.trial046.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-23T13:18:25.908 INFO:teuthology.orchestra.run.trial046.stderr:: No such file or directory 2026-02-23T13:18:25.908 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/ceph-mon.a.log 2026-02-23T13:18:25.908 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/ceph-osd.0.log 2026-02-23T13:18:25.908 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/ceph.cephadm.log 2026-02-23T13:18:25.908 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/ceph-mon.a.log: /var/log/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/ceph.audit.log 2026-02-23T13:18:25.910 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/ceph-volume.log 2026-02-23T13:18:25.910 INFO:teuthology.orchestra.run.trial046.stderr: 81.8% -- replaced with /var/log/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/ceph.cephadm.log.gz 2026-02-23T13:18:25.910 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/ceph-osd.1.log 2026-02-23T13:18:25.910 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/ceph-mgr.x.log 2026-02-23T13:18:25.910 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/ceph.log 2026-02-23T13:18:25.910 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/ceph-mgr.x.log: /var/log/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/ceph.log: 89.6% -- replaced with /var/log/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/ceph.audit.log.gz 2026-02-23T13:18:25.911 INFO:teuthology.orchestra.run.trial046.stderr: 85.8% -- replaced with /var/log/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/ceph.log.gz 2026-02-23T13:18:25.911 INFO:teuthology.orchestra.run.trial046.stderr: 94.5% -- replaced with /var/log/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/ceph-volume.log.gz 2026-02-23T13:18:25.912 INFO:teuthology.orchestra.run.trial131.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-23T13:18:25.912 INFO:teuthology.orchestra.run.trial131.stderr:: No such file or directory 2026-02-23T13:18:25.912 INFO:teuthology.orchestra.run.trial131.stderr:gzip -5 --verbose -- /var/log/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/ceph-osd.2.log 2026-02-23T13:18:25.913 INFO:teuthology.orchestra.run.trial131.stderr:gzip -5 --verbose -- /var/log/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/ceph-osd.3.log 2026-02-23T13:18:25.913 INFO:teuthology.orchestra.run.trial131.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/ceph-volume.log 2026-02-23T13:18:25.914 INFO:teuthology.orchestra.run.trial046.stderr: 95.7% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-23T13:18:25.915 INFO:teuthology.orchestra.run.trial131.stderr:/var/log/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/ceph-osd.3.log: /var/log/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/ceph-volume.log: 83.8% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-23T13:18:25.916 INFO:teuthology.orchestra.run.trial131.stderr: 94.2% -- replaced with /var/log/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/ceph-volume.log.gz 2026-02-23T13:18:26.001 INFO:teuthology.orchestra.run.trial046.stderr: 90.2% -- replaced with /var/log/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/ceph-mgr.x.log.gz 2026-02-23T13:18:26.210 INFO:teuthology.orchestra.run.trial046.stderr: 89.7% -- replaced with /var/log/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/ceph-mon.a.log.gz 2026-02-23T13:34:15.094 INFO:teuthology.orchestra.run.trial046.stderr: 93.9% -- replaced with /var/log/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/ceph-osd.0.log.gz 2026-02-23T13:35:20.959 INFO:teuthology.orchestra.run.trial131.stderr: 93.8% -- replaced with /var/log/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/ceph-osd.2.log.gz 2026-02-23T13:36:37.083 INFO:teuthology.orchestra.run.trial131.stderr: 93.9% -- replaced with /var/log/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/ceph-osd.3.log.gz 2026-02-23T13:36:37.086 INFO:teuthology.orchestra.run.trial131.stderr: 2026-02-23T13:36:37.086 INFO:teuthology.orchestra.run.trial131.stderr:real 18m11.182s 2026-02-23T13:36:37.086 INFO:teuthology.orchestra.run.trial131.stderr:user 32m24.058s 2026-02-23T13:36:37.086 INFO:teuthology.orchestra.run.trial131.stderr:sys 2m28.142s 2026-02-23T13:37:39.620 INFO:teuthology.orchestra.run.trial046.stderr: 93.7% -- replaced with /var/log/ceph/c3b3ca7d-10b7-11f1-8efe-d404e6e7d460/ceph-osd.1.log.gz 2026-02-23T13:37:39.623 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-23T13:37:39.623 INFO:teuthology.orchestra.run.trial046.stderr:real 19m13.724s 2026-02-23T13:37:39.623 INFO:teuthology.orchestra.run.trial046.stderr:user 32m18.541s 2026-02-23T13:37:39.623 INFO:teuthology.orchestra.run.trial046.stderr:sys 2m32.406s 2026-02-23T13:37:39.623 INFO:tasks.cephadm:Archiving logs... 2026-02-23T13:37:39.624 DEBUG:teuthology.misc:Transferring archived files from trial046:/var/log/ceph to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_12:27:41-crimson-rados-main-distro-debug-trial/66427/remote/trial046/log 2026-02-23T13:37:39.625 DEBUG:teuthology.orchestra.run.trial046:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-23T13:40:04.732 DEBUG:teuthology.misc:Transferring archived files from trial131:/var/log/ceph to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_12:27:41-crimson-rados-main-distro-debug-trial/66427/remote/trial131/log 2026-02-23T13:40:04.733 DEBUG:teuthology.orchestra.run.trial131:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-23T13:42:30.824 INFO:tasks.cephadm:Removing cluster... 2026-02-23T13:42:30.825 DEBUG:teuthology.orchestra.run.trial046:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 --force 2026-02-23T13:42:30.994 INFO:teuthology.orchestra.run.trial046.stdout:Deleting cluster with fsid: c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 2026-02-23T13:42:33.677 DEBUG:teuthology.orchestra.run.trial131:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 --force 2026-02-23T13:42:33.797 INFO:teuthology.orchestra.run.trial131.stdout:Deleting cluster with fsid: c3b3ca7d-10b7-11f1-8efe-d404e6e7d460 2026-02-23T13:42:36.270 INFO:tasks.cephadm:Removing cephadm ... 2026-02-23T13:42:36.271 DEBUG:teuthology.orchestra.run.trial046:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-23T13:42:36.290 DEBUG:teuthology.orchestra.run.trial131:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-23T13:42:36.307 INFO:tasks.cephadm:Teardown complete 2026-02-23T13:42:36.308 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-23T13:42:36.323 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-23T13:42:36.324 DEBUG:teuthology.orchestra.run.trial046:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-23T13:42:36.333 DEBUG:teuthology.orchestra.run.trial131:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-23T13:42:36.535 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-23T13:42:36.547 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-23T13:42:36.547 DEBUG:teuthology.orchestra.run.trial046:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-23T13:42:36.549 DEBUG:teuthology.orchestra.run.trial131:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-23T13:42:36.563 INFO:teuthology.orchestra.run.trial046.stderr:bash: line 1: ntpq: command not found 2026-02-23T13:42:36.565 INFO:teuthology.orchestra.run.trial131.stderr:bash: line 1: ntpq: command not found 2026-02-23T13:42:36.591 INFO:teuthology.orchestra.run.trial131.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-23T13:42:36.591 INFO:teuthology.orchestra.run.trial131.stdout:=============================================================================== 2026-02-23T13:42:36.592 INFO:teuthology.orchestra.run.trial131.stdout:^- t2.time.bf1.yahoo.com 2 7 377 56 -35ms[ -35ms] +/- 42ms 2026-02-23T13:42:36.592 INFO:teuthology.orchestra.run.trial131.stdout:^- 198-23-133-146-host.colo> 3 8 377 309 -175us[ -66us] +/- 78ms 2026-02-23T13:42:36.592 INFO:teuthology.orchestra.run.trial131.stdout:^- us-west-1.clearnet.pw 2 7 377 54 +3575us[+3649us] +/- 74ms 2026-02-23T13:42:36.592 INFO:teuthology.orchestra.run.trial131.stdout:^* chi2.us.ntp.li 2 6 377 49 +11us[ +88us] +/- 11ms 2026-02-23T13:42:36.599 INFO:teuthology.orchestra.run.trial046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-23T13:42:36.599 INFO:teuthology.orchestra.run.trial046.stdout:=============================================================================== 2026-02-23T13:42:36.599 INFO:teuthology.orchestra.run.trial046.stdout:^- 69-10-208-170.rainiercon> 2 7 377 111 -1638us[-1600us] +/- 80ms 2026-02-23T13:42:36.599 INFO:teuthology.orchestra.run.trial046.stdout:^- 38.45.64.130 2 9 377 293 -7841ns[ +38us] +/- 18ms 2026-02-23T13:42:36.599 INFO:teuthology.orchestra.run.trial046.stdout:^* ntp0.alb1.inoc.net 2 7 377 45 +73us[ +114us] +/- 3916us 2026-02-23T13:42:36.599 INFO:teuthology.orchestra.run.trial046.stdout:^- 198-23-133-146-host.colo> 3 8 377 109 +103us[ +141us] +/- 54ms 2026-02-23T13:42:36.600 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-23T13:42:36.612 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-23T13:42:36.612 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-23T13:42:36.627 DEBUG:teuthology.orchestra.run.trial046:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-23T13:42:36.718 DEBUG:teuthology.orchestra.run.trial131:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-23T13:42:36.777 DEBUG:teuthology.orchestra.run.trial046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-23T13:42:36.807 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:42:36.808 DEBUG:teuthology.orchestra.run.trial131:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-23T13:42:36.835 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:42:36.835 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-23T13:42:36.851 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-23T13:42:36.866 INFO:teuthology.task.internal:Duration was 4145.515244 seconds 2026-02-23T13:42:36.866 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-23T13:42:36.885 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-23T13:42:36.886 DEBUG:teuthology.orchestra.run.trial046:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-23T13:42:36.889 DEBUG:teuthology.orchestra.run.trial131:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-23T13:42:36.925 INFO:teuthology.orchestra.run.trial046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-23T13:42:36.925 INFO:teuthology.orchestra.run.trial131.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-23T13:42:37.323 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-23T13:42:37.323 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial046.front.sepia.ceph.com 2026-02-23T13:42:37.323 DEBUG:teuthology.orchestra.run.trial046:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-23T13:42:37.382 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial131.front.sepia.ceph.com 2026-02-23T13:42:37.382 DEBUG:teuthology.orchestra.run.trial131:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-23T13:42:37.402 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-23T13:42:37.403 DEBUG:teuthology.orchestra.run.trial046:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-23T13:42:37.424 DEBUG:teuthology.orchestra.run.trial131:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-23T13:42:37.790 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-23T13:42:37.790 DEBUG:teuthology.orchestra.run.trial046:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-23T13:42:37.792 DEBUG:teuthology.orchestra.run.trial131:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-23T13:42:37.814 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-23T13:42:37.815 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-23T13:42:37.815 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose/home/ubuntu/cephtest/archive/syslog/misc.log: -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-23T13:42:37.815 INFO:teuthology.orchestra.run.trial046.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-23T13:42:37.815 INFO:teuthology.orchestra.run.trial046.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-23T13:42:37.818 INFO:teuthology.orchestra.run.trial131.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-23T13:42:37.819 INFO:teuthology.orchestra.run.trial131.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-23T13:42:37.819 INFO:teuthology.orchestra.run.trial131.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-23T13:42:37.819 INFO:teuthology.orchestra.run.trial131.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-23T13:42:37.819 INFO:teuthology.orchestra.run.trial131.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-23T13:42:37.834 INFO:teuthology.orchestra.run.trial131.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 86.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-23T13:42:37.920 INFO:teuthology.orchestra.run.trial046.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 89.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-23T13:42:37.922 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-23T13:42:37.940 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-23T13:42:37.940 DEBUG:teuthology.orchestra.run.trial046:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-23T13:42:37.989 DEBUG:teuthology.orchestra.run.trial131:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-23T13:42:38.017 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-23T13:42:38.039 DEBUG:teuthology.orchestra.run.trial046:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-23T13:42:38.042 DEBUG:teuthology.orchestra.run.trial131:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-23T13:42:38.064 INFO:teuthology.orchestra.run.trial046.stdout:kernel.core_pattern = core 2026-02-23T13:42:38.080 INFO:teuthology.orchestra.run.trial131.stdout:kernel.core_pattern = core 2026-02-23T13:42:38.094 DEBUG:teuthology.orchestra.run.trial046:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-23T13:42:38.135 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:42:38.135 DEBUG:teuthology.orchestra.run.trial131:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-23T13:42:38.150 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T13:42:38.151 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-23T13:42:38.168 INFO:teuthology.task.internal:Transferring archived files... 2026-02-23T13:42:38.169 DEBUG:teuthology.misc:Transferring archived files from trial046:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_12:27:41-crimson-rados-main-distro-debug-trial/66427/remote/trial046 2026-02-23T13:42:38.169 DEBUG:teuthology.orchestra.run.trial046:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-23T13:42:38.250 DEBUG:teuthology.misc:Transferring archived files from trial131:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_12:27:41-crimson-rados-main-distro-debug-trial/66427/remote/trial131 2026-02-23T13:42:38.250 DEBUG:teuthology.orchestra.run.trial131:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-23T13:42:38.289 INFO:teuthology.task.internal:Removing archive directory... 2026-02-23T13:42:38.290 DEBUG:teuthology.orchestra.run.trial046:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-23T13:42:38.293 DEBUG:teuthology.orchestra.run.trial131:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-23T13:42:38.336 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-23T13:42:38.355 INFO:teuthology.task.internal:Not uploading archives. 2026-02-23T13:42:38.356 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-23T13:42:38.373 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-23T13:42:38.373 DEBUG:teuthology.orchestra.run.trial046:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-23T13:42:38.376 DEBUG:teuthology.orchestra.run.trial131:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-23T13:42:38.391 INFO:teuthology.orchestra.run.trial046.stdout: 917576 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 23 13:42 /home/ubuntu/cephtest 2026-02-23T13:42:38.392 INFO:teuthology.orchestra.run.trial131.stdout: 917576 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 23 13:42 /home/ubuntu/cephtest 2026-02-23T13:42:38.394 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-23T13:42:38.411 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-23T13:42:38.450 INFO:teuthology.run:Summary data: description: crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/cephadm objectstore/seastore/segmented$/{crimson_seastore_segmented} thrashers/{pggrow} thrashosds-health workloads/radosbench} duration: 4145.515244483948 flavor: debug owner: scheduled_shraddhaag@soko04.front.sepia.ceph.com success: true 2026-02-23T13:42:38.451 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T13:42:38.575 INFO:teuthology.run:pass